2024-09-21T02:12:20.187 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T02:12:20.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T02:12:20.300 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913418' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZcCYv0qdryudlcXdv1u8Suwm/aaE9kSRwMqNUqNltVfru/Q332quSg99crTgyAzHuC2qoyTPV5gecvd6hBzoE= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAt1zxEgAZB44hDxioQDfHLKJBa9xI1fPwXvJkSt5cAgvEEoRoKJEts7gWGM0+GYunB+Yrqm4CR+0UbyystCrlw= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtwddA7aqkxHexOSBCWSvKRoAMwZNtIk+PWDcCQYbwxbjtcwIuhkqw/FUKyrt3MazY70dmO7JB6N0SDdmHskwk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T02:12:20.300 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T02:12:20.301 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T02:12:20.301 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T02:12:20.303 INFO:teuthology.task.internal:Checking packages... 2024-09-21T02:12:20.351 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T02:12:20.351 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T02:12:20.352 INFO:teuthology.packaging:ref: None 2024-09-21T02:12:20.352 INFO:teuthology.packaging:tag: None 2024-09-21T02:12:20.352 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T02:12:20.352 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:12:20.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T02:12:20.501 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T02:12:20.504 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T02:12:20.511 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T02:12:20.511 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T02:12:20.517 INFO:teuthology.task.internal:Saving configuration 2024-09-21T02:12:20.538 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T02:12:20.545 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T02:12:20.571 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:07:20.705624', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZcCYv0qdryudlcXdv1u8Suwm/aaE9kSRwMqNUqNltVfru/Q332quSg99crTgyAzHuC2qoyTPV5gecvd6hBzoE='} 2024-09-21T02:12:20.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:07:20.703632', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAt1zxEgAZB44hDxioQDfHLKJBa9xI1fPwXvJkSt5cAgvEEoRoKJEts7gWGM0+GYunB+Yrqm4CR+0UbyystCrlw='} 2024-09-21T02:12:20.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:07:20.707133', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtwddA7aqkxHexOSBCWSvKRoAMwZNtIk+PWDcCQYbwxbjtcwIuhkqw/FUKyrt3MazY70dmO7JB6N0SDdmHskwk='} 2024-09-21T02:12:20.613 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T02:12:20.619 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T02:12:20.620 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T02:12:20.620 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T02:12:20.620 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T02:12:20.691 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcd5fdd8160>, signals=[15]) 2024-09-21T02:12:20.691 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T02:12:20.698 INFO:teuthology.task.internal:Opening connections... 2024-09-21T02:12:20.698 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:12:20.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:12:20.779 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-21T02:12:20.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:12:20.855 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T02:12:20.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:12:20.937 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T02:12:20.950 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-21T02:12:20.968 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-21T02:12:20.969 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-21T02:12:21.026 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-09-21T02:12:21.026 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-09-21T02:12:21.026 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-09-21T02:12:21.026 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:12:21.026 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:12:21.027 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:12:21.028 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-21T02:12:21.053 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-21T02:12:21.072 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-21T02:12:21.072 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-21T02:12:21.130 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:12:21.131 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:12:21.132 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:12:21.132 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-21T02:12:21.153 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-21T02:12:21.172 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-21T02:12:21.173 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:12:21.231 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:12:21.232 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:12:21.232 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-21T02:12:21.253 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T02:12:21.264 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T02:12:21.269 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T02:12:21.269 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:12:21.272 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:12:21.274 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:12:21.290 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T02:12:21.296 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T02:12:21.296 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:12:21.330 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:12:21.332 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:12:21.428 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T02:12:21.502 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T02:12:21.517 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T02:12:21.517 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-21T02:12:21.517 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-21T02:12:21.517 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:12:21.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:12:21.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T02:12:21.691 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T02:12:21.691 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T02:12:21.691 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-21T02:12:21.709 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-503.el9.x86_64 2024-09-21T02:12:21.709 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T02:12:21.710 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T02:12:21.710 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum upgrade -y linux-firmware 2024-09-21T02:12:24.611 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.3 MB 00:01 2024-09-21T02:12:26.462 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-21T02:12:32.712 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-21T02:12:34.946 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-21T02:12:35.884 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T02:12:41.289 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T02:12:43.276 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-21T02:12:43.287 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-21T02:12:43.287 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-21T02:12:43.287 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 1 Package 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 388 M 2024-09-21T02:12:43.288 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-21T02:12:48.723 INFO:teuthology.orchestra.run.smithi079.stdout:linux-firmware-20240905-146.el9.noarch.rpm 73 MB/s | 388 MB 00:05 2024-09-21T02:12:48.723 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:12:48.723 INFO:teuthology.orchestra.run.smithi079.stdout:Total 71 MB/s | 388 MB 00:05 2024-09-21T02:12:51.846 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-21T02:12:52.081 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-21T02:12:52.082 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-21T02:12:55.348 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-21T02:12:55.349 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-21T02:13:04.583 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-21T02:13:05.231 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T02:13:05.321 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T02:13:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T02:13:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T02:13:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T02:13:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:13:06.910 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-09-21T02:13:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T02:13:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:13:06.910 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-21T02:13:07.282 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T02:13:07.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T02:13:07.438 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T02:13:07.439 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T02:13:07.441 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi079.front.sepia.ceph.com to complete... 2024-09-21T02:13:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21 02:13:15 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T02:13:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:FINISHED --2024-09-21 02:13:15-- 2024-09-21T02:13:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:Total wall clock time: 7.6s 2024-09-21T02:13:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:Downloaded: 1 files, 343M in 7.3s (46.8 MB/s) 2024-09-21T02:13:15.084 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T02:13:15.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T02:13:17.141 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying... ######################################## 2024-09-21T02:13:17.195 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing... ######################################## 2024-09-21T02:13:17.254 INFO:teuthology.orchestra.run.smithi079.stdout:Updating / installing... 2024-09-21T02:13:25.204 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T02:14:05.987 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T02:14:05.987 DEBUG:teuthology.orchestra.run.smithi079:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T02:14:06.080 INFO:teuthology.orchestra.run.smithi079.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.080 INFO:teuthology.orchestra.run.smithi079.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.080 INFO:teuthology.orchestra.run.smithi079.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T02:14:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T02:14:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T02:14:06.083 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T02:14:06.084 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T02:14:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T02:14:06.086 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T02:14:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T02:14:06.088 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T02:14:06.089 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T02:14:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T02:14:06.091 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T02:14:06.092 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T02:14:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T02:14:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T02:14:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T02:14:06.096 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T02:14:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T02:14:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T02:14:06.099 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T02:14:06.100 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T02:14:06.101 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T02:14:06.102 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T02:14:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T02:14:06.104 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T02:14:06.105 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T02:14:06.106 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T02:14:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T02:14:06.108 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T02:14:06.109 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T02:14:06.110 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T02:14:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T02:14:06.112 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T02:14:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T02:14:06.114 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T02:14:06.115 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T02:14:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T02:14:06.117 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T02:14:06.118 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T02:14:06.119 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T02:14:06.120 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T02:14:06.121 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T02:14:06.122 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T02:14:06.123 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T02:14:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T02:14:06.125 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T02:14:06.126 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T02:14:06.127 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T02:14:06.128 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T02:14:06.129 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T02:14:06.130 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T02:14:06.131 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T02:14:06.132 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T02:14:06.133 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T02:14:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T02:14:06.135 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T02:14:06.136 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T02:14:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T02:14:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T02:14:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T02:14:06.140 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T02:14:06.141 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T02:14:06.142 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T02:14:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T02:14:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T02:14:06.145 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T02:14:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T02:14:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T02:14:06.148 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T02:14:06.149 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T02:14:06.150 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T02:14:06.151 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T02:14:06.152 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T02:14:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T02:14:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T02:14:06.155 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T02:14:06.156 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T02:14:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T02:14:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T02:14:06.159 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T02:14:06.160 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T02:14:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T02:14:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T02:14:06.163 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T02:14:06.164 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T02:14:06.165 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T02:14:06.166 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T02:14:06.167 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T02:14:06.168 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T02:14:06.169 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T02:14:06.170 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T02:14:06.171 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T02:14:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T02:14:06.173 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T02:14:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T02:14:06.175 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T02:14:06.176 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T02:14:06.177 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T02:14:06.178 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T02:14:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T02:14:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T02:14:06.181 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T02:14:06.182 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T02:14:06.183 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T02:14:06.184 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T02:14:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T02:14:06.186 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T02:14:06.187 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T02:14:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T02:14:06.189 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T02:14:06.190 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T02:14:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T02:14:06.192 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T02:14:06.193 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T02:14:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T02:14:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T02:14:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T02:14:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T02:14:06.198 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T02:14:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T02:14:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T02:14:06.201 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T02:14:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T02:14:06.203 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T02:14:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T02:14:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T02:14:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T02:14:06.207 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T02:14:06.208 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T02:14:06.209 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T02:14:06.210 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T02:14:06.211 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T02:14:06.212 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T02:14:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T02:14:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T02:14:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T02:14:06.216 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T02:14:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T02:14:06.218 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T02:14:06.221 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.222 DEBUG:teuthology.orchestra.run.smithi079:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T02:14:06.245 INFO:teuthology.orchestra.run.smithi079.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T02:14:06.245 INFO:teuthology.orchestra.run.smithi079.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T02:14:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T02:14:06.245 INFO:teuthology.orchestra.run.smithi079.stdout:fi 2024-09-21T02:14:06.245 INFO:teuthology.orchestra.run.smithi079.stdout:for file in vmlinuz System.map config; do 2024-09-21T02:14:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T02:14:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: fi 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:fi 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:fi 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.246 INFO:teuthology.orchestra.run.smithi079.stdout:fi 2024-09-21T02:14:06.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2024-09-21T02:14:06.320 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2024-09-21T02:14:06.320 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2024-09-21T02:14:06.320 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.06 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 82.el9 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Group : Unspecified 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 8274670 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : builder@centos.org 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : CentOS 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T02:14:06.321 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:14:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T02:14:06.323 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T02:14:06.323 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:06.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T02:14:06.954 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-09-21T02:14:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T02:14:08.364 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-09-21T02:14:08.374 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-21T02:14:08.390 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.yYKBcQlhnY 2024-09-21T02:14:08.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yYKBcQlhnY 2024-09-21T02:14:08.466 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.yYKBcQlhnY 2024-09-21T02:14:08.604 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.yYKBcQlhnY is 6KB 2024-09-21T02:14:08.623 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.yYKBcQlhnY 2024-09-21T02:14:08.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T02:14:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T02:14:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T02:14:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T02:14:08.701 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T02:14:08.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:14:08.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-09-21T02:14:38.846 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T02:14:38.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T02:14:38.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:15:38.848 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T02:15:47.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T02:15:47.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:15:55.541 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-21T02:15:55.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T02:15:55.995 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T02:15:55.996 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-21T02:15:56.029 INFO:teuthology.orchestra.run.smithi079.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:15:56.030 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:15:56.030 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T02:15:56.030 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T02:15:57.032 DEBUG:teuthology.parallel:result is None 2024-09-21T02:15:57.032 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T02:15:57.039 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T02:15:57.040 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:15:57.043 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:15:57.046 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:15:57.074 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T02:15:57.081 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T02:15:57.089 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T02:15:57.089 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:15:57.124 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:15:57.126 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:15:57.229 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T02:15:57.235 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T02:15:57.235 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:15:57.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:15:57.252 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:15:57.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:15:57.270 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:15:57.274 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:15:57.295 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:15:57.325 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:15:57.349 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:15:57.377 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:15:57.396 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:15:57.427 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:15:57.501 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:15:57.505 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T02:15:57.516 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T02:15:57.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:15:57.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:15:57.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:15:57.573 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T02:15:57.581 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T02:15:57.581 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:15:57.585 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:15:57.593 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:15:57.615 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:15:57.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:15:57.905 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:15:57.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:15:58.042 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:15:58.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:15:58.150 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:15:58.197 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:15:58.258 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:15:58.299 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:15:58.345 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:15:58.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:15:58.411 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:15:58.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:15:58.514 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:15:58.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:15:58.642 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:15:58.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:15:58.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-21T02:15:58.713 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-21T02:15:58.716 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-21T02:15:58.755 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:15:58.788 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:15:58.795 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:15:59.196 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T02:15:59.204 INFO:teuthology.task.internal:Starting timer... 2024-09-21T02:15:59.204 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T02:15:59.213 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T02:15:59.221 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T02:15:59.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-09-21T02:15:59.340 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-09-21T02:15:59.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-21T02:15:59.417 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-21T02:15:59.419 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-21T02:15:59.489 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-21T02:15:59.491 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T02:15:59.491 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-09-21T02:15:59.532 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-09-21T02:15:59.532 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-21T02:15:59.561 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-21T02:15:59.561 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-21T02:15:59.588 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-21T02:15:59.588 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2024-09-21T02:15:59.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:15:59.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:15:59.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:15:59.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:15:59.677 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:15:59.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:15:59.706 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T02:15:59.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:15:59.777 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:15:59.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:15:59.843 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T02:15:59.852 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T02:15:59.855 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T02:15:59.995 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T02:16:00.004 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T02:16:00.005 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T02:20:31.142 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2024-09-21T02:20:31.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T02:20:31.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:20:31.229 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-21T02:20:31.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T02:20:31.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-21T02:20:31.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:20:31.420 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-21T02:20:31.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-21T02:20:31.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T02:20:31.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:20:31.586 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-21T02:20:31.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T02:20:31.668 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T02:20:31.677 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T02:20:31.677 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:20:31.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:20:31.682 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:20:31.682 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:20:31.684 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:20:31.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:20:31.716 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:20:31.732 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:20:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:20:31.740 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:20:31.754 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:20:31.758 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-21T02:20:31.768 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:20:31.770 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-21T02:20:31.781 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-21T02:20:31.785 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:20:31.792 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-21T02:20:31.800 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:20:31.807 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:20:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-09-21T02:20:31.821 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:20:31.842 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-09-21T02:20:31.856 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:20:31.859 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:20:31.859 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-21T02:20:31.859 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.860 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.860 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.860 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.871 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:20:31.879 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:20:31.883 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:20:31.883 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T02:20:31.883 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.883 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.883 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.883 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:31.900 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:20:32.007 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:20:32.014 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:20:32.014 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-09-21T02:20:32.015 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:32.015 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:32.015 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:32.015 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:20:32.016 INFO:teuthology.run_tasks:Running task install... 2024-09-21T02:20:32.024 DEBUG:teuthology.task.install:project ceph 2024-09-21T02:20:32.024 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T02:20:32.024 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T02:20:32.024 INFO:teuthology.task.install:Using flavor: default 2024-09-21T02:20:32.030 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T02:20:32.030 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T02:20:32.030 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:20:32.031 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:20:32.032 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:20:32.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:20:32.033 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:20:32.033 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:20:32.175 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:20:32.176 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:20:32.185 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:20:32.185 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:20:32.194 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:20:32.194 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:20:32.283 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:20:32.283 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:20:32.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:20:32.293 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:20:32.293 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:20:32.293 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:20:32.298 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:20:32.299 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:20:32.299 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:20:32.320 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:20:32.320 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:20:32.326 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:20:32.326 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:20:32.339 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:20:32.339 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:20:32.388 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:20:32.393 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:20:32.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:20:32.463 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:20:32.470 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:20:32.515 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:20:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-21T02:20:32.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-21T02:20:32.534 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-21T02:20:32.536 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-21T02:20:32.569 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-09-21T02:20:32.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-09-21T02:20:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-21T02:20:32.760 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-21T02:20:32.782 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:20:32.786 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:20:32.849 INFO:teuthology.orchestra.run.smithi079.stdout:45 files removed 2024-09-21T02:20:32.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:20:33.328 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-21T02:20:33.337 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-21T02:20:33.590 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 275 kB/s | 84 kB 00:00 2024-09-21T02:20:33.621 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T02:20:33.629 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T02:20:33.888 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T02:20:33.891 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T02:20:33.905 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T02:20:34.183 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-21T02:20:34.497 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T02:20:34.522 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T02:20:34.959 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T02:20:36.398 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-21T02:20:36.465 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T02:20:40.539 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-21T02:20:41.758 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-21T02:20:42.065 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-21T02:20:43.816 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-21T02:20:44.200 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-21T02:20:44.861 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-21T02:20:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T02:20:47.443 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-21T02:20:49.002 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-21T02:20:49.848 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-21T02:20:50.284 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T02:20:50.477 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T02:20:52.411 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:20:52.412 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:20:52.423 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:20:52.424 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:20:52.424 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:20:52.425 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:20:52.427 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:20:52.429 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:20:52.430 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:20:52.493 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:20:52.511 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:20:52.512 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:20:52.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:20:52.514 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:20:52.515 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:20:52.516 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:20:52.517 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:20:52.518 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:20:52.519 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:20:52.520 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:20:52.521 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:20:52.522 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:20:52.523 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout:Install 149 Packages 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 8 Packages 2024-09-21T02:20:52.524 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:20:52.525 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 228 M 2024-09-21T02:20:52.525 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T02:20:52.649 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:20:52.649 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:20:52.663 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:20:52.664 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:20:52.665 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:20:52.666 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:20:52.668 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:20:52.670 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:20:52.671 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:20:52.736 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:20:52.764 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:20:52.765 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:20:52.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:20:52.767 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:20:52.768 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:20:52.768 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:20:52.768 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-21T02:20:52.769 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:20:52.769 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:20:52.769 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:20:52.769 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:20:52.769 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:20:52.770 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:20:52.771 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:20:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:20:52.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:20:52.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:20:52.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:20:52.776 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-21T02:20:52.777 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout:Install 149 Packages 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 228 M 2024-09-21T02:20:52.778 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-21T02:20:52.869 INFO:teuthology.orchestra.run.smithi148.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T02:20:53.144 INFO:teuthology.orchestra.run.smithi148.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.1 MB/s | 873 kB 00:00 2024-09-21T02:20:53.211 INFO:teuthology.orchestra.run.smithi148.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T02:20:53.236 INFO:teuthology.orchestra.run.smithi148.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T02:20:53.337 INFO:teuthology.orchestra.run.smithi148.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 18 MB/s | 2.3 MB 00:00 2024-09-21T02:20:53.462 INFO:teuthology.orchestra.run.smithi098.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-09-21T02:20:53.470 INFO:teuthology.orchestra.run.smithi148.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.5 MB/s | 1.5 MB 00:00 2024-09-21T02:20:53.596 INFO:teuthology.orchestra.run.smithi148.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.0 MB 00:00 2024-09-21T02:20:53.779 INFO:teuthology.orchestra.run.smithi098.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.7 MB/s | 873 kB 00:00 2024-09-21T02:20:53.813 INFO:teuthology.orchestra.run.smithi148.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T02:20:53.829 INFO:teuthology.orchestra.run.smithi098.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T02:20:53.854 INFO:teuthology.orchestra.run.smithi148.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 611 kB/s | 25 kB 00:00 2024-09-21T02:20:54.196 INFO:teuthology.orchestra.run.smithi148.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 17 MB/s | 10 MB 00:00 2024-09-21T02:20:54.255 INFO:teuthology.orchestra.run.smithi148.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T02:20:54.322 INFO:teuthology.orchestra.run.smithi148.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 406 kB/s | 27 kB 00:00 2024-09-21T02:20:54.354 INFO:teuthology.orchestra.run.smithi098.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.4 MB/s | 2.3 MB 00:00 2024-09-21T02:20:54.389 INFO:teuthology.orchestra.run.smithi148.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 478 kB/s | 32 kB 00:00 2024-09-21T02:20:54.497 INFO:teuthology.orchestra.run.smithi148.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.9 MB/s | 766 kB 00:00 2024-09-21T02:20:54.581 INFO:teuthology.orchestra.run.smithi148.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.9 MB/s | 158 kB 00:00 2024-09-21T02:20:54.656 INFO:teuthology.orchestra.run.smithi148.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.7 MB/s | 127 kB 00:00 2024-09-21T02:20:54.740 INFO:teuthology.orchestra.run.smithi148.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.9 MB/s | 507 kB 00:00 2024-09-21T02:20:54.806 INFO:teuthology.orchestra.run.smithi098.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 3.4 MB/s | 1.5 MB 00:00 2024-09-21T02:20:55.157 INFO:teuthology.orchestra.run.smithi148.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.3 MB 00:00 2024-09-21T02:20:55.332 INFO:teuthology.orchestra.run.smithi148.stdout:(19/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 9.6 MB/s | 18 MB 00:01 2024-09-21T02:20:55.357 INFO:teuthology.orchestra.run.smithi148.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 225 kB/s | 45 kB 00:00 2024-09-21T02:20:55.382 INFO:teuthology.orchestra.run.smithi148.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T02:20:55.407 INFO:teuthology.orchestra.run.smithi148.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.1 MB/s | 161 kB 00:00 2024-09-21T02:20:55.458 INFO:teuthology.orchestra.run.smithi148.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T02:20:55.483 INFO:teuthology.orchestra.run.smithi148.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T02:20:55.508 INFO:teuthology.orchestra.run.smithi148.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T02:20:55.533 INFO:teuthology.orchestra.run.smithi148.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:20:55.605 INFO:teuthology.orchestra.run.smithi098.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 6.2 MB/s | 5.0 MB 00:00 2024-09-21T02:20:55.876 INFO:teuthology.orchestra.run.smithi148.stdout:(27/157): ceph-test-19.3.0-5120.g18432218.el9.x 20 MB/s | 40 MB 00:02 2024-09-21T02:20:55.910 INFO:teuthology.orchestra.run.smithi148.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 453 kB/s | 170 kB 00:00 2024-09-21T02:20:55.927 INFO:teuthology.orchestra.run.smithi148.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 682 kB/s | 34 kB 00:00 2024-09-21T02:20:55.960 INFO:teuthology.orchestra.run.smithi148.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T02:20:55.963 INFO:teuthology.orchestra.run.smithi098.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 7.3 MB/s | 20 MB 00:02 2024-09-21T02:20:56.019 INFO:teuthology.orchestra.run.smithi148.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.1 MB/s | 3.1 MB 00:00 2024-09-21T02:20:56.039 INFO:teuthology.orchestra.run.smithi098.stdout:(8/157): ceph-base-19.3.0-5120.g18432218.el9.x8 2.0 MB/s | 5.5 MB 00:02 2024-09-21T02:20:56.119 INFO:teuthology.orchestra.run.smithi148.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.9 MB/s | 292 kB 00:00 2024-09-21T02:20:56.206 INFO:teuthology.orchestra.run.smithi098.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 151 kB/s | 25 kB 00:00 2024-09-21T02:20:56.211 INFO:teuthology.orchestra.run.smithi148.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 540 kB/s | 49 kB 00:00 2024-09-21T02:20:56.312 INFO:teuthology.orchestra.run.smithi148.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 164 kB/s | 16 kB 00:00 2024-09-21T02:20:56.320 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 9.6 kB/s | 1.7 kB 00:00 2024-09-21T02:20:56.520 INFO:teuthology.orchestra.run.smithi148.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-21T02:20:56.662 INFO:teuthology.orchestra.run.smithi148.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 19 MB/s | 14 MB 00:00 2024-09-21T02:20:56.687 INFO:teuthology.orchestra.run.smithi148.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 760 kB/s | 285 kB 00:00 2024-09-21T02:20:56.712 INFO:teuthology.orchestra.run.smithi148.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 368 kB/s | 18 kB 00:00 2024-09-21T02:20:56.740 INFO:teuthology.orchestra.run.smithi098.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 13 MB/s | 10 MB 00:00 2024-09-21T02:20:56.754 INFO:teuthology.orchestra.run.smithi148.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.3 MB/s | 784 kB 00:00 2024-09-21T02:20:56.790 INFO:teuthology.orchestra.run.smithi098.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T02:20:56.813 INFO:teuthology.orchestra.run.smithi148.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-09-21T02:20:56.823 INFO:teuthology.orchestra.run.smithi098.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 817 kB/s | 27 kB 00:00 2024-09-21T02:20:56.857 INFO:teuthology.orchestra.run.smithi098.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 953 kB/s | 32 kB 00:00 2024-09-21T02:20:56.871 INFO:teuthology.orchestra.run.smithi148.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-21T02:20:56.897 INFO:teuthology.orchestra.run.smithi148.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-21T02:20:56.924 INFO:teuthology.orchestra.run.smithi098.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T02:20:56.930 INFO:teuthology.orchestra.run.smithi148.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-21T02:20:56.955 INFO:teuthology.orchestra.run.smithi148.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T02:20:57.045 INFO:teuthology.orchestra.run.smithi098.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T02:20:57.045 INFO:teuthology.orchestra.run.smithi098.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T02:20:57.045 INFO:teuthology.orchestra.run.smithi148.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T02:20:57.045 INFO:teuthology.orchestra.run.smithi148.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T02:20:57.045 INFO:teuthology.orchestra.run.smithi148.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T02:20:57.075 INFO:teuthology.orchestra.run.smithi098.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T02:20:57.132 INFO:teuthology.orchestra.run.smithi148.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-21T02:20:57.232 INFO:teuthology.orchestra.run.smithi148.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-21T02:20:57.274 INFO:teuthology.orchestra.run.smithi148.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 754 kB/s | 107 kB 00:00 2024-09-21T02:20:57.299 INFO:teuthology.orchestra.run.smithi148.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-21T02:20:57.316 INFO:teuthology.orchestra.run.smithi148.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-21T02:20:57.325 INFO:teuthology.orchestra.run.smithi098.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 21 MB/s | 5.3 MB 00:00 2024-09-21T02:20:57.375 INFO:teuthology.orchestra.run.smithi098.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 909 kB/s | 45 kB 00:00 2024-09-21T02:20:57.391 INFO:teuthology.orchestra.run.smithi148.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T02:20:57.408 INFO:teuthology.orchestra.run.smithi148.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-21T02:20:57.417 INFO:teuthology.orchestra.run.smithi098.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 3.5 MB/s | 148 kB 00:00 2024-09-21T02:20:57.458 INFO:teuthology.orchestra.run.smithi148.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-21T02:20:57.467 INFO:teuthology.orchestra.run.smithi098.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T02:20:57.475 INFO:teuthology.orchestra.run.smithi148.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-21T02:20:57.518 INFO:teuthology.orchestra.run.smithi098.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T02:20:57.534 INFO:teuthology.orchestra.run.smithi148.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T02:20:57.569 INFO:teuthology.orchestra.run.smithi098.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T02:20:57.619 INFO:teuthology.orchestra.run.smithi098.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T02:20:57.668 INFO:teuthology.orchestra.run.smithi148.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-09-21T02:20:57.669 INFO:teuthology.orchestra.run.smithi098.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:20:57.684 INFO:teuthology.orchestra.run.smithi148.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2024-09-21T02:20:57.710 INFO:teuthology.orchestra.run.smithi148.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 684 kB/s | 160 kB 00:00 2024-09-21T02:20:57.768 INFO:teuthology.orchestra.run.smithi148.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-21T02:20:57.794 INFO:teuthology.orchestra.run.smithi148.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-21T02:20:57.827 INFO:teuthology.orchestra.run.smithi148.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-21T02:20:57.836 INFO:teuthology.orchestra.run.smithi098.stdout:(26/157): rbd-mirror-19.3.0-5120.g18432218.el9. 19 MB/s | 3.1 MB 00:00 2024-09-21T02:20:57.844 INFO:teuthology.orchestra.run.smithi148.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-21T02:20:57.895 INFO:teuthology.orchestra.run.smithi148.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T02:20:57.920 INFO:teuthology.orchestra.run.smithi148.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-21T02:20:57.945 INFO:teuthology.orchestra.run.smithi148.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T02:20:58.012 INFO:teuthology.orchestra.run.smithi098.stdout:(27/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 7.4 MB/s | 18 MB 00:02 2024-09-21T02:20:58.037 INFO:teuthology.orchestra.run.smithi098.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 850 kB/s | 170 kB 00:00 2024-09-21T02:20:58.062 INFO:teuthology.orchestra.run.smithi098.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 687 kB/s | 34 kB 00:00 2024-09-21T02:20:58.062 INFO:teuthology.orchestra.run.smithi148.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T02:20:58.087 INFO:teuthology.orchestra.run.smithi098.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T02:20:58.146 INFO:teuthology.orchestra.run.smithi148.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-21T02:20:58.179 INFO:teuthology.orchestra.run.smithi148.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-21T02:20:58.238 INFO:teuthology.orchestra.run.smithi148.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-21T02:20:58.263 INFO:teuthology.orchestra.run.smithi148.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T02:20:58.355 INFO:teuthology.orchestra.run.smithi148.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-21T02:20:58.380 INFO:teuthology.orchestra.run.smithi148.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-21T02:20:58.387 INFO:teuthology.orchestra.run.smithi098.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 25 MB/s | 7.4 MB 00:00 2024-09-21T02:20:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.7 MB/s | 1.0 MB 00:00 2024-09-21T02:20:58.438 INFO:teuthology.orchestra.run.smithi098.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.8 MB/s | 292 kB 00:00 2024-09-21T02:20:58.456 INFO:teuthology.orchestra.run.smithi148.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 813 kB/s | 61 kB 00:00 2024-09-21T02:20:58.488 INFO:teuthology.orchestra.run.smithi098.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 989 kB/s | 49 kB 00:00 2024-09-21T02:20:58.530 INFO:teuthology.orchestra.run.smithi098.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 396 kB/s | 16 kB 00:00 2024-09-21T02:20:58.539 INFO:teuthology.orchestra.run.smithi148.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 6.0 MB 00:00 2024-09-21T02:20:58.565 INFO:teuthology.orchestra.run.smithi148.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-21T02:20:58.584 INFO:teuthology.orchestra.run.smithi098.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 5.2 MB/s | 285 kB 00:00 2024-09-21T02:20:58.590 INFO:teuthology.orchestra.run.smithi148.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-21T02:20:58.615 INFO:teuthology.orchestra.run.smithi148.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-21T02:20:58.640 INFO:teuthology.orchestra.run.smithi148.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-21T02:20:58.651 INFO:teuthology.orchestra.run.smithi098.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 12 MB/s | 784 kB 00:00 2024-09-21T02:20:58.651 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:20:58.653 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:20:58.666 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:20:58.667 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:20:58.668 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:20:58.669 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:20:58.671 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:20:58.673 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:20:58.674 INFO:teuthology.orchestra.run.smithi148.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T02:20:58.674 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:20:58.691 INFO:teuthology.orchestra.run.smithi148.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-21T02:20:58.701 INFO:teuthology.orchestra.run.smithi098.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 369 kB/s | 18 kB 00:00 2024-09-21T02:20:58.739 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-21T02:20:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T02:20:58.756 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-09-21T02:20:58.756 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:20:58.757 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:20:58.758 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:20:58.759 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:20:58.760 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:20:58.761 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:20:58.762 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:20:58.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:20:58.764 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:20:58.765 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:20:58.766 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:20:58.767 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:20:58.768 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:20:58.769 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-21T02:20:58.769 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-09-21T02:20:58.769 INFO:teuthology.orchestra.run.smithi079.stdout:Install 149 Packages 2024-09-21T02:20:58.769 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 8 Packages 2024-09-21T02:20:58.769 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:20:58.769 INFO:teuthology.orchestra.run.smithi148.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-21T02:20:58.770 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 228 M 2024-09-21T02:20:58.770 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-21T02:20:58.859 INFO:teuthology.orchestra.run.smithi148.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-21T02:20:58.875 INFO:teuthology.orchestra.run.smithi148.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-09-21T02:20:58.877 INFO:teuthology.orchestra.run.smithi098.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 457 kB/s | 80 kB 00:00 2024-09-21T02:20:58.901 INFO:teuthology.orchestra.run.smithi148.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 486 kB/s | 77 kB 00:00 2024-09-21T02:20:58.934 INFO:teuthology.orchestra.run.smithi148.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T02:20:58.960 INFO:teuthology.orchestra.run.smithi148.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-09-21T02:20:58.985 INFO:teuthology.orchestra.run.smithi148.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-21T02:20:59.002 INFO:teuthology.orchestra.run.smithi148.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-09-21T02:20:59.019 INFO:teuthology.orchestra.run.smithi148.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 914 kB/s | 54 kB 00:00 2024-09-21T02:20:59.069 INFO:teuthology.orchestra.run.smithi148.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-21T02:20:59.077 INFO:teuthology.orchestra.run.smithi098.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-21T02:20:59.094 INFO:teuthology.orchestra.run.smithi148.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-21T02:20:59.136 INFO:teuthology.orchestra.run.smithi098.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T02:20:59.144 INFO:teuthology.orchestra.run.smithi148.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-21T02:20:59.170 INFO:teuthology.orchestra.run.smithi148.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-21T02:20:59.203 INFO:teuthology.orchestra.run.smithi098.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-21T02:20:59.220 INFO:teuthology.orchestra.run.smithi148.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-21T02:20:59.396 INFO:teuthology.orchestra.run.smithi148.stdout:(99/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-21T02:20:59.412 INFO:teuthology.orchestra.run.smithi148.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2024-09-21T02:20:59.438 INFO:teuthology.orchestra.run.smithi148.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-21T02:20:59.439 INFO:teuthology.orchestra.run.smithi079.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-09-21T02:20:59.471 INFO:teuthology.orchestra.run.smithi148.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-21T02:20:59.478 INFO:teuthology.orchestra.run.smithi098.stdout:(42/157): ceph-mgr-dashboard-19.3.0-5120.g18432 10 MB/s | 14 MB 00:01 2024-09-21T02:20:59.488 INFO:teuthology.orchestra.run.smithi148.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-21T02:20:59.505 INFO:teuthology.orchestra.run.smithi148.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-09-21T02:20:59.511 INFO:teuthology.orchestra.run.smithi098.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-21T02:20:59.564 INFO:teuthology.orchestra.run.smithi148.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T02:20:59.570 INFO:teuthology.orchestra.run.smithi098.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T02:20:59.581 INFO:teuthology.orchestra.run.smithi148.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 204 kB/s | 22 kB 00:00 2024-09-21T02:20:59.614 INFO:teuthology.orchestra.run.smithi148.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2024-09-21T02:20:59.620 INFO:teuthology.orchestra.run.smithi098.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T02:20:59.631 INFO:teuthology.orchestra.run.smithi148.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-21T02:20:59.648 INFO:teuthology.orchestra.run.smithi148.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T02:20:59.662 INFO:teuthology.orchestra.run.smithi098.stdout:(46/157): python3-ply-3.11-14.el9.noarch.rpm 579 kB/s | 106 kB 00:00 2024-09-21T02:20:59.681 INFO:teuthology.orchestra.run.smithi079.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T02:20:59.682 INFO:teuthology.orchestra.run.smithi148.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-09-21T02:20:59.688 INFO:teuthology.orchestra.run.smithi098.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T02:20:59.715 INFO:teuthology.orchestra.run.smithi148.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-09-21T02:20:59.741 INFO:teuthology.orchestra.run.smithi148.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-21T02:20:59.763 INFO:teuthology.orchestra.run.smithi098.stdout:(48/157): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-09-21T02:20:59.765 INFO:teuthology.orchestra.run.smithi148.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.1 MB/s | 151 kB 00:00 2024-09-21T02:20:59.811 INFO:teuthology.orchestra.run.smithi079.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T02:20:59.822 INFO:teuthology.orchestra.run.smithi098.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-21T02:20:59.824 INFO:teuthology.orchestra.run.smithi148.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-21T02:20:59.840 INFO:teuthology.orchestra.run.smithi079.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 935 kB/s | 148 kB 00:00 2024-09-21T02:20:59.855 INFO:teuthology.orchestra.run.smithi098.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-21T02:20:59.858 INFO:teuthology.orchestra.run.smithi148.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-21T02:20:59.872 INFO:teuthology.orchestra.run.smithi098.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T02:20:59.883 INFO:teuthology.orchestra.run.smithi148.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T02:20:59.914 INFO:teuthology.orchestra.run.smithi098.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T02:20:59.917 INFO:teuthology.orchestra.run.smithi148.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-09-21T02:20:59.923 INFO:teuthology.orchestra.run.smithi079.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 20 MB/s | 2.3 MB 00:00 2024-09-21T02:20:59.939 INFO:teuthology.orchestra.run.smithi098.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-21T02:20:59.942 INFO:teuthology.orchestra.run.smithi148.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-21T02:20:59.967 INFO:teuthology.orchestra.run.smithi148.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T02:20:59.998 INFO:teuthology.orchestra.run.smithi098.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-21T02:21:00.042 INFO:teuthology.orchestra.run.smithi148.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T02:21:00.049 INFO:teuthology.orchestra.run.smithi098.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-21T02:21:00.065 INFO:teuthology.orchestra.run.smithi079.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-09-21T02:21:00.068 INFO:teuthology.orchestra.run.smithi148.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-21T02:21:00.102 INFO:teuthology.orchestra.run.smithi148.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-21T02:21:00.108 INFO:teuthology.orchestra.run.smithi098.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-21T02:21:00.127 INFO:teuthology.orchestra.run.smithi148.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-21T02:21:00.152 INFO:teuthology.orchestra.run.smithi148.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T02:21:00.166 INFO:teuthology.orchestra.run.smithi098.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-21T02:21:00.177 INFO:teuthology.orchestra.run.smithi148.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-21T02:21:00.199 INFO:teuthology.orchestra.run.smithi079.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.0 MB 00:00 2024-09-21T02:21:00.202 INFO:teuthology.orchestra.run.smithi148.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-21T02:21:00.208 INFO:teuthology.orchestra.run.smithi098.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T02:21:00.228 INFO:teuthology.orchestra.run.smithi148.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-21T02:21:00.253 INFO:teuthology.orchestra.run.smithi148.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-09-21T02:21:00.270 INFO:teuthology.orchestra.run.smithi148.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-09-21T02:21:00.275 INFO:teuthology.orchestra.run.smithi098.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-21T02:21:00.304 INFO:teuthology.orchestra.run.smithi148.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-21T02:21:00.329 INFO:teuthology.orchestra.run.smithi148.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T02:21:00.334 INFO:teuthology.orchestra.run.smithi098.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-21T02:21:00.346 INFO:teuthology.orchestra.run.smithi148.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-21T02:21:00.380 INFO:teuthology.orchestra.run.smithi148.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T02:21:00.384 INFO:teuthology.orchestra.run.smithi098.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-21T02:21:00.405 INFO:teuthology.orchestra.run.smithi148.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-21T02:21:00.422 INFO:teuthology.orchestra.run.smithi148.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 393 kB/s | 16 kB 00:00 2024-09-21T02:21:00.433 INFO:teuthology.orchestra.run.smithi079.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T02:21:00.434 INFO:teuthology.orchestra.run.smithi098.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 954 kB/s | 47 kB 00:00 2024-09-21T02:21:00.439 INFO:teuthology.orchestra.run.smithi148.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-21T02:21:00.464 INFO:teuthology.orchestra.run.smithi148.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T02:21:00.466 INFO:teuthology.orchestra.run.smithi079.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 763 kB/s | 25 kB 00:00 2024-09-21T02:21:00.481 INFO:teuthology.orchestra.run.smithi148.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-21T02:21:00.498 INFO:teuthology.orchestra.run.smithi148.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T02:21:00.501 INFO:teuthology.orchestra.run.smithi098.stdout:(63/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-21T02:21:00.523 INFO:teuthology.orchestra.run.smithi148.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-21T02:21:00.541 INFO:teuthology.orchestra.run.smithi148.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 861 kB/s | 36 kB 00:00 2024-09-21T02:21:00.560 INFO:teuthology.orchestra.run.smithi098.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-21T02:21:00.565 INFO:teuthology.orchestra.run.smithi148.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T02:21:00.590 INFO:teuthology.orchestra.run.smithi148.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T02:21:00.610 INFO:teuthology.orchestra.run.smithi098.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-21T02:21:00.616 INFO:teuthology.orchestra.run.smithi148.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T02:21:00.650 INFO:teuthology.orchestra.run.smithi148.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-21T02:21:00.666 INFO:teuthology.orchestra.run.smithi148.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T02:21:00.692 INFO:teuthology.orchestra.run.smithi148.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T02:21:00.717 INFO:teuthology.orchestra.run.smithi148.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T02:21:00.767 INFO:teuthology.orchestra.run.smithi148.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T02:21:00.769 INFO:teuthology.orchestra.run.smithi098.stdout:(66/157): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-21T02:21:00.816 INFO:teuthology.orchestra.run.smithi079.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 17 MB/s | 10 MB 00:00 2024-09-21T02:21:00.884 INFO:teuthology.orchestra.run.smithi079.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T02:21:00.911 INFO:teuthology.orchestra.run.smithi098.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-21T02:21:00.995 INFO:teuthology.orchestra.run.smithi098.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T02:21:01.009 INFO:teuthology.orchestra.run.smithi079.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 216 kB/s | 27 kB 00:00 2024-09-21T02:21:01.070 INFO:teuthology.orchestra.run.smithi098.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T02:21:01.101 INFO:teuthology.orchestra.run.smithi079.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 347 kB/s | 32 kB 00:00 2024-09-21T02:21:01.109 INFO:teuthology.orchestra.run.smithi148.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.1 MB/s | 3.4 MB 00:00 2024-09-21T02:21:01.128 INFO:teuthology.orchestra.run.smithi098.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T02:21:01.287 INFO:teuthology.orchestra.run.smithi098.stdout:(71/157): postgresql-server-13.16-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-09-21T02:21:01.326 INFO:teuthology.orchestra.run.smithi079.stdout:(14/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 14 MB/s | 18 MB 00:01 2024-09-21T02:21:01.346 INFO:teuthology.orchestra.run.smithi098.stdout:(72/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-09-21T02:21:01.360 INFO:teuthology.orchestra.run.smithi079.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 2.9 MB/s | 766 kB 00:00 2024-09-21T02:21:01.376 INFO:teuthology.orchestra.run.smithi079.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T02:21:01.388 INFO:teuthology.orchestra.run.smithi098.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-21T02:21:01.401 INFO:teuthology.orchestra.run.smithi148.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.7 MB/s | 2.3 MB 00:00 2024-09-21T02:21:01.410 INFO:teuthology.orchestra.run.smithi079.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T02:21:01.438 INFO:teuthology.orchestra.run.smithi098.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 954 kB/s | 87 kB 00:00 2024-09-21T02:21:01.443 INFO:teuthology.orchestra.run.smithi148.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 984 kB/s | 41 kB 00:00 2024-09-21T02:21:01.466 INFO:teuthology.orchestra.run.smithi079.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.5 MB/s | 507 kB 00:00 2024-09-21T02:21:01.497 INFO:teuthology.orchestra.run.smithi098.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T02:21:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 741 kB/s | 45 kB 00:00 2024-09-21T02:21:01.543 INFO:teuthology.orchestra.run.smithi148.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-21T02:21:01.581 INFO:teuthology.orchestra.run.smithi098.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-09-21T02:21:01.611 INFO:teuthology.orchestra.run.smithi079.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T02:21:01.627 INFO:teuthology.orchestra.run.smithi148.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.5 MB/s | 1.8 MB 00:00 2024-09-21T02:21:01.639 INFO:teuthology.orchestra.run.smithi098.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T02:21:01.689 INFO:teuthology.orchestra.run.smithi098.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-21T02:21:01.714 INFO:teuthology.orchestra.run.smithi098.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-21T02:21:01.720 INFO:teuthology.orchestra.run.smithi079.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-21T02:21:01.740 INFO:teuthology.orchestra.run.smithi098.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T02:21:01.745 INFO:teuthology.orchestra.run.smithi079.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.2 MB/s | 161 kB 00:00 2024-09-21T02:21:01.760 INFO:teuthology.orchestra.run.smithi148.stdout:(155/157): librbd1-19.3.0-5120.g18432218.el9.x8 3.0 MB/s | 3.2 MB 00:01 2024-09-21T02:21:01.770 INFO:teuthology.orchestra.run.smithi079.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T02:21:01.774 INFO:teuthology.orchestra.run.smithi098.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 172 kB 00:00 2024-09-21T02:21:01.796 INFO:teuthology.orchestra.run.smithi079.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T02:21:01.799 INFO:teuthology.orchestra.run.smithi098.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 588 kB/s | 35 kB 00:00 2024-09-21T02:21:01.821 INFO:teuthology.orchestra.run.smithi079.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T02:21:01.846 INFO:teuthology.orchestra.run.smithi079.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:21:01.894 INFO:teuthology.orchestra.run.smithi148.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 1.4 MB 00:00 2024-09-21T02:21:01.914 INFO:teuthology.orchestra.run.smithi079.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T02:21:01.933 INFO:teuthology.orchestra.run.smithi098.stdout:(83/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-21T02:21:01.981 INFO:teuthology.orchestra.run.smithi079.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 19 MB/s | 3.1 MB 00:00 2024-09-21T02:21:01.983 INFO:teuthology.orchestra.run.smithi098.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-09-21T02:21:02.006 INFO:teuthology.orchestra.run.smithi079.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 373 kB/s | 34 kB 00:00 2024-09-21T02:21:02.008 INFO:teuthology.orchestra.run.smithi098.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-21T02:21:02.031 INFO:teuthology.orchestra.run.smithi079.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T02:21:02.050 INFO:teuthology.orchestra.run.smithi098.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T02:21:02.084 INFO:teuthology.orchestra.run.smithi098.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 767 kB/s | 77 kB 00:00 2024-09-21T02:21:02.109 INFO:teuthology.orchestra.run.smithi098.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T02:21:02.168 INFO:teuthology.orchestra.run.smithi098.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T02:21:02.194 INFO:teuthology.orchestra.run.smithi148.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 2.4 MB 00:00 2024-09-21T02:21:02.200 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:21:02.201 INFO:teuthology.orchestra.run.smithi148.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T02:21:02.218 INFO:teuthology.orchestra.run.smithi098.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-21T02:21:02.243 INFO:teuthology.orchestra.run.smithi098.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-21T02:21:02.269 INFO:teuthology.orchestra.run.smithi098.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T02:21:02.327 INFO:teuthology.orchestra.run.smithi098.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-09-21T02:21:02.386 INFO:teuthology.orchestra.run.smithi098.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-09-21T02:21:02.636 INFO:teuthology.orchestra.run.smithi098.stdout:(95/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-21T02:21:02.662 INFO:teuthology.orchestra.run.smithi098.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 802 kB/s | 221 kB 00:00 2024-09-21T02:21:02.687 INFO:teuthology.orchestra.run.smithi098.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-21T02:21:02.712 INFO:teuthology.orchestra.run.smithi098.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T02:21:02.746 INFO:teuthology.orchestra.run.smithi098.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T02:21:02.748 INFO:teuthology.orchestra.run.smithi079.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T02:21:02.771 INFO:teuthology.orchestra.run.smithi098.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-21T02:21:02.797 INFO:teuthology.orchestra.run.smithi098.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T02:21:02.799 INFO:teuthology.orchestra.run.smithi079.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.8 MB/s | 292 kB 00:00 2024-09-21T02:21:02.847 INFO:teuthology.orchestra.run.smithi098.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-21T02:21:02.872 INFO:teuthology.orchestra.run.smithi098.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 631 kB/s | 64 kB 00:00 2024-09-21T02:21:02.891 INFO:teuthology.orchestra.run.smithi079.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 8.6 MB/s | 7.4 MB 00:00 2024-09-21T02:21:02.916 INFO:teuthology.orchestra.run.smithi079.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 422 kB/s | 49 kB 00:00 2024-09-21T02:21:02.941 INFO:teuthology.orchestra.run.smithi079.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T02:21:02.956 INFO:teuthology.orchestra.run.smithi098.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-21T02:21:02.967 INFO:teuthology.orchestra.run.smithi079.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T02:21:03.008 INFO:teuthology.orchestra.run.smithi079.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 446 kB/s | 18 kB 00:00 2024-09-21T02:21:03.014 INFO:teuthology.orchestra.run.smithi098.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T02:21:03.042 INFO:teuthology.orchestra.run.smithi079.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.6 MB/s | 784 kB 00:00 2024-09-21T02:21:03.048 INFO:teuthology.orchestra.run.smithi098.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T02:21:03.073 INFO:teuthology.orchestra.run.smithi098.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-21T02:21:03.199 INFO:teuthology.orchestra.run.smithi098.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T02:21:03.224 INFO:teuthology.orchestra.run.smithi098.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T02:21:03.226 INFO:teuthology.orchestra.run.smithi079.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T02:21:03.251 INFO:teuthology.orchestra.run.smithi079.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-21T02:21:03.258 INFO:teuthology.orchestra.run.smithi098.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-21T02:21:03.283 INFO:teuthology.orchestra.run.smithi098.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-09-21T02:21:03.317 INFO:teuthology.orchestra.run.smithi098.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.6 MB/s | 151 kB 00:00 2024-09-21T02:21:03.343 INFO:teuthology.orchestra.run.smithi079.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-21T02:21:03.350 INFO:teuthology.orchestra.run.smithi098.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 729 kB/s | 67 kB 00:00 2024-09-21T02:21:03.372 INFO:teuthology.orchestra.run.smithi079.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-21T02:21:03.392 INFO:teuthology.orchestra.run.smithi098.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T02:21:03.418 INFO:teuthology.orchestra.run.smithi098.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T02:21:03.427 INFO:teuthology.orchestra.run.smithi079.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-21T02:21:03.443 INFO:teuthology.orchestra.run.smithi098.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T02:21:03.443 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T02:21:03.452 INFO:teuthology.orchestra.run.smithi079.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-21T02:21:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-21T02:21:03.494 INFO:teuthology.orchestra.run.smithi098.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-09-21T02:21:03.494 INFO:teuthology.orchestra.run.smithi079.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-21T02:21:03.519 INFO:teuthology.orchestra.run.smithi098.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T02:21:03.519 INFO:teuthology.orchestra.run.smithi079.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-21T02:21:03.544 INFO:teuthology.orchestra.run.smithi098.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-09-21T02:21:03.570 INFO:teuthology.orchestra.run.smithi098.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T02:21:03.572 INFO:teuthology.orchestra.run.smithi079.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-21T02:21:03.595 INFO:teuthology.orchestra.run.smithi098.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T02:21:03.598 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T02:21:03.598 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T02:21:03.604 INFO:teuthology.orchestra.run.smithi079.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-21T02:21:03.629 INFO:teuthology.orchestra.run.smithi098.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T02:21:03.646 INFO:teuthology.orchestra.run.smithi098.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 638 kB/s | 11 kB 00:00 2024-09-21T02:21:03.662 INFO:teuthology.orchestra.run.smithi098.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T02:21:03.679 INFO:teuthology.orchestra.run.smithi098.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T02:21:03.696 INFO:teuthology.orchestra.run.smithi098.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T02:21:03.722 INFO:teuthology.orchestra.run.smithi098.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-21T02:21:03.729 INFO:teuthology.orchestra.run.smithi079.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 856 kB/s | 107 kB 00:00 2024-09-21T02:21:03.771 INFO:teuthology.orchestra.run.smithi079.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 524 kB/s | 22 kB 00:00 2024-09-21T02:21:03.772 INFO:teuthology.orchestra.run.smithi098.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-21T02:21:03.797 INFO:teuthology.orchestra.run.smithi098.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T02:21:03.821 INFO:teuthology.orchestra.run.smithi079.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-21T02:21:03.823 INFO:teuthology.orchestra.run.smithi098.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T02:21:03.848 INFO:teuthology.orchestra.run.smithi098.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T02:21:03.855 INFO:teuthology.orchestra.run.smithi079.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-21T02:21:03.872 INFO:teuthology.orchestra.run.smithi079.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 647 kB/s | 33 kB 00:00 2024-09-21T02:21:03.873 INFO:teuthology.orchestra.run.smithi098.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-21T02:21:03.897 INFO:teuthology.orchestra.run.smithi079.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-21T02:21:03.907 INFO:teuthology.orchestra.run.smithi098.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-21T02:21:03.914 INFO:teuthology.orchestra.run.smithi079.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 434 kB/s | 18 kB 00:00 2024-09-21T02:21:03.932 INFO:teuthology.orchestra.run.smithi098.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-09-21T02:21:03.940 INFO:teuthology.orchestra.run.smithi079.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-21T02:21:03.958 INFO:teuthology.orchestra.run.smithi098.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T02:21:03.983 INFO:teuthology.orchestra.run.smithi098.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T02:21:04.015 INFO:teuthology.orchestra.run.smithi079.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-21T02:21:04.027 INFO:teuthology.orchestra.run.smithi098.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 444 kB/s | 31 kB 00:00 2024-09-21T02:21:04.057 INFO:teuthology.orchestra.run.smithi079.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T02:21:04.059 INFO:teuthology.orchestra.run.smithi098.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2024-09-21T02:21:04.083 INFO:teuthology.orchestra.run.smithi079.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-21T02:21:04.084 INFO:teuthology.orchestra.run.smithi098.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T02:21:04.110 INFO:teuthology.orchestra.run.smithi098.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-21T02:21:04.135 INFO:teuthology.orchestra.run.smithi098.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T02:21:04.168 INFO:teuthology.orchestra.run.smithi098.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T02:21:04.193 INFO:teuthology.orchestra.run.smithi098.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T02:21:04.219 INFO:teuthology.orchestra.run.smithi098.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-21T02:21:04.233 INFO:teuthology.orchestra.run.smithi079.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-21T02:21:04.261 INFO:teuthology.orchestra.run.smithi098.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-21T02:21:04.286 INFO:teuthology.orchestra.run.smithi098.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T02:21:04.291 INFO:teuthology.orchestra.run.smithi079.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-21T02:21:04.317 INFO:teuthology.orchestra.run.smithi079.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-21T02:21:04.342 INFO:teuthology.orchestra.run.smithi079.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T02:21:04.345 INFO:teuthology.orchestra.run.smithi098.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T02:21:04.501 INFO:teuthology.orchestra.run.smithi079.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-21T02:21:04.526 INFO:teuthology.orchestra.run.smithi079.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-21T02:21:04.551 INFO:teuthology.orchestra.run.smithi079.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-21T02:21:04.602 INFO:teuthology.orchestra.run.smithi079.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-21T02:21:04.796 INFO:teuthology.orchestra.run.smithi098.stdout:(149/157): ceph-test-19.3.0-5120.g18432218.el9. 4.6 MB/s | 40 MB 00:08 2024-09-21T02:21:04.871 INFO:teuthology.orchestra.run.smithi098.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.0 MB/s | 3.2 MB 00:00 2024-09-21T02:21:04.919 INFO:teuthology.orchestra.run.smithi079.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-21T02:21:04.938 INFO:teuthology.orchestra.run.smithi098.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 5.2 MB/s | 3.4 MB 00:00 2024-09-21T02:21:05.096 INFO:teuthology.orchestra.run.smithi098.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 7.7 MB/s | 2.3 MB 00:00 2024-09-21T02:21:05.113 INFO:teuthology.orchestra.run.smithi098.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 233 kB/s | 41 kB 00:00 2024-09-21T02:21:05.119 INFO:teuthology.orchestra.run.smithi079.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.5 MB/s | 910 kB 00:00 2024-09-21T02:21:05.155 INFO:teuthology.orchestra.run.smithi098.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-21T02:21:05.177 INFO:teuthology.orchestra.run.smithi079.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T02:21:05.272 INFO:teuthology.orchestra.run.smithi098.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-09-21T02:21:05.314 INFO:teuthology.orchestra.run.smithi098.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.1 MB/s | 1.8 MB 00:00 2024-09-21T02:21:05.347 INFO:teuthology.orchestra.run.smithi098.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-21T02:21:05.354 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:21:05.354 INFO:teuthology.orchestra.run.smithi098.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T02:21:05.420 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T02:21:05.420 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T02:21:05.511 INFO:teuthology.orchestra.run.smithi079.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-09-21T02:21:05.678 INFO:teuthology.orchestra.run.smithi079.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.3 MB/s | 4.9 MB 00:01 2024-09-21T02:21:05.745 INFO:teuthology.orchestra.run.smithi079.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-09-21T02:21:05.770 INFO:teuthology.orchestra.run.smithi079.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 952 kB/s | 87 kB 00:00 2024-09-21T02:21:05.812 INFO:teuthology.orchestra.run.smithi079.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T02:21:05.896 INFO:teuthology.orchestra.run.smithi079.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-21T02:21:06.047 INFO:teuthology.orchestra.run.smithi079.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T02:21:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-09-21T02:21:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-21T02:21:06.197 INFO:teuthology.orchestra.run.smithi079.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T02:21:06.239 INFO:teuthology.orchestra.run.smithi079.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 834 kB/s | 35 kB 00:00 2024-09-21T02:21:06.356 INFO:teuthology.orchestra.run.smithi079.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-09-21T02:21:06.459 INFO:teuthology.orchestra.run.smithi079.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-21T02:21:06.549 INFO:teuthology.orchestra.run.smithi079.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-21T02:21:06.594 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-21T02:21:06.607 INFO:teuthology.orchestra.run.smithi079.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T02:21:06.649 INFO:teuthology.orchestra.run.smithi079.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T02:21:06.745 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-21T02:21:06.745 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-21T02:21:06.758 INFO:teuthology.orchestra.run.smithi079.stdout:(87/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-09-21T02:21:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-21T02:21:06.817 INFO:teuthology.orchestra.run.smithi079.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T02:21:06.901 INFO:teuthology.orchestra.run.smithi079.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T02:21:06.918 INFO:teuthology.orchestra.run.smithi079.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-09-21T02:21:06.943 INFO:teuthology.orchestra.run.smithi079.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-21T02:21:06.985 INFO:teuthology.orchestra.run.smithi079.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T02:21:07.027 INFO:teuthology.orchestra.run.smithi079.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T02:21:07.111 INFO:teuthology.orchestra.run.smithi079.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-21T02:21:07.177 INFO:teuthology.orchestra.run.smithi079.stdout:(96/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-09-21T02:21:07.203 INFO:teuthology.orchestra.run.smithi079.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-09-21T02:21:07.228 INFO:teuthology.orchestra.run.smithi079.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-21T02:21:07.303 INFO:teuthology.orchestra.run.smithi079.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 770 kB/s | 58 kB 00:00 2024-09-21T02:21:07.329 INFO:teuthology.orchestra.run.smithi079.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T02:21:07.354 INFO:teuthology.orchestra.run.smithi079.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T02:21:07.379 INFO:teuthology.orchestra.run.smithi079.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T02:21:07.405 INFO:teuthology.orchestra.run.smithi079.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 887 kB/s | 45 kB 00:00 2024-09-21T02:21:07.463 INFO:teuthology.orchestra.run.smithi079.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-21T02:21:07.522 INFO:teuthology.orchestra.run.smithi079.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T02:21:07.556 INFO:teuthology.orchestra.run.smithi079.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T02:21:07.581 INFO:teuthology.orchestra.run.smithi079.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-21T02:21:07.623 INFO:teuthology.orchestra.run.smithi079.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-21T02:21:07.702 INFO:teuthology.orchestra.run.smithi079.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 333 kB/s | 26 kB 00:00 2024-09-21T02:21:07.732 INFO:teuthology.orchestra.run.smithi079.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.6 MB/s | 49 kB 00:00 2024-09-21T02:21:07.757 INFO:teuthology.orchestra.run.smithi079.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T02:21:07.783 INFO:teuthology.orchestra.run.smithi079.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T02:21:07.825 INFO:teuthology.orchestra.run.smithi079.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T02:21:07.858 INFO:teuthology.orchestra.run.smithi079.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T02:21:07.884 INFO:teuthology.orchestra.run.smithi079.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T02:21:07.909 INFO:teuthology.orchestra.run.smithi079.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T02:21:07.934 INFO:teuthology.orchestra.run.smithi079.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-21T02:21:07.968 INFO:teuthology.orchestra.run.smithi079.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-21T02:21:08.010 INFO:teuthology.orchestra.run.smithi079.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-21T02:21:08.044 INFO:teuthology.orchestra.run.smithi079.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T02:21:08.131 INFO:teuthology.orchestra.run.smithi079.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-09-21T02:21:08.161 INFO:teuthology.orchestra.run.smithi079.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-21T02:21:08.186 INFO:teuthology.orchestra.run.smithi079.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T02:21:08.212 INFO:teuthology.orchestra.run.smithi079.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T02:21:08.237 INFO:teuthology.orchestra.run.smithi079.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T02:21:08.262 INFO:teuthology.orchestra.run.smithi079.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-21T02:21:08.288 INFO:teuthology.orchestra.run.smithi079.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-21T02:21:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-09-21T02:21:08.380 INFO:teuthology.orchestra.run.smithi079.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-21T02:21:08.406 INFO:teuthology.orchestra.run.smithi079.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T02:21:08.456 INFO:teuthology.orchestra.run.smithi079.stdout:(131/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.3 MB/s | 2.0 MB 00:00 2024-09-21T02:21:08.481 INFO:teuthology.orchestra.run.smithi079.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-21T02:21:08.570 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-21T02:21:08.570 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-21T02:21:08.640 INFO:teuthology.orchestra.run.smithi079.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 313 kB/s | 58 kB 00:00 2024-09-21T02:21:08.666 INFO:teuthology.orchestra.run.smithi079.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 654 kB/s | 16 kB 00:00 2024-09-21T02:21:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-21T02:21:08.716 INFO:teuthology.orchestra.run.smithi079.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T02:21:08.742 INFO:teuthology.orchestra.run.smithi079.stdout:(137/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-09-21T02:21:08.767 INFO:teuthology.orchestra.run.smithi079.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T02:21:08.793 INFO:teuthology.orchestra.run.smithi079.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T02:21:08.818 INFO:teuthology.orchestra.run.smithi079.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T02:21:08.843 INFO:teuthology.orchestra.run.smithi079.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T02:21:08.868 INFO:teuthology.orchestra.run.smithi079.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T02:21:08.894 INFO:teuthology.orchestra.run.smithi079.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T02:21:08.919 INFO:teuthology.orchestra.run.smithi079.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T02:21:08.945 INFO:teuthology.orchestra.run.smithi079.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-21T02:21:09.146 INFO:teuthology.orchestra.run.smithi079.stdout:(146/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.3 MB/s | 16 MB 00:02 2024-09-21T02:21:09.187 INFO:teuthology.orchestra.run.smithi079.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 792 kB/s | 191 kB 00:00 2024-09-21T02:21:09.220 INFO:teuthology.orchestra.run.smithi079.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-09-21T02:21:09.279 INFO:teuthology.orchestra.run.smithi079.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-21T02:21:09.438 INFO:teuthology.orchestra.run.smithi079.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T02:21:09.563 INFO:teuthology.orchestra.run.smithi079.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-21T02:21:09.655 INFO:teuthology.orchestra.run.smithi079.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 448 kB/s | 41 kB 00:00 2024-09-21T02:21:09.755 INFO:teuthology.orchestra.run.smithi079.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-21T02:21:09.806 INFO:teuthology.orchestra.run.smithi079.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.4 MB/s | 2.3 MB 00:00 2024-09-21T02:21:09.956 INFO:teuthology.orchestra.run.smithi079.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.5 MB/s | 1.8 MB 00:00 2024-09-21T02:21:10.007 INFO:teuthology.orchestra.run.smithi079.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-21T02:21:10.506 INFO:teuthology.orchestra.run.smithi079.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-21T02:21:10.513 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:21:10.513 INFO:teuthology.orchestra.run.smithi079.stdout:Total 19 MB/s | 228 MB 00:11 2024-09-21T02:21:11.794 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T02:21:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:21:11.928 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:21:11.981 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:21:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:21:12.041 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:21:12.082 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:21:12.415 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:21:12.533 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-21T02:21:12.541 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:21:12.668 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:21:12.701 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:21:12.714 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-21T02:21:12.714 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-21T02:21:12.775 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:21:12.805 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:21:12.835 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:21:12.987 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:21:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:21:13.064 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:21:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:21:13.199 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:21:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:21:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:21:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:21:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:21:13.614 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:21:13.715 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:21:13.812 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:13.883 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:14.105 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:21:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:21:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:21:14.354 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:21:14.410 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:21:14.449 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:21:14.493 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:21:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:21:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:21:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:21:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:21:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:21:14.750 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:21:14.832 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:21:14.869 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:21:14.913 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:21:14.942 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:21:15.087 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-21T02:21:15.087 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-21T02:21:15.092 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-21T02:21:15.112 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:21:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:21:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:21:15.310 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:21:15.344 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:21:15.364 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:21:15.370 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:21:15.412 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:21:15.438 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:21:15.570 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:21:15.624 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:21:15.747 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:21:15.862 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:21:15.988 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:21:16.022 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:21:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:21:16.149 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:21:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:21:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:21:16.228 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:21:16.257 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:21:16.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:21:16.330 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:21:16.333 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:21:16.371 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:21:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:21:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:21:16.502 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:21:16.527 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:21:16.528 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:21:16.574 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:21:16.591 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:21:16.596 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:21:16.614 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:21:16.675 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:21:16.730 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:21:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:21:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:21:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:21:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:21:16.918 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:21:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:21:16.954 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:21:16.997 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:21:17.036 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:21:17.139 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:17.205 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:17.254 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:21:17.402 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:21:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:17.440 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:21:17.482 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:21:17.537 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:21:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:21:17.586 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:21:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:21:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:21:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:21:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:21:17.687 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:21:17.706 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:21:17.739 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:21:17.771 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:21:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:21:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:21:17.873 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:21:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:21:17.901 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:21:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:21:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:21:17.969 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:21:17.991 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:21:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:21:18.030 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:21:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:21:18.062 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:21:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:21:18.092 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:21:18.127 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:21:18.160 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:21:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:21:18.202 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:21:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:21:18.236 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:21:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:21:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:21:18.322 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:21:18.375 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:21:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:21:18.406 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:21:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:21:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:21:18.510 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:21:18.565 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:21:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:21:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:21:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:21:19.290 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:21:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:21:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:21:19.337 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:21:19.371 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:21:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:21:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:21:19.467 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:21:19.469 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:21:19.526 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:21:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:21:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:21:19.658 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:21:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:21:19.707 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:21:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:21:19.851 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:21:19.891 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:21:19.921 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:21:19.924 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:21:19.956 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:21:19.992 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:21:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:21:20.039 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:21:20.075 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:21:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:21:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:21:20.312 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:21:20.355 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:21:20.395 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:21:20.646 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:21:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:21:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:21:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:21:20.845 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:21:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:21:20.903 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:21:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:21:21.113 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:21:21.153 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:21:21.181 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:21:21.215 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:21:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:21:21.286 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:21:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:21:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:21:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:21:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:21:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:21:21.572 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:21:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:21:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:21:21.749 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:21:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-21T02:21:21.805 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:21:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:21:22.004 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:21:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:21:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:21:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:21:22.112 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:21:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:21:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:21:22.451 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:21:22.472 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:21:22.513 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:21:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:21:22.522 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:21:22.562 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:21:22.596 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:21:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:21:22.695 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:21:22.729 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:21:22.743 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:21:22.795 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:21:22.882 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:21:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:21:22.906 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:21:22.923 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:21:23.038 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:21:23.106 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:21:23.137 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:21:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:21:23.214 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:21:23.215 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:21:23.353 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:21:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:21:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:21:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:21:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:21:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:21:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:21:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:21:23.735 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:21:23.762 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:21:23.845 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:21:23.899 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:21:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:21:23.960 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:21:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:21:24.031 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:21:24.076 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:21:24.309 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:21:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:21:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:21:24.843 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:25.007 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:21:25.276 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:21:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:21:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:21:25.353 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:21:25.413 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:21:25.449 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:21:25.490 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:21:25.572 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:21:25.635 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:21:25.674 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:21:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:21:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:21:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:21:25.769 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:21:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:21:25.818 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:21:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:21:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:25.882 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:21:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:21:25.968 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:21:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:21:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:21:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:21:26.205 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:21:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:21:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:21:26.363 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:21:26.380 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:21:26.403 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:21:26.417 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:21:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:21:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:21:26.509 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:21:26.538 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:26.579 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:21:26.662 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:21:26.662 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:21:26.662 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:21:26.662 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:26.666 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:21:26.697 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:21:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:21:27.355 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:21:27.455 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:21:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:21:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:21:27.882 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:21:27.935 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:21:28.109 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:21:28.169 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:21:28.276 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:21:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:21:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:21:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:21:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:21:28.565 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:21:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:21:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:21:28.711 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:21:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:21:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:21:28.926 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:21:29.082 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:21:29.124 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:21:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:21:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:21:29.238 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:21:29.368 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:21:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:29.522 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:21:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:21:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:21:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:21:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:21:29.631 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:21:29.631 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:21:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:29.643 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:21:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:21:29.692 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:21:29.731 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:21:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:21:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:21:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:21:29.880 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:21:29.929 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:21:30.028 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:21:30.079 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:21:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:21:30.237 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:21:30.297 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:21:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:21:31.251 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:21:31.285 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:21:31.398 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:21:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:21:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:21:31.632 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:21:31.671 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:21:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:21:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:21:32.068 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:21:32.880 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:21:33.022 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:21:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:21:34.676 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:21:34.712 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:21:34.745 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:21:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:21:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:21:35.775 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:21:35.847 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:21:35.895 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:21:36.436 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:21:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:21:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:21:36.587 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-21T02:21:38.449 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:21:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:21:38.642 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:38.642 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:21:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:39.139 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:39.193 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:39.856 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:21:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:21:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:21:40.051 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:21:40.051 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:21:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:21:40.089 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:21:40.236 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:21:40.263 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:21:40.263 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:40.263 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:21:40.263 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:21:40.263 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:21:40.263 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:40.487 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:21:40.510 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:21:40.510 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:40.510 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:21:40.510 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:21:40.511 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:21:40.511 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:21:41.003 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:21:41.003 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:41.003 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:21:41.003 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:21:41.003 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:21:41.003 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:41.118 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:21:41.175 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:21:41.230 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:21:41.417 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:21:41.463 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:21:41.541 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-21T02:21:41.605 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:41.631 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:21:41.777 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:21:41.778 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:21:41.795 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:21:41.795 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:41.795 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:21:41.796 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:41.821 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:21:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:21:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:21:42.281 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:21:42.304 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:21:42.329 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:21:42.386 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:21:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:21:43.356 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:21:43.384 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:21:43.384 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:43.384 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:21:43.384 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:21:43.384 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:21:43.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:43.615 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:21:43.639 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:21:43.639 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:43.639 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:21:43.639 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:21:43.639 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:21:43.639 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:44.108 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:21:44.132 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:21:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:21:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:21:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:21:44.132 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:44.238 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:21:44.295 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:21:44.358 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:21:44.544 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:21:44.592 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:21:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:21:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:21:44.914 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:21:44.951 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:21:44.983 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:21:45.011 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:21:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:21:45.518 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:21:45.550 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:21:45.608 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:21:45.616 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:21:45.641 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:21:45.675 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:21:46.642 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:21:46.667 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:21:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:21:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:21:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:21:46.993 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:21:46.994 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:46.994 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:21:46.994 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:21:46.994 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:21:46.994 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:47.045 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:21:47.057 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:21:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:21:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:21:48.177 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:48.273 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:21:48.296 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:21:48.296 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:48.296 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:21:48.296 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:48.349 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:21:48.373 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:21:48.373 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:48.373 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:21:48.373 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:21:48.373 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:21:48.373 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:21:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:21:48.723 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:48.723 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:21:48.723 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:21:48.723 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:21:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:21:48.826 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:21:48.889 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:21:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:21:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:21:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:21:50.157 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:21:50.192 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:21:50.216 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:21:50.216 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:50.216 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:21:50.216 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:21:50.216 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:21:50.216 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:50.267 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:21:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:21:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:21:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:21:51.392 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:21:51.420 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:21:51.444 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:21:51.444 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:51.444 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:21:51.444 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:21:51.444 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:21:51.445 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:51.488 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:21:51.511 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:21:51.511 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:51.511 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:21:51.511 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:51.931 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:21:51.955 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:21:51.956 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:51.956 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:21:51.956 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:21:51.956 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:21:51.956 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:21:52.687 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:21:52.728 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:21:52.768 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:21:52.801 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:21:52.828 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:21:53.016 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:21:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:21:53.057 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-09-21T02:21:53.057 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-09-21T02:21:53.057 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-09-21T02:21:53.057 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-09-21T02:21:53.057 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-09-21T02:21:53.058 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-09-21T02:21:53.058 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-09-21T02:21:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:21:53.058 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:21:53.088 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:21:53.118 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:21:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:21:53.273 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:21:53.307 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:21:53.308 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:53.308 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:21:53.308 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:21:53.769 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:21:53.803 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:21:53.824 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:21:54.666 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:21:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:21:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:21:54.888 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:21:54.919 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:21:54.945 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:21:54.970 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:21:54.970 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:21:55.054 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:21:55.055 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:21:55.061 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:21:55.118 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:21:55.119 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:55.119 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:21:55.119 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:21:55.119 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:21:55.119 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:21:55.139 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:21:55.163 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:21:55.169 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:21:55.169 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:21:55.358 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:21:55.358 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:21:55.370 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:21:55.421 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:21:55.421 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:55.421 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:21:55.421 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:21:55.421 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:21:55.421 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:21:55.433 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:21:55.497 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:21:55.937 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:21:55.960 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:21:55.988 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:21:55.988 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:21:55.988 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:21:55.988 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:21:55.988 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:21:55.988 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:21:56.002 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:21:56.042 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:21:56.074 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:21:56.102 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:21:56.113 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:21:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:21:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:21:56.285 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:21:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:21:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:21:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:21:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:21:56.479 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:21:56.556 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:21:56.646 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:21:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:21:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:21:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:21:57.032 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:21:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:21:57.058 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:21:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:21:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:21:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:21:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:21:57.683 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:21:57.765 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:21:57.806 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:21:57.924 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:21:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:21:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:21:58.147 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:21:58.187 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:21:58.213 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:21:58.239 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:21:58.239 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:21:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:21:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:21:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:21:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:21:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:21:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:21:58.610 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:21:58.610 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:21:58.701 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:21:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:01.437 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:22:01.504 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:22:02.002 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:02.002 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:22:02.002 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:22:02.003 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:22:02.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:22:02.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:22:02.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:22:02.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:22:02.016 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:22:02.016 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:22:02.017 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:22:02.018 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:22:02.019 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:22:02.020 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:22:02.021 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:22:02.022 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:22:02.023 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:22:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:22:02.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:22:02.026 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:22:02.581 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:22:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:22:02.762 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:22:02.941 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:22:02.973 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:22:03.025 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:22:03.025 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:22:03.025 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:22:03.025 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:22:03.025 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:22:03.025 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:03.106 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:22:03.131 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:22:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:22:03.308 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:22:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:22:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:22:04.430 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:22:04.430 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:22:04.430 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:22:04.430 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:22:04.430 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:22:04.430 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:04.478 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:22:04.527 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:22:04.527 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:22:04.527 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:22:04.527 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:04.579 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:22:04.629 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:22:04.630 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:22:04.630 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:22:04.630 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:22:04.630 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:22:04.630 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:22:04.744 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-21T02:22:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:22:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:22:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:22:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:22:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:22:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:22:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:22:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:22:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:22:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:22:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:22:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:22:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:22:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:22:04.756 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T02:22:04.988 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:22:05.041 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:22:05.041 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:22:05.042 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:22:05.042 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:22:05.042 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:22:05.042 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:05.172 DEBUG:teuthology.parallel:result is None 2024-09-21T02:22:05.371 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:05.371 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:22:05.371 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:22:05.371 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:22:05.371 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:22:05.372 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:22:05.373 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:22:05.384 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:22:05.384 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:22:05.384 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:22:05.384 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:22:05.385 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:22:05.386 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:22:05.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:22:05.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:22:05.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:22:05.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:22:05.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:22:05.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:22:05.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:22:05.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:22:05.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:22:05.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:22:05.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:22:05.391 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:22:05.392 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:22:05.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:22:05.394 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:22:05.395 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:22:05.396 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:22:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:07.575 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:22:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:22:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:22:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:22:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:22:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:22:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:22:07.586 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-21T02:22:08.014 DEBUG:teuthology.parallel:result is None 2024-09-21T02:22:09.395 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:22:09.453 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:22:09.504 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:22:09.533 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:22:09.568 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:22:09.835 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:22:09.882 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:22:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:22:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:22:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:22:10.691 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:22:10.736 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:22:10.778 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:22:12.065 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:22:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:22:12.234 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:22:12.351 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:22:12.391 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:22:12.416 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:22:12.461 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:22:12.461 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:22:12.585 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:22:12.586 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:22:12.695 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:22:12.719 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:22:12.734 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:22:12.734 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:22:12.980 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:22:12.980 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:22:13.089 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:22:13.172 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:13.365 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:13.366 INFO:teuthology.orchestra.run.smithi079.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T02:22:13.366 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:22:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:22:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:22:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:22:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:22:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:22:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:22:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:22:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:22:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:22:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:22:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:22:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:22:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:22:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:22:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:22:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:22:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:22:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:22:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:22:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:22:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:22:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:22:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:22:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:22:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:22:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:22:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:22:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:22:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:22:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:22:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:22:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:22:22.040 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-21T02:22:22.760 DEBUG:teuthology.parallel:result is None 2024-09-21T02:22:22.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:22:22.899 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:22:22.944 INFO:teuthology.orchestra.run.smithi079.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:22:22.945 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:22:22.945 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:22:22.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:22:23.094 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:22:23.121 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:22:23.121 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:22:23.121 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:22:23.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:22:23.277 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:22:23.304 INFO:teuthology.orchestra.run.smithi148.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:22:23.304 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:22:23.304 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:22:23.306 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T02:22:23.306 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:22:23.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:22:23.370 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:22:23.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:22:23.402 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:22:23.402 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:22:23.434 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T02:22:23.435 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:22:23.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:22:23.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:22:23.598 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:22:23.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:22:23.627 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:22:23.697 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:22:23.697 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:22:23.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:22:23.791 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T02:22:23.791 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:22:23.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:22:23.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:22:23.952 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:22:23.952 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:22:23.979 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:22:24.043 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:22:24.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:22:24.080 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:22:24.147 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T02:22:24.147 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:22:24.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:22:24.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:22:24.301 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:22:24.301 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:22:24.326 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:22:24.391 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:22:24.391 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:22:24.416 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:22:24.481 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T02:22:24.573 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T02:22:24.573 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:22:24.573 INFO:tasks.cephadm:Cluster fsid is 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:22:24.574 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T02:22:24.574 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.79', 'mon.b': '172.21.15.98', 'mon.c': '172.21.15.148'} 2024-09-21T02:22:24.574 INFO:tasks.cephadm:First mon is mon.a on smithi079 2024-09-21T02:22:24.574 INFO:tasks.cephadm:First mgr is x 2024-09-21T02:22:24.574 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T02:22:24.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2024-09-21T02:22:24.634 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-09-21T02:22:24.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname $(hostname -s) 2024-09-21T02:22:24.685 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T02:22:24.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:22:24.831 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T02:22:24.973 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:22:24.975 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T02:22:24.975 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T02:22:24.975 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:25.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:22 /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:25.535 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:26.099 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:22 /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:26.100 DEBUG:teuthology.orchestra.run.smithi148:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:26.624 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:22 /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:26.624 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:26.666 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:26.686 DEBUG:teuthology.orchestra.run.smithi148:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:22:26.719 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T02:22:26.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:22:26.724 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:22:26.728 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:22:28.322 INFO:teuthology.orchestra.run.smithi148.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:22:28.393 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:22:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:23:01.756 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:23:01.756 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:23:01.756 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:23:01.756 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2024-09-21T02:23:01.756 INFO:teuthology.orchestra.run.smithi079.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:23:01.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:23:01.756 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:23:18.879 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-21T02:23:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:23:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:23:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-09-21T02:23:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:23:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-21T02:23:18.880 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-21T02:23:21.248 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T02:23:21.248 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:23:21.249 INFO:teuthology.orchestra.run.smithi148.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:23:21.249 INFO:teuthology.orchestra.run.smithi148.stdout: "repo_digests": [ 2024-09-21T02:23:21.249 INFO:teuthology.orchestra.run.smithi148.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:23:21.249 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T02:23:21.249 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T02:23:21.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2024-09-21T02:23:21.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-09-21T02:23:21.371 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph 2024-09-21T02:23:21.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2024-09-21T02:23:21.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-09-21T02:23:21.486 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /etc/ceph 2024-09-21T02:23:21.511 INFO:tasks.cephadm:Writing seed config... 2024-09-21T02:23:21.512 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T02:23:21.513 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T02:23:21.514 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T02:23:21.515 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:23:21.515 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T02:23:21.550 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 56d10306-77c0-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T02:23:21.551 DEBUG:teuthology.orchestra.run.smithi079:mon.a> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T02:23:21.595 DEBUG:teuthology.orchestra.run.smithi079:mgr.x> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T02:23:21.640 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T02:23:21.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 56d10306-77c0-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.79 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:23:21.899 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:23:21.899 INFO:teuthology.orchestra.run.smithi079.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.79', '--skip-admin-label'] 2024-09-21T02:23:21.900 INFO:teuthology.orchestra.run.smithi079.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T02:23:21.900 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying podman|docker is present... 2024-09-21T02:23:21.945 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 5.2.2 2024-09-21T02:23:21.945 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying lvm2 is present... 2024-09-21T02:23:21.945 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying time synchronization is in place... 2024-09-21T02:23:21.959 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T02:23:21.959 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T02:23:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T02:23:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-21T02:23:21.985 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-09-21T02:23:21.998 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-09-21T02:23:21.998 INFO:teuthology.orchestra.run.smithi079.stdout:Unit chronyd.service is enabled and running 2024-09-21T02:23:21.998 INFO:teuthology.orchestra.run.smithi079.stdout:Repeating the final host check... 2024-09-21T02:23:22.041 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 5.2.2 2024-09-21T02:23:22.041 INFO:teuthology.orchestra.run.smithi079.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T02:23:22.041 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl is present 2024-09-21T02:23:22.041 INFO:teuthology.orchestra.run.smithi079.stdout:lvcreate is present 2024-09-21T02:23:22.054 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T02:23:22.054 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T02:23:22.066 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T02:23:22.066 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-21T02:23:22.080 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-09-21T02:23:22.092 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-09-21T02:23:22.092 INFO:teuthology.orchestra.run.smithi079.stdout:Unit chronyd.service is enabled and running 2024-09-21T02:23:22.092 INFO:teuthology.orchestra.run.smithi079.stdout:Host looks OK 2024-09-21T02:23:22.093 INFO:teuthology.orchestra.run.smithi079.stdout:Cluster fsid: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:22.093 INFO:teuthology.orchestra.run.smithi079.stdout:Acquiring lock 139949287746192 on /run/cephadm/56d10306-77c0-11ef-baf5-efdc52797490.lock 2024-09-21T02:23:22.093 INFO:teuthology.orchestra.run.smithi079.stdout:Lock 139949287746192 acquired on /run/cephadm/56d10306-77c0-11ef-baf5-efdc52797490.lock 2024-09-21T02:23:22.093 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 3300 ... 2024-09-21T02:23:22.094 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 6789 ... 2024-09-21T02:23:22.094 INFO:teuthology.orchestra.run.smithi079.stdout:Base mon IP(s) is [172.21.15.79:3300, 172.21.15.79:6789], mon addrv is [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-21T02:23:22.101 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.79 metric 100 2024-09-21T02:23:22.101 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.79 metric 100 2024-09-21T02:23:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T02:23:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T02:23:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T02:23:22.112 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T02:23:22.113 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T02:23:22.113 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T02:23:22.113 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T02:23:22.113 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link noprefixroute 2024-09-21T02:23:22.113 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T02:23:22.113 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-09-21T02:23:22.114 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-09-21T02:23:22.114 INFO:teuthology.orchestra.run.smithi079.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T02:23:22.114 INFO:teuthology.orchestra.run.smithi079.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T02:23:22.115 INFO:teuthology.orchestra.run.smithi079.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:23:22.661 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T02:23:22.661 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:23:22.661 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T02:23:22.661 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T02:23:22.661 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T02:23:22.662 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T02:23:22.662 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T02:23:23.842 INFO:teuthology.orchestra.run.smithi079.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T02:23:23.842 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T02:23:23.842 INFO:teuthology.orchestra.run.smithi079.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T02:23:24.861 INFO:teuthology.orchestra.run.smithi079.stdout:stat: stdout 167 167 2024-09-21T02:23:24.861 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial keys... 2024-09-21T02:23:25.918 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQAdLu5mgM/HERAA7x/d5KvmVBazjKWpJ7imtg== 2024-09-21T02:23:27.009 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQAeLu5mK0D8FxAAaV6r/wIrGPoyzSRpJqj2rg== 2024-09-21T02:23:28.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQAfLu5m/GNZGBAAIcI65nPY0eiyeaVbIxhpdQ== 2024-09-21T02:23:28.014 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial monmap... 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool for a [v2:172.21.15.79:3300,v1:172.21.15.79:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = quincy 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: set fsid to 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:23:29.124 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mon... 2024-09-21T02:23:30.174 INFO:teuthology.orchestra.run.smithi079.stdout:create mon.a on 2024-09-21T02:23:30.484 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T02:23:30.704 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T02:23:30.987 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-56d10306-77c0-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-56d10306-77c0-11ef-baf5-efdc52797490.target. 2024-09-21T02:23:30.988 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-56d10306-77c0-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-56d10306-77c0-11ef-baf5-efdc52797490.target. 2024-09-21T02:23:31.322 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a 2024-09-21T02:23:31.322 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T02:23:31.587 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-56d10306-77c0-11ef-baf5-efdc52797490.target.wants/ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-56d10306-77c0-11ef-baf5-efdc52797490@.service. 2024-09-21T02:23:32.210 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:31 smithi079 podman[30402]: 2024-09-21 02:23:31.944577081 +0000 UTC m=+0.134605738 container create 11859785aa20f18855febbb2ec3887f065a99233a51985250d3bd02b61f6b473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T02:23:32.210 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:32 smithi079 podman[30402]: 2024-09-21 02:23:32.205903282 +0000 UTC m=+0.395931940 container init 11859785aa20f18855febbb2ec3887f065a99233a51985250d3bd02b61f6b473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T02:23:32.335 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:23:32.335 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-21T02:23:32.350 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:23:32.350 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-21T02:23:32.350 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-21T02:23:32.350 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T02:23:32.351 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon to start... 2024-09-21T02:23:32.351 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon... 2024-09-21T02:23:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:32 smithi079 podman[30402]: 2024-09-21 02:23:32.213106914 +0000 UTC m=+0.403135574 container start 11859785aa20f18855febbb2ec3887f065a99233a51985250d3bd02b61f6b473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T02:23:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:32 smithi079 bash[30402]: 11859785aa20f18855febbb2ec3887f065a99233a51985250d3bd02b61f6b473 2024-09-21T02:23:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:32 smithi079 systemd[1]: Started Ceph mon.a for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:23:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:32 smithi079 ceph-mon[30425]: mkfs 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:32 smithi079 ceph-mon[30425]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: monmap epoch 1 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: last_changed 2024-09-21T02:23:28.486626+0000 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: min_mon_release 19 (squid) 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: election_strategy: 1 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: fsmap 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: mgrmap e1: no daemons active 2024-09-21T02:23:33.571 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:33 smithi079 ceph-mon[30425]: from='client.? 172.21.15.79:0/2875134015' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T02:23:33.577 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T02:23:33.578 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout id: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout services: 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.641235s) 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout data: 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:33.579 INFO:teuthology.orchestra.run.smithi079.stdout:mon is available 2024-09-21T02:23:33.580 INFO:teuthology.orchestra.run.smithi079.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T02:23:34.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:34 smithi079 ceph-mon[30425]: from='client.? 172.21.15.79:0/3690123748' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T02:23:34.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:34 smithi079 ceph-mon[30425]: from='client.? 172.21.15.79:0/3690123748' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:34.844 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T02:23:34.845 INFO:teuthology.orchestra.run.smithi079.stdout:Generating new minimal ceph.conf... 2024-09-21T02:23:35.800 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:35 smithi079 ceph-mon[30425]: from='client.? 172.21.15.79:0/346432941' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:23:36.098 INFO:teuthology.orchestra.run.smithi079.stdout:Restarting the monitor... 2024-09-21T02:23:36.441 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:36 smithi079 systemd[1]: Stopping Ceph mon.a for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:23:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a[30421]: 2024-09-21T02:23:36.439+0000 7f8fd9200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:23:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a[30421]: 2024-09-21T02:23:36.439+0000 7f8fd9200640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T02:23:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:36 smithi079 podman[30668]: 2024-09-21 02:23:36.665537892 +0000 UTC m=+0.348312751 container died 11859785aa20f18855febbb2ec3887f065a99233a51985250d3bd02b61f6b473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T02:23:37.296 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 podman[30668]: 2024-09-21 02:23:37.127849627 +0000 UTC m=+0.810624485 container cleanup 11859785aa20f18855febbb2ec3887f065a99233a51985250d3bd02b61f6b473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T02:23:37.296 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 bash[30668]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a 2024-09-21T02:23:37.548 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 podman[30680]: 2024-09-21 02:23:37.29544991 +0000 UTC m=+0.620552788 container remove 11859785aa20f18855febbb2ec3887f065a99233a51985250d3bd02b61f6b473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:23:37.858 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 systemd[1]: ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T02:23:37.858 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 systemd[1]: Stopped Ceph mon.a for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:23:37.858 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 systemd[1]: ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a.service: Consumed 1.298s CPU time. 2024-09-21T02:23:37.859 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 systemd[1]: Starting Ceph mon.a for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:23:38.132 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 podman[30769]: 2024-09-21 02:23:37.762522321 +0000 UTC m=+0.026979671 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:23:38.132 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:37 smithi079 podman[30769]: 2024-09-21 02:23:37.871337886 +0000 UTC m=+0.135795235 container create b8599cd87a62783196fd089c3a4db1f94faca4ae66a3d7609fed1b4a1f0c6738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T02:23:38.132 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 podman[30769]: 2024-09-21 02:23:38.04851955 +0000 UTC m=+0.312976899 container init b8599cd87a62783196fd089c3a4db1f94faca4ae66a3d7609fed1b4a1f0c6738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T02:23:38.132 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 podman[30769]: 2024-09-21 02:23:38.054871831 +0000 UTC m=+0.319329181 container start b8599cd87a62783196fd089c3a4db1f94faca4ae66a3d7609fed1b4a1f0c6738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T02:23:38.140 INFO:teuthology.orchestra.run.smithi079.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T02:23:38.401 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 bash[30769]: b8599cd87a62783196fd089c3a4db1f94faca4ae66a3d7609fed1b4a1f0c6738 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 systemd[1]: Started Ceph mon.a for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: pidfile_write: ignore empty --pid-file 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: load: jerasure load: lrc 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: RocksDB version: 7.9.2 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Git sha 0 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: DB SUMMARY 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: DB Session ID: S8YX09JESPM6MOXOWARN 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: CURRENT file: CURRENT 2024-09-21T02:23:38.402 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 93712 ; 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.error_if_exists: 0 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.create_if_missing: 0 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.paranoid_checks: 1 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.env: 0x55751d5d1d60 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.info_log: 0x55755c15b320 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.statistics: (nil) 2024-09-21T02:23:38.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.use_fsync: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_log_file_size: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.allow_fallocate: 1 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.use_direct_reads: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T02:23:38.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.db_log_dir: 2024-09-21T02:23:38.405 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.wal_dir: 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.write_buffer_manager: 0x55755c15fd60 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T02:23:38.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.unordered_write: 0 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.row_cache: None 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.wal_filter: None 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T02:23:38.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.two_write_queues: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.wal_compression: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.atomic_flush: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.log_readahead_size: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T02:23:38.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_background_jobs: 2 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_background_compactions: -1 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_subcompactions: 1 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_open_files: -1 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T02:23:38.409 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_background_flushes: -1 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Compression algorithms supported: 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kZSTD supported: 0 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kXpressCompression supported: 0 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kBZip2Compression supported: 0 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kLZ4Compression supported: 1 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kZlibCompression supported: 1 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: kSnappyCompression supported: 1 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T02:23:38.410 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.merge_operator: 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_filter: None 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55755c15af60) 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout: cache_index_and_filter_blocks: 1 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout: pin_top_level_index_and_filter: 1 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout: index_type: 0 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout: data_block_index_type: 0 2024-09-21T02:23:38.411 INFO:journalctl@ceph.mon.a.smithi079.stdout: index_shortening: 1 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: checksum: 4 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: no_block_cache: 0 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache: 0x55755811f610 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache_name: BinnedLRUCache 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache_options: 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: capacity : 536870912 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: num_shard_bits : 4 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: strict_capacity_limit : 0 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: high_pri_pool_ratio: 0.000 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache_compressed: (nil) 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: persistent_cache: (nil) 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_size: 4096 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_size_deviation: 10 2024-09-21T02:23:38.412 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_restart_interval: 16 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: index_block_restart_interval: 1 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: metadata_block_size: 4096 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: partition_filters: 0 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: use_delta_encoding: 1 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: filter_policy: bloomfilter 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: whole_key_filtering: 1 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: verify_compression: 0 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: read_amp_bytes_per_bit: 0 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: format_version: 5 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: enable_index_compression: 1 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_align: 0 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: max_auto_readahead_size: 262144 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: prepopulate_block_cache: 0 2024-09-21T02:23:38.413 INFO:journalctl@ceph.mon.a.smithi079.stdout: initial_auto_readahead_size: 8192 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression: NoCompression 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.num_levels: 7 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T02:23:38.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T02:23:38.415 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T02:23:38.416 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T02:23:38.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.inplace_update_support: 0 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.bloom_locality: 0 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.max_successive_merges: 0 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T02:23:38.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.ttl: 2592000 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.enable_blob_files: false 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.min_blob_size: 0 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T02:23:38.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7d0e24da-803f-4e51-b18a-01604ded46b5 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885418162454, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885418164336, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 89981, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 279, "table_properties": {"data_size": 88051, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11333, "raw_average_key_size": 47, "raw_value_size": 81656, "raw_average_value_size": 343, "num_data_blocks": 11, "num_entries": 238, "num_filter_entries": 238, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726885418, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7d0e24da-803f-4e51-b18a-01604ded46b5", "db_session_id": "S8YX09JESPM6MOXOWARN", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885418164534, "job": 1, "event": "recovery_finished"} 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55755c180a80 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: DB pointer 0x55755cf22000 2024-09-21T02:23:38.420 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** DB Stats ** 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** Compaction Stats [default] ** 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T02:23:38.421 INFO:journalctl@ceph.mon.a.smithi079.stdout: L0 2/0 89.73 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: Sum 2/0 89.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** Compaction Stats [default] ** 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 70.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T02:23:38.422 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative compaction: 0.00 GB write, 13.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval compaction: 0.00 GB write, 13.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: Block cache BinnedLRUCache@0x55755811f610#2 capacity: 512.00 MB usage: 1.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: starting mon.a rank 0 at public addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] at bind addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???) e1 preinit fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???).mds e1 new map 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???).mds e1 print_map 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: e1 2024-09-21T02:23:38.423 INFO:journalctl@ceph.mon.a.smithi079.stdout: btime 2024-09-21T02:23:32:342373+0000 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout: legacy client fscid: -1 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout: No filesystems configured 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: monmap epoch 1 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:38.424 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: last_changed 2024-09-21T02:23:28.486626+0000 2024-09-21T02:23:38.425 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:23:38.425 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: min_mon_release 19 (squid) 2024-09-21T02:23:38.425 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: election_strategy: 1 2024-09-21T02:23:38.425 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:23:38.425 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: fsmap 2024-09-21T02:23:38.425 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T02:23:38.425 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:38 smithi079 ceph-mon[30788]: mgrmap e1: no daemons active 2024-09-21T02:23:39.653 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T02:23:39.679 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:23:39.679 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mgr... 2024-09-21T02:23:39.680 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T02:23:39.680 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T02:23:40.024 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.x 2024-09-21T02:23:40.025 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T02:23:40.251 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-56d10306-77c0-11ef-baf5-efdc52797490.target.wants/ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-56d10306-77c0-11ef-baf5-efdc52797490@.service. 2024-09-21T02:23:40.274 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:40 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3242658219' entity='client.admin' 2024-09-21T02:23:40.592 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:40 smithi079 systemd[1]: Starting Ceph mgr.x for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:23:40.843 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:40 smithi079 podman[30997]: 2024-09-21 02:23:40.49569047 +0000 UTC m=+0.026926339 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:23:40.843 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:40 smithi079 podman[30997]: 2024-09-21 02:23:40.598293602 +0000 UTC m=+0.129529471 container create be1dafa6756ba6543e9eb74ca5aff069e85861fa0ca4d2e6304f5798c4e41cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:23:40.844 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:40 smithi079 podman[30997]: 2024-09-21 02:23:40.842836585 +0000 UTC m=+0.374072453 container init be1dafa6756ba6543e9eb74ca5aff069e85861fa0ca4d2e6304f5798c4e41cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T02:23:40.953 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:23:40.954 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-21T02:23:40.969 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:23:40.969 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-21T02:23:40.969 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-21T02:23:40.969 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T02:23:40.986 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:23:40.986 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-21T02:23:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:23:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-21T02:23:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-21T02:23:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T02:23:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr to start... 2024-09-21T02:23:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr... 2024-09-21T02:23:41.143 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:40 smithi079 podman[30997]: 2024-09-21 02:23:40.849098465 +0000 UTC m=+0.380334334 container start be1dafa6756ba6543e9eb74ca5aff069e85861fa0ca4d2e6304f5798c4e41cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:23:41.143 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:40 smithi079 bash[30997]: be1dafa6756ba6543e9eb74ca5aff069e85861fa0ca4d2e6304f5798c4e41cd9 2024-09-21T02:23:41.143 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:40 smithi079 systemd[1]: Started Ceph mgr.x for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:23:41.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:41 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/841389196' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:23:42.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:42.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:23:42.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "56d10306-77c0-11ef-baf5-efdc52797490", 2024-09-21T02:23:42.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:23:42.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:23:42.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:42.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:23:42.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:23:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:23:32:342373+0000", 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T02:23:42.389 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:23:32.343439+0000", 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:23:42.390 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:42.391 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:23:42.391 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:23:42.391 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (1/15)... 2024-09-21T02:23:45.443 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:45 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1526178513' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "56d10306-77c0-11ef-baf5-efdc52797490", 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:23:45.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:23:45.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:23:45.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:23:45.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:23:45.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:23:45.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:23:45.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:45.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:23:45.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:23:45.785 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:23:32:342373+0000", 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:45.786 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:23:45.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:45.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:23:32.343439+0000", 2024-09-21T02:23:45.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:23:45.788 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:45.789 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:23:45.789 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:23:45.789 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (2/15)... 2024-09-21T02:23:47.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: Activating manager daemon x 2024-09-21T02:23:47.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: mgrmap e2: x(active, starting, since 0.00487262s) 2024-09-21T02:23:47.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: Manager daemon x is now available 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' 2024-09-21T02:23:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:47 smithi079 ceph-mon[30788]: from='mgr.14100 172.21.15.79:0/2704367398' entity='mgr.x' 2024-09-21T02:23:49.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:48 smithi079 ceph-mon[30788]: mgrmap e3: x(active, since 1.01013s) 2024-09-21T02:23:49.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:48 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1946491408' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:23:49.251 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:49.251 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:23:49.251 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "56d10306-77c0-11ef-baf5-efdc52797490", 2024-09-21T02:23:49.251 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:23:49.251 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-21T02:23:49.252 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:23:49.253 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:23:49.258 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:23:32:342373+0000", 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:49.259 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:23:49.260 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:23:32.343439+0000", 2024-09-21T02:23:49.261 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:23:49.261 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:23:49.261 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:23:49.261 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:23:49.261 INFO:teuthology.orchestra.run.smithi079.stdout:mgr is available 2024-09-21T02:23:50.350 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:49 smithi079 ceph-mon[30788]: mgrmap e4: x(active, since 2s) 2024-09-21T02:23:50.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:50.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T02:23:50.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:23:50.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T02:23:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T02:23:50.684 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T02:23:50.684 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T02:23:50.684 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T02:23:50.684 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T02:23:50.684 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling cephadm module... 2024-09-21T02:23:51.194 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:50 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1022558825' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T02:23:52.323 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:51 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/142133311' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T02:23:52.324 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: ignoring --setuser ceph since I am not root 2024-09-21T02:23:52.324 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: ignoring --setgroup ceph since I am not root 2024-09-21T02:23:53.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:52 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/142133311' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T02:23:53.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:52 smithi079 ceph-mon[30788]: mgrmap e5: x(active, since 5s) 2024-09-21T02:23:54.117 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:23:54.118 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T02:23:54.118 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:23:54.118 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T02:23:54.118 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T02:23:54.118 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:23:54.118 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-09-21T02:23:54.118 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 5... 2024-09-21T02:23:54.263 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:53 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1978211158' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T02:23:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: Active manager daemon x restarted 2024-09-21T02:23:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: Activating manager daemon x 2024-09-21T02:23:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T02:23:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: mgrmap e6: x(active, starting, since 0.00456222s) 2024-09-21T02:23:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:23:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:23:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:23:58.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:23:58.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:23:58.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:58 smithi079 ceph-mon[30788]: Manager daemon x is now available 2024-09-21T02:23:59.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:23:59.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: Found migration_current of "None". Setting to last migration. 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: mgrmap e7: x(active, since 1.00768s) 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-mon[30788]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:23:59.431+0000 7f9045000640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:02:23:59] ENGINE Error in HTTPServer.serve 2024-09-21T02:23:59.729 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: Traceback (most recent call last): 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self._connections.run(self.expiration_interval) 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self._run(expiration_interval) 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:23:59.730 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: s = self.context.wrap_socket( 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: return self.sslsocket_class._create( 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self.do_handshake() 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self._sslobj.do_handshake() 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:23:59.731 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:23:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:23:59.841 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:23:59.842 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T02:23:59.842 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T02:23:59.842 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:23:59.842 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 5 is available 2024-09-21T02:23:59.842 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying orchestrator module is enabled... 2024-09-21T02:24:00.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:00 smithi079 ceph-mon[30788]: [21/Sep/2024:02:23:59] ENGINE Bus STARTING 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:00 smithi079 ceph-mon[30788]: [21/Sep/2024:02:23:59] ENGINE Serving on https://172.21.15.79:7150 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:00 smithi079 ceph-mon[30788]: [21/Sep/2024:02:23:59] ENGINE Error in HTTPServer.serve 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: Traceback (most recent call last): 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._run(expiration_interval) 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:24:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout: s = self.context.wrap_socket( 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout: return self.sslsocket_class._create( 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout: self.do_handshake() 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._sslobj.do_handshake() 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:00 smithi079 ceph-mon[30788]: [21/Sep/2024:02:23:59] ENGINE Serving on http://172.21.15.79:8765 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:00 smithi079 ceph-mon[30788]: [21/Sep/2024:02:23:59] ENGINE Bus STARTED 2024-09-21T02:24:00.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:00 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:24:01.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:01 smithi079 ceph-mon[30788]: mgrmap e8: x(active, since 2s) 2024-09-21T02:24:01.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:01 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1179411120' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T02:24:02.100 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T02:24:02.100 INFO:teuthology.orchestra.run.smithi079.stdout:Setting orchestrator backend to cephadm... 2024-09-21T02:24:02.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:02 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1179411120' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T02:24:02.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:02 smithi079 ceph-mon[30788]: mgrmap e9: x(active, since 3s) 2024-09-21T02:24:04.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:03 smithi079 ceph-mon[30788]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:04.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:03 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:04.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:03 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:24:04.924 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T02:24:04.925 INFO:teuthology.orchestra.run.smithi079.stdout:Generating ssh key... 2024-09-21T02:24:05.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-mon[30788]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:06.228 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: Generating public/private rsa key pair. 2024-09-21T02:24:06.228 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: Your identification has been saved in /tmp/tmpi6odr3s2/key 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: Your public key has been saved in /tmp/tmpi6odr3s2/key.pub 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: The key fingerprint is: 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: SHA256:Q9GV7MnSaPCuj6zi1mvaeDkFR6GF0nLjqnBAeFyye2U ceph-56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: The key's randomart image is: 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: +---[RSA 3072]----+ 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: |...... .+o o.. | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: |..ooo =oo.. o | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: |... =Eo.o = . | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: |. . oo.. = = | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: | .. .. oSo . | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: |. ... ... | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: | o . . o . | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: | . oo*... | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: | o+=++o.. | 2024-09-21T02:24:06.229 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: +----[SHA256]-----+ 2024-09-21T02:24:07.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:06 smithi079 ceph-mon[30788]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:07.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:06 smithi079 ceph-mon[30788]: Generating ssh key... 2024-09-21T02:24:07.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:06 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:07.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:06 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:07.945 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjg/92rV59WO7IJnjtS2koNSNlBSddkhud8yLl0J34DVCLArtid0jjT3aH0p7U+rmaJ2RsGNILJ3e0a2Va1d1cnZwWmV0RZHHHF/JLLuflTzj9/bzR+8h4Yms7kvKSiZbngaViVp+RP2YVnbwLuRzR0pr4LBSGGlJjPf3D6gpOjq2t1h58NpXEodTFhICtxXcyrzMP6Gm15lxpUwf5BAaD2hHzm+ORz8HO+zpcTf91R3DlLvPZt139UbXGsKAVwBCXkCKCRbO4jSnxBhEM9fFs+sjiWsZ/1xRTvrOJspNSMK0Bp8b+qjJbTtAX8uYYpei42PtKpMQWFzarOSWB+qnfXNAOWjAqbO0osDFqmRA7gB7Pu0CleiJB+PWN/QnraUXHAOpcBHkIfvA4pZlrRl3KA9SI9TtCPIyO5ryL2TlMCqQ79v6ejqkEdDR8MS79IQwgNiigf3Cpfx+ClG2z957fXe/Nq54m7VWKs+/D+Q+RikXf/uEcE+vielLrM/ZMgkc= ceph-56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:24:07.946 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:24:07.946 INFO:teuthology.orchestra.run.smithi079.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T02:24:07.950 INFO:teuthology.orchestra.run.smithi079.stdout:Adding host smithi079... 2024-09-21T02:24:08.500 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:08 smithi079 ceph-mon[30788]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:09.258 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:09 smithi079 ceph-mon[30788]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "addr": "172.21.15.79", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:10.344 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:10 smithi079 ceph-mon[30788]: Deploying cephadm binary to smithi079 2024-09-21T02:24:13.202 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Added host 'smithi079' with addr '172.21.15.79' 2024-09-21T02:24:13.202 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying unmanaged mon service... 2024-09-21T02:24:13.894 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:13 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:13.894 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:13 smithi079 ceph-mon[30788]: Added host smithi079 2024-09-21T02:24:13.894 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:13 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:24:15.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:15 smithi079 ceph-mon[30788]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:15.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:15 smithi079 ceph-mon[30788]: Saving service mon spec with placement count:5 2024-09-21T02:24:15.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:15 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:16.049 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T02:24:16.050 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying unmanaged mgr service... 2024-09-21T02:24:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:16 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:16 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:17.723 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T02:24:17.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:17 smithi079 ceph-mon[30788]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:17.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:17 smithi079 ceph-mon[30788]: Saving service mgr spec with placement count:2 2024-09-21T02:24:17.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:17 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:19.469 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:19 smithi079 ceph-mon[30788]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:19.469 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:19 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:19.469 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:19 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3610822430' entity='client.admin' 2024-09-21T02:24:20.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:20 smithi079 ceph-mon[30788]: from='mgr.14118 172.21.15.79:0/926061599' entity='mgr.x' 2024-09-21T02:24:20.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:20 smithi079 ceph-mon[30788]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:20.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:20 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3836980324' entity='client.admin' 2024-09-21T02:24:21.820 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling the dashboard module... 2024-09-21T02:24:23.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:23 smithi079 ceph-mon[30788]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:23.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:23 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/671998514' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T02:24:23.479 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:23 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: ignoring --setuser ceph since I am not root 2024-09-21T02:24:23.479 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:23 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: ignoring --setgroup ceph since I am not root 2024-09-21T02:24:24.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:24 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/671998514' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T02:24:24.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:24 smithi079 ceph-mon[30788]: mgrmap e10: x(active, since 25s) 2024-09-21T02:24:25.327 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:25 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/834512267' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T02:24:25.332 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:24:25.333 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T02:24:25.333 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:24:25.333 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T02:24:25.333 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T02:24:25.334 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:24:25.334 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-09-21T02:24:25.334 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 10... 2024-09-21T02:24:29.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: Active manager daemon x restarted 2024-09-21T02:24:29.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: Activating manager daemon x 2024-09-21T02:24:29.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T02:24:29.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: mgrmap e11: x(active, starting, since 0.00441543s) 2024-09-21T02:24:29.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:24:29.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:24:29.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:24:29.679 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:24:29.679 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:24:29.679 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:29 smithi079 ceph-mon[30788]: Manager daemon x is now available 2024-09-21T02:24:30.674 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:24:30.674 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:24:30.674 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:24:30.674 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-mon[30788]: mgrmap e12: x(active, since 1.00865s) 2024-09-21T02:24:30.973 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:24:30.890+0000 7fbac7800640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:02:24:30] ENGINE Error in HTTPServer.serve 2024-09-21T02:24:30.973 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: Traceback (most recent call last): 2024-09-21T02:24:30.973 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self._connections.run(self.expiration_interval) 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self._run(expiration_interval) 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: s = self.context.wrap_socket( 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: return self.sslsocket_class._create( 2024-09-21T02:24:30.974 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:24:30.975 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self.do_handshake() 2024-09-21T02:24:30.975 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:24:30.975 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: self._sslobj.do_handshake() 2024-09-21T02:24:30.975 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:24:30.975 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:24:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:24:30.978 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:24:30.978 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T02:24:30.978 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T02:24:30.978 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:24:30.978 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 10 is available 2024-09-21T02:24:30.978 INFO:teuthology.orchestra.run.smithi079.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T02:24:31.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:31 smithi079 ceph-mon[30788]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T02:24:31.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:31 smithi079 ceph-mon[30788]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T02:24:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:32 smithi079 ceph-mon[30788]: [21/Sep/2024:02:24:30] ENGINE Bus STARTING 2024-09-21T02:24:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:32 smithi079 ceph-mon[30788]: [21/Sep/2024:02:24:30] ENGINE Serving on https://172.21.15.79:7150 2024-09-21T02:24:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:32 smithi079 ceph-mon[30788]: [21/Sep/2024:02:24:30] ENGINE Error in HTTPServer.serve 2024-09-21T02:24:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout: Traceback (most recent call last): 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._run(expiration_interval) 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: s = self.context.wrap_socket( 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: return self.sslsocket_class._create( 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:24:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout: self.do_handshake() 2024-09-21T02:24:32.730 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:24:32.730 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._sslobj.do_handshake() 2024-09-21T02:24:32.730 INFO:journalctl@ceph.mon.a.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:24:32.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:32 smithi079 ceph-mon[30788]: [21/Sep/2024:02:24:30] ENGINE Serving on http://172.21.15.79:8765 2024-09-21T02:24:32.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:32 smithi079 ceph-mon[30788]: [21/Sep/2024:02:24:30] ENGINE Bus STARTED 2024-09-21T02:24:32.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:32 smithi079 ceph-mon[30788]: mgrmap e13: x(active, since 2s) 2024-09-21T02:24:32.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:34.087 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUbaiE5Y+dSXmXI0w1MPoL8l1c68IwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAyMjQzM1oXDTM0\nMDkyMjAyMjQzM1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1Ljc5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA5H0dEVE4SP/+MEd4t+6UTgRb542E1il5fWQt\nxw4GvJIl20s9QY7eqvLDOcULQSWf/2ItaVVnBo7TFViq7iG2mRn9SqWOvXfiRApc\njD3juMtLhSAerXVWsLZgwJms/Gl4PdvlbpUNVpr7v65RRSlsIE0Rgn0GlSF7n+8m\neKZ/gJ0jSQpqiJmc8nxntHfoajUsgSwLPbg3w9Z7A0IPNfisCgSsPQov6gIubVPo\nyhU82shfh73DzmmApgC7VLQ90VsiS8G1slXwvH1wW4YPCM7NpqDI+olujVIdc/zM\n1qW45reLdTFzuIeQp1z9EO3o1XBqu2CQmDG7Vk6EF4/7Xg1EC2mB7zk4aG8yjt5Y\nJ/aPQC9LPODFxec/4ICaA3yuSrY59sCm6T1CAKP9zz89DX/w5SpjkDsf9IBh4UcN\nIgZUe78vGhB5ly2PghnQtzCVwBmDGNbRYmZuUVat5IxCq2BEJ6KPvInaExkSGQEg\nnAQ8gS07VT4L2G8CiLafVZQ8QdcG2x3v7chs+zg3nCwoYXl8dAZLBlimqJOUAw1j\nzNS3QdENZo95e2CAEonBuQHcvBsI5QxPyWS12adC8WKhk9wDshDtGAd1vAWFcxSV\nq0nlPx9/fgVLdVMSrlpR0u8k1A5/9vTWlNzqJn5XkLSXgXGplEJm6iHOwCKziUa5\n1206MD8CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDc5ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPTzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAh\n7OQ76Dbz+tITLk3iHhFi4c4vCSGMFFM0/aSFyUtemY0nuq2eAnIz1oBkiIWsNq5O\nPxQxefs2ymnIou3AGTKkAZlwPQry4yy5vCWtBLLr+NIuubUVidBXAWZmeQr9PeAJ\n9Gl8K0jeRaSabi0DTVN8NtTtlMQPaskQr8z6ZrnHgfcdpEaDXZup/v/GjwHTncDO\nREJh0ciUpV4hNCzfLt8i/CDoZ4UcBLdn6qZeUsiizK43qbrJ4+JDgjUlS4fzv8bY\n+ErGwOCricnyPXt0TmofICAPYPDLyAadnIkAdafIc2b0mxya5xFEfaWX+L4y9jHt\nNJecCITPrqu/ZeT/dKJ4hqXMe4miFiZzB2PsJhT4Iky/1DkOJCLoHoISpOQw15UD\nAF9WuSzLAw5qyBOYstA3/ZnC6erYtp1U3jHewgCy7qvgXtMATbIRtyp3/Bzp7NvH\nPu2H67ZWxHqk5ay4aP6MwlrLUVBhZAFgafYEwsTZTDkcIuldoppRt0OVRC2qYM2R\nnxG/iRHag5+XYdJt1BBoLgcIN+uJn/H1AaVKRqp0LZHokIRLCo/lA8JA830w7zEv\n35/TyTXW+qVNc8q/9gwGeStXzT2b/5a0n3IFLXoFTwFtdIF7opBnNjIQkc68tFjg\naVXxsgq1L/EvSYHSSQrhyOSgFgYPDC/DSl5bjYTxgQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEA5H0dEVE4SP/+MEd4t+6UTgRb542E1il5fWQtxw4GvJIl20s9\nQY7eqvLDOcULQSWf/2ItaVVnBo7TFViq7iG2mRn9SqWOvXfiRApcjD3juMtLhSAe\nrXVWsLZgwJms/Gl4PdvlbpUNVpr7v65RRSlsIE0Rgn0GlSF7n+8meKZ/gJ0jSQpq\niJmc8nxntHfoajUsgSwLPbg3w9Z7A0IPNfisCgSsPQov6gIubVPoyhU82shfh73D\nzmmApgC7VLQ90VsiS8G1slXwvH1wW4YPCM7NpqDI+olujVIdc/zM1qW45reLdTFz\nuIeQp1z9EO3o1XBqu2CQmDG7Vk6EF4/7Xg1EC2mB7zk4aG8yjt5YJ/aPQC9LPODF\nxec/4ICaA3yuSrY59sCm6T1CAKP9zz89DX/w5SpjkDsf9IBh4UcNIgZUe78vGhB5\nly2PghnQtzCVwBmDGNbRYmZuUVat5IxCq2BEJ6KPvInaExkSGQEgnAQ8gS07VT4L\n2G8CiLafVZQ8QdcG2x3v7chs+zg3nCwoYXl8dAZLBlimqJOUAw1jzNS3QdENZo95\ne2CAEonBuQHcvBsI5QxPyWS12adC8WKhk9wDshDtGAd1vAWFcxSVq0nlPx9/fgVL\ndVMSrlpR0u8k1A5/9vTWlNzqJn5XkLSXgXGplEJm6iHOwCKziUa51206MD8CAwEA\nAQKCAgASoccx3HsoAhlYFi6YZRqahWLPLixJCycZMVxFm/WzASyYG3m6c6w2/sZ/\nr/s7y+smTVBhrgam3hUFa8O92RRFm30a+LF77so4fSsl09LS2gplp9mzOwXKMYe7\nPOzXxRalM14cAd3ivuRM3FShPKr7XqgmXrafiOmcAEmVU2fDSk0QeDUkFXlbEVz4\nNkJGuDZRruXtxFdmdKzMS7c80fM0JURm/S0sumfPH3q0ppMIo4fyuZKS2D9Biiln\nKK7VIxwtVvWk6LrRoV2nq6C55E9DHrUKL78gRAlwe2ANbYR3P+azNEijoV5g33Ao\nJhZd9/r5c6WRhkCosuIKSoHsyKJ7L6ApQ5PtX2HDNNa2mG3nC8npSHZ9yjPErzCg\n4VEYmyCTJxS/zsT4fCIRK36SxxgSwL1pOzJYLiT8MWaRL/TGGBGVqy9NRfO0g5wx\nhEG/a6n0ff8sa3FkOLlFGweJ99jH1D+J5aeDPQSX+e/8Stz1wuE5vbn5Slh6wo3V\ne5vdQkoS9iO3W6uC8l3kZoBTtSclQnqiV/gLgGbRcspvlLdpLi/n8eTbtC55jMDA\n05xFRWIa0FwZUNpvTvIDqPRnW1MTrCPRnqE9XdEd8MFWBg4kmkv3qFMeByZSm/P/\nX30AMrImHWvTiG/oo+Tz5HkYEjlPZrkZPJCKgAt73xiRY3PgVQKCAQEA+VBJUvnF\nc6MLipjrpJb2pBeTGoutioz7iAqOZMBFnRBJoMpWDg6LGQ4LQPuhNh8OF+iYR36T\nepJ2hh31JwFX9iuGz7IknMbenS16660rM8V5VQ86c32ZQVaNlvxAtLEf9gkCaXfy\n4T2UEz3uKLNMOD8Ew7pGko4jqOsAn47NmYp60lCyMcdZIITLhRMeY7y1PFq6uhc3\nQOWlC4HOcZgouQLX0m6b5kovrhKl1GSEdpJC8l0YhA7XWvTKXb4CFJVHHaXk0uAN\nbrhIzsYPTmAmo0Q+k9UYjxM/AeHcePy1asTEt2iir6QOdzaum0pBwBBF7Yzf571x\naUZo8MG3GkgZ2wKCAQEA6p3ZfLS0BW4YvSD565P0zX5CnSlC39yRNQO616lUxhMs\nK8ERcm9hmCGcHHp+d6dbloY2C1zP6wAwksR/bG6X9vvoSpey0qanPXfOORyekezI\npkzcwIw4JU0YwAY4HUiOiueowKVnADcWWjQJ8RiW8xogxN5vUOSoWu9ewzmwA/BS\nEvPcaUgKq4SZoCRpypKgB4G2Z9AYxPg5ccPcbs9kk20sx25KUovmfOLKQJYK3rgT\nJ0bxgCX7uaTJkgXw0KXVVvzuMCT7q3bZHZ2HltIJKMgVfYtsM5IBOldjlaabFt9p\naZtHteEOLWPoxt6t5QcwU6mCKthfPyOyC0SUaD/qbQKCAQBw5HYPaKKMVkwnmk85\n3FIaw8IMxyryDhzn4T/RR28+S93LPVPyUYuS8NUPu+GoDC/pi51I4nwNiLy6xl34\nJ5eZFOSar+P8SeEL80gx59wkOUtTxO2G1lzLRVIgCGGUcJA0bKf28iW88JFYlTZ+\nn5Hn9kFGD9ddDZgAKUnC9nsLB7XN/lRyTf6BxyARRjMAnrbCeaMMGO8gJ9ywdTry\nHSBzhmIMG6HkibtFa5RDtLB2sIw4CwfK5J2HxkjMYfm3MFFfj3sqMeJjPHdbijvs\nFYXpcEGV12yjfOePBqM69dOAYVFia7MfLX6PZOdz0hAr1DKV+rB400PDk+p4+n7b\nG8L5AoIBAHXqQ6aDg36/KLvVWQZnZD/rVzt5w1yTlH9akotVVX//ntGWxVgIVrqJ\nGdbOUcV9XXC3n23yhaUMgV0iWRB8PPArB0KGH5/zllY0YncdxSx+HxJFyyUS1B0b\nNHc+KPG+x7VUXOIFv1DCXv+S6/Q6cZNY7GNFkBjN8zdQ2wWvdqFkJTvVSE+5n3M4\nv6VW57yiGL/tF2nxkqFcSDK/R4iBv4DA/CJ3ce8u1ParXQ882dW6GhZBd5r6fBt/\nkLdNOQ0Ea8a+dE/KJpq0rsZNqBnLEkNm3DYu3oDEvs09opVSGNxUCLzFCDOHGwMB\nFbrtq+RRyp4hsYQrHyOyowc6voPuq7kCggEAfzVOofrXiw3hPFd0snF2ZrzeImZ8\nI128aDJ+KZh3rKwQeu1FD2nGz79iBUHH1zwIf09vQ+GhBaLcJb/Em6nxtjmWSWgf\nYx9TvqBfKuXOjGhJdfpUcbiFy9WJWsryvLF/VfifSyeQqQBOjQibRpOdbd8FRlz0\nA5rbDz+Xtg7gd50kBkp2sNDwII55dOTpgEwguKUqnFZmpDpzH2ej9dkqeCvcH7BQ\nw1qbclqWBGRuPLK/RFJz+duaLjGU4JkOZX1xEtnFIlPLWwh/YbdIQiRKZ4HmpyGP\n8mhroxYTtcmFBptpWR098tNUpGJQi5e/uUO+XBfJ6S0D3ZqQOopXs6c6Dg==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T02:24:34.334 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:34 smithi079 ceph-mon[30788]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:34.334 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:35.989 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T02:24:36.126 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:35 smithi079 ceph-mon[30788]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:36.126 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:37.564 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T02:24:37.564 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial admin user... 2024-09-21T02:24:38.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:37 smithi079 ceph-mon[30788]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:38.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:39.181 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:38 smithi079 ceph-mon[30788]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:39.182 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:38 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:39.187 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$mGdThdQKMcp/2xB2uJRKtO1MOAmnpTyNJO6bzJbhCNAstyDV3Jaru", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726885478, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T02:24:39.188 INFO:teuthology.orchestra.run.smithi079.stdout:Fetching dashboard port number... 2024-09-21T02:24:40.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:40 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3919991804' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T02:24:40.753 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T02:24:40.772 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:24:40.772 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-21T02:24:40.785 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:24:40.785 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-21T02:24:40.785 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-21T02:24:40.785 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T02:24:40.788 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph Dashboard is now available at: 2024-09-21T02:24:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: URL: https://smithi079.front.sepia.ceph.com:8443/ 2024-09-21T02:24:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: User: admin 2024-09-21T02:24:40.788 INFO:teuthology.orchestra.run.smithi079.stdout: Password: 5io7i3cnfj 2024-09-21T02:24:40.789 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:40.789 INFO:teuthology.orchestra.run.smithi079.stdout:Saving cluster configuration to /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config directory 2024-09-21T02:24:42.299 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T02:24:42.299 INFO:teuthology.orchestra.run.smithi079.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T02:24:42.299 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.299 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:24:42.299 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.299 INFO:teuthology.orchestra.run.smithi079.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: ceph telemetry on 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout:For more information see: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:42.300 INFO:teuthology.orchestra.run.smithi079.stdout:Bootstrap complete. 2024-09-21T02:24:42.357 INFO:tasks.cephadm:Fetching config... 2024-09-21T02:24:42.358 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:24:42.358 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T02:24:42.396 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T02:24:42.396 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:24:42.396 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T02:24:42.475 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T02:24:42.475 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:24:42.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T02:24:42.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:42 smithi079 ceph-mon[30788]: mgrmap e14: x(active, since 12s) 2024-09-21T02:24:42.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:42 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1877117555' entity='client.admin' 2024-09-21T02:24:42.571 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T02:24:42.571 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:24:42.571 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T02:24:42.647 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T02:24:42.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjg/92rV59WO7IJnjtS2koNSNlBSddkhud8yLl0J34DVCLArtid0jjT3aH0p7U+rmaJ2RsGNILJ3e0a2Va1d1cnZwWmV0RZHHHF/JLLuflTzj9/bzR+8h4Yms7kvKSiZbngaViVp+RP2YVnbwLuRzR0pr4LBSGGlJjPf3D6gpOjq2t1h58NpXEodTFhICtxXcyrzMP6Gm15lxpUwf5BAaD2hHzm+ORz8HO+zpcTf91R3DlLvPZt139UbXGsKAVwBCXkCKCRbO4jSnxBhEM9fFs+sjiWsZ/1xRTvrOJspNSMK0Bp8b+qjJbTtAX8uYYpei42PtKpMQWFzarOSWB+qnfXNAOWjAqbO0osDFqmRA7gB7Pu0CleiJB+PWN/QnraUXHAOpcBHkIfvA4pZlrRl3KA9SI9TtCPIyO5ryL2TlMCqQ79v6ejqkEdDR8MS79IQwgNiigf3Cpfx+ClG2z957fXe/Nq54m7VWKs+/D+Q+RikXf/uEcE+vielLrM/ZMgkc= ceph-56d10306-77c0-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:24:42.767 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjg/92rV59WO7IJnjtS2koNSNlBSddkhud8yLl0J34DVCLArtid0jjT3aH0p7U+rmaJ2RsGNILJ3e0a2Va1d1cnZwWmV0RZHHHF/JLLuflTzj9/bzR+8h4Yms7kvKSiZbngaViVp+RP2YVnbwLuRzR0pr4LBSGGlJjPf3D6gpOjq2t1h58NpXEodTFhICtxXcyrzMP6Gm15lxpUwf5BAaD2hHzm+ORz8HO+zpcTf91R3DlLvPZt139UbXGsKAVwBCXkCKCRbO4jSnxBhEM9fFs+sjiWsZ/1xRTvrOJspNSMK0Bp8b+qjJbTtAX8uYYpei42PtKpMQWFzarOSWB+qnfXNAOWjAqbO0osDFqmRA7gB7Pu0CleiJB+PWN/QnraUXHAOpcBHkIfvA4pZlrRl3KA9SI9TtCPIyO5ryL2TlMCqQ79v6ejqkEdDR8MS79IQwgNiigf3Cpfx+ClG2z957fXe/Nq54m7VWKs+/D+Q+RikXf/uEcE+vielLrM/ZMgkc= ceph-56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:24:42.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjg/92rV59WO7IJnjtS2koNSNlBSddkhud8yLl0J34DVCLArtid0jjT3aH0p7U+rmaJ2RsGNILJ3e0a2Va1d1cnZwWmV0RZHHHF/JLLuflTzj9/bzR+8h4Yms7kvKSiZbngaViVp+RP2YVnbwLuRzR0pr4LBSGGlJjPf3D6gpOjq2t1h58NpXEodTFhICtxXcyrzMP6Gm15lxpUwf5BAaD2hHzm+ORz8HO+zpcTf91R3DlLvPZt139UbXGsKAVwBCXkCKCRbO4jSnxBhEM9fFs+sjiWsZ/1xRTvrOJspNSMK0Bp8b+qjJbTtAX8uYYpei42PtKpMQWFzarOSWB+qnfXNAOWjAqbO0osDFqmRA7gB7Pu0CleiJB+PWN/QnraUXHAOpcBHkIfvA4pZlrRl3KA9SI9TtCPIyO5ryL2TlMCqQ79v6ejqkEdDR8MS79IQwgNiigf3Cpfx+ClG2z957fXe/Nq54m7VWKs+/D+Q+RikXf/uEcE+vielLrM/ZMgkc= ceph-56d10306-77c0-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:24:42.833 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjg/92rV59WO7IJnjtS2koNSNlBSddkhud8yLl0J34DVCLArtid0jjT3aH0p7U+rmaJ2RsGNILJ3e0a2Va1d1cnZwWmV0RZHHHF/JLLuflTzj9/bzR+8h4Yms7kvKSiZbngaViVp+RP2YVnbwLuRzR0pr4LBSGGlJjPf3D6gpOjq2t1h58NpXEodTFhICtxXcyrzMP6Gm15lxpUwf5BAaD2hHzm+ORz8HO+zpcTf91R3DlLvPZt139UbXGsKAVwBCXkCKCRbO4jSnxBhEM9fFs+sjiWsZ/1xRTvrOJspNSMK0Bp8b+qjJbTtAX8uYYpei42PtKpMQWFzarOSWB+qnfXNAOWjAqbO0osDFqmRA7gB7Pu0CleiJB+PWN/QnraUXHAOpcBHkIfvA4pZlrRl3KA9SI9TtCPIyO5ryL2TlMCqQ79v6ejqkEdDR8MS79IQwgNiigf3Cpfx+ClG2z957fXe/Nq54m7VWKs+/D+Q+RikXf/uEcE+vielLrM/ZMgkc= ceph-56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:24:42.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjg/92rV59WO7IJnjtS2koNSNlBSddkhud8yLl0J34DVCLArtid0jjT3aH0p7U+rmaJ2RsGNILJ3e0a2Va1d1cnZwWmV0RZHHHF/JLLuflTzj9/bzR+8h4Yms7kvKSiZbngaViVp+RP2YVnbwLuRzR0pr4LBSGGlJjPf3D6gpOjq2t1h58NpXEodTFhICtxXcyrzMP6Gm15lxpUwf5BAaD2hHzm+ORz8HO+zpcTf91R3DlLvPZt139UbXGsKAVwBCXkCKCRbO4jSnxBhEM9fFs+sjiWsZ/1xRTvrOJspNSMK0Bp8b+qjJbTtAX8uYYpei42PtKpMQWFzarOSWB+qnfXNAOWjAqbO0osDFqmRA7gB7Pu0CleiJB+PWN/QnraUXHAOpcBHkIfvA4pZlrRl3KA9SI9TtCPIyO5ryL2TlMCqQ79v6ejqkEdDR8MS79IQwgNiigf3Cpfx+ClG2z957fXe/Nq54m7VWKs+/D+Q+RikXf/uEcE+vielLrM/ZMgkc= ceph-56d10306-77c0-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:24:42.887 INFO:teuthology.orchestra.run.smithi148.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjg/92rV59WO7IJnjtS2koNSNlBSddkhud8yLl0J34DVCLArtid0jjT3aH0p7U+rmaJ2RsGNILJ3e0a2Va1d1cnZwWmV0RZHHHF/JLLuflTzj9/bzR+8h4Yms7kvKSiZbngaViVp+RP2YVnbwLuRzR0pr4LBSGGlJjPf3D6gpOjq2t1h58NpXEodTFhICtxXcyrzMP6Gm15lxpUwf5BAaD2hHzm+ORz8HO+zpcTf91R3DlLvPZt139UbXGsKAVwBCXkCKCRbO4jSnxBhEM9fFs+sjiWsZ/1xRTvrOJspNSMK0Bp8b+qjJbTtAX8uYYpei42PtKpMQWFzarOSWB+qnfXNAOWjAqbO0osDFqmRA7gB7Pu0CleiJB+PWN/QnraUXHAOpcBHkIfvA4pZlrRl3KA9SI9TtCPIyO5ryL2TlMCqQ79v6ejqkEdDR8MS79IQwgNiigf3Cpfx+ClG2z957fXe/Nq54m7VWKs+/D+Q+RikXf/uEcE+vielLrM/ZMgkc= ceph-56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:24:42.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T02:24:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:24:44.763 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T02:24:44.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T02:24:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:24:45.464 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:45 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2757361429' entity='client.admin' 2024-09-21T02:24:47.362 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2024-09-21T02:24:47.362 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:24:47.362 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2024-09-21T02:24:47.382 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:24:47.382 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:24:47.441 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2024-09-21T02:24:47.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch host add smithi098 2024-09-21T02:24:47.705 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:47 smithi079 ceph-mon[30788]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:47.706 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:48.078 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:24:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-21T02:24:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:24:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:24:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:49 smithi079 ceph-mon[30788]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T02:24:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:49 smithi079 ceph-mon[30788]: Updating smithi079:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:24:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:24:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: Updating smithi079:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:24:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:24:50.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:24:50.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:24:50.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:50.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:50 smithi079 ceph-mon[30788]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:51.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:51 smithi079 ceph-mon[30788]: Deploying cephadm binary to smithi098 2024-09-21T02:24:52.055 INFO:teuthology.orchestra.run.smithi079.stdout:Added host 'smithi098' with addr '172.21.15.98' 2024-09-21T02:24:52.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:52 smithi079 ceph-mon[30788]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:52.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:52.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:24:52.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T02:24:53.122 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:24:53.549 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:53 smithi079 ceph-mon[30788]: Added host smithi098 2024-09-21T02:24:53.549 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:53.549 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:53.923 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:24:53.923 INFO:teuthology.orchestra.run.smithi079.stdout:[{"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}] 2024-09-21T02:24:54.544 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:54 smithi079 ceph-mon[30788]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:54.544 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:54.582 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi148 2024-09-21T02:24:54.582 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:24:54.582 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/etc/ceph/ceph.conf 2024-09-21T02:24:54.602 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:24:54.602 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:24:54.659 INFO:tasks.cephadm:Adding host smithi148 to orchestrator... 2024-09-21T02:24:54.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch host add smithi148 2024-09-21T02:24:55.012 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:24:55.427 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:55 smithi079 ceph-mon[30788]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:24:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"} : dispatch 2024-09-21T02:24:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:24:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:24:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:57 smithi079 ceph-mon[30788]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:57 smithi079 ceph-mon[30788]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T02:24:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:57 smithi079 ceph-mon[30788]: Updating smithi098:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:24:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:24:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:58 smithi079 ceph-mon[30788]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:24:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:58 smithi079 ceph-mon[30788]: Updating smithi098:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:24:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:58 smithi079 ceph-mon[30788]: Deploying cephadm binary to smithi148 2024-09-21T02:24:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:58 smithi079 ceph-mon[30788]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:24:58.924 INFO:teuthology.orchestra.run.smithi079.stdout:Added host 'smithi148' with addr '172.21.15.148' 2024-09-21T02:24:59.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T02:24:59.984 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:00.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:00.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:59 smithi079 ceph-mon[30788]: Added host smithi148 2024-09-21T02:25:00.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:00.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:00.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:59 smithi079 ceph-mon[30788]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:00.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:24:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:00.794 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:25:00.794 INFO:teuthology.orchestra.run.smithi079.stdout:[{"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}, {"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}] 2024-09-21T02:25:01.464 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:01 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:01.509 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T02:25:01.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T02:25:01.876 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:02.342 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:02 smithi079 ceph-mon[30788]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:25:02.342 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:02 smithi079 ceph-mon[30788]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:03.249 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/151579058' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:03.901 INFO:tasks.cephadm:Adding mon.a on smithi079 2024-09-21T02:25:03.901 INFO:tasks.cephadm:Adding mon.b on smithi098 2024-09-21T02:25:03.901 INFO:tasks.cephadm:Adding mon.c on smithi148 2024-09-21T02:25:03.901 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi079:172.21.15.79=a;smithi098:172.21.15.98=b;smithi148:172.21.15.148=c' 2024-09-21T02:25:04.140 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:25:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T02:25:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: Updating smithi148:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:25:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:25:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/151579058' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T02:25:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: Updating smithi148:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:25:04.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:04.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:04.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:04.800 INFO:teuthology.orchestra.run.smithi148.stdout:Scheduled mon update... 2024-09-21T02:25:05.449 DEBUG:teuthology.orchestra.run.smithi098:mon.b> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T02:25:05.452 DEBUG:teuthology.orchestra.run.smithi148:mon.c> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T02:25:05.454 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:25:05.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:25:06.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi098:172.21.15.98=b;smithi148:172.21.15.148=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: Saving service mon spec with placement smithi079:172.21.15.79=a;smithi098:172.21.15.98=b;smithi148:172.21.15.148=c;count:3 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: Deploying daemon mon.c on smithi148 2024-09-21T02:25:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:05 smithi079 ceph-mon[30788]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:06.574 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:25:08.697 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:25:08.697 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","modified":"2024-09-21T02:23:28.486626Z","created":"2024-09-21T02:23:28.486626Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T02:25:08.698 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-21T02:25:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:08 smithi079 ceph-mon[30788]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:09.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:08 smithi148 systemd[1]: Starting Ceph mon.c for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:25:09.653 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 podman[34608]: 2024-09-21 02:25:09.550206473 +0000 UTC m=+0.123957086 container create 05eb18de48fb81a7c44350718ed3866aa4258033c36d13254dfcb2996dd8acc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T02:25:09.653 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 podman[34608]: 2024-09-21 02:25:09.45611341 +0000 UTC m=+0.029863996 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:25:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:09 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/3510106312' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:25:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 podman[34608]: 2024-09-21 02:25:09.782432475 +0000 UTC m=+0.356183046 container init 05eb18de48fb81a7c44350718ed3866aa4258033c36d13254dfcb2996dd8acc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T02:25:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 podman[34608]: 2024-09-21 02:25:09.785711226 +0000 UTC m=+0.359461798 container start 05eb18de48fb81a7c44350718ed3866aa4258033c36d13254dfcb2996dd8acc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:25:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T02:25:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T02:25:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pidfile_write: ignore empty --pid-file 2024-09-21T02:25:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: load: jerasure load: lrc 2024-09-21T02:25:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: RocksDB version: 7.9.2 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Git sha 0 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: DB SUMMARY 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: DB Session ID: QNHDNG9GK0B9ZUYIXM4M 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: CURRENT file: CURRENT 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.error_if_exists: 0 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.create_if_missing: 0 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.paranoid_checks: 1 2024-09-21T02:25:10.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T02:25:10.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T02:25:10.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T02:25:10.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.env: 0x55d57aa02d60 2024-09-21T02:25:10.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T02:25:10.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.info_log: 0x55d580437360 2024-09-21T02:25:10.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T02:25:10.066 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.statistics: (nil) 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.use_fsync: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_log_file_size: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.allow_fallocate: 1 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.use_direct_reads: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.db_log_dir: 2024-09-21T02:25:10.067 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.wal_dir: 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.write_buffer_manager: 0x55d58043bd60 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T02:25:10.068 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.unordered_write: 0 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.row_cache: None 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.wal_filter: None 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T02:25:10.069 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.two_write_queues: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.wal_compression: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.atomic_flush: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.log_readahead_size: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T02:25:10.070 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_background_jobs: 2 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_background_compactions: -1 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_subcompactions: 1 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_open_files: -1 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T02:25:10.071 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_background_flushes: -1 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Compression algorithms supported: 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kZSTD supported: 0 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kXpressCompression supported: 0 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kBZip2Compression supported: 0 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kLZ4Compression supported: 1 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kZlibCompression supported: 1 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: kSnappyCompression supported: 1 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T02:25:10.072 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.merge_operator: 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_filter: None 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d580436fa0) 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: cache_index_and_filter_blocks: 1 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: pin_top_level_index_and_filter: 1 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: index_type: 0 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: data_block_index_type: 0 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: index_shortening: 1 2024-09-21T02:25:10.073 INFO:journalctl@ceph.mon.c.smithi148.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: checksum: 4 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: no_block_cache: 0 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache: 0x55d57c3fb610 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache_name: BinnedLRUCache 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache_options: 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: capacity : 536870912 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: num_shard_bits : 4 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: strict_capacity_limit : 0 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: high_pri_pool_ratio: 0.000 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache_compressed: (nil) 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: persistent_cache: (nil) 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_size: 4096 2024-09-21T02:25:10.074 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_size_deviation: 10 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_restart_interval: 16 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: index_block_restart_interval: 1 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: metadata_block_size: 4096 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: partition_filters: 0 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: use_delta_encoding: 1 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: filter_policy: bloomfilter 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: whole_key_filtering: 1 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: verify_compression: 0 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: read_amp_bytes_per_bit: 0 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: format_version: 5 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: enable_index_compression: 1 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_align: 0 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: max_auto_readahead_size: 262144 2024-09-21T02:25:10.075 INFO:journalctl@ceph.mon.c.smithi148.stdout: prepopulate_block_cache: 0 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout: initial_auto_readahead_size: 8192 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression: NoCompression 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.num_levels: 7 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T02:25:10.076 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:25:10.077 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T02:25:10.078 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T02:25:10.079 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.inplace_update_support: 0 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T02:25:10.080 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.bloom_locality: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.max_successive_merges: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.ttl: 2592000 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.enable_blob_files: false 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.min_blob_size: 0 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T02:25:10.081 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b0664bf3-d00f-4f00-b88c-3598c1e7ecff 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885509823454, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885509824046, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726885509, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b0664bf3-d00f-4f00-b88c-3598c1e7ecff", "db_session_id": "QNHDNG9GK0B9ZUYIXM4M", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885509824172, "job": 1, "event": "recovery_finished"} 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T02:25:10.082 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d58045aa80 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: DB pointer 0x55d581200000 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** DB Stats ** 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T02:25:10.083 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T02:25:10.084 INFO:journalctl@ceph.mon.c.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: Block cache BinnedLRUCache@0x55d57c3fb610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T02:25:10.085 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: using public_addr v2:172.21.15.148:0/0 -> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: starting mon.c rank -1 at public addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] at bind addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(???) e0 preinit fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout: e1 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout: btime 2024-09-21T02:23:32:342373+0000 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout: legacy client fscid: -1 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout: No filesystems configured 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T02:25:10.086 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Added host smithi098 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.087 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"} : dispatch 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi098:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.088 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi098:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Deploying cephadm binary to smithi148 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Added host smithi148 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.089 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/151579058' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi148:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/151579058' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.090 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Updating smithi148:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi098:172.21.15.98=b;smithi148:172.21.15.148=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Saving service mon spec with placement smithi079:172.21.15.79=a;smithi098:172.21.15.98=b;smithi148:172.21.15.148=c;count:3 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: Deploying daemon mon.c on smithi148 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:10.091 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/3510106312' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:25:10.092 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 ceph-mon[34626]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T02:25:10.092 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 bash[34608]: 05eb18de48fb81a7c44350718ed3866aa4258033c36d13254dfcb2996dd8acc1 2024-09-21T02:25:10.092 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:09 smithi148 systemd[1]: Started Ceph mon.c for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:25:10.362 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:25:10.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:25:10.618 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: mon.a calling monitor election 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: mon.c calling monitor election 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: monmap epoch 2 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: last_changed 2024-09-21T02:25:09.857940+0000 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: min_mon_release 19 (squid) 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: election_strategy: 1 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: fsmap 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: mgrmap e14: x(active, since 45s) 2024-09-21T02:25:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: overall HEALTH_OK 2024-09-21T02:25:15.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:15.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:15.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:15.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:15.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: mon.a calling monitor election 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: mon.c calling monitor election 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:15.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: monmap epoch 2 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: last_changed 2024-09-21T02:25:09.857940+0000 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: min_mon_release 19 (squid) 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: election_strategy: 1 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: fsmap 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: mgrmap e14: x(active, since 45s) 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: overall HEALTH_OK 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:15.315 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:15.316 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:15.316 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:15.733 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:25:15.733 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","modified":"2024-09-21T02:25:09.857940Z","created":"2024-09-21T02:23:28.486626Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T02:25:15.733 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 2 2024-09-21T02:25:16.041 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:15 smithi148 ceph-mon[34626]: Deploying daemon mon.b on smithi098 2024-09-21T02:25:16.041 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:15 smithi148 ceph-mon[34626]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:16.041 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:15 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/1506989963' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:25:16.042 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:16.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:15 smithi079 ceph-mon[30788]: Deploying daemon mon.b on smithi098 2024-09-21T02:25:16.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:15 smithi079 ceph-mon[30788]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:16.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:15 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/1506989963' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:25:16.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:17.344 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:25:17.344 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:25:17.598 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:25:18.450 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:25:18.450 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","modified":"2024-09-21T02:25:09.857940Z","created":"2024-09-21T02:23:28.486626Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T02:25:18.450 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 2 2024-09-21T02:25:18.450 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:18 smithi148 ceph-mon[34626]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:18 smithi079 ceph-mon[30788]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:18.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:18 smithi098 systemd[1]: Started Ceph mon.b for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:25:20.077 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:25:20.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:25:20.330 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:25:23.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: mon.a calling monitor election 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: mon.c calling monitor election 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:23.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: monmap epoch 3 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: last_changed 2024-09-21T02:25:18.595534+0000 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: min_mon_release 19 (squid) 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: election_strategy: 1 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: fsmap 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:23.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: mgrmap e14: x(active, since 54s) 2024-09-21T02:25:23.981 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: overall HEALTH_OK 2024-09-21T02:25:23.981 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:23.981 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:23.981 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:23.981 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: mon.a calling monitor election 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: mon.c calling monitor election 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: monmap epoch 3 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: last_changed 2024-09-21T02:25:18.595534+0000 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: min_mon_release 19 (squid) 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: election_strategy: 1 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: fsmap 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: mgrmap e14: x(active, since 54s) 2024-09-21T02:25:24.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: overall HEALTH_OK 2024-09-21T02:25:24.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:24.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:24.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:24.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:24.099 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:25:24.099 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":3,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","modified":"2024-09-21T02:25:18.595534Z","created":"2024-09-21T02:23:28.486626Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T02:25:24.099 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 3 2024-09-21T02:25:24.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:24.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:24 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/4289681791' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:25:24.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:24.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:24.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:24.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:24 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/4289681791' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:25:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.371 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T02:25:25.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T02:25:25.752 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:25:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: mon.a calling monitor election 2024-09-21T02:25:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: mon.c calling monitor election 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: monmap epoch 3 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:25.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: last_changed 2024-09-21T02:25:18.595534+0000 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: min_mon_release 19 (squid) 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: election_strategy: 1 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: fsmap 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: mgrmap e14: x(active, since 54s) 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: overall HEALTH_OK 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.908 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.908 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:25.908 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/4289681791' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:25:25.908 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.908 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:25.908 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:25.908 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: mon.b calling monitor election 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: mon.b calling monitor election 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: mon.c calling monitor election 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: mon.a calling monitor election 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: monmap epoch 3 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: last_changed 2024-09-21T02:25:18.595534+0000 2024-09-21T02:25:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: min_mon_release 19 (squid) 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: election_strategy: 1 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: fsmap 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: mgrmap e14: x(active, since 56s) 2024-09-21T02:25:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:26 smithi148 ceph-mon[34626]: overall HEALTH_OK 2024-09-21T02:25:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: mon.b calling monitor election 2024-09-21T02:25:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: mon.b calling monitor election 2024-09-21T02:25:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: mon.c calling monitor election 2024-09-21T02:25:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: mon.a calling monitor election 2024-09-21T02:25:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: monmap epoch 3 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: last_changed 2024-09-21T02:25:18.595534+0000 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: min_mon_release 19 (squid) 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: election_strategy: 1 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: fsmap 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: mgrmap e14: x(active, since 56s) 2024-09-21T02:25:26.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:26 smithi098 ceph-mon[34832]: overall HEALTH_OK 2024-09-21T02:25:26.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: mon.b calling monitor election 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: mon.b calling monitor election 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: mon.c calling monitor election 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: mon.a calling monitor election 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: monmap epoch 3 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: last_changed 2024-09-21T02:25:18.595534+0000 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: created 2024-09-21T02:23:28.486626+0000 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: min_mon_release 19 (squid) 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: election_strategy: 1 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T02:25:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T02:25:26.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-21T02:25:26.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: fsmap 2024-09-21T02:25:26.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:25:26.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: mgrmap e14: x(active, since 56s) 2024-09-21T02:25:26.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:26 smithi079 ceph-mon[30788]: overall HEALTH_OK 2024-09-21T02:25:27.214 INFO:teuthology.orchestra.run.smithi079.stdout:# minimal ceph.conf for 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:27.214 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-09-21T02:25:27.214 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:25:27.214 INFO:teuthology.orchestra.run.smithi079.stdout: mon_host = [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-21T02:25:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:27 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:27 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3312210202' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:27.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:27 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:27.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:27 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3312210202' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:27.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:27 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:25:27.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:27 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3312210202' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:28.184 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T02:25:28.184 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:25:28.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:25:28.241 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:25:28.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:25:28.337 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:25:28.337 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:25:28.365 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:25:28.365 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:25:28.426 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:28 smithi098 ceph-mon[34832]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:28.426 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:28.426 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:28.426 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:28.426 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:25:28.426 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:28.430 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:25:28.430 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:25:28.463 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:25:28.463 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:25:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:28 smithi079 ceph-mon[30788]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:25:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:28.531 INFO:tasks.cephadm:Adding mgr.x on smithi079 2024-09-21T02:25:28.531 INFO:tasks.cephadm:Adding mgr.y on smithi098 2024-09-21T02:25:28.531 INFO:tasks.cephadm:Adding mgr.z on smithi148 2024-09-21T02:25:28.532 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi079=x;smithi098=y;smithi148=z' 2024-09-21T02:25:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:28 smithi148 ceph-mon[34626]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:25:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:28.815 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:25:29.491 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:25:29.491 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: Reconfiguring daemon mon.b on smithi098 2024-09-21T02:25:29.491 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:29.491 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:29.491 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:25:29.491 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:29.492 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:25:29.492 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:29.492 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: Reconfiguring daemon mon.c on smithi148 2024-09-21T02:25:29.492 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:29 smithi148 ceph-mon[34626]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:29.494 INFO:teuthology.orchestra.run.smithi148.stdout:Scheduled mgr update... 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: Reconfiguring daemon mon.b on smithi098 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:25:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:29.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: Reconfiguring daemon mon.c on smithi148 2024-09-21T02:25:29.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:29 smithi098 ceph-mon[34832]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:29.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: Reconfiguring daemon mon.b on smithi098 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: Reconfiguring daemon mon.c on smithi148 2024-09-21T02:25:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:29 smithi079 ceph-mon[30788]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:30.474 DEBUG:teuthology.orchestra.run.smithi098:mgr.y> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T02:25:30.477 DEBUG:teuthology.orchestra.run.smithi148:mgr.z> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T02:25:30.479 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T02:25:30.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T02:25:30.484 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T02:25:30.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T02:25:30.528 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T02:25:30.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T02:25:30.575 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T02:25:30.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T02:25:30.620 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T02:25:30.620 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T02:25:30.667 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T02:25:30.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T02:25:30.713 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T02:25:30.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T02:25:30.759 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T02:25:30.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T02:25:30.788 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:30 smithi079 ceph-mon[30788]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi079=x;smithi098=y;smithi148=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:30.788 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:30 smithi079 ceph-mon[30788]: Saving service mgr spec with placement smithi079=x;smithi098=y;smithi148=z;count:3 2024-09-21T02:25:30.789 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:30.796 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T02:25:30.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T02:25:30.803 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:30 smithi148 ceph-mon[34626]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi079=x;smithi098=y;smithi148=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:30.803 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:30 smithi148 ceph-mon[34626]: Saving service mgr spec with placement smithi079=x;smithi098=y;smithi148=z;count:3 2024-09-21T02:25:30.803 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:30.850 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T02:25:30.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T02:25:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:30 smithi098 ceph-mon[34832]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi079=x;smithi098=y;smithi148=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:30 smithi098 ceph-mon[34832]: Saving service mgr spec with placement smithi079=x;smithi098=y;smithi148=z;count:3 2024-09-21T02:25:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:30.934 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T02:25:30.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T02:25:30.987 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T02:25:30.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T02:25:31.044 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T02:25:31.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T02:25:31.095 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T02:25:31.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T02:25:31.151 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T02:25:31.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T02:25:31.208 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T02:25:31.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T02:25:31.209 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:31.273 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T02:25:31.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T02:25:31.331 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T02:25:31.331 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T02:25:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:31.382 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T02:25:31.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T02:25:31.444 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T02:25:31.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T02:25:31.499 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T02:25:31.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T02:25:31.556 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T02:25:31.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T02:25:31.618 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T02:25:31.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T02:25:31.674 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T02:25:31.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T02:25:31.725 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T02:25:31.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T02:25:31.790 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T02:25:31.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T02:25:31.841 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T02:25:31.841 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi079') 2024-09-21T02:25:31.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:31.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:31.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:31.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:31.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:31.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:31.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:31.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:25:31.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:31.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:31.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: Deploying daemon mgr.z on smithi148 2024-09-21T02:25:31.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:31 smithi079 ceph-mon[30788]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:32.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:25:32.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:32.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:32.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: Deploying daemon mgr.z on smithi148 2024-09-21T02:25:32.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:31 smithi148 ceph-mon[34626]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:25:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:32.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:32.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: Deploying daemon mgr.z on smithi148 2024-09-21T02:25:32.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:31 smithi098 ceph-mon[34832]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:32.813 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:32 smithi148 systemd[1]: Starting Ceph mgr.z for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:25:33.168 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:32 smithi148 podman[35871]: 2024-09-21 02:25:32.81334539 +0000 UTC m=+0.015574618 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:25:33.168 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:32 smithi148 podman[35871]: 2024-09-21 02:25:32.919503692 +0000 UTC m=+0.121732919 container create 4985fdf89efaaf4faded05d73938ff8e1a46429bbd02e55fe5f3fc1da7651561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-z, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T02:25:33.168 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:33 smithi148 podman[35871]: 2024-09-21 02:25:33.12997324 +0000 UTC m=+0.332202466 container init 4985fdf89efaaf4faded05d73938ff8e1a46429bbd02e55fe5f3fc1da7651561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T02:25:33.169 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:33 smithi148 podman[35871]: 2024-09-21 02:25:33.133470789 +0000 UTC m=+0.335700014 container start 4985fdf89efaaf4faded05d73938ff8e1a46429bbd02e55fe5f3fc1da7651561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:25:33.563 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mgr[35890]: -- 172.21.15.148:0/960347778 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56077a7670e0 con 0x56077f50a480 2024-09-21T02:25:33.563 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:33 smithi148 bash[35871]: 4985fdf89efaaf4faded05d73938ff8e1a46429bbd02e55fe5f3fc1da7651561 2024-09-21T02:25:33.563 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:25:33 smithi148 systemd[1]: Started Ceph mgr.z for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:25:33.982 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: Deploying daemon mgr.y on smithi098 2024-09-21T02:25:33.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:33 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:34.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:34.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:34.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:34.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:34.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:34.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:34.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:25:34.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:34.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:34.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: Deploying daemon mgr.y on smithi098 2024-09-21T02:25:34.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:33 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:34.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:34.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: Deploying daemon mgr.y on smithi098 2024-09-21T02:25:34.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:33 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:34.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.633+0000 7f0f9e000640 1 -- 172.21.15.79:0/3202629440 <== mon.2 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v12)=0 v12) ==== 109+0+0 (secure 0 0 0) 0x7f0f94039430 con 0x7f0fa0103770 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.635+0000 7f0fa8200640 1 -- 172.21.15.79:0/3202629440 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0f8803fb20 msgr2=0x7f0f88042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.635+0000 7f0fa8200640 1 --2- 172.21.15.79:0/3202629440 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0f8803fb20 0x7f0f88042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009bd0 tx=0x7f0f8c005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 -- 172.21.15.79:0/3202629440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fa0103770 msgr2=0x7f0fa0076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 --2- 172.21.15.79:0/3202629440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fa0103770 0x7f0fa0076e40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009880 tx=0x7f0f94030830 comp rx=0 tx=0).stop 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 -- 172.21.15.79:0/3202629440 shutdown_connections 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 --2- 172.21.15.79:0/3202629440 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0f8803fb20 0x7f0f88042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 --2- 172.21.15.79:0/3202629440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fa01051a0 0x7f0fa0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 --2- 172.21.15.79:0/3202629440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fa0104800 0x7f0fa0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:34.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 --2- 172.21.15.79:0/3202629440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0fa0103770 0x7f0fa0076e40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:34.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 -- 172.21.15.79:0/3202629440 >> 172.21.15.79:0/3202629440 conn(0x7f0fa00ff100 msgr2=0x7f0fa0107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:34.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 -- 172.21.15.79:0/3202629440 shutdown_connections 2024-09-21T02:25:34.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:34.636+0000 7f0fa8200640 1 -- 172.21.15.79:0/3202629440 wait complete. 2024-09-21T02:25:35.093 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:35.093 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:35.148 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi079') 2024-09-21T02:25:35.148 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi079') 2024-09-21T02:25:35.155 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 systemd[1]: Starting Ceph mgr.y for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:25:35.304 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:35.304 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:35.305 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:35.508 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 podman[35638]: 2024-09-21 02:25:35.123156279 +0000 UTC m=+0.015535863 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:25:35.508 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 podman[35638]: 2024-09-21 02:25:35.246860321 +0000 UTC m=+0.139239943 container create b5c217b38a539d0acb166b0226cef3569e2e7ed2a226b6fc1362327cf1c8887f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:25:35.508 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 podman[35638]: 2024-09-21 02:25:35.432434767 +0000 UTC m=+0.324814347 container init b5c217b38a539d0acb166b0226cef3569e2e7ed2a226b6fc1362327cf1c8887f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T02:25:35.508 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 podman[35638]: 2024-09-21 02:25:35.435362335 +0000 UTC m=+0.327741916 container start b5c217b38a539d0acb166b0226cef3569e2e7ed2a226b6fc1362327cf1c8887f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-y, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T02:25:35.508 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 ceph-mgr[35657]: -- 172.21.15.98:0/1434256083 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560076d370e0 con 0x560076d55a80 2024-09-21T02:25:35.508 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 bash[35638]: b5c217b38a539d0acb166b0226cef3569e2e7ed2a226b6fc1362327cf1c8887f 2024-09-21T02:25:35.683 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:35 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:35.683 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:35 smithi079 ceph-mon[30788]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:35.683 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:35.684 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:35.684 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:35.684 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:35.759 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-09-21T02:25:35.905 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:25:35 smithi098 systemd[1]: Started Ceph mgr.y for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:25:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:35 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:35 smithi098 ceph-mon[34832]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:35.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:35 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:35 smithi148 ceph-mon[34626]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:36.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 -- 172.21.15.79:0/3738643962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce340770e0 msgr2=0x7fce340757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 --2- 172.21.15.79:0/3738643962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce340770e0 0x7fce340757b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fce28009900 tx=0x7fce2802a410 comp rx=0 tx=0).stop 2024-09-21T02:25:36.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 -- 172.21.15.79:0/3738643962 shutdown_connections 2024-09-21T02:25:36.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 --2- 172.21.15.79:0/3738643962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3410fef0 0x7fce34112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 --2- 172.21.15.79:0/3738643962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 0x7fce34076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 --2- 172.21.15.79:0/3738643962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce340770e0 0x7fce340757b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 -- 172.21.15.79:0/3738643962 >> 172.21.15.79:0/3738643962 conn(0x7fce340ff0b0 msgr2=0x7fce34101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 -- 172.21.15.79:0/3738643962 shutdown_connections 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.248+0000 7fce3be00640 1 -- 172.21.15.79:0/3738643962 wait complete. 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.249+0000 7fce3be00640 1 Processor -- start 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce3be00640 1 -- start start 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce3be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 0x7fce341a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce3be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce340770e0 0x7fce341a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce3be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3410fef0 0x7fce341a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce3be00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce34115750 con 0x7fce3410fef0 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce3be00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce341155d0 con 0x7fce34075cf0 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce3be00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce341158d0 con 0x7fce340770e0 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.250+0000 7fce39400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 0x7fce341a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 0x7fce341a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57016/0 (socket says 172.21.15.79:57016) 2024-09-21T02:25:36.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 -- 172.21.15.79:0/3659581109 learned_addr learned my addr 172.21.15.79:0/3659581109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39e00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3410fef0 0x7fce341a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce38a00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce340770e0 0x7fce341a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 -- 172.21.15.79:0/3659581109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce340770e0 msgr2=0x7fce341a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce340770e0 0x7fce341a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 -- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3410fef0 msgr2=0x7fce341a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3410fef0 0x7fce341a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 -- 172.21.15.79:0/3659581109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce341a1e20 con 0x7fce34075cf0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.251+0000 7fce39400640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 0x7fce341a03f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce2802a930 tx=0x7fce280045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.252+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2803f070 con 0x7fce34075cf0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.252+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fce28003a60 con 0x7fce34075cf0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.252+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce341a20b0 con 0x7fce34075cf0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.252+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28035030 con 0x7fce34075cf0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.252+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce341a8810 con 0x7fce34075cf0 2024-09-21T02:25:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.253+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce34076100 con 0x7fce34075cf0 2024-09-21T02:25:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.253+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7fce28042070 con 0x7fce34075cf0 2024-09-21T02:25:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.254+0000 7fce32000640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce1c03fb20 0x7fce1c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.254+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fce28074d00 con 0x7fce34075cf0 2024-09-21T02:25:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.254+0000 7fce38a00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce1c03fb20 0x7fce1c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.255+0000 7fce38a00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce1c03fb20 0x7fce1c042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce200095f0 tx=0x7fce20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.260+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce2802f300 con 0x7fce34075cf0 2024-09-21T02:25:36.375 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:36.384 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:36.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.387+0000 7f331d800640 1 -- 172.21.15.79:0/134460184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 msgr2=0x7f3318104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.387+0000 7f331d800640 1 --2- 172.21.15.79:0/134460184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 0x7f3318104a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3304009860 tx=0x7f330402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.392+0000 7f331d800640 1 -- 172.21.15.79:0/134460184 shutdown_connections 2024-09-21T02:25:36.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.392+0000 7f331d800640 1 --2- 172.21.15.79:0/134460184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3318104fe0 0x7f331810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.392+0000 7f331d800640 1 --2- 172.21.15.79:0/134460184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 0x7f3318104a50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.392+0000 7f331d800640 1 --2- 172.21.15.79:0/134460184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33181035b0 0x7f3318103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.392+0000 7f331d800640 1 -- 172.21.15.79:0/134460184 >> 172.21.15.79:0/134460184 conn(0x7f33180fef20 msgr2=0x7f33181013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:36.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.392+0000 7f331d800640 1 -- 172.21.15.79:0/134460184 shutdown_connections 2024-09-21T02:25:36.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.392+0000 7f331d800640 1 -- 172.21.15.79:0/134460184 wait complete. 2024-09-21T02:25:36.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.395+0000 7f331d800640 1 Processor -- start 2024-09-21T02:25:36.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.395+0000 7f331d800640 1 -- start start 2024-09-21T02:25:36.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.397+0000 7f331d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33181035b0 0x7f3318197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.397+0000 7f331d800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 0x7f3318198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.401 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:36.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.397+0000 7f331d800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3318104fe0 0x7f3318198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.398+0000 7f3317e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33181035b0 0x7f3318197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.398+0000 7f3317e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33181035b0 0x7f3318197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:59202/0 (socket says 172.21.15.79:59202) 2024-09-21T02:25:36.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.400+0000 7f331ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3318104fe0 0x7f3318198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.400+0000 7f331ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3318104fe0 0x7f3318198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53528/0 (socket says 172.21.15.79:53528) 2024-09-21T02:25:36.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.401+0000 7f3317400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 0x7f3318198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.401+0000 7f331d800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f331810f030 con 0x7f3318104fe0 2024-09-21T02:25:36.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.401+0000 7f331d800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f331810eeb0 con 0x7f3318104640 2024-09-21T02:25:36.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.401+0000 7f331d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f331810f1b0 con 0x7f33181035b0 2024-09-21T02:25:36.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.402+0000 7f3317400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 0x7f3318198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57028/0 (socket says 172.21.15.79:57028) 2024-09-21T02:25:36.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.402+0000 7f3317400640 1 -- 172.21.15.79:0/2357228871 learned_addr learned my addr 172.21.15.79:0/2357228871 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:36.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.403+0000 7f3317e00640 1 -- 172.21.15.79:0/2357228871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 msgr2=0x7f3318198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.408 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:36.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.403+0000 7f3317e00640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 0x7f3318198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.403+0000 7f3317e00640 1 -- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3318104fe0 msgr2=0x7f3318198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.406+0000 7f3317e00640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3318104fe0 0x7f3318198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.406+0000 7f3317e00640 1 -- 172.21.15.79:0/2357228871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3318199520 con 0x7f33181035b0 2024-09-21T02:25:36.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.407+0000 7f331ce00640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3318104fe0 0x7f3318198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:36.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.412+0000 7f3317e00640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33181035b0 0x7f3318197af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f330800d6d0 tx=0x7f330800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.416+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308017070 con 0x7f33181035b0 2024-09-21T02:25:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.416+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f3308010460 con 0x7f33181035b0 2024-09-21T02:25:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.416+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3318199810 con 0x7f33181035b0 2024-09-21T02:25:36.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.416+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330800f620 con 0x7f33181035b0 2024-09-21T02:25:36.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.416+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331819bf70 con 0x7f33181035b0 2024-09-21T02:25:36.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.419+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f330801a070 con 0x7f33181035b0 2024-09-21T02:25:36.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.419+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3318103a20 con 0x7f33181035b0 2024-09-21T02:25:36.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.420+0000 7f3314c00640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32fc03fb60 0x7f32fc042070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:36.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.420+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f33080540d0 con 0x7f33181035b0 2024-09-21T02:25:36.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.421+0000 7f3317400640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32fc03fb60 0x7f32fc042070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:36.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.422+0000 7f3317400640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32fc03fb60 0x7f32fc042070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3304030840 tx=0x7f330402a8f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:36.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.425+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3308015110 con 0x7f33181035b0 2024-09-21T02:25:36.444 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:36.492 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:36.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.571+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fce3402e8f0 con 0x7fce34075cf0 2024-09-21T02:25:36.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.577+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fce2807a080 con 0x7fce34075cf0 2024-09-21T02:25:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.577+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3308010910 con 0x7f33181035b0 2024-09-21T02:25:36.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.577+0000 7fce32000640 1 -- 172.21.15.79:0/3659581109 <== mon.2 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7fce2803be20 con 0x7fce34075cf0 2024-09-21T02:25:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.580+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce1c03fb20 msgr2=0x7fce1c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.580+0000 7fce3be00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce1c03fb20 0x7fce1c042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce200095f0 tx=0x7fce20005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.580+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 msgr2=0x7fce341a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.580+0000 7fce3be00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 0x7fce341a03f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce2802a930 tx=0x7fce280045f0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.580+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 shutdown_connections 2024-09-21T02:25:36.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.580+0000 7fce3be00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce1c03fb20 0x7fce1c042030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.580+0000 7fce3be00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce3410fef0 0x7fce341a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.581+0000 7fce3be00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce340770e0 0x7fce341a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.581+0000 7fce3be00640 1 --2- 172.21.15.79:0/3659581109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce34075cf0 0x7fce341a03f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.581+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 >> 172.21.15.79:0/3659581109 conn(0x7fce340ff0b0 msgr2=0x7fce34103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.581+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 shutdown_connections 2024-09-21T02:25:36.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.581+0000 7fce3be00640 1 -- 172.21.15.79:0/3659581109 wait complete. 2024-09-21T02:25:36.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.699+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f331819c990 con 0x7f33181035b0 2024-09-21T02:25:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.704+0000 7f3314c00640 1 -- 172.21.15.79:0/2357228871 <== mon.1 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v14)=0 v14) ==== 106+0+0 (secure 0 0 0) 0x7f331819c990 con 0x7f33181035b0 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32fc03fb60 msgr2=0x7f32fc042070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32fc03fb60 0x7f32fc042070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3304030840 tx=0x7f330402a8f0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33181035b0 msgr2=0x7f3318197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33181035b0 0x7f3318197af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f330800d6d0 tx=0x7f330800db90 comp rx=0 tx=0).stop 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 shutdown_connections 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32fc03fb60 0x7f32fc042070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3318104fe0 0x7f3318198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3318104640 0x7f3318198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 --2- 172.21.15.79:0/2357228871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33181035b0 0x7f3318197af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.706+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 >> 172.21.15.79:0/2357228871 conn(0x7f33180fef20 msgr2=0x7f3318105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.707+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 shutdown_connections 2024-09-21T02:25:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:36.707+0000 7f331d800640 1 -- 172.21.15.79:0/2357228871 wait complete. 2024-09-21T02:25:36.852 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:36 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:36.852 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:36 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:36 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:36 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:37.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:36 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:37.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:36 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:37.078 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:37.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:37.691 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: Reconfiguring daemon mgr.x on smithi079 2024-09-21T02:25:37.691 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:37 smithi079 ceph-mon[30788]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:38.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 -- 172.21.15.79:0/2257453462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 msgr2=0x7f8738078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 --2- 172.21.15.79:0/2257453462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 0x7f8738078080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8728009900 tx=0x7f872802a480 comp rx=0 tx=0).stop 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 -- 172.21.15.79:0/2257453462 shutdown_connections 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 --2- 172.21.15.79:0/2257453462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738079640 0x7f8738079fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 --2- 172.21.15.79:0/2257453462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8738078ca0 0x7f87380790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 --2- 172.21.15.79:0/2257453462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 0x7f8738078080 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 -- 172.21.15.79:0/2257453462 >> 172.21.15.79:0/2257453462 conn(0x7f87381012c0 msgr2=0x7f8738103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 -- 172.21.15.79:0/2257453462 shutdown_connections 2024-09-21T02:25:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.014+0000 7f873d800640 1 -- 172.21.15.79:0/2257453462 wait complete. 2024-09-21T02:25:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.015+0000 7f873d800640 1 Processor -- start 2024-09-21T02:25:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.015+0000 7f873d800640 1 -- start start 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f873d800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 0x7f87381a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f873d800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738078ca0 0x7f87381a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f873d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8738079640 0x7f87381a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f873d800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f87381158c0 con 0x7f8738077c10 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f873d800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8738115740 con 0x7f8738078ca0 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f873d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8738115a40 con 0x7f8738079640 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 0x7f87381a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738078ca0 0x7f87381a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738078ca0 0x7f87381a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57042/0 (socket says 172.21.15.79:57042) 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 -- 172.21.15.79:0/1010912593 learned_addr learned my addr 172.21.15.79:0/1010912593 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8737400640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8738079640 0x7f87381a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 -- 172.21.15.79:0/1010912593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8738079640 msgr2=0x7f87381a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8738079640 0x7f87381a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 -- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 msgr2=0x7f87381a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 0x7f87381a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736000640 1 -- 172.21.15.79:0/1010912593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87381a1f60 con 0x7f8738078ca0 2024-09-21T02:25:38.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.016+0000 7f8736a00640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 0x7f87381a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.017+0000 7f8736000640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738078ca0 0x7f87381a0ba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f872400e9f0 tx=0x7f872400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.017+0000 7f872f400640 1 -- 172.21.15.79:0/1010912593 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872400ccc0 con 0x7f8738078ca0 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.017+0000 7f872f400640 1 -- 172.21.15.79:0/1010912593 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f872400ce60 con 0x7f8738078ca0 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.017+0000 7f872f400640 1 -- 172.21.15.79:0/1010912593 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724010430 con 0x7f8738078ca0 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.017+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87381a2250 con 0x7f8738078ca0 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.017+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87381a8950 con 0x7f8738078ca0 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.019+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8738112bb0 con 0x7f8738078ca0 2024-09-21T02:25:38.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.019+0000 7f872f400640 1 -- 172.21.15.79:0/1010912593 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f87240105d0 con 0x7f8738078ca0 2024-09-21T02:25:38.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.019+0000 7f872f400640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f871c03fb20 0x7f871c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.019+0000 7f872f400640 1 -- 172.21.15.79:0/1010912593 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8724054a80 con 0x7f8738078ca0 2024-09-21T02:25:38.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.019+0000 7f8736a00640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f871c03fb20 0x7f871c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.020+0000 7f8736a00640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f871c03fb20 0x7f871c042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8728000c00 tx=0x7f8728031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.024+0000 7f872f400640 1 -- 172.21.15.79:0/1010912593 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8724016330 con 0x7f8738078ca0 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: Reconfiguring daemon mgr.x on smithi079 2024-09-21T02:25:38.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:37 smithi148 ceph-mon[34626]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: Reconfiguring daemon mgr.x on smithi079 2024-09-21T02:25:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:37 smithi098 ceph-mon[34832]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:38.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.237+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f873802e640 con 0x7f8738078ca0 2024-09-21T02:25:38.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.243+0000 7f872f400640 1 -- 172.21.15.79:0/1010912593 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f8724039020 con 0x7f8738078ca0 2024-09-21T02:25:38.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f871c03fb20 msgr2=0x7f871c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f871c03fb20 0x7f871c042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8728000c00 tx=0x7f8728031400 comp rx=0 tx=0).stop 2024-09-21T02:25:38.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738078ca0 msgr2=0x7f87381a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738078ca0 0x7f87381a0ba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f872400e9f0 tx=0x7f872400edf0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 shutdown_connections 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f871c03fb20 0x7f871c042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8738079640 0x7f87381a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8738078ca0 0x7f87381a0ba0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 --2- 172.21.15.79:0/1010912593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738077c10 0x7f87381a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 >> 172.21.15.79:0/1010912593 conn(0x7f87381012c0 msgr2=0x7f873810fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 shutdown_connections 2024-09-21T02:25:38.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.246+0000 7f873d800640 1 -- 172.21.15.79:0/1010912593 wait complete. 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 -- 172.21.15.79:0/3072622028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71080770e0 msgr2=0x7f71080757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 --2- 172.21.15.79:0/3072622028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71080770e0 0x7f71080757b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009900 tx=0x7f70f802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 -- 172.21.15.79:0/3072622028 shutdown_connections 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 --2- 172.21.15.79:0/3072622028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f710810b6f0 0x7f710810db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 --2- 172.21.15.79:0/3072622028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7108075cf0 0x7f7108076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 --2- 172.21.15.79:0/3072622028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71080770e0 0x7f71080757b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 -- 172.21.15.79:0/3072622028 >> 172.21.15.79:0/3072622028 conn(0x7f71080ff0e0 msgr2=0x7f7108101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 -- 172.21.15.79:0/3072622028 shutdown_connections 2024-09-21T02:25:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.400+0000 7f710f200640 1 -- 172.21.15.79:0/3072622028 wait complete. 2024-09-21T02:25:38.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.401+0000 7f710f200640 1 Processor -- start 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.401+0000 7f710f200640 1 -- start start 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710f200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7108075cf0 0x7f710819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710f200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71080770e0 0x7f710819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f710810b6f0 0x7f710819d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710f200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7108111470 con 0x7f71080770e0 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710f200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71081112f0 con 0x7f710810b6f0 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710f200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f71081115f0 con 0x7f7108075cf0 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7108075cf0 0x7f710819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71080770e0 0x7f710819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7108075cf0 0x7f710819c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:59242/0 (socket says 172.21.15.79:59242) 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 -- 172.21.15.79:0/2445635692 learned_addr learned my addr 172.21.15.79:0/2445635692 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71080770e0 0x7f710819c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53568/0 (socket says 172.21.15.79:53568) 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710d200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f710810b6f0 0x7f710819d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 -- 172.21.15.79:0/2445635692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f710810b6f0 msgr2=0x7f710819d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f710810b6f0 0x7f710819d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 -- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71080770e0 msgr2=0x7f710819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71080770e0 0x7f710819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f7107e00640 1 -- 172.21.15.79:0/2445635692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710819daf0 con 0x7f7108075cf0 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.402+0000 7f710d200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f710810b6f0 0x7f710819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.403+0000 7f7107e00640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7108075cf0 0x7f710819c0c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f70f8031440 tx=0x7f70f8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.403+0000 7f7104c00640 1 -- 172.21.15.79:0/2445635692 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f803f070 con 0x7f7108075cf0 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.403+0000 7f7104c00640 1 -- 172.21.15.79:0/2445635692 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f70f8031b80 con 0x7f7108075cf0 2024-09-21T02:25:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.403+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710819dd80 con 0x7f7108075cf0 2024-09-21T02:25:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.403+0000 7f7104c00640 1 -- 172.21.15.79:0/2445635692 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8035030 con 0x7f7108075cf0 2024-09-21T02:25:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.403+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71081a44e0 con 0x7f7108075cf0 2024-09-21T02:25:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.404+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710810a500 con 0x7f7108075cf0 2024-09-21T02:25:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.404+0000 7f7104c00640 1 -- 172.21.15.79:0/2445635692 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f70f8042070 con 0x7f7108075cf0 2024-09-21T02:25:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.405+0000 7f7104c00640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f70ec03fb20 0x7f70ec042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.405+0000 7f7104c00640 1 -- 172.21.15.79:0/2445635692 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f70f8074ff0 con 0x7f7108075cf0 2024-09-21T02:25:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.405+0000 7f7107400640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f70ec03fb20 0x7f70ec042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:38.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.406+0000 7f7107400640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f70ec03fb20 0x7f70ec042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005d00 tx=0x7f70f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.410+0000 7f7104c00640 1 -- 172.21.15.79:0/2445635692 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70f8074860 con 0x7f7108075cf0 2024-09-21T02:25:38.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.617+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f710802e640 con 0x7f7108075cf0 2024-09-21T02:25:38.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.623+0000 7f7104c00640 1 -- 172.21.15.79:0/2445635692 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v16)=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f70f8043e50 con 0x7f7108075cf0 2024-09-21T02:25:38.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f70ec03fb20 msgr2=0x7f70ec042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f70ec03fb20 0x7f70ec042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70f4005d00 tx=0x7f70f400b410 comp rx=0 tx=0).stop 2024-09-21T02:25:38.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7108075cf0 msgr2=0x7f710819c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:38.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7108075cf0 0x7f710819c0c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f70f8031440 tx=0x7f70f8003c10 comp rx=0 tx=0).stop 2024-09-21T02:25:38.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 shutdown_connections 2024-09-21T02:25:38.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f70ec03fb20 0x7f70ec042030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f710810b6f0 0x7f710819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71080770e0 0x7f710819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 --2- 172.21.15.79:0/2445635692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7108075cf0 0x7f710819c0c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:38.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 >> 172.21.15.79:0/2445635692 conn(0x7f71080ff0e0 msgr2=0x7f71081076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:38.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 shutdown_connections 2024-09-21T02:25:38.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.626+0000 7f710f200640 1 -- 172.21.15.79:0/2445635692 wait complete. 2024-09-21T02:25:39.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:38 smithi079 ceph-mon[30788]: Standby manager daemon z started 2024-09-21T02:25:39.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:38 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:25:39.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:38 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:25:39.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:38 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:25:39.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:38 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:25:39.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:38 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:39.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:38 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:39.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:38 smithi148 ceph-mon[34626]: Standby manager daemon z started 2024-09-21T02:25:39.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:38 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:25:39.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:38 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:25:39.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:38 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:25:39.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:38 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:25:39.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:38 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:39.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:38 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:38 smithi098 ceph-mon[34832]: Standby manager daemon z started 2024-09-21T02:25:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:38 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:25:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:38 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:25:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:38 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:25:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:38 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.148:0/3658804480' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:25:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:38 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:38 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:39.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 -- 172.21.15.79:0/3345525670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c06b8c0 msgr2=0x7fc35c106270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 --2- 172.21.15.79:0/3345525670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c06b8c0 0x7fc35c106270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009860 tx=0x7fc34c02a340 comp rx=0 tx=0).stop 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 -- 172.21.15.79:0/3345525670 shutdown_connections 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 --2- 172.21.15.79:0/3345525670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c109290 0x7fc35c10b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 --2- 172.21.15.79:0/3345525670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc35c1067b0 0x7fc35c108bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 --2- 172.21.15.79:0/3345525670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c06b8c0 0x7fc35c106270 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 -- 172.21.15.79:0/3345525670 >> 172.21.15.79:0/3345525670 conn(0x7fc35c0fddd0 msgr2=0x7fc35c100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 -- 172.21.15.79:0/3345525670 shutdown_connections 2024-09-21T02:25:39.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.860+0000 7fc35be00640 1 -- 172.21.15.79:0/3345525670 wait complete. 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.861+0000 7fc35be00640 1 Processor -- start 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.861+0000 7fc35be00640 1 -- start start 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc35c06b8c0 0x7fc35c19bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1067b0 0x7fc35c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c109290 0x7fc35c19d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35be00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c10f060 con 0x7fc35c1067b0 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35be00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c10eee0 con 0x7fc35c109290 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35be00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c10f1e0 con 0x7fc35c06b8c0 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1067b0 0x7fc35c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1067b0 0x7fc35c19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53600/0 (socket says 172.21.15.79:53600) 2024-09-21T02:25:39.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 -- 172.21.15.79:0/3089488476 learned_addr learned my addr 172.21.15.79:0/3089488476 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35b400640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c109290 0x7fc35c19d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35aa00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc35c06b8c0 0x7fc35c19bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 -- 172.21.15.79:0/3089488476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc35c06b8c0 msgr2=0x7fc35c19bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc35c06b8c0 0x7fc35c19bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 -- 172.21.15.79:0/3089488476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c109290 msgr2=0x7fc35c19d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c109290 0x7fc35c19d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc352000640 1 -- 172.21.15.79:0/3089488476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c19d980 con 0x7fc35c1067b0 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.862+0000 7fc35b400640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c109290 0x7fc35c19d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.863+0000 7fc352000640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1067b0 0x7fc35c19c5c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc34400e9f0 tx=0x7fc34400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:39.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.863+0000 7fc353e00640 1 -- 172.21.15.79:0/3089488476 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34400cd80 con 0x7fc35c1067b0 2024-09-21T02:25:39.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.863+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c19dc70 con 0x7fc35c1067b0 2024-09-21T02:25:39.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.863+0000 7fc353e00640 1 -- 172.21.15.79:0/3089488476 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc3440054b0 con 0x7fc35c1067b0 2024-09-21T02:25:39.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.863+0000 7fc353e00640 1 -- 172.21.15.79:0/3089488476 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344010430 con 0x7fc35c1067b0 2024-09-21T02:25:39.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.863+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c1a4370 con 0x7fc35c1067b0 2024-09-21T02:25:39.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.864+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c1a4540 con 0x7fc35c1067b0 2024-09-21T02:25:39.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.865+0000 7fc353e00640 1 -- 172.21.15.79:0/3089488476 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7fc3440046c0 con 0x7fc35c1067b0 2024-09-21T02:25:39.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.866+0000 7fc353e00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc34007afd0 0x7fc34007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:39.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.867+0000 7fc353e00640 1 -- 172.21.15.79:0/3089488476 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc34409d080 con 0x7fc35c1067b0 2024-09-21T02:25:39.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.867+0000 7fc35aa00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc34007afd0 0x7fc34007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:39.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.867+0000 7fc35aa00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc34007afd0 0x7fc34007d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005cd0 tx=0x7fc34c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:39.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.871+0000 7fc353e00640 1 -- 172.21.15.79:0/3089488476 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc344069b80 con 0x7fc35c1067b0 2024-09-21T02:25:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:39 smithi079 ceph-mon[30788]: mgrmap e15: x(active, since 69s), standbys: z 2024-09-21T02:25:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:25:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:39 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:39 smithi079 ceph-mon[30788]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.061+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc35c1a4ad0 con 0x7fc35c1067b0 2024-09-21T02:25:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:39 smithi148 ceph-mon[34626]: mgrmap e15: x(active, since 69s), standbys: z 2024-09-21T02:25:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:25:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:39 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:39 smithi148 ceph-mon[34626]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:40.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.067+0000 7fc353e00640 1 -- 172.21.15.79:0/3089488476 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fc34406ea30 con 0x7fc35c1067b0 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc34007afd0 msgr2=0x7fc34007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc34007afd0 0x7fc34007d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005cd0 tx=0x7fc34c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1067b0 msgr2=0x7fc35c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1067b0 0x7fc35c19c5c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc34400e9f0 tx=0x7fc34400edf0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 shutdown_connections 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc34007afd0 0x7fc34007d4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c109290 0x7fc35c19d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1067b0 0x7fc35c19c5c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 --2- 172.21.15.79:0/3089488476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc35c06b8c0 0x7fc35c19bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 >> 172.21.15.79:0/3089488476 conn(0x7fc35c0fddd0 msgr2=0x7fc35c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:40.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 shutdown_connections 2024-09-21T02:25:40.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.070+0000 7fc35be00640 1 -- 172.21.15.79:0/3089488476 wait complete. 2024-09-21T02:25:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:39 smithi098 ceph-mon[34832]: mgrmap e15: x(active, since 69s), standbys: z 2024-09-21T02:25:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:25:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:39 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:39 smithi098 ceph-mon[34832]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 -- 172.21.15.79:0/3936319750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104600 msgr2=0x7f7be8104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 --2- 172.21.15.79:0/3936319750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104600 0x7f7be8104a10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009900 tx=0x7f7bd402a480 comp rx=0 tx=0).stop 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 -- 172.21.15.79:0/3936319750 shutdown_connections 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 --2- 172.21.15.79:0/3936319750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7be8104fa0 0x7f7be810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 --2- 172.21.15.79:0/3936319750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104600 0x7f7be8104a10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 --2- 172.21.15.79:0/3936319750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8103570 0x7f7be81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 -- 172.21.15.79:0/3936319750 >> 172.21.15.79:0/3936319750 conn(0x7f7be80feec0 msgr2=0x7f7be8101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 -- 172.21.15.79:0/3936319750 shutdown_connections 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.855+0000 7f7beda00640 1 -- 172.21.15.79:0/3936319750 wait complete. 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 Processor -- start 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 -- start start 2024-09-21T02:25:40.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7be8103570 0x7f7be8199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8104600 0x7f7be819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104fa0 0x7f7be819af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7be810f0c0 con 0x7f7be8104600 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7be810ef40 con 0x7f7be8104fa0 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.857+0000 7f7beda00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7be810f240 con 0x7f7be8103570 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7be7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8104600 0x7f7be819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7be7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8104600 0x7f7be819a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53588/0 (socket says 172.21.15.79:53588) 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7be7400640 1 -- 172.21.15.79:0/1920191356 learned_addr learned my addr 172.21.15.79:0/1920191356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7bed000640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104fa0 0x7f7be819af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7be7e00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7be8103570 0x7f7be8199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7bed000640 1 -- 172.21.15.79:0/1920191356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7be8103570 msgr2=0x7f7be8199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7bed000640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7be8103570 0x7f7be8199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7bed000640 1 -- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8104600 msgr2=0x7f7be819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:40.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7bed000640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8104600 0x7f7be819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7bed000640 1 -- 172.21.15.79:0/1920191356 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be819b770 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.858+0000 7f7be7e00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7be8103570 0x7f7be8199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.859+0000 7f7be7400640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8104600 0x7f7be819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.859+0000 7f7bed000640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104fa0 0x7f7be819af50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7be0010f90 tx=0x7f7be000b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.859+0000 7f7be4c00640 1 -- 172.21.15.79:0/1920191356 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0003970 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.859+0000 7f7be4c00640 1 -- 172.21.15.79:0/1920191356 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7be0004020 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.859+0000 7f7be4c00640 1 -- 172.21.15.79:0/1920191356 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0017780 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.859+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be819ba60 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.859+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be80757c0 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.860+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be810a750 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.861+0000 7f7be4c00640 1 -- 172.21.15.79:0/1920191356 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f7be0003b10 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.862+0000 7f7be4c00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7bcc07afd0 0x7f7bcc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.863+0000 7f7be4c00640 1 -- 172.21.15.79:0/1920191356 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7be00a0af0 con 0x7f7be8104fa0 2024-09-21T02:25:40.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.863+0000 7f7be7e00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7bcc07afd0 0x7f7bcc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.863+0000 7f7be7e00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7bcc07afd0 0x7f7bcc07d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009b50 tx=0x7f7bd8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:38.867+0000 7f7be4c00640 1 -- 172.21.15.79:0/1920191356 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7be006d4b0 con 0x7f7be8104fa0 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.059+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f7be802e950 con 0x7f7be8104fa0 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.064+0000 7f7be4c00640 1 -- 172.21.15.79:0/1920191356 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f7be0072360 con 0x7f7be8104fa0 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7bcc07afd0 msgr2=0x7f7bcc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7bcc07afd0 0x7f7bcc07d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009b50 tx=0x7f7bd8005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104fa0 msgr2=0x7f7be819af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104fa0 0x7f7be819af50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7be0010f90 tx=0x7f7be000b750 comp rx=0 tx=0).stop 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 shutdown_connections 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7bcc07afd0 0x7f7bcc07d4e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7be8104fa0 0x7f7be819af50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7be8104600 0x7f7be819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 --2- 172.21.15.79:0/1920191356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7be8103570 0x7f7be8199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 >> 172.21.15.79:0/1920191356 conn(0x7f7be80feec0 msgr2=0x7f7be8107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:40.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 shutdown_connections 2024-09-21T02:25:40.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:39.067+0000 7f7beda00640 1 -- 172.21.15.79:0/1920191356 wait complete. 2024-09-21T02:25:41.391 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:41 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3089488476' entity='client.admin' 2024-09-21T02:25:41.392 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:41 smithi079 ceph-mon[30788]: Standby manager daemon y started 2024-09-21T02:25:41.392 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:41 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:25:41.392 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:41 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:25:41.392 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:41 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:25:41.392 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:41 smithi079 ceph-mon[30788]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:25:41.398 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:41 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3089488476' entity='client.admin' 2024-09-21T02:25:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:41 smithi098 ceph-mon[34832]: Standby manager daemon y started 2024-09-21T02:25:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:41 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:25:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:41 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:25:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:41 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:25:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:41 smithi098 ceph-mon[34832]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:25:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:41 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3089488476' entity='client.admin' 2024-09-21T02:25:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:41 smithi148 ceph-mon[34626]: Standby manager daemon y started 2024-09-21T02:25:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:41 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:25:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:41 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:25:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:41 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:25:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:41 smithi148 ceph-mon[34626]: from='mgr.? 172.21.15.98:0/2564504954' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:25:41.655 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:41.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 -- 172.21.15.79:0/734294498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d41068e0 msgr2=0x7f51d4108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:41.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 --2- 172.21.15.79:0/734294498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d41068e0 0x7f51d4108d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009900 tx=0x7f51c002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 -- 172.21.15.79:0/734294498 shutdown_connections 2024-09-21T02:25:41.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 --2- 172.21.15.79:0/734294498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51d4109480 0x7f51d410b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 --2- 172.21.15.79:0/734294498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d41068e0 0x7f51d4108d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 --2- 172.21.15.79:0/734294498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d406c660 0x7f51d41063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 -- 172.21.15.79:0/734294498 >> 172.21.15.79:0/734294498 conn(0x7f51d40fdfe0 msgr2=0x7f51d4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 -- 172.21.15.79:0/734294498 shutdown_connections 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.890+0000 7f51dc000640 1 -- 172.21.15.79:0/734294498 wait complete. 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.891+0000 7f51dc000640 1 Processor -- start 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.891+0000 7f51dc000640 1 -- start start 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51dc000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d406c660 0x7f51d419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51dc000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d41068e0 0x7f51d419c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51dc000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51d4109480 0x7f51d419d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51dc000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f51d410f250 con 0x7f51d406c660 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51dc000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f51d410f0d0 con 0x7f51d41068e0 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51dc000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f51d410f3d0 con 0x7f51d4109480 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d9600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d406c660 0x7f51d419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d41068e0 0x7f51d419c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d41068e0 0x7f51d419c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57116/0 (socket says 172.21.15.79:57116) 2024-09-21T02:25:41.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 -- 172.21.15.79:0/458913508 learned_addr learned my addr 172.21.15.79:0/458913508 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d9600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d406c660 0x7f51d419c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53618/0 (socket says 172.21.15.79:53618) 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51da000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51d4109480 0x7f51d419d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 -- 172.21.15.79:0/458913508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51d4109480 msgr2=0x7f51d419d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51d4109480 0x7f51d419d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 -- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d406c660 msgr2=0x7f51d419c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d406c660 0x7f51d419c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51d8c00640 1 -- 172.21.15.79:0/458913508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d419db30 con 0x7f51d41068e0 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.892+0000 7f51da000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51d4109480 0x7f51d419d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.893+0000 7f51d8c00640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d41068e0 0x7f51d419c770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f51c0004770 tx=0x7f51c00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.893+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c003f030 con 0x7f51d41068e0 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.893+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f51c00044c0 con 0x7f51d41068e0 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.893+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d419ddc0 con 0x7f51d41068e0 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.893+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c0035070 con 0x7f51d41068e0 2024-09-21T02:25:41.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.893+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d41a4520 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.894+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d4106d30 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.895+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f51c0042030 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.896+0000 7f51d2000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f51bc07afd0 0x7f51bc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.896+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f51c00bd190 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.897+0000 7f51d9600640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f51bc07afd0 0x7f51bc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.897+0000 7f51d9600640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f51bc07afd0 0x7f51bc07d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f51c80099a0 tx=0x7f51c8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:40.901+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51c0089c70 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.075+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f51c0003d10 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.099+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f51d41a4790 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.104+0000 7f51d2000640 1 -- 172.21.15.79:0/458913508 <== mon.2 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f51c00a0750 con 0x7f51d41068e0 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f51bc07afd0 msgr2=0x7f51bc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f51bc07afd0 0x7f51bc07d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f51c80099a0 tx=0x7f51c8009500 comp rx=0 tx=0).stop 2024-09-21T02:25:41.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d41068e0 msgr2=0x7f51d419c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d41068e0 0x7f51d419c770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f51c0004770 tx=0x7f51c00040c0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 shutdown_connections 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f51bc07afd0 0x7f51bc07d4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51d4109480 0x7f51d419d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51d41068e0 0x7f51d419c770 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 --2- 172.21.15.79:0/458913508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51d406c660 0x7f51d419c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 >> 172.21.15.79:0/458913508 conn(0x7f51d40fdfe0 msgr2=0x7f51d4100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 shutdown_connections 2024-09-21T02:25:41.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:41.107+0000 7f51dc000640 1 -- 172.21.15.79:0/458913508 wait complete. 2024-09-21T02:25:42.369 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:42 smithi079 ceph-mon[30788]: mgrmap e16: x(active, since 71s), standbys: z, y 2024-09-21T02:25:42.369 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:42 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:25:42.370 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:42 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:42.370 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:42 smithi079 ceph-mon[30788]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:42.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:42 smithi098 ceph-mon[34832]: mgrmap e16: x(active, since 71s), standbys: z, y 2024-09-21T02:25:42.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:42 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:25:42.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:42 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:42.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:42 smithi098 ceph-mon[34832]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.439+0000 7f3697200640 1 -- 172.21.15.79:0/1959864715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 msgr2=0x7f3698079fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.439+0000 7f3697200640 1 --2- 172.21.15.79:0/1959864715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f3698079fb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3690009ca0 tx=0x7f369002a950 comp rx=0 tx=0).stop 2024-09-21T02:25:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.439+0000 7f3697200640 1 -- 172.21.15.79:0/1959864715 shutdown_connections 2024-09-21T02:25:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.439+0000 7f3697200640 1 --2- 172.21.15.79:0/1959864715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f3698079fb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.439+0000 7f3697200640 1 --2- 172.21.15.79:0/1959864715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3698078ca0 0x7f36980790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.439+0000 7f3697200640 1 --2- 172.21.15.79:0/1959864715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3698077c10 0x7f3698078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.439+0000 7f3697200640 1 -- 172.21.15.79:0/1959864715 >> 172.21.15.79:0/1959864715 conn(0x7f3698101100 msgr2=0x7f36981035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.440+0000 7f3697200640 1 -- 172.21.15.79:0/1959864715 shutdown_connections 2024-09-21T02:25:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.440+0000 7f3697200640 1 -- 172.21.15.79:0/1959864715 wait complete. 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.440+0000 7f3697200640 1 Processor -- start 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3697200640 1 -- start start 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3697200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3698077c10 0x7f36981a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3697200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3698078ca0 0x7f36981a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3697200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f36981a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3697200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3698115740 con 0x7f3698079640 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3697200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f36981155c0 con 0x7f3698077c10 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3697200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f36981158c0 con 0x7f3698078ca0 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3696800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f36981a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3696800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f36981a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53632/0 (socket says 172.21.15.79:53632) 2024-09-21T02:25:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3696800640 1 -- 172.21.15.79:0/4085845427 learned_addr learned my addr 172.21.15.79:0/4085845427 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f3695e00640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3698077c10 0x7f36981a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.441+0000 7f368d400640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3698078ca0 0x7f36981a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3695e00640 1 -- 172.21.15.79:0/4085845427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3698078ca0 msgr2=0x7f36981a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3695e00640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3698078ca0 0x7f36981a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3695e00640 1 -- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 msgr2=0x7f36981a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3695e00640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f36981a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3695e00640 1 -- 172.21.15.79:0/4085845427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36981a1ce0 con 0x7f3698077c10 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3696800640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f36981a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3695e00640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3698077c10 0x7f36981a02b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f368800e9f0 tx=0x7f368800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f368f400640 1 -- 172.21.15.79:0/4085845427 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368800ccc0 con 0x7f3698077c10 2024-09-21T02:25:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f368f400640 1 -- 172.21.15.79:0/4085845427 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f36880108c0 con 0x7f3698077c10 2024-09-21T02:25:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36981a1fd0 con 0x7f3698077c10 2024-09-21T02:25:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.442+0000 7f368f400640 1 -- 172.21.15.79:0/4085845427 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36880187c0 con 0x7f3698077c10 2024-09-21T02:25:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.443+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36981a86d0 con 0x7f3698077c10 2024-09-21T02:25:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.444+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36981129d0 con 0x7f3698077c10 2024-09-21T02:25:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.446+0000 7f368f400640 1 -- 172.21.15.79:0/4085845427 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f3688010430 con 0x7f3698077c10 2024-09-21T02:25:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.447+0000 7f368f400640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f367c0b6480 0x7f367c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.447+0000 7f368f400640 1 -- 172.21.15.79:0/4085845427 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f36880e5950 con 0x7f3698077c10 2024-09-21T02:25:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.447+0000 7f368d400640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f367c0b6480 0x7f367c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.448+0000 7f368d400640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f367c0b6480 0x7f367c0b8990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3680005d00 tx=0x7f368000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:42.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.451+0000 7f368f400640 1 -- 172.21.15.79:0/4085845427 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36880b21f0 con 0x7f3698077c10 2024-09-21T02:25:42.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:42 smithi148 ceph-mon[34626]: mgrmap e16: x(active, since 71s), standbys: z, y 2024-09-21T02:25:42.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:42 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:25:42.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:42 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:42.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:42 smithi148 ceph-mon[34626]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:42.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.646+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f3698063fc0 con 0x7f3698077c10 2024-09-21T02:25:42.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.653+0000 7f368f400640 1 -- 172.21.15.79:0/4085845427 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7f36880b7130 con 0x7f3698077c10 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f367c0b6480 msgr2=0x7f367c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f367c0b6480 0x7f367c0b8990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3680005d00 tx=0x7f368000b410 comp rx=0 tx=0).stop 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3698077c10 msgr2=0x7f36981a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3698077c10 0x7f36981a02b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f368800e9f0 tx=0x7f368800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 shutdown_connections 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f367c0b6480 0x7f367c0b8990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3698079640 0x7f36981a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3698078ca0 0x7f36981a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 --2- 172.21.15.79:0/4085845427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3698077c10 0x7f36981a02b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.655+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 >> 172.21.15.79:0/4085845427 conn(0x7f3698101100 msgr2=0x7f369810fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.656+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 shutdown_connections 2024-09-21T02:25:42.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:42.656+0000 7f3697200640 1 -- 172.21.15.79:0/4085845427 wait complete. 2024-09-21T02:25:43.862 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:43 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:43.862 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:43 smithi079 ceph-mon[30788]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.704+0000 7fce52c00640 1 -- 172.21.15.79:0/3573296614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c077c10 msgr2=0x7fce4c078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.704+0000 7fce52c00640 1 --2- 172.21.15.79:0/3573296614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c077c10 0x7fce4c078080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009900 tx=0x7fce3c02a480 comp rx=0 tx=0).stop 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.705+0000 7fce52c00640 1 -- 172.21.15.79:0/3573296614 shutdown_connections 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.705+0000 7fce52c00640 1 --2- 172.21.15.79:0/3573296614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c079640 0x7fce4c079fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.705+0000 7fce52c00640 1 --2- 172.21.15.79:0/3573296614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c078ca0 0x7fce4c0790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.705+0000 7fce52c00640 1 --2- 172.21.15.79:0/3573296614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c077c10 0x7fce4c078080 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.705+0000 7fce52c00640 1 -- 172.21.15.79:0/3573296614 >> 172.21.15.79:0/3573296614 conn(0x7fce4c1012f0 msgr2=0x7fce4c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.705+0000 7fce52c00640 1 -- 172.21.15.79:0/3573296614 shutdown_connections 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.705+0000 7fce52c00640 1 -- 172.21.15.79:0/3573296614 wait complete. 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 Processor -- start 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 -- start start 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c077c10 0x7fce4c1a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c078ca0 0x7fce4c1a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c079640 0x7fce4c1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c115930 con 0x7fce4c079640 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1157b0 con 0x7fce4c077c10 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce52c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c115ab0 con 0x7fce4c078ca0 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce50c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c079640 0x7fce4c1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce4be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c077c10 0x7fce4c1a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce50c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c079640 0x7fce4c1a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53640/0 (socket says 172.21.15.79:53640) 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce4be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c077c10 0x7fce4c1a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57158/0 (socket says 172.21.15.79:57158) 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.706+0000 7fce50c00640 1 -- 172.21.15.79:0/2689996893 learned_addr learned my addr 172.21.15.79:0/2689996893 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce43e00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c078ca0 0x7fce4c1a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce4be00640 1 -- 172.21.15.79:0/2689996893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c078ca0 msgr2=0x7fce4c1a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce4be00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c078ca0 0x7fce4c1a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce4be00640 1 -- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c079640 msgr2=0x7fce4c1a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce4be00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c079640 0x7fce4c1a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce4be00640 1 -- 172.21.15.79:0/2689996893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c1a1f90 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce50c00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c079640 0x7fce4c1a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.707+0000 7fce4be00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c077c10 0x7fce4c1a0560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fce3c02aa70 tx=0x7fce3c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.708+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c03f070 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.708+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c1a2220 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.708+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c1a87b0 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.708+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fce3c031b80 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.708+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c049060 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.709+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce4c112bc0 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.711+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fce3c042070 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.712+0000 7fce49600640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce300b6500 0x7fce300b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.713+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fce3c106590 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.713+0000 7fce43e00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce300b6500 0x7fce300b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.713+0000 7fce43e00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce300b6500 0x7fce300b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce34005fd0 tx=0x7fce3400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.715+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce3c0d2e30 con 0x7fce4c077c10 2024-09-21T02:25:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.914+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fce4c02e640 con 0x7fce4c077c10 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.921+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce3c031d30 con 0x7fce4c077c10 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.921+0000 7fce49600640 1 -- 172.21.15.79:0/2689996893 <== mon.2 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v21)=0 v21) ==== 123+0+0 (secure 0 0 0) 0x7fce3c0d7030 con 0x7fce4c077c10 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce300b6500 msgr2=0x7fce300b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce300b6500 0x7fce300b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce34005fd0 tx=0x7fce3400b390 comp rx=0 tx=0).stop 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c077c10 msgr2=0x7fce4c1a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c077c10 0x7fce4c1a0560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fce3c02aa70 tx=0x7fce3c003c10 comp rx=0 tx=0).stop 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 shutdown_connections 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce300b6500 0x7fce300b8a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4c079640 0x7fce4c1a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c078ca0 0x7fce4c1a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 --2- 172.21.15.79:0/2689996893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce4c077c10 0x7fce4c1a0560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.923+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 >> 172.21.15.79:0/2689996893 conn(0x7fce4c1012f0 msgr2=0x7fce4c10fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.924+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 shutdown_connections 2024-09-21T02:25:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:43.924+0000 7fce52c00640 1 -- 172.21.15.79:0/2689996893 wait complete. 2024-09-21T02:25:44.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:43 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:44.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:43 smithi148 ceph-mon[34626]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:43 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:43 smithi098 ceph-mon[34832]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:45.138 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:44 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:45.138 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:44 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4225594160' entity='client.admin' 2024-09-21T02:25:45.146 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:45.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:44 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:45.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:44 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4225594160' entity='client.admin' 2024-09-21T02:25:45.325 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:44 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:45.325 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:44 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4225594160' entity='client.admin' 2024-09-21T02:25:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 -- 172.21.15.79:0/1436742055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40075c90 msgr2=0x7f9a400760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 --2- 172.21.15.79:0/1436742055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40075c90 0x7f9a400760a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009900 tx=0x7f9a2c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:25:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 -- 172.21.15.79:0/1436742055 shutdown_connections 2024-09-21T02:25:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 --2- 172.21.15.79:0/1436742055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a4010b750 0x7f9a4010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 --2- 172.21.15.79:0/1436742055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40075c90 0x7f9a400760a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 --2- 172.21.15.79:0/1436742055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a40077080 0x7f9a40075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 -- 172.21.15.79:0/1436742055 >> 172.21.15.79:0/1436742055 conn(0x7f9a400ff0c0 msgr2=0x7f9a40101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:45.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 -- 172.21.15.79:0/1436742055 shutdown_connections 2024-09-21T02:25:45.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.785+0000 7f9a46400640 1 -- 172.21.15.79:0/1436742055 wait complete. 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.786+0000 7f9a46400640 1 Processor -- start 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a46400640 1 -- start start 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a46400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a40075c90 0x7f9a4019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a46400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40077080 0x7f9a4019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a46400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a4010b750 0x7f9a4019d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a46400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401115e0 con 0x7f9a40077080 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a46400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40111460 con 0x7f9a40075c90 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a46400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40111760 con 0x7f9a4010b750 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a3f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a40075c90 0x7f9a4019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a3ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40077080 0x7f9a4019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a3f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a40075c90 0x7f9a4019c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:34624/0 (socket says 172.21.15.79:34624) 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.787+0000 7f9a3f400640 1 -- 172.21.15.79:0/1195203420 learned_addr learned my addr 172.21.15.79:0/1195203420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a3f400640 1 -- 172.21.15.79:0/1195203420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a4010b750 msgr2=0x7f9a4019d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a3fe00640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a4010b750 0x7f9a4019d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a3f400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a4010b750 0x7f9a4019d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a3f400640 1 -- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40077080 msgr2=0x7f9a4019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a3f400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40077080 0x7f9a4019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a3f400640 1 -- 172.21.15.79:0/1195203420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4019dc40 con 0x7f9a40075c90 2024-09-21T02:25:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a3f400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a40075c90 0x7f9a4019c210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000e9f0 tx=0x7f9a3000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a37e00640 1 -- 172.21.15.79:0/1195203420 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3000cd80 con 0x7f9a40075c90 2024-09-21T02:25:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a37e00640 1 -- 172.21.15.79:0/1195203420 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a300054d0 con 0x7f9a40075c90 2024-09-21T02:25:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a37e00640 1 -- 172.21.15.79:0/1195203420 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30010690 con 0x7f9a40075c90 2024-09-21T02:25:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.788+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4019df30 con 0x7f9a40075c90 2024-09-21T02:25:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.789+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a401a4630 con 0x7f9a40075c90 2024-09-21T02:25:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.790+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4010a560 con 0x7f9a40075c90 2024-09-21T02:25:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.793+0000 7f9a37e00640 1 -- 172.21.15.79:0/1195203420 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f9a30004e30 con 0x7f9a40075c90 2024-09-21T02:25:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.795+0000 7f9a37e00640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a240b6480 0x7f9a240b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:45.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.795+0000 7f9a37e00640 1 -- 172.21.15.79:0/1195203420 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9a300e5c90 con 0x7f9a40075c90 2024-09-21T02:25:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.795+0000 7f9a3ea00640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a240b6480 0x7f9a240b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.795+0000 7f9a37e00640 1 -- 172.21.15.79:0/1195203420 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a300a9d60 con 0x7f9a40075c90 2024-09-21T02:25:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.796+0000 7f9a3ea00640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a240b6480 0x7f9a240b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c004770 tx=0x7f9a2c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.001+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f9a4002e640 con 0x7f9a40075c90 2024-09-21T02:25:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.007+0000 7f9a37e00640 1 -- 172.21.15.79:0/1195203420 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v25)=0 v25) ==== 125+0+0 (secure 0 0 0) 0x7f9a300ae1f0 con 0x7f9a40075c90 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a240b6480 msgr2=0x7f9a240b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a240b6480 0x7f9a240b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c004770 tx=0x7f9a2c0314a0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a40075c90 msgr2=0x7f9a4019c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a40075c90 0x7f9a4019c210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000e9f0 tx=0x7f9a3000edf0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 shutdown_connections 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a240b6480 0x7f9a240b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a4010b750 0x7f9a4019d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a40077080 0x7f9a4019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 --2- 172.21.15.79:0/1195203420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a40075c90 0x7f9a4019c210 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 >> 172.21.15.79:0/1195203420 conn(0x7f9a400ff0c0 msgr2=0x7f9a40107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 shutdown_connections 2024-09-21T02:25:46.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:46.010+0000 7f9a46400640 1 -- 172.21.15.79:0/1195203420 wait complete. 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 -- 172.21.15.79:0/3492124065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 msgr2=0x7f195c076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 --2- 172.21.15.79:0/3492124065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c076100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1948009900 tx=0x7f194802a410 comp rx=0 tx=0).stop 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 -- 172.21.15.79:0/3492124065 shutdown_connections 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 --2- 172.21.15.79:0/3492124065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195c10b510 0x7f195c10d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 --2- 172.21.15.79:0/3492124065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c076100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 --2- 172.21.15.79:0/3492124065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f195c0770e0 0x7f195c0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 -- 172.21.15.79:0/3492124065 >> 172.21.15.79:0/3492124065 conn(0x7f195c0feec0 msgr2=0x7f195c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 -- 172.21.15.79:0/3492124065 shutdown_connections 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.424+0000 7f1962e00640 1 -- 172.21.15.79:0/3492124065 wait complete. 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.425+0000 7f1962e00640 1 Processor -- start 2024-09-21T02:25:46.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962e00640 1 -- start start 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f195c0770e0 0x7f195c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195c10b510 0x7f195c19d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f195c111400 con 0x7f195c075cf0 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f195c111280 con 0x7f195c0770e0 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f195c111580 con 0x7f195c10b510 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1961a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1961a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c19bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35284/0 (socket says 172.21.15.79:35284) 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1961a00640 1 -- 172.21.15.79:0/4225594160 learned_addr learned my addr 172.21.15.79:0/4225594160 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1961000640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f195c0770e0 0x7f195c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.426+0000 7f1962400640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195c10b510 0x7f195c19d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1961a00640 1 -- 172.21.15.79:0/4225594160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195c10b510 msgr2=0x7f195c19d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:46.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1961a00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195c10b510 0x7f195c19d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1961a00640 1 -- 172.21.15.79:0/4225594160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f195c0770e0 msgr2=0x7f195c19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1961a00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f195c0770e0 0x7f195c19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1961a00640 1 -- 172.21.15.79:0/4225594160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c19da20 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1962400640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195c10b510 0x7f195c19d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1961a00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c19bff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f195000e9f0 tx=0x7f195000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f195a000640 1 -- 172.21.15.79:0/4225594160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195000cd80 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f195a000640 1 -- 172.21.15.79:0/4225594160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19500108e0 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195c19dd10 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f195a000640 1 -- 172.21.15.79:0/4225594160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950018980 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.427+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195c1a4410 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.429+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195c1a45e0 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.431+0000 7f195a000640 1 -- 172.21.15.79:0/4225594160 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f1950010430 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.432+0000 7f195a000640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f19440b6500 0x7f19440b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.433+0000 7f195a000640 1 -- 172.21.15.79:0/4225594160 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f19500e5ea0 con 0x7f195c075cf0 2024-09-21T02:25:46.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.433+0000 7f1961000640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f19440b6500 0x7f19440b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.434+0000 7f1961000640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f19440b6500 0x7f19440b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1948004770 tx=0x7f19480314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.435+0000 7f195a000640 1 -- 172.21.15.79:0/4225594160 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19500ae360 con 0x7f195c075cf0 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.635+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f195c1a47b0 con 0x7f195c075cf0 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.639+0000 7f195a000640 1 -- 172.21.15.79:0/4225594160 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v22)=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7f19500b2740 con 0x7f195c075cf0 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.642+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f19440b6500 msgr2=0x7f19440b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.642+0000 7f1962e00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f19440b6500 0x7f19440b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1948004770 tx=0x7f19480314a0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.642+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 msgr2=0x7f195c19bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.642+0000 7f1962e00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c19bff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f195000e9f0 tx=0x7f195000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 shutdown_connections 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f19440b6500 0x7f19440b8a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195c10b510 0x7f195c19d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f195c0770e0 0x7f195c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 --2- 172.21.15.79:0/4225594160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f195c075cf0 0x7f195c19bff0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 >> 172.21.15.79:0/4225594160 conn(0x7f195c0feec0 msgr2=0x7f195c0ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:46.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 shutdown_connections 2024-09-21T02:25:46.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:44.643+0000 7f1962e00640 1 -- 172.21.15.79:0/4225594160 wait complete. 2024-09-21T02:25:46.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:46 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2748802000' entity='client.admin' 2024-09-21T02:25:46.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:46 smithi148 ceph-mon[34626]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:46.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:46 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:46.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:46 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:46 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2748802000' entity='client.admin' 2024-09-21T02:25:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:46 smithi098 ceph-mon[34832]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:46 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:46 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:46.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:46 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2748802000' entity='client.admin' 2024-09-21T02:25:46.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:46 smithi079 ceph-mon[30788]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:46.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:46 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:46.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:46 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:47.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 -- 172.21.15.79:0/3534487385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad41047f0 msgr2=0x7f0ad4104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:47.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/3534487385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad41047f0 0x7f0ad4104c00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009900 tx=0x7f0ac002a480 comp rx=0 tx=0).stop 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 -- 172.21.15.79:0/3534487385 shutdown_connections 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/3534487385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ad4105190 0x7f0ad410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/3534487385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad41047f0 0x7f0ad4104c00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/3534487385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 0x7f0ad4103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 -- 172.21.15.79:0/3534487385 >> 172.21.15.79:0/3534487385 conn(0x7f0ad40ff0b0 msgr2=0x7f0ad4101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 -- 172.21.15.79:0/3534487385 shutdown_connections 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.705+0000 7f0ad9c00640 1 -- 172.21.15.79:0/3534487385 wait complete. 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 Processor -- start 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 -- start start 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 0x7f0ad419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ad41047f0 0x7f0ad419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad4105190 0x7f0ad419d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad410f400 con 0x7f0ad4105190 2024-09-21T02:25:47.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad410f280 con 0x7f0ad4103760 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.706+0000 7f0ad9c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad410f580 con 0x7f0ad41047f0 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 0x7f0ad419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ad41047f0 0x7f0ad419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 0x7f0ad419c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:34606/0 (socket says 172.21.15.79:34606) 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad4105190 0x7f0ad419d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 -- 172.21.15.79:0/2775328148 learned_addr learned my addr 172.21.15.79:0/2775328148 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 -- 172.21.15.79:0/2775328148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ad41047f0 msgr2=0x7f0ad419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ad41047f0 0x7f0ad419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 -- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad4105190 msgr2=0x7f0ad419d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad4105190 0x7f0ad419d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.707+0000 7f0ad2a00640 1 -- 172.21.15.79:0/2775328148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad419dc30 con 0x7f0ad4103760 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.708+0000 7f0ad2a00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 0x7f0ad419c200 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400ea60 tx=0x7f0ac400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.708+0000 7f0acb400640 1 -- 172.21.15.79:0/2775328148 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400cde0 con 0x7f0ad4103760 2024-09-21T02:25:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.708+0000 7f0acb400640 1 -- 172.21.15.79:0/2775328148 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ac40035f0 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.708+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad419df20 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.708+0000 7f0acb400640 1 -- 172.21.15.79:0/2775328148 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4010690 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.708+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad41a4620 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.709+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad41a47f0 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.713+0000 7f0acb400640 1 -- 172.21.15.79:0/2775328148 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f0ac4004020 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.714+0000 7f0acb400640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ab80b6480 0x7f0ab80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.715+0000 7f0acb400640 1 -- 172.21.15.79:0/2775328148 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0ac40e5980 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.715+0000 7f0ad2000640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ab80b6480 0x7f0ab80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.716+0000 7f0ad2000640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ab80b6480 0x7f0ab80b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0004770 tx=0x7f0ac00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.718+0000 7f0acb400640 1 -- 172.21.15.79:0/2775328148 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ac40ade40 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.920+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f0ad41a49c0 con 0x7f0ad4103760 2024-09-21T02:25:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.926+0000 7f0acb400640 1 -- 172.21.15.79:0/2775328148 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v24)=0 v24) ==== 116+0+0 (secure 0 0 0) 0x7f0ac40b2220 con 0x7f0ad4103760 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ab80b6480 msgr2=0x7f0ab80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ab80b6480 0x7f0ab80b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0004770 tx=0x7f0ac00314a0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 msgr2=0x7f0ad419c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 0x7f0ad419c200 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400ea60 tx=0x7f0ac400ef20 comp rx=0 tx=0).stop 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 shutdown_connections 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ab80b6480 0x7f0ab80b8990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad4105190 0x7f0ad419d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ad41047f0 0x7f0ad419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 --2- 172.21.15.79:0/2775328148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad4103760 0x7f0ad419c200 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 >> 172.21.15.79:0/2775328148 conn(0x7f0ad40ff0b0 msgr2=0x7f0ad40755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 shutdown_connections 2024-09-21T02:25:47.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.928+0000 7f0ad9c00640 1 -- 172.21.15.79:0/2775328148 wait complete. 2024-09-21T02:25:48.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:48 smithi079 ceph-mon[30788]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:48 smithi098 ceph-mon[34832]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:48.781 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:48 smithi148 ceph-mon[34626]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:49.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 -- 172.21.15.79:0/936168297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e01073b0 msgr2=0x7f75e010dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 --2- 172.21.15.79:0/936168297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e01073b0 0x7f75e010dd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009ca0 tx=0x7f75d802a950 comp rx=0 tx=0).stop 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 -- 172.21.15.79:0/936168297 shutdown_connections 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 --2- 172.21.15.79:0/936168297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e01073b0 0x7f75e010dd50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 --2- 172.21.15.79:0/936168297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75e0106a10 0x7f75e0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 --2- 172.21.15.79:0/936168297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e0105980 0x7f75e0105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 -- 172.21.15.79:0/936168297 >> 172.21.15.79:0/936168297 conn(0x7f75e01012f0 msgr2=0x7f75e01037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 -- 172.21.15.79:0/936168297 shutdown_connections 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.004+0000 7f75e5600640 1 -- 172.21.15.79:0/936168297 wait complete. 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 Processor -- start 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 -- start start 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e0105980 0x7f75e019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e0106a10 0x7f75e019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75e01073b0 0x7f75e019d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01115d0 con 0x7f75e0106a10 2024-09-21T02:25:49.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0111450 con 0x7f75e0105980 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.005+0000 7f75e5600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0111750 con 0x7f75e01073b0 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e0106a10 0x7f75e019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e0106a10 0x7f75e019c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35292/0 (socket says 172.21.15.79:35292) 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 -- 172.21.15.79:0/2748802000 learned_addr learned my addr 172.21.15.79:0/2748802000 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75dea00640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e0105980 0x7f75e019c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75df400640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75e01073b0 0x7f75e019d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 -- 172.21.15.79:0/2748802000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75e01073b0 msgr2=0x7f75e019d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75e01073b0 0x7f75e019d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 -- 172.21.15.79:0/2748802000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e0105980 msgr2=0x7f75e019c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e0105980 0x7f75e019c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 -- 172.21.15.79:0/2748802000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e019dbc0 con 0x7f75e0106a10 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7e00640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e0106a10 0x7f75e019c800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e9f0 tx=0x7f75c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.006+0000 7f75d7400640 1 -- 172.21.15.79:0/2748802000 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c800cd80 con 0x7f75e0106a10 2024-09-21T02:25:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.007+0000 7f75d7400640 1 -- 172.21.15.79:0/2748802000 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75c80054d0 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.007+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e019deb0 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.007+0000 7f75d7400640 1 -- 172.21.15.79:0/2748802000 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c8010690 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.007+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e01a45b0 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.008+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e010cb40 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.010+0000 7f75d7400640 1 -- 172.21.15.79:0/2748802000 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f75c8004e30 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.011+0000 7f75d7400640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f75c40b6500 0x7f75c40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.012+0000 7f75d7400640 1 -- 172.21.15.79:0/2748802000 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f75c80e5c10 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.012+0000 7f75dea00640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f75c40b6500 0x7f75c40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.012+0000 7f75dea00640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f75c40b6500 0x7f75c40b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75d00095f0 tx=0x7f75d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.014+0000 7f75d7400640 1 -- 172.21.15.79:0/2748802000 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75c80ae0d0 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.225+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f75e002e640 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.230+0000 7f75d7400640 1 -- 172.21.15.79:0/2748802000 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7f75c80b24b0 con 0x7f75e0106a10 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f75c40b6500 msgr2=0x7f75c40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f75c40b6500 0x7f75c40b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75d00095f0 tx=0x7f75d0005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e0106a10 msgr2=0x7f75e019c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e0106a10 0x7f75e019c800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e9f0 tx=0x7f75c800edf0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 shutdown_connections 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f75c40b6500 0x7f75c40b8a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75e01073b0 0x7f75e019d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75e0106a10 0x7f75e019c800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 --2- 172.21.15.79:0/2748802000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e0105980 0x7f75e019c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 >> 172.21.15.79:0/2748802000 conn(0x7f75e01012f0 msgr2=0x7f75e0109d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 shutdown_connections 2024-09-21T02:25:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:45.233+0000 7f75e5600640 1 -- 172.21.15.79:0/2748802000 wait complete. 2024-09-21T02:25:49.798 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:49 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:49.798 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:49 smithi079 ceph-mon[30788]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:49.806 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:49.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:49 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:49.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:49 smithi148 ceph-mon[34626]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 -- 172.21.15.79:0/1365853323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f48077060 msgr2=0x7f5f48075730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/1365853323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f48077060 0x7f5f48075730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009900 tx=0x7f5f3802a410 comp rx=0 tx=0).stop 2024-09-21T02:25:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 -- 172.21.15.79:0/1365853323 shutdown_connections 2024-09-21T02:25:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/1365853323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f4810b770 0x7f5f4810db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/1365853323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f48075c70 0x7f5f48076080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/1365853323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f48077060 0x7f5f48075730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 -- 172.21.15.79:0/1365853323 >> 172.21.15.79:0/1365853323 conn(0x7f5f480ff0c0 msgr2=0x7f5f48101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 -- 172.21.15.79:0/1365853323 shutdown_connections 2024-09-21T02:25:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.889+0000 7f5f4ea00640 1 -- 172.21.15.79:0/1365853323 wait complete. 2024-09-21T02:25:49.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.890+0000 7f5f4ea00640 1 Processor -- start 2024-09-21T02:25:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.890+0000 7f5f4ea00640 1 -- start start 2024-09-21T02:25:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f4ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48075c70 0x7f5f4819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f4ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f48077060 0x7f5f4819c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f4ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4810b770 0x7f5f4819d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f4ea00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48111580 con 0x7f5f4810b770 2024-09-21T02:25:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f4ea00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48111400 con 0x7f5f48075c70 2024-09-21T02:25:49.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f4ea00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48111700 con 0x7f5f48077060 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48075c70 0x7f5f4819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f4ca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4810b770 0x7f5f4819d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48075c70 0x7f5f4819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:34656/0 (socket says 172.21.15.79:34656) 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f48077060 0x7f5f4819c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 -- 172.21.15.79:0/175894529 learned_addr learned my addr 172.21.15.79:0/175894529 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 -- 172.21.15.79:0/175894529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f48077060 msgr2=0x7f5f4819c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f48077060 0x7f5f4819c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 -- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4810b770 msgr2=0x7f5f4819d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4810b770 0x7f5f4819d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47e00640 1 -- 172.21.15.79:0/175894529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4819dbf0 con 0x7f5f48075c70 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.891+0000 7f5f47400640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f48077060 0x7f5f4819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.892+0000 7f5f47e00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48075c70 0x7f5f4819c230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5f38006010 tx=0x7f5f380042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:49.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.892+0000 7f5f44c00640 1 -- 172.21.15.79:0/175894529 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3803f030 con 0x7f5f48075c70 2024-09-21T02:25:49.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.892+0000 7f5f44c00640 1 -- 172.21.15.79:0/175894529 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f38031910 con 0x7f5f48075c70 2024-09-21T02:25:49.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.892+0000 7f5f44c00640 1 -- 172.21.15.79:0/175894529 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38035070 con 0x7f5f48075c70 2024-09-21T02:25:49.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.892+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4819de80 con 0x7f5f48075c70 2024-09-21T02:25:49.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.892+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f481a4410 con 0x7f5f48075c70 2024-09-21T02:25:49.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.893+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4810a580 con 0x7f5f48075c70 2024-09-21T02:25:49.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.895+0000 7f5f44c00640 1 -- 172.21.15.79:0/175894529 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f5f38042030 con 0x7f5f48075c70 2024-09-21T02:25:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.897+0000 7f5f44c00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.897+0000 7f5f44c00640 1 -- 172.21.15.79:0/175894529 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f38105f10 con 0x7f5f48075c70 2024-09-21T02:25:49.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.897+0000 7f5f47400640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:49.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.898+0000 7f5f47400640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009fc0 tx=0x7f5f30005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:49.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:49.899+0000 7f5f44c00640 1 -- 172.21.15.79:0/175894529 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f380d27b0 con 0x7f5f48075c70 2024-09-21T02:25:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:49 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:49 smithi098 ceph-mon[34832]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:50.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.117+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f5f4802e640 con 0x7f5f48075c70 2024-09-21T02:25:50.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.124+0000 7f5f44c00640 1 -- 172.21.15.79:0/175894529 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v27)=0 v27) ==== 127+0+0 (secure 0 0 0) 0x7f5f380d76f0 con 0x7f5f48075c70 2024-09-21T02:25:50.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5f2c0b6480 msgr2=0x7f5f2c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:50.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009fc0 tx=0x7f5f30005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:50.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48075c70 msgr2=0x7f5f4819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:50.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48075c70 0x7f5f4819c230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5f38006010 tx=0x7f5f380042f0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 shutdown_connections 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4810b770 0x7f5f4819d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f48077060 0x7f5f4819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 --2- 172.21.15.79:0/175894529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48075c70 0x7f5f4819c230 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 >> 172.21.15.79:0/175894529 conn(0x7f5f480ff0c0 msgr2=0x7f5f48107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 shutdown_connections 2024-09-21T02:25:50.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:50.126+0000 7f5f4ea00640 1 -- 172.21.15.79:0/175894529 wait complete. 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 -- 172.21.15.79:0/3026711534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4881073b0 msgr2=0x7fc48810dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 --2- 172.21.15.79:0/3026711534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4881073b0 0x7fc48810dd50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc480009ca0 tx=0x7fc48002a950 comp rx=0 tx=0).stop 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 -- 172.21.15.79:0/3026711534 shutdown_connections 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 --2- 172.21.15.79:0/3026711534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4881073b0 0x7fc48810dd50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 --2- 172.21.15.79:0/3026711534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc488106a10 0x7fc488106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 --2- 172.21.15.79:0/3026711534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc488105980 0x7fc488105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 -- 172.21.15.79:0/3026711534 >> 172.21.15.79:0/3026711534 conn(0x7fc4881012f0 msgr2=0x7fc4881037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 -- 172.21.15.79:0/3026711534 shutdown_connections 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.310+0000 7fc48d400640 1 -- 172.21.15.79:0/3026711534 wait complete. 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 Processor -- start 2024-09-21T02:25:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 -- start start 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488105980 0x7fc48819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc488106a10 0x7fc48819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4881073b0 0x7fc48819d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881115d0 con 0x7fc488105980 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc488111450 con 0x7fc488106a10 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.311+0000 7fc48d400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc488111750 con 0x7fc4881073b0 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc486800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488105980 0x7fc48819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4881073b0 0x7fc48819d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4881073b0 0x7fc48819d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:36882/0 (socket says 172.21.15.79:36882) 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 -- 172.21.15.79:0/1229815150 learned_addr learned my addr 172.21.15.79:0/1229815150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc485e00640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc488106a10 0x7fc48819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 -- 172.21.15.79:0/1229815150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc488106a10 msgr2=0x7fc48819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:50.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc488106a10 0x7fc48819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 -- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488105980 msgr2=0x7fc48819c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488105980 0x7fc48819c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 -- 172.21.15.79:0/1229815150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48819dbc0 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.312+0000 7fc487200640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4881073b0 0x7fc48819d3a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc480006010 tx=0x7fc48002fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.313+0000 7fc47f400640 1 -- 172.21.15.79:0/1229815150 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480034040 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.313+0000 7fc47f400640 1 -- 172.21.15.79:0/1229815150 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4800308f0 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.313+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48819de50 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.313+0000 7fc47f400640 1 -- 172.21.15.79:0/1229815150 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480039450 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.313+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4881a43e0 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.314+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48810cb60 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.316+0000 7fc47f400640 1 -- 172.21.15.79:0/1229815150 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fc480037020 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.317+0000 7fc47f400640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc46c0b6480 0x7fc46c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.318+0000 7fc47f400640 1 -- 172.21.15.79:0/1229815150 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc4801068f0 con 0x7fc4881073b0 2024-09-21T02:25:50.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.318+0000 7fc486800640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc46c0b6480 0x7fc46c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.318+0000 7fc486800640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc46c0b6480 0x7fc46c0b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc478009bd0 tx=0x7fc478005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.320+0000 7fc47f400640 1 -- 172.21.15.79:0/1229815150 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4800cee40 con 0x7fc4881073b0 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.520+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fc48802e640 con 0x7fc4881073b0 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.526+0000 7fc47f400640 1 -- 172.21.15.79:0/1229815150 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fc480030ac0 con 0x7fc4881073b0 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc46c0b6480 msgr2=0x7fc46c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc46c0b6480 0x7fc46c0b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc478009bd0 tx=0x7fc478005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4881073b0 msgr2=0x7fc48819d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4881073b0 0x7fc48819d3a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc480006010 tx=0x7fc48002fc20 comp rx=0 tx=0).stop 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 shutdown_connections 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc46c0b6480 0x7fc46c0b8990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4881073b0 0x7fc48819d3a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc488106a10 0x7fc48819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 --2- 172.21.15.79:0/1229815150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc488105980 0x7fc48819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 >> 172.21.15.79:0/1229815150 conn(0x7fc4881012f0 msgr2=0x7fc488109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 shutdown_connections 2024-09-21T02:25:50.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:48.528+0000 7fc48d400640 1 -- 172.21.15.79:0/1229815150 wait complete. 2024-09-21T02:25:51.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:51 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:51.423 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:51 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:51.438 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:51.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:51 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:52.036 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:52.037 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:52.388 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:52 smithi079 ceph-mon[30788]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:52.388 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.388 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.388 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:52.389 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:52.389 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:52.389 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:52 smithi098 ceph-mon[34832]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:52.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:52.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:52.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:52.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:52 smithi148 ceph-mon[34626]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:52.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 -- 172.21.15.79:0/541348808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658106820 msgr2=0x7fa658106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:52.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 --2- 172.21.15.79:0/541348808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658106820 0x7fa658106c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa640009900 tx=0x7fa64002a480 comp rx=0 tx=0).stop 2024-09-21T02:25:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 -- 172.21.15.79:0/541348808 shutdown_connections 2024-09-21T02:25:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 --2- 172.21.15.79:0/541348808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6581071c0 0x7fa65810db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 --2- 172.21.15.79:0/541348808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658106820 0x7fa658106c30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 --2- 172.21.15.79:0/541348808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa658105790 0x7fa658105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 -- 172.21.15.79:0/541348808 >> 172.21.15.79:0/541348808 conn(0x7fa6581010e0 msgr2=0x7fa6581035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 -- 172.21.15.79:0/541348808 shutdown_connections 2024-09-21T02:25:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.907+0000 7fa657200640 1 -- 172.21.15.79:0/541348808 wait complete. 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.908+0000 7fa657200640 1 Processor -- start 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.908+0000 7fa657200640 1 -- start start 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.908+0000 7fa657200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658105790 0x7fa65819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa657200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa658106820 0x7fa65819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa657200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6581071c0 0x7fa65819d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa657200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6581113c0 con 0x7fa658105790 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa657200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa658111240 con 0x7fa6581071c0 2024-09-21T02:25:52.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa657200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa658111540 con 0x7fa658106820 2024-09-21T02:25:52.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658105790 0x7fa65819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:52.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658105790 0x7fa65819bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35378/0 (socket says 172.21.15.79:35378) 2024-09-21T02:25:52.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 -- 172.21.15.79:0/116159983 learned_addr learned my addr 172.21.15.79:0/116159983 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:52.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa64fe00640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa658106820 0x7fa65819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:52.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa656800640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6581071c0 0x7fa65819d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:52.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 -- 172.21.15.79:0/116159983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa658106820 msgr2=0x7fa65819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa658106820 0x7fa65819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 -- 172.21.15.79:0/116159983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6581071c0 msgr2=0x7fa65819d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6581071c0 0x7fa65819d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.909+0000 7fa655e00640 1 -- 172.21.15.79:0/116159983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65819da20 con 0x7fa658105790 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.910+0000 7fa655e00640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658105790 0x7fa65819bff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa64800d950 tx=0x7fa64800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.910+0000 7fa64ea00640 1 -- 172.21.15.79:0/116159983 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648017030 con 0x7fa658105790 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.910+0000 7fa64ea00640 1 -- 172.21.15.79:0/116159983 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa648004020 con 0x7fa658105790 2024-09-21T02:25:52.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.910+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65819dd10 con 0x7fa658105790 2024-09-21T02:25:52.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.910+0000 7fa64ea00640 1 -- 172.21.15.79:0/116159983 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480047a0 con 0x7fa658105790 2024-09-21T02:25:52.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.910+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6581a4410 con 0x7fa658105790 2024-09-21T02:25:52.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.911+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65810c970 con 0x7fa658105790 2024-09-21T02:25:52.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.914+0000 7fa64ea00640 1 -- 172.21.15.79:0/116159983 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fa648009a30 con 0x7fa658105790 2024-09-21T02:25:52.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.915+0000 7fa64ea00640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa63c0b6480 0x7fa63c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:52.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.915+0000 7fa64ea00640 1 -- 172.21.15.79:0/116159983 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa6480e5710 con 0x7fa658105790 2024-09-21T02:25:52.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.915+0000 7fa64fe00640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa63c0b6480 0x7fa63c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:52.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.916+0000 7fa64fe00640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa63c0b6480 0x7fa63c0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c00 tx=0x7fa640031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:52.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:52.917+0000 7fa64ea00640 1 -- 172.21.15.79:0/116159983 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6480adbd0 con 0x7fa658105790 2024-09-21T02:25:53.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.111+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fa65802e640 con 0x7fa658105790 2024-09-21T02:25:53.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.112+0000 7fa64ea00640 1 -- 172.21.15.79:0/116159983 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v27)=0 v27) ==== 108+0+0 (secure 0 0 0) 0x7fa6480b1fb0 con 0x7fa658105790 2024-09-21T02:25:53.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa63c0b6480 msgr2=0x7fa63c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:53.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa63c0b6480 0x7fa63c0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c00 tx=0x7fa640031400 comp rx=0 tx=0).stop 2024-09-21T02:25:53.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658105790 msgr2=0x7fa65819bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:53.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658105790 0x7fa65819bff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa64800d950 tx=0x7fa64800de10 comp rx=0 tx=0).stop 2024-09-21T02:25:53.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 shutdown_connections 2024-09-21T02:25:53.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa63c0b6480 0x7fa63c0b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:53.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6581071c0 0x7fa65819d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:53.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa658106820 0x7fa65819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:53.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 --2- 172.21.15.79:0/116159983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa658105790 0x7fa65819bff0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:53.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 >> 172.21.15.79:0/116159983 conn(0x7fa6581010e0 msgr2=0x7fa658109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:53.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 shutdown_connections 2024-09-21T02:25:53.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:53.114+0000 7fa657200640 1 -- 172.21.15.79:0/116159983 wait complete. 2024-09-21T02:25:53.801 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-09-21T02:25:53.801 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi079') 2024-09-21T02:25:53.801 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi079') 2024-09-21T02:25:53.801 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi079') 2024-09-21T02:25:53.802 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi079') 2024-09-21T02:25:54.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:54 smithi079 ceph-mon[30788]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:54.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 -- 172.21.15.79:0/1807610296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c103760 msgr2=0x7f685c103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:54.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 --2- 172.21.15.79:0/1807610296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c103760 0x7f685c103bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f684c009900 tx=0x7f684c02a480 comp rx=0 tx=0).stop 2024-09-21T02:25:54.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 -- 172.21.15.79:0/1807610296 shutdown_connections 2024-09-21T02:25:54.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 --2- 172.21.15.79:0/1807610296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f685c105190 0x7f685c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 --2- 172.21.15.79:0/1807610296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f685c1047f0 0x7f685c104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 --2- 172.21.15.79:0/1807610296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c103760 0x7f685c103bd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 -- 172.21.15.79:0/1807610296 >> 172.21.15.79:0/1807610296 conn(0x7f685c0ff0b0 msgr2=0x7f685c101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 -- 172.21.15.79:0/1807610296 shutdown_connections 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.596+0000 7f6861400640 1 -- 172.21.15.79:0/1807610296 wait complete. 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.597+0000 7f6861400640 1 Processor -- start 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.597+0000 7f6861400640 1 -- start start 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f6861400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f685c103760 0x7f685c19c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f6861400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f685c1047f0 0x7f685c19c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f6861400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c105190 0x7f685c19d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f6861400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f685c10f3d0 con 0x7f685c105190 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f6861400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f685c10f250 con 0x7f685c1047f0 2024-09-21T02:25:54.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f6861400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f685c10f550 con 0x7f685c103760 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c105190 0x7f685c19d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c105190 0x7f685c19d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57636/0 (socket says 172.21.15.79:57636) 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 -- 172.21.15.79:0/1146036585 learned_addr learned my addr 172.21.15.79:0/1146036585 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685a800640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f685c103760 0x7f685c19c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f6859e00640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f685c1047f0 0x7f685c19c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 -- 172.21.15.79:0/1146036585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f685c103760 msgr2=0x7f685c19c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f685c103760 0x7f685c19c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 -- 172.21.15.79:0/1146036585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f685c1047f0 msgr2=0x7f685c19c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f685c1047f0 0x7f685c19c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.598+0000 7f685b200640 1 -- 172.21.15.79:0/1146036585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c19dbf0 con 0x7f685c105190 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.599+0000 7f685b200640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c105190 0x7f685c19d3d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f685400eaa0 tx=0x7f685400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.599+0000 7f6853400640 1 -- 172.21.15.79:0/1146036585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685400cdb0 con 0x7f685c105190 2024-09-21T02:25:54.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.599+0000 7f6853400640 1 -- 172.21.15.79:0/1146036585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6854005020 con 0x7f685c105190 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.599+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685c19dee0 con 0x7f685c105190 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.599+0000 7f6853400640 1 -- 172.21.15.79:0/1146036585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540116d0 con 0x7f685c105190 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.599+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685c1a45e0 con 0x7f685c105190 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.600+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683c0052c0 con 0x7f685c105190 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.604+0000 7f6853400640 1 -- 172.21.15.79:0/1146036585 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f6854004a40 con 0x7f685c105190 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.606+0000 7f6853400640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68400b6580 0x7f68400b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.606+0000 7f6853400640 1 -- 172.21.15.79:0/1146036585 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f68540e5a70 con 0x7f685c105190 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.606+0000 7f685a800640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68400b6580 0x7f68400b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.607+0000 7f685a800640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68400b6580 0x7f68400b8a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f684c004770 tx=0x7f684c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:54.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.608+0000 7f6853400640 1 -- 172.21.15.79:0/1146036585 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6854016030 con 0x7f685c105190 2024-09-21T02:25:54.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:54 smithi098 ceph-mon[34832]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:54.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.798+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f683c0055b0 con 0x7f685c105190 2024-09-21T02:25:54.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.805+0000 7f6853400640 1 -- 172.21.15.79:0/1146036585 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7f68540b2390 con 0x7f685c105190 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.808+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68400b6580 msgr2=0x7f68400b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.808+0000 7f6861400640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68400b6580 0x7f68400b8a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f684c004770 tx=0x7f684c0314a0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.808+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c105190 msgr2=0x7f685c19d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.808+0000 7f6861400640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c105190 0x7f685c19d3d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f685400eaa0 tx=0x7f685400ef60 comp rx=0 tx=0).stop 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 shutdown_connections 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68400b6580 0x7f68400b8a90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c105190 0x7f685c19d3d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f685c1047f0 0x7f685c19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 --2- 172.21.15.79:0/1146036585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f685c103760 0x7f685c19c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 >> 172.21.15.79:0/1146036585 conn(0x7f685c0ff0b0 msgr2=0x7f685c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:54.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 shutdown_connections 2024-09-21T02:25:54.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.809+0000 7f6861400640 1 -- 172.21.15.79:0/1146036585 wait complete. 2024-09-21T02:25:54.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:54 smithi148 ceph-mon[34626]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:54.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 -- 172.21.15.79:0/59994994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e9010b750 msgr2=0x7f2e9010db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 --2- 172.21.15.79:0/59994994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e9010b750 0x7f2e9010db90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009ca0 tx=0x7f2e8802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 -- 172.21.15.79:0/59994994 shutdown_connections 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 --2- 172.21.15.79:0/59994994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e9010b750 0x7f2e9010db90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 --2- 172.21.15.79:0/59994994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e90075c90 0x7f2e900760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 --2- 172.21.15.79:0/59994994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e90077080 0x7f2e90075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 -- 172.21.15.79:0/59994994 >> 172.21.15.79:0/59994994 conn(0x7f2e900ff0c0 msgr2=0x7f2e90101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 -- 172.21.15.79:0/59994994 shutdown_connections 2024-09-21T02:25:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.947+0000 7f2e97000640 1 -- 172.21.15.79:0/59994994 wait complete. 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.948+0000 7f2e97000640 1 Processor -- start 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e97000640 1 -- start start 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e97000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e90075c90 0x7f2e9019c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e97000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e90077080 0x7f2e9019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e97000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9010b750 0x7f2e9019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e97000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901115e0 con 0x7f2e9010b750 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e97000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90111460 con 0x7f2e90075c90 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e97000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90111760 con 0x7f2e90077080 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e90075c90 0x7f2e9019c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e90075c90 0x7f2e9019c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58704/0 (socket says 172.21.15.79:58704) 2024-09-21T02:25:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e8fe00640 1 -- 172.21.15.79:0/558879273 learned_addr learned my addr 172.21.15.79:0/558879273 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e95000640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9010b750 0x7f2e9019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.949+0000 7f2e8f400640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e90077080 0x7f2e9019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8fe00640 1 -- 172.21.15.79:0/558879273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e90077080 msgr2=0x7f2e9019c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8fe00640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e90077080 0x7f2e9019c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8fe00640 1 -- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9010b750 msgr2=0x7f2e9019d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8fe00640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9010b750 0x7f2e9019d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8fe00640 1 -- 172.21.15.79:0/558879273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9019dbd0 con 0x7f2e90075c90 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8f400640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e90077080 0x7f2e9019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8fe00640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e90075c90 0x7f2e9019c1a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000e9f0 tx=0x7f2e8000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8cc00640 1 -- 172.21.15.79:0/558879273 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000cd80 con 0x7f2e90075c90 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8cc00640 1 -- 172.21.15.79:0/558879273 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e800054d0 con 0x7f2e90075c90 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e8cc00640 1 -- 172.21.15.79:0/558879273 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80010690 con 0x7f2e90075c90 2024-09-21T02:25:55.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9019dec0 con 0x7f2e90075c90 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.950+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e901a45c0 con 0x7f2e90075c90 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.951+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e90109e50 con 0x7f2e90075c90 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.954+0000 7f2e8cc00640 1 -- 172.21.15.79:0/558879273 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f2e80004e90 con 0x7f2e90075c90 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.955+0000 7f2e8cc00640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e740b6480 0x7f2e740b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.955+0000 7f2e8cc00640 1 -- 172.21.15.79:0/558879273 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2e800e5f10 con 0x7f2e90075c90 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.955+0000 7f2e8f400640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e740b6480 0x7f2e740b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.956+0000 7f2e8f400640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e740b6480 0x7f2e740b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009c20 tx=0x7f2e7c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:54.957+0000 7f2e8cc00640 1 -- 172.21.15.79:0/558879273 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e800ae3d0 con 0x7f2e90075c90 2024-09-21T02:25:55.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 -- 172.21.15.79:0/1572563555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 msgr2=0x7f889c104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 --2- 172.21.15.79:0/1572563555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c104a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8888009900 tx=0x7f888802a480 comp rx=0 tx=0).stop 2024-09-21T02:25:55.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 -- 172.21.15.79:0/1572563555 shutdown_connections 2024-09-21T02:25:55.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 --2- 172.21.15.79:0/1572563555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f889c104fa0 0x7f889c10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 --2- 172.21.15.79:0/1572563555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c104a10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 --2- 172.21.15.79:0/1572563555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c103570 0x7f889c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 -- 172.21.15.79:0/1572563555 >> 172.21.15.79:0/1572563555 conn(0x7f889c0feec0 msgr2=0x7f889c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:55.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 -- 172.21.15.79:0/1572563555 shutdown_connections 2024-09-21T02:25:55.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.138+0000 7f88a1200640 1 -- 172.21.15.79:0/1572563555 wait complete. 2024-09-21T02:25:55.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.139+0000 7f88a1200640 1 Processor -- start 2024-09-21T02:25:55.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f88a1200640 1 -- start start 2024-09-21T02:25:55.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f88a1200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f889c103570 0x7f889c199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f88a1200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f88a1200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c104fa0 0x7f889c19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f88a1200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f889c10f1a0 con 0x7f889c104600 2024-09-21T02:25:55.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f88a1200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f889c10f020 con 0x7f889c104fa0 2024-09-21T02:25:55.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f88a1200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f889c10f320 con 0x7f889c103570 2024-09-21T02:25:55.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.140+0000 7f889aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f889c103570 0x7f889c199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c104fa0 0x7f889c19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c104fa0 0x7f889c19b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58728/0 (socket says 172.21.15.79:58728) 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57680/0 (socket says 172.21.15.79:57680) 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 -- 172.21.15.79:0/197329344 learned_addr learned my addr 172.21.15.79:0/197329344 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 -- 172.21.15.79:0/197329344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f889c103570 msgr2=0x7f889c199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f889c103570 0x7f889c199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 -- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 msgr2=0x7f889c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 -- 172.21.15.79:0/197329344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c19b830 con 0x7f889c104fa0 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889b400640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f889c103570 0x7f889c199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889aa00640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.141+0000 7f889be00640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c104fa0 0x7f889c19b010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f889400eb10 tx=0x7f889400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.142+0000 7f8893e00640 1 -- 172.21.15.79:0/197329344 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894004b20 con 0x7f889c104fa0 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.142+0000 7f8893e00640 1 -- 172.21.15.79:0/197329344 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8894004cc0 con 0x7f889c104fa0 2024-09-21T02:25:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.142+0000 7f8893e00640 1 -- 172.21.15.79:0/197329344 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894010670 con 0x7f889c104fa0 2024-09-21T02:25:55.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.142+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c19bb20 con 0x7f889c104fa0 2024-09-21T02:25:55.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.142+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1a2220 con 0x7f889c104fa0 2024-09-21T02:25:55.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.144+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c10a750 con 0x7f889c104fa0 2024-09-21T02:25:55.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.146+0000 7f8893e00640 1 -- 172.21.15.79:0/197329344 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f8894005020 con 0x7f889c104fa0 2024-09-21T02:25:55.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.148+0000 7f8893e00640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88800b6500 0x7f88800b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:55.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.148+0000 7f8893e00640 1 -- 172.21.15.79:0/197329344 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f88940e5ca0 con 0x7f889c104fa0 2024-09-21T02:25:55.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.148+0000 7f889b400640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88800b6500 0x7f88800b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:55.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.149+0000 7f889b400640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88800b6500 0x7f88800b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f888c009c20 tx=0x7f888c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:55.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.151+0000 7f8893e00640 1 -- 172.21.15.79:0/197329344 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88940ae160 con 0x7f889c104fa0 2024-09-21T02:25:55.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.163+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2e9002e640 con 0x7f2e90075c90 2024-09-21T02:25:55.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.170+0000 7f2e8cc00640 1 -- 172.21.15.79:0/558879273 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f2e800b27b0 con 0x7f2e90075c90 2024-09-21T02:25:55.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e740b6480 msgr2=0x7f2e740b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e740b6480 0x7f2e740b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009c20 tx=0x7f2e7c005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:55.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e90075c90 msgr2=0x7f2e9019c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e90075c90 0x7f2e9019c1a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000e9f0 tx=0x7f2e8000edf0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 shutdown_connections 2024-09-21T02:25:55.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e740b6480 0x7f2e740b8990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9010b750 0x7f2e9019d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e90077080 0x7f2e9019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 --2- 172.21.15.79:0/558879273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e90075c90 0x7f2e9019c1a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 >> 172.21.15.79:0/558879273 conn(0x7f2e900ff0c0 msgr2=0x7f2e90101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:55.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 shutdown_connections 2024-09-21T02:25:55.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.173+0000 7f2e97000640 1 -- 172.21.15.79:0/558879273 wait complete. 2024-09-21T02:25:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.361+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f889c02e640 con 0x7f889c104fa0 2024-09-21T02:25:55.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.368+0000 7f8893e00640 1 -- 172.21.15.79:0/197329344 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f88940b2540 con 0x7f889c104fa0 2024-09-21T02:25:55.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88800b6500 msgr2=0x7f88800b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88800b6500 0x7f88800b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f888c009c20 tx=0x7f888c005f90 comp rx=0 tx=0).stop 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c104fa0 msgr2=0x7f889c19b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c104fa0 0x7f889c19b010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f889400eb10 tx=0x7f889400c2d0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 shutdown_connections 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88800b6500 0x7f88800b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f889c104fa0 0x7f889c19b010 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889c104600 0x7f889c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 --2- 172.21.15.79:0/197329344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f889c103570 0x7f889c199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 >> 172.21.15.79:0/197329344 conn(0x7f889c0feec0 msgr2=0x7f889c107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 shutdown_connections 2024-09-21T02:25:55.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.370+0000 7f88a1200640 1 -- 172.21.15.79:0/197329344 wait complete. 2024-09-21T02:25:55.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi079') 2024-09-21T02:25:55.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi079') 2024-09-21T02:25:55.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi079') 2024-09-21T02:25:55.780 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi079') 2024-09-21T02:25:55.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1146036585' entity='client.admin' 2024-09-21T02:25:55.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:55.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1146036585' entity='client.admin' 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:56.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:56.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:56.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:56.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:56.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1146036585' entity='client.admin' 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:56.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:56.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:25:56.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:25:56.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:25:56.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.413+0000 7f0066000640 1 -- 172.21.15.79:0/757818909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 msgr2=0x7f0060104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.413+0000 7f0066000640 1 --2- 172.21.15.79:0/757818909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 0x7f0060104c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c02a480 comp rx=0 tx=0).stop 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.413+0000 7f0066000640 1 -- 172.21.15.79:0/757818909 shutdown_connections 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.413+0000 7f0066000640 1 --2- 172.21.15.79:0/757818909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060105190 0x7f006010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.413+0000 7f0066000640 1 --2- 172.21.15.79:0/757818909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 0x7f0060104c00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.413+0000 7f0066000640 1 --2- 172.21.15.79:0/757818909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0060103760 0x7f0060103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.414+0000 7f0066000640 1 -- 172.21.15.79:0/757818909 >> 172.21.15.79:0/757818909 conn(0x7f00600ff0b0 msgr2=0x7f0060101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.414+0000 7f0066000640 1 -- 172.21.15.79:0/757818909 shutdown_connections 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.414+0000 7f0066000640 1 -- 172.21.15.79:0/757818909 wait complete. 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 Processor -- start 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 -- start start 2024-09-21T02:25:56.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060103760 0x7f0060199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 0x7f006019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0060105190 0x7f006019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f006010f3e0 con 0x7f00601047f0 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f006010f260 con 0x7f0060103760 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.415+0000 7f0066000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f006010f560 con 0x7f0060105190 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060103760 0x7f0060199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060103760 0x7f0060199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58740/0 (socket says 172.21.15.79:58740) 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 -- 172.21.15.79:0/835849868 learned_addr learned my addr 172.21.15.79:0/835849868 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005ea00640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 0x7f006019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005fe00640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0060105190 0x7f006019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 -- 172.21.15.79:0/835849868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0060105190 msgr2=0x7f006019b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0060105190 0x7f006019b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 -- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 msgr2=0x7f006019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 0x7f006019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 -- 172.21.15.79:0/835849868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006019ba00 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005fe00640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0060105190 0x7f006019b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005ea00640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 0x7f006019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.416+0000 7f005f400640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060103760 0x7f0060199fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f005000d950 tx=0x7f005000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.417+0000 7f0057e00640 1 -- 172.21.15.79:0/835849868 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050017030 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.417+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006019bcf0 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.417+0000 7f0057e00640 1 -- 172.21.15.79:0/835849868 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0050004020 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.417+0000 7f0057e00640 1 -- 172.21.15.79:0/835849868 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00500047a0 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.417+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00600757c0 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.418+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0060103bd0 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.420+0000 7f0057e00640 1 -- 172.21.15.79:0/835849868 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f0050009a30 con 0x7f0060103760 2024-09-21T02:25:56.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.421+0000 7f0057e00640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f00440b6480 0x7f00440b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.422+0000 7f0057e00640 1 -- 172.21.15.79:0/835849868 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f00500e5390 con 0x7f0060103760 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.422+0000 7f005ea00640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f00440b6480 0x7f00440b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.422+0000 7f005ea00640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f00440b6480 0x7f00440b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.424+0000 7f0057e00640 1 -- 172.21.15.79:0/835849868 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00500ad850 con 0x7f0060103760 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.614+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f006010a920 con 0x7f0060103760 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.620+0000 7f0057e00640 1 -- 172.21.15.79:0/835849868 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v31)=0 v31) ==== 111+0+0 (secure 0 0 0) 0x7f00500b1c30 con 0x7f0060103760 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f00440b6480 msgr2=0x7f00440b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f00440b6480 0x7f00440b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c031400 comp rx=0 tx=0).stop 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060103760 msgr2=0x7f0060199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060103760 0x7f0060199fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f005000d950 tx=0x7f005000de10 comp rx=0 tx=0).stop 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 shutdown_connections 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f00440b6480 0x7f00440b8990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0060105190 0x7f006019b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601047f0 0x7f006019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 --2- 172.21.15.79:0/835849868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0060103760 0x7f0060199fd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:56.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.622+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 >> 172.21.15.79:0/835849868 conn(0x7f00600ff0b0 msgr2=0x7f0060107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:56.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.623+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 shutdown_connections 2024-09-21T02:25:56.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:55.623+0000 7f0066000640 1 -- 172.21.15.79:0/835849868 wait complete. 2024-09-21T02:25:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.297+0000 7f28eb800640 1 -- 172.21.15.79:0/3873989407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4077c10 msgr2=0x7f28e4078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.297+0000 7f28eb800640 1 --2- 172.21.15.79:0/3873989407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4077c10 0x7f28e4078080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009900 tx=0x7f28d802a480 comp rx=0 tx=0).stop 2024-09-21T02:25:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.298+0000 7f28eb800640 1 -- 172.21.15.79:0/3873989407 shutdown_connections 2024-09-21T02:25:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.298+0000 7f28eb800640 1 --2- 172.21.15.79:0/3873989407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4079640 0x7f28e4079fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.298+0000 7f28eb800640 1 --2- 172.21.15.79:0/3873989407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e4078ca0 0x7f28e40790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.298+0000 7f28eb800640 1 --2- 172.21.15.79:0/3873989407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4077c10 0x7f28e4078080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.298+0000 7f28eb800640 1 -- 172.21.15.79:0/3873989407 >> 172.21.15.79:0/3873989407 conn(0x7f28e41012f0 msgr2=0x7f28e41037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.298+0000 7f28eb800640 1 -- 172.21.15.79:0/3873989407 shutdown_connections 2024-09-21T02:25:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.298+0000 7f28eb800640 1 -- 172.21.15.79:0/3873989407 wait complete. 2024-09-21T02:25:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.299+0000 7f28eb800640 1 Processor -- start 2024-09-21T02:25:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.299+0000 7f28eb800640 1 -- start start 2024-09-21T02:25:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28eb800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4077c10 0x7f28e41a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28eb800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e4078ca0 0x7f28e41a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28eb800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4079640 0x7f28e41a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28eb800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4115a50 con 0x7f28e4079640 2024-09-21T02:25:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28eb800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41158d0 con 0x7f28e4077c10 2024-09-21T02:25:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28eb800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4115bd0 con 0x7f28e4078ca0 2024-09-21T02:25:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28e9800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4079640 0x7f28e41a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4077c10 0x7f28e41a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28e8e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4077c10 0x7f28e41a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58746/0 (socket says 172.21.15.79:58746) 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28e8e00640 1 -- 172.21.15.79:0/1695577385 learned_addr learned my addr 172.21.15.79:0/1695577385 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.300+0000 7f28e3e00640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e4078ca0 0x7f28e41a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e8e00640 1 -- 172.21.15.79:0/1695577385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e4078ca0 msgr2=0x7f28e41a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e8e00640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e4078ca0 0x7f28e41a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e8e00640 1 -- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4079640 msgr2=0x7f28e41a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e8e00640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4079640 0x7f28e41a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e8e00640 1 -- 172.21.15.79:0/1695577385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e41a2040 con 0x7f28e4077c10 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e8e00640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4077c10 0x7f28e41a0610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f28d8031440 tx=0x7f28d8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e1600640 1 -- 172.21.15.79:0/1695577385 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d803f070 con 0x7f28e4077c10 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e1600640 1 -- 172.21.15.79:0/1695577385 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28d8031c50 con 0x7f28e4077c10 2024-09-21T02:25:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e41a22d0 con 0x7f28e4077c10 2024-09-21T02:25:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.301+0000 7f28e1600640 1 -- 172.21.15.79:0/1695577385 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8035030 con 0x7f28e4077c10 2024-09-21T02:25:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.302+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41a8860 con 0x7f28e4077c10 2024-09-21T02:25:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.303+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e41124b0 con 0x7f28e4077c10 2024-09-21T02:25:57.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.305+0000 7f28e1600640 1 -- 172.21.15.79:0/1695577385 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f28d8042070 con 0x7f28e4077c10 2024-09-21T02:25:57.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.306+0000 7f28e1600640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28cc0b6480 0x7f28cc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:57.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.307+0000 7f28e1600640 1 -- 172.21.15.79:0/1695577385 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f28d8106600 con 0x7f28e4077c10 2024-09-21T02:25:57.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.307+0000 7f28e3e00640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28cc0b6480 0x7f28cc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:57.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.307+0000 7f28e3e00640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28cc0b6480 0x7f28cc0b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28d000bbe0 tx=0x7f28d000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:57.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.308+0000 7f28e1600640 1 -- 172.21.15.79:0/1695577385 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28d80d2ea0 con 0x7f28e4077c10 2024-09-21T02:25:57.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.508+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f28e402e640 con 0x7f28e4077c10 2024-09-21T02:25:57.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.514+0000 7f28e1600640 1 -- 172.21.15.79:0/1695577385 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v32)=0 v32) ==== 115+0+0 (secure 0 0 0) 0x7f28d80d7de0 con 0x7f28e4077c10 2024-09-21T02:25:57.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28cc0b6480 msgr2=0x7f28cc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:57.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28cc0b6480 0x7f28cc0b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28d000bbe0 tx=0x7f28d000b390 comp rx=0 tx=0).stop 2024-09-21T02:25:57.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4077c10 msgr2=0x7f28e41a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:57.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4077c10 0x7f28e41a0610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f28d8031440 tx=0x7f28d8003c10 comp rx=0 tx=0).stop 2024-09-21T02:25:57.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 shutdown_connections 2024-09-21T02:25:57.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28cc0b6480 0x7f28cc0b8990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28e4079640 0x7f28e41a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e4078ca0 0x7f28e41a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 --2- 172.21.15.79:0/1695577385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28e4077c10 0x7f28e41a0610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:57.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 >> 172.21.15.79:0/1695577385 conn(0x7f28e41012f0 msgr2=0x7f28e4103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:57.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 shutdown_connections 2024-09-21T02:25:57.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:57.517+0000 7f28eb800640 1 -- 172.21.15.79:0/1695577385 wait complete. 2024-09-21T02:25:58.306 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:25:58.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:58 smithi148 ceph-mon[34626]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:58.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:58 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:25:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 -- 172.21.15.79:0/3246043655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb58105980 msgr2=0x7ffb58105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/3246043655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb58105980 0x7ffb58105df0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009900 tx=0x7ffb4802a480 comp rx=0 tx=0).stop 2024-09-21T02:25:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 -- 172.21.15.79:0/3246043655 shutdown_connections 2024-09-21T02:25:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/3246043655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb581073b0 0x7ffb5810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/3246043655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb58106a10 0x7ffb58106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/3246043655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb58105980 0x7ffb58105df0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 -- 172.21.15.79:0/3246043655 >> 172.21.15.79:0/3246043655 conn(0x7ffb581012f0 msgr2=0x7ffb581037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 -- 172.21.15.79:0/3246043655 shutdown_connections 2024-09-21T02:25:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.588+0000 7ffb5ea00640 1 -- 172.21.15.79:0/3246043655 wait complete. 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 Processor -- start 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 -- start start 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb58105980 0x7ffb5819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb58106a10 0x7ffb5819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb581073b0 0x7ffb5819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb58111610 con 0x7ffb581073b0 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb58111490 con 0x7ffb58106a10 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.589+0000 7ffb5ea00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffb58111790 con 0x7ffb58105980 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb57e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb58105980 0x7ffb5819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:58.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb4f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb58106a10 0x7ffb5819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:58.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb5ca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb581073b0 0x7ffb5819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:58.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb57e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb58105980 0x7ffb5819c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58808/0 (socket says 172.21.15.79:58808) 2024-09-21T02:25:58.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb57e00640 1 -- 172.21.15.79:0/1135164825 learned_addr learned my addr 172.21.15.79:0/1135164825 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb4f400640 1 -- 172.21.15.79:0/1135164825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb58105980 msgr2=0x7ffb5819c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb4f400640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb58105980 0x7ffb5819c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb4f400640 1 -- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb581073b0 msgr2=0x7ffb5819d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb4f400640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb581073b0 0x7ffb5819d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb4f400640 1 -- 172.21.15.79:0/1135164825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5819dc30 con 0x7ffb58106a10 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb57e00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb58105980 0x7ffb5819c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.590+0000 7ffb5ca00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb581073b0 0x7ffb5819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:25:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.591+0000 7ffb4f400640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb58106a10 0x7ffb5819c870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000e9f0 tx=0x7ffb4000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:58.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.591+0000 7ffb55600640 1 -- 172.21.15.79:0/1135164825 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000ccc0 con 0x7ffb58106a10 2024-09-21T02:25:58.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.591+0000 7ffb55600640 1 -- 172.21.15.79:0/1135164825 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb400108e0 con 0x7ffb58106a10 2024-09-21T02:25:58.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.591+0000 7ffb55600640 1 -- 172.21.15.79:0/1135164825 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40018880 con 0x7ffb58106a10 2024-09-21T02:25:58.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.591+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5819df20 con 0x7ffb58106a10 2024-09-21T02:25:58.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.591+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb581a4620 con 0x7ffb58106a10 2024-09-21T02:25:58.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.592+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb58105df0 con 0x7ffb58106a10 2024-09-21T02:25:58.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.594+0000 7ffb55600640 1 -- 172.21.15.79:0/1135164825 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7ffb40010430 con 0x7ffb58106a10 2024-09-21T02:25:58.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.596+0000 7ffb55600640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb3c0b6480 0x7ffb3c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:25:58.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.596+0000 7ffb55600640 1 -- 172.21.15.79:0/1135164825 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffb400e5c10 con 0x7ffb58106a10 2024-09-21T02:25:58.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.596+0000 7ffb57e00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb3c0b6480 0x7ffb3c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:25:58.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.597+0000 7ffb57e00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb3c0b6480 0x7ffb3c0b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb48005f70 tx=0x7ffb480314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:25:58.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.598+0000 7ffb55600640 1 -- 172.21.15.79:0/1135164825 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb400b24b0 con 0x7ffb58106a10 2024-09-21T02:25:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:58 smithi098 ceph-mon[34832]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:58 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:25:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:58 smithi079 ceph-mon[30788]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:25:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:58 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:25:58.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.787+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7ffb5802e640 con 0x7ffb58106a10 2024-09-21T02:25:58.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.795+0000 7ffb55600640 1 -- 172.21.15.79:0/1135164825 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7ffb400b73f0 con 0x7ffb58106a10 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb3c0b6480 msgr2=0x7ffb3c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb3c0b6480 0x7ffb3c0b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb48005f70 tx=0x7ffb480314a0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb58106a10 msgr2=0x7ffb5819c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb58106a10 0x7ffb5819c870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000e9f0 tx=0x7ffb4000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 shutdown_connections 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb3c0b6480 0x7ffb3c0b8990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb581073b0 0x7ffb5819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb58106a10 0x7ffb5819c870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 --2- 172.21.15.79:0/1135164825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb58105980 0x7ffb5819c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:25:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.797+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 >> 172.21.15.79:0/1135164825 conn(0x7ffb581012f0 msgr2=0x7ffb58109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:25:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.798+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 shutdown_connections 2024-09-21T02:25:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:25:58.798+0000 7ffb5ea00640 1 -- 172.21.15.79:0/1135164825 wait complete. 2024-09-21T02:26:00.041 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:59 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' 2024-09-21T02:26:00.042 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:25:59 smithi079 ceph-mon[30788]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:00.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:59 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' 2024-09-21T02:26:00.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:25:59 smithi148 ceph-mon[34626]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:00.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:59 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' 2024-09-21T02:26:00.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:25:59 smithi098 ceph-mon[34832]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 -- 172.21.15.79:0/3802638315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820104600 msgr2=0x7f6820104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 --2- 172.21.15.79:0/3802638315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820104600 0x7f6820104a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f680c009900 tx=0x7f680c02a480 comp rx=0 tx=0).stop 2024-09-21T02:26:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 -- 172.21.15.79:0/3802638315 shutdown_connections 2024-09-21T02:26:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 --2- 172.21.15.79:0/3802638315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6820104fa0 0x7f682010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 --2- 172.21.15.79:0/3802638315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820104600 0x7f6820104a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 --2- 172.21.15.79:0/3802638315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820103570 0x7f68201039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 -- 172.21.15.79:0/3802638315 >> 172.21.15.79:0/3802638315 conn(0x7f68200feec0 msgr2=0x7f6820101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:26:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 -- 172.21.15.79:0/3802638315 shutdown_connections 2024-09-21T02:26:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.222+0000 7f6825000640 1 -- 172.21.15.79:0/3802638315 wait complete. 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 Processor -- start 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 -- start start 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820103570 0x7f6820076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820104600 0x7f6820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6820104fa0 0x7f6820075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f682010f1c0 con 0x7f6820103570 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f682010f040 con 0x7f6820104600 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.223+0000 7f6825000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f682010f340 con 0x7f6820104fa0 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820103570 0x7f6820076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820104600 0x7f6820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820104600 0x7f6820075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58778/0 (socket says 172.21.15.79:58778) 2024-09-21T02:26:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6820104fa0 0x7f6820075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 -- 172.21.15.79:0/1997025125 learned_addr learned my addr 172.21.15.79:0/1997025125 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 -- 172.21.15.79:0/1997025125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6820104fa0 msgr2=0x7f6820075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6820104fa0 0x7f6820075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 -- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820103570 msgr2=0x7f6820076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820103570 0x7f6820076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.224+0000 7f681ea00640 1 -- 172.21.15.79:0/1997025125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6820076350 con 0x7f6820104600 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.225+0000 7f681ea00640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820104600 0x7f6820075710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f680c006010 tx=0x7f680c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.225+0000 7f6817e00640 1 -- 172.21.15.79:0/1997025125 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c03f030 con 0x7f6820104600 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.225+0000 7f6817e00640 1 -- 172.21.15.79:0/1997025125 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f680c031910 con 0x7f6820104600 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.225+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68201a3ea0 con 0x7f6820104600 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.225+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68201a4240 con 0x7f6820104600 2024-09-21T02:26:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.225+0000 7f6817e00640 1 -- 172.21.15.79:0/1997025125 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c035070 con 0x7f6820104600 2024-09-21T02:26:00.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.226+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68201039e0 con 0x7f6820104600 2024-09-21T02:26:00.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.228+0000 7f6817e00640 1 -- 172.21.15.79:0/1997025125 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f680c042030 con 0x7f6820104600 2024-09-21T02:26:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.230+0000 7f6817e00640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68040b6480 0x7f68040b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.230+0000 7f6817e00640 1 -- 172.21.15.79:0/1997025125 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f680c105ef0 con 0x7f6820104600 2024-09-21T02:26:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.230+0000 7f681f400640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68040b6480 0x7f68040b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:00.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.231+0000 7f681f400640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68040b6480 0x7f68040b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6810009bd0 tx=0x7f6810005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:00.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.231+0000 7f6817e00640 1 -- 172.21.15.79:0/1997025125 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f680c0d2790 con 0x7f6820104600 2024-09-21T02:26:00.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.428+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f682002e6e0 con 0x7f6820104600 2024-09-21T02:26:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.430+0000 7f6817e00640 1 -- 172.21.15.79:0/1997025125 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v33)=0 v33) ==== 106+0+0 (secure 0 0 0) 0x7f682002e6e0 con 0x7f6820104600 2024-09-21T02:26:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68040b6480 msgr2=0x7f68040b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68040b6480 0x7f68040b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6810009bd0 tx=0x7f6810005f90 comp rx=0 tx=0).stop 2024-09-21T02:26:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820104600 msgr2=0x7f6820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820104600 0x7f6820075710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f680c006010 tx=0x7f680c0042f0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 shutdown_connections 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f68040b6480 0x7f68040b8990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6820104fa0 0x7f6820075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6820104600 0x7f6820075710 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 --2- 172.21.15.79:0/1997025125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820103570 0x7f6820076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 >> 172.21.15.79:0/1997025125 conn(0x7f68200feec0 msgr2=0x7f6820107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 shutdown_connections 2024-09-21T02:26:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:00.432+0000 7f6825000640 1 -- 172.21.15.79:0/1997025125 wait complete. 2024-09-21T02:26:00.537 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi079') 2024-09-21T02:26:00.537 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.224 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.224 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.224 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.224 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.224 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.224 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.225 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.225 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.225 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.225 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.225 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56d10306-77c0-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi079') 2024-09-21T02:26:02.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T02:26:02.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:02 smithi079 ceph-mon[30788]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:26:02.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:02 smithi098 ceph-mon[34832]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:02.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:02 smithi148 ceph-mon[34626]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 -- 172.21.15.79:0/1764340810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c105180 msgr2=0x7f4e0c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1764340810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c105180 0x7f4e0c10bb20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009ca0 tx=0x7f4e0402a950 comp rx=0 tx=0).stop 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 -- 172.21.15.79:0/1764340810 shutdown_connections 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1764340810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c105180 0x7f4e0c10bb20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1764340810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e0c1047e0 0x7f4e0c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1764340810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c103750 0x7f4e0c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 -- 172.21.15.79:0/1764340810 >> 172.21.15.79:0/1764340810 conn(0x7f4e0c0ff0c0 msgr2=0x7f4e0c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 -- 172.21.15.79:0/1764340810 shutdown_connections 2024-09-21T02:26:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.174+0000 7f4e11e00640 1 -- 172.21.15.79:0/1764340810 wait complete. 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.175+0000 7f4e11e00640 1 Processor -- start 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.175+0000 7f4e11e00640 1 -- start start 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e11e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c103750 0x7f4e0c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e11e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c1047e0 0x7f4e0c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e11e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e0c105180 0x7f4e0c19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e11e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c10f3d0 con 0x7f4e0c103750 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e11e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c10f250 con 0x7f4e0c105180 2024-09-21T02:26:03.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e11e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c10f550 con 0x7f4e0c1047e0 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e0aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c103750 0x7f4e0c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e0aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c103750 0x7f4e0c199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57784/0 (socket says 172.21.15.79:57784) 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e0aa00640 1 -- 172.21.15.79:0/1386936609 learned_addr learned my addr 172.21.15.79:0/1386936609 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e02000640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c1047e0 0x7f4e0c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.176+0000 7f4e0b400640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e0c105180 0x7f4e0c19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e0aa00640 1 -- 172.21.15.79:0/1386936609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c1047e0 msgr2=0x7f4e0c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e0aa00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c1047e0 0x7f4e0c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e0aa00640 1 -- 172.21.15.79:0/1386936609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e0c105180 msgr2=0x7f4e0c19b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e0aa00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e0c105180 0x7f4e0c19b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e0aa00640 1 -- 172.21.15.79:0/1386936609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c19b9a0 con 0x7f4e0c103750 2024-09-21T02:26:03.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e0aa00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c103750 0x7f4e0c199f70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00d950 tx=0x7f4dfc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:03.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e10a00640 1 -- 172.21.15.79:0/1386936609 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc017030 con 0x7f4e0c103750 2024-09-21T02:26:03.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e10a00640 1 -- 172.21.15.79:0/1386936609 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dfc004020 con 0x7f4e0c103750 2024-09-21T02:26:03.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e10a00640 1 -- 172.21.15.79:0/1386936609 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0047a0 con 0x7f4e0c103750 2024-09-21T02:26:03.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c19bc90 con 0x7f4e0c103750 2024-09-21T02:26:03.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.177+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c1a2390 con 0x7f4e0c103750 2024-09-21T02:26:03.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.179+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c10a910 con 0x7f4e0c103750 2024-09-21T02:26:03.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.181+0000 7f4e10a00640 1 -- 172.21.15.79:0/1386936609 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f4dfc009a30 con 0x7f4e0c103750 2024-09-21T02:26:03.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.183+0000 7f4e10a00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4df00b6580 0x7f4df00b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:03.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.183+0000 7f4e10a00640 1 -- 172.21.15.79:0/1386936609 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4dfc0e56e0 con 0x7f4e0c103750 2024-09-21T02:26:03.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.183+0000 7f4e02000640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4df00b6580 0x7f4df00b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:03.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.183+0000 7f4e02000640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4df00b6580 0x7f4df00b8a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4df40095f0 tx=0x7f4df4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:03.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.185+0000 7f4e10a00640 1 -- 172.21.15.79:0/1386936609 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4dfc0adc20 con 0x7f4e0c103750 2024-09-21T02:26:03.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.371+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4e0c02e640 con 0x7f4e0c103750 2024-09-21T02:26:03.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.372+0000 7f4e10a00640 1 -- 172.21.15.79:0/1386936609 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+20909 (secure 0 0 0) 0x7f4dfc0b2000 con 0x7f4e0c103750 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global dev auth_debug true 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global basic log_to_file true 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global basic log_to_journald false 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global basic log_to_stderr false 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_allow_pool_delete true 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T02:26:03.374 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global dev ms_die_on_bug true 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global dev ms_die_on_old_message true 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global dev ms_die_on_skipped_message false 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T02:26:03.375 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced debug_mon 20/20 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced debug_ms 1/1 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced debug_paxos 20/20 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T02:26:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced client_mount_timeout 30 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced debug_client 20/20 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced debug_mgr 20/20 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced debug_ms 1/1 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T02:26:03.377 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev bdev_debug_aio true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced debug_bluefs 20/20 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced debug_bluestore 20/20 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced debug_ms 1/1 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced debug_osd 20/20 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev osd_debug_op_order true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev osd_debug_shutdown true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T02:26:03.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T02:26:03.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced debug_mds 20/20 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced debug_ms 2/2 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced mds_bal_split_size 100 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds dev mds_debug_frag true 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds dev mds_debug_scatterstat true 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds dev mds_verify_scatter true 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T02:26:03.380 INFO:teuthology.orchestra.run.smithi079.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client advanced client_mount_timeout 600 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client advanced debug_client 20/20 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client advanced debug_ms 1/1 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T02:26:03.381 INFO:teuthology.orchestra.run.smithi079.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4df00b6580 msgr2=0x7f4df00b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4df00b6580 0x7f4df00b8a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4df40095f0 tx=0x7f4df4005f90 comp rx=0 tx=0).stop 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c103750 msgr2=0x7f4e0c199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c103750 0x7f4e0c199f70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00d950 tx=0x7f4dfc00de10 comp rx=0 tx=0).stop 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 shutdown_connections 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4df00b6580 0x7f4df00b8a90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e0c105180 0x7f4e0c19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c1047e0 0x7f4e0c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 --2- 172.21.15.79:0/1386936609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0c103750 0x7f4e0c199f70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 >> 172.21.15.79:0/1386936609 conn(0x7f4e0c0ff0c0 msgr2=0x7f4e0c107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:26:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 shutdown_connections 2024-09-21T02:26:03.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:03.375+0000 7f4e11e00640 1 -- 172.21.15.79:0/1386936609 wait complete. 2024-09-21T02:26:04.069 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T02:26:04.069 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:26:04.069 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:26:04.105 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:26:04.105 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-21T02:26:04.180 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 02:24:46.730059192 +0000 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 02:20:06.971061741 +0000 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 02:20:06.971061741 +0000 2024-09-21T02:26:04.181 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 02:20:06.971061741 +0000 2024-09-21T02:26:04.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:26:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T02:26:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T02:26:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000345407 s, 1.5 MB/s 2024-09-21T02:26:04.277 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:26:04.313 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 02:24:46.768058331 +0000 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 02:20:07.466050462 +0000 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 02:20:07.466050462 +0000 2024-09-21T02:26:04.389 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 02:20:07.466050462 +0000 2024-09-21T02:26:04.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:26:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T02:26:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T02:26:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000282119 s, 1.8 MB/s 2024-09-21T02:26:04.484 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:26:04.520 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 02:24:46.806057471 +0000 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 02:20:07.924040026 +0000 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 02:20:07.924040026 +0000 2024-09-21T02:26:04.596 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 02:20:07.924040026 +0000 2024-09-21T02:26:04.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:26:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:04 smithi098 ceph-mon[34832]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:04 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1386936609' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:26:04.683 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:04 smithi079 ceph-mon[30788]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:04.683 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:04 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1386936609' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:26:04.688 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T02:26:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T02:26:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000305864 s, 1.7 MB/s 2024-09-21T02:26:04.691 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:26:04.727 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-21T02:26:04.802 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:26:04.802 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:04.803 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-21T02:26:04.803 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:04.803 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:04.803 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 02:24:46.844056610 +0000 2024-09-21T02:26:04.803 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 02:20:08.414028861 +0000 2024-09-21T02:26:04.803 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 02:20:08.414028861 +0000 2024-09-21T02:26:04.803 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 02:20:08.414028861 +0000 2024-09-21T02:26:04.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:26:04.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:04 smithi148 ceph-mon[34626]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:04.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:04 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1386936609' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:26:04.895 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T02:26:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T02:26:04.896 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000277271 s, 1.8 MB/s 2024-09-21T02:26:04.898 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:26:04.934 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T02:26:04.934 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:26:04.954 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:26:04.954 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-21T02:26:05.012 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:26:05.012 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:05.012 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T02:26:05.013 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:05.013 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:05.013 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 02:25:34.950298049 +0000 2024-09-21T02:26:05.013 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 02:19:34.568893649 +0000 2024-09-21T02:26:05.013 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 02:19:34.568893649 +0000 2024-09-21T02:26:05.013 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 02:19:34.568893649 +0000 2024-09-21T02:26:05.013 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:26:05.082 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T02:26:05.082 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T02:26:05.082 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00023324 s, 2.2 MB/s 2024-09-21T02:26:05.084 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:26:05.142 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-21T02:26:05.199 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 02:25:34.950298049 +0000 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 02:19:34.882889624 +0000 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 02:19:34.882889624 +0000 2024-09-21T02:26:05.200 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 02:19:34.882889624 +0000 2024-09-21T02:26:05.200 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:26:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T02:26:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T02:26:05.266 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000195522 s, 2.6 MB/s 2024-09-21T02:26:05.267 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:26:05.325 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-21T02:26:05.381 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:26:05.381 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:05.381 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T02:26:05.381 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:05.381 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:05.381 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 02:25:34.951298037 +0000 2024-09-21T02:26:05.381 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 02:19:35.216885342 +0000 2024-09-21T02:26:05.382 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 02:19:35.216885342 +0000 2024-09-21T02:26:05.382 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 02:19:35.216885342 +0000 2024-09-21T02:26:05.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:26:05.445 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T02:26:05.446 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T02:26:05.446 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00020693 s, 2.5 MB/s 2024-09-21T02:26:05.447 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:26:05.503 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 02:25:34.951298037 +0000 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 02:19:35.539881200 +0000 2024-09-21T02:26:05.560 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 02:19:35.539881200 +0000 2024-09-21T02:26:05.561 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 02:19:35.539881200 +0000 2024-09-21T02:26:05.561 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:26:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T02:26:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T02:26:05.625 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000209325 s, 2.4 MB/s 2024-09-21T02:26:05.626 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:26:05.683 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T02:26:05.684 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:26:05.703 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:26:05.704 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 02:25:32.634804532 +0000 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 02:19:38.951822387 +0000 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 02:19:38.951822387 +0000 2024-09-21T02:26:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 02:19:38.951822387 +0000 2024-09-21T02:26:05.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:26:05.834 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T02:26:05.834 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T02:26:05.834 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000295319 s, 1.7 MB/s 2024-09-21T02:26:05.835 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:26:05.895 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-21T02:26:05.952 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:26:05.952 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:05.953 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T02:26:05.953 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:05.953 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:05.953 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 02:25:32.635804509 +0000 2024-09-21T02:26:05.953 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 02:19:39.271814524 +0000 2024-09-21T02:26:05.953 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 02:19:39.271814524 +0000 2024-09-21T02:26:05.953 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 02:19:39.271814524 +0000 2024-09-21T02:26:05.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:26:06.020 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T02:26:06.020 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T02:26:06.020 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000222657 s, 2.3 MB/s 2024-09-21T02:26:06.021 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:26:06.079 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 02:25:32.635804509 +0000 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 02:19:39.603806364 +0000 2024-09-21T02:26:06.136 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 02:19:39.603806364 +0000 2024-09-21T02:26:06.137 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 02:19:39.603806364 +0000 2024-09-21T02:26:06.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:26:06.201 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T02:26:06.202 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T02:26:06.202 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000201957 s, 2.5 MB/s 2024-09-21T02:26:06.203 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:26:06.260 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-21T02:26:06.315 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 02:25:32.635804509 +0000 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 02:19:39.947797909 +0000 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 02:19:39.947797909 +0000 2024-09-21T02:26:06.316 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 02:19:39.947797909 +0000 2024-09-21T02:26:06.316 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:26:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T02:26:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T02:26:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000197854 s, 2.6 MB/s 2024-09-21T02:26:06.381 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:26:06.438 INFO:tasks.cephadm:Deploying osd.0 on smithi079 with /dev/vg_nvme/lv_4... 2024-09-21T02:26:06.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:26:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:06 smithi148 ceph-mon[34626]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:06.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:06 smithi098 ceph-mon[34832]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:06.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:06 smithi079 ceph-mon[30788]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:06.802 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:26:08.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:08 smithi079 ceph-mon[30788]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:08.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:08 smithi098 ceph-mon[34832]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:08 smithi148 ceph-mon[34626]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:09.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:26:09.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_4 2024-09-21T02:26:10.220 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:26:10.642 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:10 smithi079 ceph-mon[30788]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:10.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:10 smithi098 ceph-mon[34832]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:10 smithi148 ceph-mon[34626]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 -- 172.21.15.79:0/3086163375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 msgr2=0x7f26cc10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 --2- 172.21.15.79:0/3086163375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 0x7f26cc10db60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009ca0 tx=0x7f26c402a950 comp rx=0 tx=0).stop 2024-09-21T02:26:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 -- 172.21.15.79:0/3086163375 shutdown_connections 2024-09-21T02:26:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 --2- 172.21.15.79:0/3086163375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 0x7f26cc10db60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:10.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 --2- 172.21.15.79:0/3086163375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26cc106820 0x7f26cc106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 --2- 172.21.15.79:0/3086163375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 0x7f26cc105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 -- 172.21.15.79:0/3086163375 >> 172.21.15.79:0/3086163375 conn(0x7f26cc101100 msgr2=0x7f26cc1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:26:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 -- 172.21.15.79:0/3086163375 shutdown_connections 2024-09-21T02:26:10.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.819+0000 7f26d1e00640 1 -- 172.21.15.79:0/3086163375 wait complete. 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 Processor -- start 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 -- start start 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 0x7f26cc19bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26cc106820 0x7f26cc19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 0x7f26cc19d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1113e0 con 0x7f26cc1071c0 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc111260 con 0x7f26cc105790 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.820+0000 7f26d1e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc111560 con 0x7f26cc106820 2024-09-21T02:26:10.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 0x7f26cc19bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:10.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 0x7f26cc19bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36120/0 (socket says 172.21.15.79:36120) 2024-09-21T02:26:10.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 -- 172.21.15.79:0/480394248 learned_addr learned my addr 172.21.15.79:0/480394248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:26:10.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d1400640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 0x7f26cc19d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:10.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26cbe00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26cc106820 0x7f26cc19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 -- 172.21.15.79:0/480394248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26cc106820 msgr2=0x7f26cc19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26cc106820 0x7f26cc19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 -- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 msgr2=0x7f26cc19d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 0x7f26cc19d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 -- 172.21.15.79:0/480394248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc19da00 con 0x7f26cc105790 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.821+0000 7f26d0a00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 0x7f26cc19bfd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9f0 tx=0x7f26bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.822+0000 7f26c9600640 1 -- 172.21.15.79:0/480394248 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00cd80 con 0x7f26cc105790 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.822+0000 7f26c9600640 1 -- 172.21.15.79:0/480394248 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26bc0108e0 con 0x7f26cc105790 2024-09-21T02:26:10.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.822+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc19dcf0 con 0x7f26cc105790 2024-09-21T02:26:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.822+0000 7f26c9600640 1 -- 172.21.15.79:0/480394248 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc018980 con 0x7f26cc105790 2024-09-21T02:26:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.822+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc1a43f0 con 0x7f26cc105790 2024-09-21T02:26:10.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.823+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26cc10c950 con 0x7f26cc105790 2024-09-21T02:26:10.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.825+0000 7f26c9600640 1 -- 172.21.15.79:0/480394248 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f26bc010430 con 0x7f26cc105790 2024-09-21T02:26:10.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.827+0000 7f26c9600640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f26b00b6500 0x7f26b00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.827+0000 7f26c9600640 1 -- 172.21.15.79:0/480394248 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f26bc0e5e20 con 0x7f26cc105790 2024-09-21T02:26:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.827+0000 7f26cbe00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f26b00b6500 0x7f26b00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.827+0000 7f26cbe00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f26b00b6500 0x7f26b00b8a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009bd0 tx=0x7f26b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:10.828+0000 7f26c9600640 1 -- 172.21.15.79:0/480394248 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26bc0b26c0 con 0x7f26cc105790 2024-09-21T02:26:11.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:11.026+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f26cc063800 con 0x7f26b00b6500 2024-09-21T02:26:11.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:11 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:26:11.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:11 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:26:11.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:11 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:11.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:11 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:26:11.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:11 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:26:11.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:11 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:11 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:26:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:11 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:26:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:11 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:12.639 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:12 smithi079 ceph-mon[30788]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:12.639 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:12 smithi079 ceph-mon[30788]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:12.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:12 smithi098 ceph-mon[34832]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:12.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:12 smithi098 ceph-mon[34832]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:12.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:12 smithi148 ceph-mon[34626]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:12.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:12 smithi148 ceph-mon[34626]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:14 smithi098 ceph-mon[34832]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:14 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2255481618' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "054c4c62-2d11-4950-ae9e-2eae3c70d216"} : dispatch 2024-09-21T02:26:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:14 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2255481618' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "054c4c62-2d11-4950-ae9e-2eae3c70d216"}]': finished 2024-09-21T02:26:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:14 smithi098 ceph-mon[34832]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:26:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:14.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:14 smithi079 ceph-mon[30788]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:14.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:14 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2255481618' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "054c4c62-2d11-4950-ae9e-2eae3c70d216"} : dispatch 2024-09-21T02:26:14.679 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:14 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2255481618' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "054c4c62-2d11-4950-ae9e-2eae3c70d216"}]': finished 2024-09-21T02:26:14.679 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:14 smithi079 ceph-mon[30788]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:26:14.679 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:14 smithi148 ceph-mon[34626]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:14 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2255481618' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "054c4c62-2d11-4950-ae9e-2eae3c70d216"} : dispatch 2024-09-21T02:26:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:14 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2255481618' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "054c4c62-2d11-4950-ae9e-2eae3c70d216"}]': finished 2024-09-21T02:26:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:14 smithi148 ceph-mon[34626]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:26:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:15 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3454431058' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:26:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:15 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3454431058' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:26:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:15 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3454431058' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:26:16.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:16 smithi098 ceph-mon[34832]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:16.714 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:16 smithi148 ceph-mon[34626]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:16 smithi079 ceph-mon[30788]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:17.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:17 smithi098 ceph-mon[34832]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:17 smithi079 ceph-mon[30788]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:17.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:17 smithi148 ceph-mon[34626]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:20.648 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:20 smithi079 ceph-mon[30788]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:20.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:20 smithi098 ceph-mon[34832]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:20.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:20 smithi148 ceph-mon[34626]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:22.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:22 smithi079 ceph-mon[30788]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:22.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:22 smithi098 ceph-mon[34832]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:22 smithi148 ceph-mon[34626]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:23.630 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:26:23.630 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:26:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:23.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:26:23.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:24.522 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:24 smithi079 ceph-mon[30788]: Deploying daemon osd.0 on smithi079 2024-09-21T02:26:24.522 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:24 smithi079 ceph-mon[30788]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:24 smithi098 ceph-mon[34832]: Deploying daemon osd.0 on smithi079 2024-09-21T02:26:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:24 smithi098 ceph-mon[34832]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:24 smithi148 ceph-mon[34626]: Deploying daemon osd.0 on smithi079 2024-09-21T02:26:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:24 smithi148 ceph-mon[34626]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:26 smithi098 ceph-mon[34832]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:26.668 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:26 smithi079 ceph-mon[30788]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:26 smithi148 ceph-mon[34626]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:28 smithi098 ceph-mon[34832]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:28 smithi079 ceph-mon[30788]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:28 smithi148 ceph-mon[34626]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:30.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:30 smithi079 ceph-mon[30788]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:30 smithi098 ceph-mon[34832]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:30 smithi148 ceph-mon[34626]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:32 smithi079 ceph-mon[30788]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:32.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:32.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:32 smithi098 ceph-mon[34832]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:32 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:32 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:32 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:32 smithi148 ceph-mon[34626]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:32 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:32 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:32 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:34 smithi098 ceph-mon[34832]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:34.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:34 smithi079 ceph-mon[30788]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:34 smithi148 ceph-mon[34626]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:26:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:35 smithi098 ceph-mon[34832]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:36.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:36.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:26:36.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:35 smithi079 ceph-mon[30788]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:36.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:36.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:26:36.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:36.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:35 smithi148 ceph-mon[34626]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:37.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.268+0000 7f26c9600640 1 -- 172.21.15.79:0/480394248 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26cc063800 con 0x7f26b00b6500 2024-09-21T02:26:37.270 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 0 on host 'smithi079' 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f26b00b6500 msgr2=0x7f26b00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f26b00b6500 0x7f26b00b8a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009bd0 tx=0x7f26b8005f90 comp rx=0 tx=0).stop 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 msgr2=0x7f26cc19bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 0x7f26cc19bfd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9f0 tx=0x7f26bc00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 shutdown_connections 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f26b00b6500 0x7f26b00b8a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26cc1071c0 0x7f26cc19d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:37.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26cc106820 0x7f26cc19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:37.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 --2- 172.21.15.79:0/480394248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26cc105790 0x7f26cc19bfd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:37.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.271+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 >> 172.21.15.79:0/480394248 conn(0x7f26cc101100 msgr2=0x7f26cc109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:26:37.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.272+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 shutdown_connections 2024-09-21T02:26:37.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:26:37.272+0000 7f26d1e00640 1 -- 172.21.15.79:0/480394248 wait complete. 2024-09-21T02:26:37.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:37 smithi079 ceph-mon[30788]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:26:37.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:37 smithi148 ceph-mon[34626]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:26:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:37 smithi098 ceph-mon[34832]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:26:38.054 DEBUG:teuthology.orchestra.run.smithi079:osd.0> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T02:26:38.058 INFO:tasks.cephadm:Deploying osd.1 on smithi098 with /dev/vg_nvme/lv_4... 2024-09-21T02:26:38.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:26:38.314 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:26:38.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:26:38.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:26:38.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:26:38.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:38.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:38.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:38.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:38.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:38.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:26:38.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:26:38.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:38 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:26:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:26:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:26:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:38.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:38.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:38.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:26:38.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:26:38.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:38 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:26:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:26:38.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:38 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:39.211 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:26:39 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0[46279]: 2024-09-21T02:26:39.029+0000 7fbc46000640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T02:26:39.211 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:26:39 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0[46279]: 2024-09-21T02:26:39.044+0000 7fbc3c000640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:26:39.401 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:39.401 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:39 smithi098 ceph-mon[34832]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' 2024-09-21T02:26:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:39 smithi079 ceph-mon[30788]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' 2024-09-21T02:26:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:39 smithi148 ceph-mon[34626]: from='osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665]' entity='osd.0' 2024-09-21T02:26:40.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:40 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:26:40.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:40 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:26:40.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:40 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:40.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:40 smithi079 ceph-mon[30788]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:40.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:40 smithi079 ceph-mon[30788]: osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] boot 2024-09-21T02:26:40.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:40 smithi079 ceph-mon[30788]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:26:40.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:40 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:40 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:26:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:40 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:26:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:40 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:40 smithi148 ceph-mon[34626]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:40 smithi148 ceph-mon[34626]: osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] boot 2024-09-21T02:26:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:40 smithi148 ceph-mon[34626]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:26:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:40 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:40.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:40 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:26:40.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:40 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:26:40.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:40 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:40.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:40 smithi098 ceph-mon[34832]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:26:40.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:40 smithi098 ceph-mon[34832]: osd.0 [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] boot 2024-09-21T02:26:40.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:40 smithi098 ceph-mon[34832]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:26:40.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:40 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:26:40.711 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:26:40.737 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-09-21T02:26:40.983 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 -- 172.21.15.98:0/1531094276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420103700 msgr2=0x7f3420103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 --2- 172.21.15.98:0/1531094276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420103700 0x7f3420103b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f341c009900 tx=0x7f341c02a480 comp rx=0 tx=0).stop 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 -- 172.21.15.98:0/1531094276 shutdown_connections 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 --2- 172.21.15.98:0/1531094276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34201040a0 0x7f342010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 --2- 172.21.15.98:0/1531094276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420103700 0x7f3420103b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 --2- 172.21.15.98:0/1531094276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3420102670 0x7f3420102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 -- 172.21.15.98:0/1531094276 >> 172.21.15.98:0/1531094276 conn(0x7f34200fdfe0 msgr2=0x7f3420100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:26:41.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 -- 172.21.15.98:0/1531094276 shutdown_connections 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.470+0000 7f3427d00640 1 -- 172.21.15.98:0/1531094276 wait complete. 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 Processor -- start 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 -- start start 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420102670 0x7f342019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3420103700 0x7f342019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34201040a0 0x7f342019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f342010e2a0 con 0x7f3420103700 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f342010e120 con 0x7f3420102670 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3427d00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f342010e420 con 0x7f34201040a0 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420102670 0x7f342019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420102670 0x7f342019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58612/0 (socket says 172.21.15.98:58612) 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 -- 172.21.15.98:0/3137763872 learned_addr learned my addr 172.21.15.98:0/3137763872 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T02:26:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f342529b640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3420103700 0x7f342019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f342629d640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34201040a0 0x7f342019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 -- 172.21.15.98:0/3137763872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34201040a0 msgr2=0x7f342019b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34201040a0 0x7f342019b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 -- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3420103700 msgr2=0x7f342019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3420103700 0x7f342019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f3425a9c640 1 -- 172.21.15.98:0/3137763872 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342019b9a0 con 0x7f3420102670 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.471+0000 7f342629d640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34201040a0 0x7f342019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.472+0000 7f3425a9c640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420102670 0x7f342019a000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f341000c920 tx=0x7f341000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.472+0000 7f3416ffd640 1 -- 172.21.15.98:0/3137763872 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410007c70 con 0x7f3420102670 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.472+0000 7f3416ffd640 1 -- 172.21.15.98:0/3137763872 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3410007e10 con 0x7f3420102670 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.472+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342019bc90 con 0x7f3420102670 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.472+0000 7f3416ffd640 1 -- 172.21.15.98:0/3137763872 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410018820 con 0x7f3420102670 2024-09-21T02:26:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.472+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34201a2420 con 0x7f3420102670 2024-09-21T02:26:41.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.473+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34201a25f0 con 0x7f3420102670 2024-09-21T02:26:41.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.474+0000 7f3416ffd640 1 -- 172.21.15.98:0/3137763872 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f341000f450 con 0x7f3420102670 2024-09-21T02:26:41.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.475+0000 7f3416ffd640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f340c0b6500 0x7f340c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:26:41.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.475+0000 7f3416ffd640 1 -- 172.21.15.98:0/3137763872 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f34100e5940 con 0x7f3420102670 2024-09-21T02:26:41.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.475+0000 7f342529b640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f340c0b6500 0x7f340c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:26:41.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.476+0000 7f342529b640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f340c0b6500 0x7f340c0b8a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f341c000c00 tx=0x7f341c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:26:41.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.479+0000 7f3416ffd640 1 -- 172.21.15.98:0/3137763872 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3410014030 con 0x7f3420102670 2024-09-21T02:26:41.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:26:41.666+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3420100030 con 0x7f340c0b6500 2024-09-21T02:26:42.207 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:42 smithi079 ceph-mon[30788]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:26:42.207 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:42 smithi079 ceph-mon[30788]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:42.207 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:42 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:26:42.208 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:42 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:26:42.208 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:42 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:42.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:42 smithi148 ceph-mon[34626]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:26:42.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:42 smithi148 ceph-mon[34626]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:42.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:42 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:26:42.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:42 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:26:42.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:42 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:42.339 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:42 smithi098 ceph-mon[34832]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:26:42.339 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:42 smithi098 ceph-mon[34832]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:42.339 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:42 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:26:42.339 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:42 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:26:42.340 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:42 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi079 2024-09-21T02:26:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:26:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi079 to 17089M 2024-09-21T02:26:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:43.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:26:43.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.621 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:43.621 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi079 2024-09-21T02:26:43.621 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.621 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.621 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:26:43.621 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi079 to 17089M 2024-09-21T02:26:43.621 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.622 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:43.622 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:26:43.622 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi079 2024-09-21T02:26:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:26:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi079 to 17089M 2024-09-21T02:26:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:26:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:44.555 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:44 smithi098 ceph-mon[34832]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:44.555 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:44 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/1081401803' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"} : dispatch 2024-09-21T02:26:44.555 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:44 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"} : dispatch 2024-09-21T02:26:44.556 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:44 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"}]': finished 2024-09-21T02:26:44.556 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:44 smithi098 ceph-mon[34832]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:26:44.556 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:44 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:26:44.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:44 smithi148 ceph-mon[34626]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:44.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:44 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/1081401803' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"} : dispatch 2024-09-21T02:26:44.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:44 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"} : dispatch 2024-09-21T02:26:44.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:44 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"}]': finished 2024-09-21T02:26:44.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:44 smithi148 ceph-mon[34626]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:26:44.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:44 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:26:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:44 smithi079 ceph-mon[30788]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:44 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/1081401803' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"} : dispatch 2024-09-21T02:26:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:44 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"} : dispatch 2024-09-21T02:26:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:44 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d15ddd7c-8be1-4eec-904a-88fb150baae8"}]': finished 2024-09-21T02:26:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:44 smithi079 ceph-mon[30788]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:26:44.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:44 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:26:45.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:45 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/1772217665' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:26:45.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:45 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/1772217665' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:26:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:45 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/1772217665' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:26:46.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:46 smithi148 ceph-mon[34626]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:46 smithi098 ceph-mon[34832]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:46 smithi079 ceph-mon[30788]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:48 smithi098 ceph-mon[34832]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:48 smithi079 ceph-mon[30788]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:48 smithi148 ceph-mon[34626]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:50.446 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:50 smithi098 ceph-mon[34832]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:50 smithi079 ceph-mon[30788]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:50 smithi148 ceph-mon[34626]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:52.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:52 smithi098 ceph-mon[34832]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:52 smithi079 ceph-mon[30788]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:52 smithi148 ceph-mon[34626]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:53.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:53 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:26:53.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:53 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:53.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:53 smithi098 ceph-mon[34832]: Deploying daemon osd.1 on smithi098 2024-09-21T02:26:53.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:26:53.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:53.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:53 smithi079 ceph-mon[30788]: Deploying daemon osd.1 on smithi098 2024-09-21T02:26:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:53 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:26:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:53 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:26:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:53 smithi148 ceph-mon[34626]: Deploying daemon osd.1 on smithi098 2024-09-21T02:26:54.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:54 smithi098 ceph-mon[34832]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:54 smithi079 ceph-mon[30788]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:54.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:54 smithi148 ceph-mon[34626]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:56 smithi098 ceph-mon[34832]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:56 smithi079 ceph-mon[30788]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:56.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:56 smithi148 ceph-mon[34626]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:58.506 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:58 smithi098 ceph-mon[34832]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:58 smithi079 ceph-mon[30788]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:58.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:58 smithi148 ceph-mon[34626]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:26:59.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:59.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:59.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:26:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:59.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:59.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:59.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:26:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:26:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:26:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:26:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:00.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:00 smithi098 ceph-mon[34832]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:00 smithi079 ceph-mon[30788]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:00 smithi148 ceph-mon[34626]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:02.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.272+0000 7f3416ffd640 1 -- 172.21.15.98:0/3137763872 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3420100030 con 0x7f340c0b6500 2024-09-21T02:27:02.273 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 1 on host 'smithi098' 2024-09-21T02:27:02.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f340c0b6500 msgr2=0x7f340c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:02.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f340c0b6500 0x7f340c0b8a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f341c000c00 tx=0x7f341c031400 comp rx=0 tx=0).stop 2024-09-21T02:27:02.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420102670 msgr2=0x7f342019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420102670 0x7f342019a000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f341000c920 tx=0x7f341000cde0 comp rx=0 tx=0).stop 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 shutdown_connections 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f340c0b6500 0x7f340c0b8a10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34201040a0 0x7f342019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3420103700 0x7f342019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 --2- 172.21.15.98:0/3137763872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3420102670 0x7f342019a000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 >> 172.21.15.98:0/3137763872 conn(0x7f34200fdfe0 msgr2=0x7f34200ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 shutdown_connections 2024-09-21T02:27:02.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:27:02.274+0000 7f3427d00640 1 -- 172.21.15.98:0/3137763872 wait complete. 2024-09-21T02:27:02.592 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: pgmap v76: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:02.592 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.592 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.593 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:02.593 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:02.593 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.593 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:02.593 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.593 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: pgmap v76: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:02.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:02.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:02.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:02.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: pgmap v76: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:02.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:02.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:02.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:02.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:02.919 DEBUG:teuthology.orchestra.run.smithi098:osd.1> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T02:27:02.922 INFO:tasks.cephadm:Deploying osd.2 on smithi148 with /dev/vg_nvme/lv_4... 2024-09-21T02:27:02.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:27:03.177 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:27:04.535 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:04 smithi148 ceph-mon[34626]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:04 smithi098 ceph-mon[34832]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:04 smithi079 ceph-mon[30788]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:05.314 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:05 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1[38783]: 2024-09-21T02:27:05.130+0000 7f8b005c8640 -1 osd.1 0 log_to_monitors true 2024-09-21T02:27:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:05 smithi148 ceph-mon[34626]: from='osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:27:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:05 smithi148 ceph-mon[34626]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:27:05.633 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:27:05.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:05 smithi098 ceph-mon[34832]: from='osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:27:05.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:05 smithi098 ceph-mon[34832]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:27:05.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_4 2024-09-21T02:27:05.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:05 smithi079 ceph-mon[30788]: from='osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:27:05.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:05 smithi079 ceph-mon[30788]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:27:05.925 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:27:06.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 -- 172.21.15.148:0/407772240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c001047e0 msgr2=0x7f0c00104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:06.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 --2- 172.21.15.148:0/407772240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c001047e0 0x7f0c00104bf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009900 tx=0x7f0bf402a480 comp rx=0 tx=0).stop 2024-09-21T02:27:06.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 -- 172.21.15.148:0/407772240 shutdown_connections 2024-09-21T02:27:06.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 --2- 172.21.15.148:0/407772240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c00105180 0x7f0c0010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 --2- 172.21.15.148:0/407772240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c001047e0 0x7f0c00104bf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 --2- 172.21.15.148:0/407772240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c00103750 0x7f0c00103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 -- 172.21.15.148:0/407772240 >> 172.21.15.148:0/407772240 conn(0x7f0c000ff0c0 msgr2=0x7f0c00101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 -- 172.21.15.148:0/407772240 shutdown_connections 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.437+0000 7f0c06691640 1 -- 172.21.15.148:0/407772240 wait complete. 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 Processor -- start 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 -- start start 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c00103750 0x7f0c0019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c001047e0 0x7f0c0019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c00105180 0x7f0c0019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0010f410 con 0x7f0c00103750 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0010f290 con 0x7f0c001047e0 2024-09-21T02:27:06.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c06691640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0010f590 con 0x7f0c00105180 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.438+0000 7f0c04c2e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c00105180 0x7f0c0019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c00105180 0x7f0c0019b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44108/0 (socket says 172.21.15.148:44108) 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 -- 172.21.15.148:0/496792855 learned_addr learned my addr 172.21.15.148:0/496792855 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0bff7fe640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c001047e0 0x7f0c0019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0bfffff640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c00103750 0x7f0c0019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 -- 172.21.15.148:0/496792855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c001047e0 msgr2=0x7f0c0019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c001047e0 0x7f0c0019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 -- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c00103750 msgr2=0x7f0c0019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c00103750 0x7f0c0019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 -- 172.21.15.148:0/496792855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0019ba30 con 0x7f0c00105180 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0bfffff640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c00103750 0x7f0c0019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:27:06.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c04c2e640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c00105180 0x7f0c0019b210 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800eaa0 tx=0x7f0bf800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:27:06.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0bfd7fa640 1 -- 172.21.15.148:0/496792855 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800cdb0 con 0x7f0c00105180 2024-09-21T02:27:06.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0bfd7fa640 1 -- 172.21.15.148:0/496792855 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bf8005020 con 0x7f0c00105180 2024-09-21T02:27:06.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0019bd20 con 0x7f0c00105180 2024-09-21T02:27:06.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0bfd7fa640 1 -- 172.21.15.148:0/496792855 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80116d0 con 0x7f0c00105180 2024-09-21T02:27:06.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.439+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c001a2420 con 0x7f0c00105180 2024-09-21T02:27:06.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.440+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0010a930 con 0x7f0c00105180 2024-09-21T02:27:06.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.442+0000 7f0bfd7fa640 1 -- 172.21.15.148:0/496792855 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f0bf80051d0 con 0x7f0c00105180 2024-09-21T02:27:06.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.443+0000 7f0bfd7fa640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0be80b6500 0x7f0be80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:06.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.443+0000 7f0bfd7fa640 1 -- 172.21.15.148:0/496792855 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f0bf80e5e80 con 0x7f0c00105180 2024-09-21T02:27:06.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.443+0000 7f0bfffff640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0be80b6500 0x7f0be80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:06.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.444+0000 7f0bfffff640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0be80b6500 0x7f0be80b8a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006fd0 tx=0x7f0bf0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:27:06.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.446+0000 7f0bfd7fa640 1 -- 172.21.15.148:0/496792855 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0bf8016030 con 0x7f0c00105180 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: pgmap v78: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:27:06.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:06.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:06.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:06.636+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0c00063800 con 0x7f0be80b6500 2024-09-21T02:27:06.738 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: pgmap v78: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:06.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: pgmap v78: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:06.740 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:06.741 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:07.399 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1[38783]: 2024-09-21T02:27:07.125+0000 7f8afc54a640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T02:27:07.399 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1[38783]: 2024-09-21T02:27:07.130+0000 7f8af4340640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:27:07.572 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi098 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:07.573 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:07 smithi148 ceph-mon[34626]: from='osd.1 ' entity='osd.1' 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi098 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:27:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:07.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:07 smithi098 ceph-mon[34832]: from='osd.1 ' entity='osd.1' 2024-09-21T02:27:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi098 2024-09-21T02:27:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-21T02:27:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:27:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:27:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:27:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:27:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:07 smithi079 ceph-mon[30788]: from='osd.1 ' entity='osd.1' 2024-09-21T02:27:08.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:27:08.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:27:08.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:08.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: pgmap v81: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:08.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:08.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] boot 2024-09-21T02:27:08.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:27:08.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:08 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:27:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:27:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: pgmap v81: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] boot 2024-09-21T02:27:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:27:08.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:08 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: pgmap v81: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: osd.1 [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] boot 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:27:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:08 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:27:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:09 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/3753058684' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"} : dispatch 2024-09-21T02:27:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:09 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"} : dispatch 2024-09-21T02:27:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:09 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"}]': finished 2024-09-21T02:27:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:09 smithi098 ceph-mon[34832]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T02:27:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:09 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:09 smithi098 ceph-mon[34832]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:09 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/3753058684' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"} : dispatch 2024-09-21T02:27:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:09 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"} : dispatch 2024-09-21T02:27:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:09 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"}]': finished 2024-09-21T02:27:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:09 smithi079 ceph-mon[30788]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T02:27:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:09 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:09 smithi079 ceph-mon[30788]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:09 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/3753058684' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"} : dispatch 2024-09-21T02:27:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:09 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"} : dispatch 2024-09-21T02:27:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:09 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "152e63e3-25e3-4219-bea1-94fdb639be4d"}]': finished 2024-09-21T02:27:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:09 smithi148 ceph-mon[34626]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T02:27:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:09 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:09 smithi148 ceph-mon[34626]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:10.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:10 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/380390236' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:27:10.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:10 smithi098 ceph-mon[34832]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:27:10.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:10.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:10 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/380390236' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:27:10.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:10 smithi079 ceph-mon[30788]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:27:10.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:10.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:10 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/380390236' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:27:10.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:10 smithi148 ceph-mon[34626]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:27:10.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:11.679 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:11 smithi148 ceph-mon[34626]: pgmap v86: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:11.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:11 smithi079 ceph-mon[30788]: pgmap v86: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:11 smithi098 ceph-mon[34832]: pgmap v86: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:14.641 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:14 smithi148 ceph-mon[34626]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:14 smithi098 ceph-mon[34832]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:14.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:14 smithi079 ceph-mon[30788]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:16.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:16 smithi098 ceph-mon[34832]: pgmap v88: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:16 smithi079 ceph-mon[30788]: pgmap v88: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:16 smithi148 ceph-mon[34626]: pgmap v88: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:27:17.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:17.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:27:17.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:27:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:18.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:18 smithi148 ceph-mon[34626]: Deploying daemon osd.2 on smithi148 2024-09-21T02:27:18.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:18 smithi148 ceph-mon[34626]: pgmap v89: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:18.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:18 smithi098 ceph-mon[34832]: Deploying daemon osd.2 on smithi148 2024-09-21T02:27:18.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:18 smithi098 ceph-mon[34832]: pgmap v89: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:18 smithi079 ceph-mon[30788]: Deploying daemon osd.2 on smithi148 2024-09-21T02:27:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:18 smithi079 ceph-mon[30788]: pgmap v89: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:20.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:20 smithi098 ceph-mon[34832]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:20.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:20 smithi079 ceph-mon[30788]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:20.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:20 smithi148 ceph-mon[34626]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:22.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:22 smithi098 ceph-mon[34832]: pgmap v91: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:22.705 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:22 smithi148 ceph-mon[34626]: pgmap v91: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:22 smithi079 ceph-mon[30788]: pgmap v91: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:23.676 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:23.676 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:23.676 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:23.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:23.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:23.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:24 smithi098 ceph-mon[34832]: pgmap v92: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:24.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:24 smithi079 ceph-mon[30788]: pgmap v92: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:24.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:24 smithi148 ceph-mon[34626]: pgmap v92: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:26 smithi098 ceph-mon[34832]: pgmap v93: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:26 smithi079 ceph-mon[30788]: pgmap v93: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:26.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:26.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:26 smithi148 ceph-mon[34626]: pgmap v93: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:27.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.475+0000 7f0bfd7fa640 1 -- 172.21.15.148:0/496792855 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0c00063800 con 0x7f0be80b6500 2024-09-21T02:27:27.476 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 2 on host 'smithi148' 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0be80b6500 msgr2=0x7f0be80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0be80b6500 0x7f0be80b8a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006fd0 tx=0x7f0bf0008040 comp rx=0 tx=0).stop 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c00105180 msgr2=0x7f0c0019b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c00105180 0x7f0c0019b210 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800eaa0 tx=0x7f0bf800ef60 comp rx=0 tx=0).stop 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 shutdown_connections 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0be80b6500 0x7f0be80b8a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c00105180 0x7f0c0019b210 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c001047e0 0x7f0c0019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 --2- 172.21.15.148:0/496792855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c00103750 0x7f0c0019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 >> 172.21.15.148:0/496792855 conn(0x7f0c000ff0c0 msgr2=0x7f0c00107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:27:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 shutdown_connections 2024-09-21T02:27:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:27:27.478+0000 7f0c06691640 1 -- 172.21.15.148:0/496792855 wait complete. 2024-09-21T02:27:28.138 DEBUG:teuthology.orchestra.run.smithi148:osd.2> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T02:27:28.140 INFO:tasks.cephadm:Deploying osd.3 on smithi079 with /dev/vg_nvme/lv_3... 2024-09-21T02:27:28.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:27:28.368 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:28 smithi148 ceph-mon[34626]: pgmap v94: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:28.368 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:28.368 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:28.368 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:28 smithi079 ceph-mon[30788]: pgmap v94: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:28.514 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:27:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:28 smithi098 ceph-mon[34832]: pgmap v94: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:29.313 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2[39081]: 2024-09-21T02:27:29.096+0000 7f0d25fce640 -1 osd.2 0 log_to_monitors true 2024-09-21T02:27:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:29 smithi098 ceph-mon[34832]: from='osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:27:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:29 smithi098 ceph-mon[34832]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:27:29.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:29 smithi079 ceph-mon[30788]: from='osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:27:29.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:29 smithi079 ceph-mon[30788]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:27:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:29 smithi148 ceph-mon[34626]: from='osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:27:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:29 smithi148 ceph-mon[34626]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:27:30.632 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2[39081]: 2024-09-21T02:27:30.354+0000 7f0d21f50640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T02:27:30.632 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2[39081]: 2024-09-21T02:27:30.358+0000 7f0d1dd4e640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:27:30.632 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-mon[34626]: pgmap v95: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:30.632 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-mon[34626]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:27:30.632 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-mon[34626]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:27:30.633 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:30.633 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-mon[34626]: from='osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:27:30.633 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:30 smithi148 ceph-mon[34626]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:27:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:30 smithi098 ceph-mon[34832]: pgmap v95: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:30 smithi098 ceph-mon[34832]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:27:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:30 smithi098 ceph-mon[34832]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:27:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:30 smithi098 ceph-mon[34832]: from='osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:27:30.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:30 smithi098 ceph-mon[34832]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:27:30.693 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:30 smithi079 ceph-mon[30788]: pgmap v95: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:30.693 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:30 smithi079 ceph-mon[30788]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:27:30.693 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:30 smithi079 ceph-mon[30788]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:27:30.693 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:30.693 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:30 smithi079 ceph-mon[30788]: from='osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:27:30.693 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:30 smithi079 ceph-mon[30788]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:27:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:27:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T02:27:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:31.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:27:31.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:31.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:31.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.702 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:31.703 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:31.703 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.756 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:27:31.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_3 2024-09-21T02:27:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:27:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T02:27:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:31.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:27:31.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:31.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:31.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:31.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:32.150 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:27:32.544 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:27:32.544 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:27:32.544 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi148 2024-09-21T02:27:32.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T02:27:32.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: pgmap v98: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:32.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:32.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] boot 2024-09-21T02:27:32.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:27:32.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:32.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:27:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:27:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:27:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi148 2024-09-21T02:27:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T02:27:32.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: pgmap v98: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:32.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:32.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] boot 2024-09-21T02:27:32.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:27:32.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:32.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:32 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:27:32.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.712+0000 7f05f9200640 1 -- 172.21.15.79:0/1886006464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 msgr2=0x7f05f4108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:32.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.712+0000 7f05f9200640 1 --2- 172.21.15.79:0/1886006464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 0x7f05f4108d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009900 tx=0x7f05dc02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:27:32.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.713+0000 7f05f9200640 1 -- 172.21.15.79:0/1886006464 shutdown_connections 2024-09-21T02:27:32.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.713+0000 7f05f9200640 1 --2- 172.21.15.79:0/1886006464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 0x7f05f410b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:32.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.713+0000 7f05f9200640 1 --2- 172.21.15.79:0/1886006464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 0x7f05f4108d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:32.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.713+0000 7f05f9200640 1 --2- 172.21.15.79:0/1886006464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f406c660 0x7f05f41063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:32.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.713+0000 7f05f9200640 1 -- 172.21.15.79:0/1886006464 >> 172.21.15.79:0/1886006464 conn(0x7f05f40fdfe0 msgr2=0x7f05f4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:27:32.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.713+0000 7f05f9200640 1 -- 172.21.15.79:0/1886006464 shutdown_connections 2024-09-21T02:27:32.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.713+0000 7f05f9200640 1 -- 172.21.15.79:0/1886006464 wait complete. 2024-09-21T02:27:32.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 Processor -- start 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 -- start start 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f406c660 0x7f05f4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 0x7f05f419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 0x7f05f419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410f3c0 con 0x7f05f41068e0 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410f240 con 0x7f05f406c660 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f9200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410f540 con 0x7f05f4109480 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05ebe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 0x7f05f419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 0x7f05f419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 0x7f05f419b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:60186/0 (socket says 172.21.15.79:60186) 2024-09-21T02:27:32.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.714+0000 7f05f2800640 1 -- 172.21.15.79:0/2393604019 learned_addr learned my addr 172.21.15.79:0/2393604019 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05f1e00640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f406c660 0x7f05f4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05f2800640 1 -- 172.21.15.79:0/2393604019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f406c660 msgr2=0x7f05f4199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05f2800640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f406c660 0x7f05f4199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05f2800640 1 -- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 msgr2=0x7f05f419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05f2800640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 0x7f05f419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05f2800640 1 -- 172.21.15.79:0/2393604019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f419ba20 con 0x7f05f4109480 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05f2800640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 0x7f05f419b200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00efd0 tx=0x7f05ec00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.715+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec003b70 con 0x7f05f4109480 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.716+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f419bd10 con 0x7f05f4109480 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.716+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ec003d10 con 0x7f05f4109480 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.716+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0108a0 con 0x7f05f4109480 2024-09-21T02:27:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.716+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f41a2410 con 0x7f05f4109480 2024-09-21T02:27:32.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.717+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f40ffb00 con 0x7f05f4109480 2024-09-21T02:27:32.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.719+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f05ec004b40 con 0x7f05f4109480 2024-09-21T02:27:32.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.721+0000 7f05eaa00640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f05d80b6480 0x7f05d80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:27:32.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.721+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7f05ec0e66d0 con 0x7f05f4109480 2024-09-21T02:27:32.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.721+0000 7f05f1e00640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f05d80b6480 0x7f05d80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:27:32.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.722+0000 7f05f1e00640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f05d80b6480 0x7f05d80b8990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009bd0 tx=0x7f05e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:27:32.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.723+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05ec0ae380 con 0x7f05f4109480 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi148 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: pgmap v98: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: osd.2 [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] boot 2024-09-21T02:27:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:27:32.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:27:32.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:32 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:27:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:32.923+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f05f4063800 con 0x7f05d80b6480 2024-09-21T02:27:33.625 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:27:33.625 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 ceph-mon[30788]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:27:33.625 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:27:33.626 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:27:33.626 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:27:33.626 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50754]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50754]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50754]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50757]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:33.626 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50757]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:33.631 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:27:33.631 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 ceph-mon[34626]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:27:33.632 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:27:33.632 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:27:33.632 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:27:33.632 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:27:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 ceph-mon[34832]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:27:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:27:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:27:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:27:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:33.655 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42535]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:27:33.655 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42535]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:33.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:33.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42535]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:33.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42538]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:27:33.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42538]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:33.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:33.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42538]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50764]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50764]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50764]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50767]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50767]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:33.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:33 smithi079 sudo[50767]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:27:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42702]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42705]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:27:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42705]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:34.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42705]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42696]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42696]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42696]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42699]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42699]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:34.064 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:27:33 smithi148 sudo[42699]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:34.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42541]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:27:34.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42541]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:34.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:34.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42541]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:34.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42544]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:27:34.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42544]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:27:34.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:27:34.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:33 smithi098 sudo[42544]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:34 smithi079 ceph-mon[30788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:27:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:34 smithi098 ceph-mon[34832]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:27:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T02:27:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:27:34.815 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:34 smithi148 ceph-mon[34626]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:27:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:35.401+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f05ec0a9ef0 con 0x7f05f4109480 2024-09-21T02:27:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:35 smithi098 ceph-mon[34832]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T02:27:35.692 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:35 smithi079 ceph-mon[30788]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T02:27:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:35 smithi148 ceph-mon[34626]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T02:27:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:36 smithi098 ceph-mon[34832]: pgmap v104: 1 pgs: 1 active+clean; 320 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:36 smithi098 ceph-mon[34832]: mgrmap e17: x(active, since 3m), standbys: z, y 2024-09-21T02:27:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:36 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/342971468' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37557004-b63b-4a46-8eb8-4925af257828"} : dispatch 2024-09-21T02:27:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:36 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/342971468' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37557004-b63b-4a46-8eb8-4925af257828"}]': finished 2024-09-21T02:27:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:36 smithi098 ceph-mon[34832]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:27:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:36 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:27:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:36 smithi079 ceph-mon[30788]: pgmap v104: 1 pgs: 1 active+clean; 320 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:36 smithi079 ceph-mon[30788]: mgrmap e17: x(active, since 3m), standbys: z, y 2024-09-21T02:27:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:36 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/342971468' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37557004-b63b-4a46-8eb8-4925af257828"} : dispatch 2024-09-21T02:27:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:36 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/342971468' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37557004-b63b-4a46-8eb8-4925af257828"}]': finished 2024-09-21T02:27:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:36 smithi079 ceph-mon[30788]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:27:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:36 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:27:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:36 smithi148 ceph-mon[34626]: pgmap v104: 1 pgs: 1 active+clean; 320 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:36 smithi148 ceph-mon[34626]: mgrmap e17: x(active, since 3m), standbys: z, y 2024-09-21T02:27:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:36 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/342971468' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37557004-b63b-4a46-8eb8-4925af257828"} : dispatch 2024-09-21T02:27:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:36 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/342971468' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37557004-b63b-4a46-8eb8-4925af257828"}]': finished 2024-09-21T02:27:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:36 smithi148 ceph-mon[34626]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:27:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:36 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:27:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:37 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2436330328' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:27:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:37 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2436330328' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:27:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:37 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2436330328' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:27:38.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:38 smithi098 ceph-mon[34832]: pgmap v106: 1 pgs: 1 active+clean; 320 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:38.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:38 smithi079 ceph-mon[30788]: pgmap v106: 1 pgs: 1 active+clean; 320 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:38 smithi148 ceph-mon[34626]: pgmap v106: 1 pgs: 1 active+clean; 320 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:39.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:39 smithi079 ceph-mon[30788]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 370 KiB/s wr, 27 op/s 2024-09-21T02:27:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:39 smithi148 ceph-mon[34626]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 370 KiB/s wr, 27 op/s 2024-09-21T02:27:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:39 smithi098 ceph-mon[34832]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 370 KiB/s wr, 27 op/s 2024-09-21T02:27:42.647 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:42 smithi079 ceph-mon[30788]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 263 KiB/s wr, 19 op/s 2024-09-21T02:27:42.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:42 smithi098 ceph-mon[34832]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 263 KiB/s wr, 19 op/s 2024-09-21T02:27:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:42 smithi148 ceph-mon[34626]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 263 KiB/s wr, 19 op/s 2024-09-21T02:27:44.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:44 smithi098 ceph-mon[34832]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 204 KiB/s wr, 15 op/s 2024-09-21T02:27:44.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:44 smithi079 ceph-mon[30788]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 204 KiB/s wr, 15 op/s 2024-09-21T02:27:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:44 smithi148 ceph-mon[34626]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 204 KiB/s wr, 15 op/s 2024-09-21T02:27:45.638 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:45 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:27:45.638 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:45 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:45.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:45 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:27:45.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:45 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:45 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:27:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:45 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:46 smithi098 ceph-mon[34832]: Deploying daemon osd.3 on smithi079 2024-09-21T02:27:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:46 smithi098 ceph-mon[34832]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 183 KiB/s wr, 13 op/s 2024-09-21T02:27:46.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:46 smithi079 ceph-mon[30788]: Deploying daemon osd.3 on smithi079 2024-09-21T02:27:46.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:46 smithi079 ceph-mon[30788]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 183 KiB/s wr, 13 op/s 2024-09-21T02:27:46.714 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:46 smithi148 ceph-mon[34626]: Deploying daemon osd.3 on smithi079 2024-09-21T02:27:46.714 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:46 smithi148 ceph-mon[34626]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 183 KiB/s wr, 13 op/s 2024-09-21T02:27:48.591 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:48 smithi079 ceph-mon[30788]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 162 KiB/s wr, 12 op/s 2024-09-21T02:27:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:48 smithi098 ceph-mon[34832]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 162 KiB/s wr, 12 op/s 2024-09-21T02:27:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:48 smithi148 ceph-mon[34626]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 162 KiB/s wr, 12 op/s 2024-09-21T02:27:50.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:50 smithi098 ceph-mon[34832]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 152 KiB/s wr, 11 op/s 2024-09-21T02:27:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:50 smithi079 ceph-mon[30788]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 152 KiB/s wr, 11 op/s 2024-09-21T02:27:50.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:50 smithi148 ceph-mon[34626]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 152 KiB/s wr, 11 op/s 2024-09-21T02:27:52.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:52 smithi098 ceph-mon[34832]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:52 smithi079 ceph-mon[30788]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:52.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:52 smithi148 ceph-mon[34626]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:54.612 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:54 smithi079 ceph-mon[30788]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:54.612 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:54.612 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:54.612 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:54.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:54 smithi098 ceph-mon[34832]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:54.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:54.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:54.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:54 smithi148 ceph-mon[34626]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:56.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:56 smithi079 ceph-mon[30788]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:56.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:56.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:56 smithi148 ceph-mon[34626]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:56 smithi098 ceph-mon[34832]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:57 smithi079 ceph-mon[30788]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:57.906 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:57.906 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:57.907 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:57 smithi148 ceph-mon[34626]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:57.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:27:57.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:27:57.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:57.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:57 smithi098 ceph-mon[34832]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:27:59.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.077+0000 7f05eaa00640 1 -- 172.21.15.79:0/2393604019 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f05f4063800 con 0x7f05d80b6480 2024-09-21T02:27:59.079 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 3 on host 'smithi079' 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f05d80b6480 msgr2=0x7f05d80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f05d80b6480 0x7f05d80b8990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009bd0 tx=0x7f05e4005f90 comp rx=0 tx=0).stop 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 msgr2=0x7f05f419b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 0x7f05f419b200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00efd0 tx=0x7f05ec00c6a0 comp rx=0 tx=0).stop 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 shutdown_connections 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f05d80b6480 0x7f05d80b8990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05f4109480 0x7f05f419b200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05f41068e0 0x7f05f419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 --2- 172.21.15.79:0/2393604019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05f406c660 0x7f05f4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:27:59.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.080+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 >> 172.21.15.79:0/2393604019 conn(0x7f05f40fdfe0 msgr2=0x7f05f4104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:27:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.082+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 shutdown_connections 2024-09-21T02:27:59.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:27:59.082+0000 7f05f9200640 1 -- 172.21.15.79:0/2393604019 wait complete. 2024-09-21T02:27:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:27:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:59.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:59.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:59.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:27:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:59.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:27:59.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:59.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:27:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:27:59.905 DEBUG:teuthology.orchestra.run.smithi079:osd.3> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T02:27:59.909 INFO:tasks.cephadm:Deploying osd.4 on smithi098 with /dev/vg_nvme/lv_3... 2024-09-21T02:27:59.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:28:00.168 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:28:00.288 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:00 smithi098 ceph-mon[34832]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:28:00.288 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:00 smithi098 ceph-mon[34832]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:28:00.391 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:00 smithi079 ceph-mon[30788]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:28:00.392 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:00 smithi079 ceph-mon[30788]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:28:00.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:00 smithi148 ceph-mon[34626]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:28:00.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:00 smithi148 ceph-mon[34626]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:28:01.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:01 smithi079 ceph-mon[30788]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:28:01.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:01 smithi079 ceph-mon[30788]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:28:01.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:01 smithi079 ceph-mon[30788]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:28:01.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:01 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:01 smithi098 ceph-mon[34832]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:28:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:01 smithi098 ceph-mon[34832]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:28:01.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:01 smithi098 ceph-mon[34832]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:28:01.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:01 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:01 smithi148 ceph-mon[34626]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:28:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:01 smithi148 ceph-mon[34626]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:28:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:01 smithi148 ceph-mon[34626]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:28:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:01 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:02.143 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:28:01 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:28:01.889+0000 7fd621c00640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T02:28:02.143 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:28:01 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:28:01.909+0000 7fd617200640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:28:02.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:02 smithi098 ceph-mon[34832]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:28:02.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:02 smithi098 ceph-mon[34832]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T02:28:02.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:02.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:02.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:02 smithi098 ceph-mon[34832]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:28:02.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:02 smithi098 ceph-mon[34832]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' 2024-09-21T02:28:02.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:02 smithi079 ceph-mon[30788]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:28:02.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:02 smithi079 ceph-mon[30788]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T02:28:02.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:02.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:02.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:02 smithi079 ceph-mon[30788]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:28:02.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:02 smithi079 ceph-mon[30788]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' 2024-09-21T02:28:02.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:02 smithi148 ceph-mon[34626]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:28:02.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:02 smithi148 ceph-mon[34626]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T02:28:02.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:02.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:02.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:02 smithi148 ceph-mon[34626]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:28:02.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:02 smithi148 ceph-mon[34626]: from='osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463]' entity='osd.3' 2024-09-21T02:28:02.731 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:28:02.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-09-21T02:28:02.996 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:28:03.144 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:03 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:28:03.144 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:03 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:28:03.144 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:03 smithi079 ceph-mon[30788]: osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] boot 2024-09-21T02:28:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:03 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:28:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:03 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:28:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:03 smithi098 ceph-mon[34832]: osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] boot 2024-09-21T02:28:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:03 smithi098 ceph-mon[34832]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:28:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:03 smithi098 ceph-mon[34832]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:28:03.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:03 smithi079 ceph-mon[30788]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:28:03.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:03.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:03 smithi079 ceph-mon[30788]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:28:03.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 -- 172.21.15.98:0/2625059542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e40103780 msgr2=0x7f0e40103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 --2- 172.21.15.98:0/2625059542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e40103780 0x7f0e40103bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009ca0 tx=0x7f0e3002a950 comp rx=0 tx=0).stop 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 -- 172.21.15.98:0/2625059542 shutdown_connections 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 --2- 172.21.15.98:0/2625059542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e401051b0 0x7f0e4010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 --2- 172.21.15.98:0/2625059542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e40104810 0x7f0e40104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 --2- 172.21.15.98:0/2625059542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e40103780 0x7f0e40103bf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 -- 172.21.15.98:0/2625059542 >> 172.21.15.98:0/2625059542 conn(0x7f0e400ff0f0 msgr2=0x7f0e401015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 -- 172.21.15.98:0/2625059542 shutdown_connections 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.498+0000 7f0e47731640 1 -- 172.21.15.98:0/2625059542 wait complete. 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 Processor -- start 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 -- start start 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e40103780 0x7f0e40076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:03.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e40104810 0x7f0e40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:03.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e401051b0 0x7f0e40075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:03.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4010f4a0 con 0x7f0e40103780 2024-09-21T02:28:03.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4010f320 con 0x7f0e401051b0 2024-09-21T02:28:03.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e47731640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4010f620 con 0x7f0e40104810 2024-09-21T02:28:03.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e401051b0 0x7f0e40075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:03.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e401051b0 0x7f0e40075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57908/0 (socket says 172.21.15.98:57908) 2024-09-21T02:28:03.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 -- 172.21.15.98:0/3704020832 learned_addr learned my addr 172.21.15.98:0/3704020832 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e44ccc640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e40104810 0x7f0e40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e454cd640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e40103780 0x7f0e40076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 -- 172.21.15.98:0/3704020832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e40104810 msgr2=0x7f0e40075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e40104810 0x7f0e40075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 -- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e40103780 msgr2=0x7f0e40076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e40103780 0x7f0e40076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 -- 172.21.15.98:0/3704020832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e40076350 con 0x7f0e401051b0 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e454cd640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e40103780 0x7f0e40076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.499+0000 7f0e45cce640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e401051b0 0x7f0e40075c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009fd0 tx=0x7f0e3800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:28:03.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.500+0000 7f0e3e7fc640 1 -- 172.21.15.98:0/3704020832 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38011830 con 0x7f0e401051b0 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.500+0000 7f0e3e7fc640 1 -- 172.21.15.98:0/3704020832 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e38016070 con 0x7f0e401051b0 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.500+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e401a41c0 con 0x7f0e401051b0 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.500+0000 7f0e3e7fc640 1 -- 172.21.15.98:0/3704020832 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38010de0 con 0x7f0e401051b0 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.500+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e401a46f0 con 0x7f0e401051b0 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.501+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4010a960 con 0x7f0e401051b0 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.502+0000 7f0e3e7fc640 1 -- 172.21.15.98:0/3704020832 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0e380119d0 con 0x7f0e401051b0 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.503+0000 7f0e3e7fc640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e280b6590 0x7f0e280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:03.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.503+0000 7f0e3e7fc640 1 -- 172.21.15.98:0/3704020832 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3669+0+0 (secure 0 0 0) 0x7f0e380e5d40 con 0x7f0e401051b0 2024-09-21T02:28:03.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.504+0000 7f0e454cd640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e280b6590 0x7f0e280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:03.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.504+0000 7f0e454cd640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e280b6590 0x7f0e280b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e30006010 tx=0x7f0e30009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:28:03.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.506+0000 7f0e3e7fc640 1 -- 172.21.15.98:0/3704020832 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e380ad7f0 con 0x7f0e401051b0 2024-09-21T02:28:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:03 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:28:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:03 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:28:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:03 smithi148 ceph-mon[34626]: osd.3 [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] boot 2024-09-21T02:28:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:03 smithi148 ceph-mon[34626]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:28:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:28:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:03 smithi148 ceph-mon[34626]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:28:03.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:03.696+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0e40063800 con 0x7f0e280b6590 2024-09-21T02:28:04.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:04.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:04.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:04 smithi098 ceph-mon[34832]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T02:28:04.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:04.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:04.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:04 smithi079 ceph-mon[30788]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:04.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:04 smithi148 ceph-mon[34626]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T02:28:05.345 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:05 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi079 2024-09-21T02:28:05.345 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:05 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi079 to 8544M 2024-09-21T02:28:05.345 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:05 smithi098 ceph-mon[34832]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:05.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:05 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi079 2024-09-21T02:28:05.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:05 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi079 to 8544M 2024-09-21T02:28:05.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:05 smithi079 ceph-mon[30788]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:05 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi079 2024-09-21T02:28:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:05 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi079 to 8544M 2024-09-21T02:28:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:05 smithi148 ceph-mon[34626]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:06.449 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:06 smithi098 ceph-mon[34832]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:06.449 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:06 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/1260907038' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"} : dispatch 2024-09-21T02:28:06.449 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:06 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"} : dispatch 2024-09-21T02:28:06.449 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:06 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"}]': finished 2024-09-21T02:28:06.449 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:06 smithi098 ceph-mon[34832]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:28:06.449 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:06 smithi079 ceph-mon[30788]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:06 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/1260907038' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"} : dispatch 2024-09-21T02:28:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:06 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"} : dispatch 2024-09-21T02:28:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:06 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"}]': finished 2024-09-21T02:28:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:06 smithi079 ceph-mon[30788]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:28:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:06 smithi148 ceph-mon[34626]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:06 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/1260907038' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"} : dispatch 2024-09-21T02:28:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:06 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"} : dispatch 2024-09-21T02:28:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:06 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf8be53e-2fbd-4ba9-8186-73a91f978b03"}]': finished 2024-09-21T02:28:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:06 smithi148 ceph-mon[34626]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:28:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:07.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:07 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/2232660614' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:28:07.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:07 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/2232660614' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:28:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:07 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/2232660614' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:28:08.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:08 smithi079 ceph-mon[30788]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:08.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:08 smithi148 ceph-mon[34626]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:08.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:08 smithi098 ceph-mon[34832]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:10.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:10 smithi098 ceph-mon[34832]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T02:28:10.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:10 smithi079 ceph-mon[30788]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T02:28:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:10 smithi148 ceph-mon[34626]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T02:28:12.476 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:12 smithi098 ceph-mon[34832]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:28:12.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:12 smithi079 ceph-mon[30788]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:28:12.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:12 smithi148 ceph-mon[34626]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:28:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:14 smithi098 ceph-mon[34832]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:28:14.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:14 smithi079 ceph-mon[30788]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:28:14.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:14 smithi148 ceph-mon[34626]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:28:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:28:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:28:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:15.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:28:15.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:16.607 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:16 smithi098 ceph-mon[34832]: Deploying daemon osd.4 on smithi098 2024-09-21T02:28:16.607 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:16 smithi098 ceph-mon[34832]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:28:16.714 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:16 smithi148 ceph-mon[34626]: Deploying daemon osd.4 on smithi098 2024-09-21T02:28:16.714 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:16 smithi148 ceph-mon[34626]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:28:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:16 smithi079 ceph-mon[30788]: Deploying daemon osd.4 on smithi098 2024-09-21T02:28:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:16 smithi079 ceph-mon[30788]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:28:18.477 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:18 smithi098 ceph-mon[34832]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T02:28:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:18 smithi079 ceph-mon[30788]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T02:28:18.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:18 smithi148 ceph-mon[34626]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T02:28:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:19 smithi079 ceph-mon[30788]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:28:19.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:19 smithi148 ceph-mon[34626]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:28:19.870 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:19 smithi098 ceph-mon[34832]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:28:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:21 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:21 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:21 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:21.583 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:21 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:21.583 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:21 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:21.583 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:21 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:21 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:21 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:21 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:22.511 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:22 smithi098 ceph-mon[34832]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:22.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:22 smithi148 ceph-mon[34626]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:22 smithi079 ceph-mon[30788]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:24 smithi098 ceph-mon[34832]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:24 smithi079 ceph-mon[30788]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:24.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:24.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:24.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:24 smithi148 ceph-mon[34626]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:25.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.291+0000 7f0e3e7fc640 1 -- 172.21.15.98:0/3704020832 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0e40063800 con 0x7f0e280b6590 2024-09-21T02:28:25.293 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 4 on host 'smithi098' 2024-09-21T02:28:25.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e280b6590 msgr2=0x7f0e280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:25.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e280b6590 0x7f0e280b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e30006010 tx=0x7f0e30009360 comp rx=0 tx=0).stop 2024-09-21T02:28:25.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e401051b0 msgr2=0x7f0e40075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:25.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e401051b0 0x7f0e40075c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009fd0 tx=0x7f0e3800b8e0 comp rx=0 tx=0).stop 2024-09-21T02:28:25.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 shutdown_connections 2024-09-21T02:28:25.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e280b6590 0x7f0e280b8aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:25.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e401051b0 0x7f0e40075c50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:25.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e40104810 0x7f0e40075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:25.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 --2- 172.21.15.98:0/3704020832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e40103780 0x7f0e40076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:25.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 >> 172.21.15.98:0/3704020832 conn(0x7f0e400ff0f0 msgr2=0x7f0e40107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:28:25.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 shutdown_connections 2024-09-21T02:28:25.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:28:25.294+0000 7f0e47731640 1 -- 172.21.15.98:0/3704020832 wait complete. 2024-09-21T02:28:25.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:25.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:25.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:25.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:25 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:25.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:25 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:25.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:25 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:25.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:25 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:25.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:25 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:25.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:25 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:25.982 DEBUG:teuthology.orchestra.run.smithi098:osd.4> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T02:28:25.985 INFO:tasks.cephadm:Deploying osd.5 on smithi148 with /dev/vg_nvme/lv_3... 2024-09-21T02:28:25.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:28:26.241 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:28:26.630 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:26 smithi148 ceph-mon[34626]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:26.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:26 smithi098 ceph-mon[34832]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:26.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:26 smithi079 ceph-mon[30788]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:27.155 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:28:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:28:26.792+0000 7f8b92528640 -1 osd.4 0 log_to_monitors true 2024-09-21T02:28:27.453 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:27 smithi098 ceph-mon[34832]: from='osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:28:27.453 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:27 smithi098 ceph-mon[34832]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:28:27.652 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:27 smithi148 ceph-mon[34626]: from='osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:28:27.652 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:27 smithi148 ceph-mon[34626]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:28:27.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:27 smithi079 ceph-mon[30788]: from='osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:28:27.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:27 smithi079 ceph-mon[30788]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:28:28.518 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:28:28.407+0000 7f8b8e4aa640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T02:28:28.519 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:28:28.415+0000 7f8b8a2a8640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:28:28.519 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-mon[34832]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:28.519 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-mon[34832]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:28:28.519 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-mon[34832]: from='osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:28:28.519 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-mon[34832]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:28:28.519 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:28.519 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:28 smithi098 ceph-mon[34832]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:28:28.530 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:28 smithi148 ceph-mon[34626]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:28.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:28 smithi148 ceph-mon[34626]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:28:28.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:28 smithi148 ceph-mon[34626]: from='osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:28:28.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:28 smithi148 ceph-mon[34626]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:28:28.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:28.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:28 smithi148 ceph-mon[34626]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:28:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:28 smithi079 ceph-mon[30788]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:28 smithi079 ceph-mon[30788]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:28:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:28 smithi079 ceph-mon[30788]: from='osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:28:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:28 smithi079 ceph-mon[30788]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:28:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:28 smithi079 ceph-mon[30788]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:28:28.886 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:28:28.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_3 2024-09-21T02:28:29.163 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:28:29.537 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:28:29.537 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T02:28:29.537 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:29.538 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:28:29.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T02:28:29.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:29.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:29.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 -- 172.21.15.148:0/3610393875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 msgr2=0x7f1738102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:29.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 --2- 172.21.15.148:0/3610393875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f1738102ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1728009900 tx=0x7f172802a480 comp rx=0 tx=0).stop 2024-09-21T02:28:29.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 -- 172.21.15.148:0/3610393875 shutdown_connections 2024-09-21T02:28:29.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 --2- 172.21.15.148:0/3610393875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1738104090 0x7f173810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 --2- 172.21.15.148:0/3610393875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17381036f0 0x7f1738103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 --2- 172.21.15.148:0/3610393875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f1738102ad0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 -- 172.21.15.148:0/3610393875 >> 172.21.15.148:0/3610393875 conn(0x7f17380fdfd0 msgr2=0x7f1738100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:28:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 -- 172.21.15.148:0/3610393875 shutdown_connections 2024-09-21T02:28:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.754+0000 7f173c882640 1 -- 172.21.15.148:0/3610393875 wait complete. 2024-09-21T02:28:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 Processor -- start 2024-09-21T02:28:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 -- start start 2024-09-21T02:28:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f173819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17381036f0 0x7f173819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1738104090 0x7f173819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f173810f410 con 0x7f1738104090 2024-09-21T02:28:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f173810f290 con 0x7f17381036f0 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.755+0000 7f173c882640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f173810f590 con 0x7f1738102660 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f173819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f173819a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58958/0 (socket says 172.21.15.148:58958) 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 -- 172.21.15.148:0/269524109 learned_addr learned my addr 172.21.15.148:0/269524109 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f172ffff640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17381036f0 0x7f173819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f1736d9d640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1738104090 0x7f173819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 -- 172.21.15.148:0/269524109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17381036f0 msgr2=0x7f173819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17381036f0 0x7f173819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 -- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1738104090 msgr2=0x7f173819b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1738104090 0x7f173819b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 -- 172.21.15.148:0/269524109 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173819ba70 con 0x7f1738102660 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173659c640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f173819a040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1728006010 tx=0x7f1728004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f172f7fe640 1 -- 172.21.15.148:0/269524109 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172803f030 con 0x7f1738102660 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f172f7fe640 1 -- 172.21.15.148:0/269524109 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1728003cb0 con 0x7f1738102660 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173819bd00 con 0x7f1738102660 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f172f7fe640 1 -- 172.21.15.148:0/269524109 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728035070 con 0x7f1738102660 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.756+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17381a2310 con 0x7f1738102660 2024-09-21T02:28:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.757+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1738109840 con 0x7f1738102660 2024-09-21T02:28:29.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.759+0000 7f172f7fe640 1 -- 172.21.15.148:0/269524109 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1728042030 con 0x7f1738102660 2024-09-21T02:28:29.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.760+0000 7f172f7fe640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f17240b6510 0x7f17240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:29.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.760+0000 7f172f7fe640 1 -- 172.21.15.148:0/269524109 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4101+0+0 (secure 0 0 0) 0x7f1728106fb0 con 0x7f1738102660 2024-09-21T02:28:29.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.760+0000 7f172ffff640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f17240b6510 0x7f17240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:29.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.761+0000 7f172ffff640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f17240b6510 0x7f17240b8a20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f172000bbe0 tx=0x7f172000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:28:29.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.763+0000 7f172f7fe640 1 -- 172.21.15.148:0/269524109 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17280ce8b0 con 0x7f1738102660 2024-09-21T02:28:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:28:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T02:28:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:29.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:29.953+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1738063800 con 0x7f17240b6510 2024-09-21T02:28:30.664 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi098 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] boot 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:30.665 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:28:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:28:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi098 2024-09-21T02:28:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] boot 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:28:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:28:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi098 2024-09-21T02:28:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-21T02:28:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:28:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: osd.4 [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] boot 2024-09-21T02:28:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:28:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:28:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:31.617 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:31 smithi148 ceph-mon[34626]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T02:28:31.617 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:31 smithi148 ceph-mon[34626]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:31.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:31 smithi079 ceph-mon[30788]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T02:28:31.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:31 smithi079 ceph-mon[30788]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:31 smithi098 ceph-mon[34832]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T02:28:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:31 smithi098 ceph-mon[34832]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:32.681 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:32 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/734458943' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"} : dispatch 2024-09-21T02:28:32.682 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:32 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"} : dispatch 2024-09-21T02:28:32.682 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:32 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"}]': finished 2024-09-21T02:28:32.682 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:32 smithi148 ceph-mon[34626]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:28:32.682 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:32 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:32 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/734458943' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"} : dispatch 2024-09-21T02:28:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:32 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"} : dispatch 2024-09-21T02:28:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:32 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"}]': finished 2024-09-21T02:28:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:32 smithi079 ceph-mon[30788]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:28:32.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:32 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:32 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/734458943' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"} : dispatch 2024-09-21T02:28:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:32 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"} : dispatch 2024-09-21T02:28:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:32 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "446809f9-3274-40e0-a46d-0537ad693e9b"}]': finished 2024-09-21T02:28:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:32 smithi098 ceph-mon[34832]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:28:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:32 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:33.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:33 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/3869709354' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:28:33.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:33 smithi079 ceph-mon[30788]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:33.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:33 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/3869709354' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:28:33.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:33 smithi148 ceph-mon[34626]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:33 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/3869709354' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:28:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:33 smithi098 ceph-mon[34832]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:36 smithi098 ceph-mon[34832]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:36 smithi079 ceph-mon[30788]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:36 smithi148 ceph-mon[34626]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:38 smithi148 ceph-mon[34626]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:38.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:38 smithi098 ceph-mon[34832]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:38.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:38 smithi079 ceph-mon[30788]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:40 smithi148 ceph-mon[34626]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:40.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:40 smithi098 ceph-mon[34832]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:40 smithi079 ceph-mon[30788]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:41.642 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:28:41.642 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:28:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:28:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:42.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:42 smithi148 ceph-mon[34626]: Deploying daemon osd.5 on smithi148 2024-09-21T02:28:42.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:42 smithi148 ceph-mon[34626]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:42 smithi079 ceph-mon[30788]: Deploying daemon osd.5 on smithi148 2024-09-21T02:28:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:42 smithi079 ceph-mon[30788]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:42 smithi098 ceph-mon[34832]: Deploying daemon osd.5 on smithi148 2024-09-21T02:28:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:42 smithi098 ceph-mon[34832]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:44.515 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:44 smithi148 ceph-mon[34626]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:44 smithi079 ceph-mon[30788]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:44 smithi098 ceph-mon[34832]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:46.644 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:46 smithi148 ceph-mon[34626]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:46.707 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:46 smithi098 ceph-mon[34832]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:46 smithi079 ceph-mon[30788]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:47.690 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:47.690 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:47.691 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:47.691 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:47 smithi148 ceph-mon[34626]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:47 smithi079 ceph-mon[30788]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:47 smithi098 ceph-mon[34832]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:50.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:50 smithi148 ceph-mon[34626]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:50.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:50.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:50.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:50 smithi098 ceph-mon[34832]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:50.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:50.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:50.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:50 smithi079 ceph-mon[30788]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:50.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:50.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:50.923 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 5 on host 'smithi148' 2024-09-21T02:28:50.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.922+0000 7f172f7fe640 1 -- 172.21.15.148:0/269524109 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1738063800 con 0x7f17240b6510 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f17240b6510 msgr2=0x7f17240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f17240b6510 0x7f17240b8a20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f172000bbe0 tx=0x7f172000b390 comp rx=0 tx=0).stop 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 msgr2=0x7f173819a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f173819a040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1728006010 tx=0x7f1728004340 comp rx=0 tx=0).stop 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 shutdown_connections 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f17240b6510 0x7f17240b8a20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1738104090 0x7f173819b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17381036f0 0x7f173819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 --2- 172.21.15.148:0/269524109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738102660 0x7f173819a040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 >> 172.21.15.148:0/269524109 conn(0x7f17380fdfd0 msgr2=0x7f1738106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:28:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 shutdown_connections 2024-09-21T02:28:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:28:50.925+0000 7f173c882640 1 -- 172.21.15.148:0/269524109 wait complete. 2024-09-21T02:28:51.518 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:51.518 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:51.518 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:51.544 DEBUG:teuthology.orchestra.run.smithi148:osd.5> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T02:28:51.546 INFO:tasks.cephadm:Deploying osd.6 on smithi079 with /dev/vg_nvme/lv_2... 2024-09-21T02:28:51.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:28:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:28:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:51.920 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:28:52.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:52 smithi098 ceph-mon[34832]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:52.716 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:52 smithi148 ceph-mon[34626]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:52 smithi079 ceph-mon[30788]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:53.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:53 smithi079 ceph-mon[30788]: from='osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:28:53.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:53 smithi079 ceph-mon[30788]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:28:53.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:53 smithi098 ceph-mon[34832]: from='osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:28:53.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:53 smithi098 ceph-mon[34832]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:28:53.736 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:53 smithi148 ceph-mon[34626]: from='osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:28:53.736 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:53 smithi148 ceph-mon[34626]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:28:53.737 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:28:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:28:53.371+0000 7f1f1dcdf640 -1 osd.5 0 log_to_monitors true 2024-09-21T02:28:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:54 smithi079 ceph-mon[30788]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:54 smithi079 ceph-mon[30788]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:28:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:54 smithi079 ceph-mon[30788]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:28:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:54 smithi079 ceph-mon[30788]: from='osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:28:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:54 smithi079 ceph-mon[30788]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:28:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:54 smithi148 ceph-mon[34626]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:54 smithi148 ceph-mon[34626]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:28:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:54 smithi148 ceph-mon[34626]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:28:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:54 smithi148 ceph-mon[34626]: from='osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:28:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:54 smithi148 ceph-mon[34626]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:28:54.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:54 smithi098 ceph-mon[34832]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:54.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:54 smithi098 ceph-mon[34832]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:28:54.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:54 smithi098 ceph-mon[34832]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:28:54.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:54.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:54 smithi098 ceph-mon[34832]: from='osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:28:54.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:54 smithi098 ceph-mon[34832]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:28:55.255 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:28:55.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_2 2024-09-21T02:28:55.420 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:28:55.094+0000 7f1f19c61640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T02:28:55.420 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:28:55.100+0000 7f1f11a57640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:28:55.661 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:55.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:55.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:55.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:55 smithi079 ceph-mon[30788]: from='osd.5 ' entity='osd.5' 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:55 smithi148 ceph-mon[34626]: from='osd.5 ' entity='osd.5' 2024-09-21T02:28:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:28:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T02:28:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:55.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:28:55.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:55.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:28:55.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:28:55.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:55 smithi098 ceph-mon[34832]: from='osd.5 ' entity='osd.5' 2024-09-21T02:28:56.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 -- 172.21.15.79:0/3850708095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f81073b0 msgr2=0x7f64f810dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:56.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 --2- 172.21.15.79:0/3850708095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f81073b0 0x7f64f810dd50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009ca0 tx=0x7f64f002a950 comp rx=0 tx=0).stop 2024-09-21T02:28:56.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 -- 172.21.15.79:0/3850708095 shutdown_connections 2024-09-21T02:28:56.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 --2- 172.21.15.79:0/3850708095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f81073b0 0x7f64f810dd50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:56.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 --2- 172.21.15.79:0/3850708095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f8106a10 0x7f64f8106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:56.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 --2- 172.21.15.79:0/3850708095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64f8105980 0x7f64f8105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:56.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 -- 172.21.15.79:0/3850708095 >> 172.21.15.79:0/3850708095 conn(0x7f64f81012f0 msgr2=0x7f64f81037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:28:56.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 -- 172.21.15.79:0/3850708095 shutdown_connections 2024-09-21T02:28:56.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.307+0000 7f64fea00640 1 -- 172.21.15.79:0/3850708095 wait complete. 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.308+0000 7f64fea00640 1 Processor -- start 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fea00640 1 -- start start 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64f8105980 0x7f64f819c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f8106a10 0x7f64f819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f81073b0 0x7f64f819d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fea00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64f81115b0 con 0x7f64f8106a10 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fea00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f64f8111430 con 0x7f64f8105980 2024-09-21T02:28:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fea00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f64f8111730 con 0x7f64f81073b0 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64f7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f8106a10 0x7f64f819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64f7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f8106a10 0x7f64f819c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42374/0 (socket says 172.21.15.79:42374) 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64f7400640 1 -- 172.21.15.79:0/623386528 learned_addr learned my addr 172.21.15.79:0/623386528 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64f7e00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64f8105980 0x7f64f819c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.309+0000 7f64fca00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f81073b0 0x7f64f819d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f7400640 1 -- 172.21.15.79:0/623386528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f81073b0 msgr2=0x7f64f819d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f7400640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f81073b0 0x7f64f819d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f7400640 1 -- 172.21.15.79:0/623386528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64f8105980 msgr2=0x7f64f819c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f7400640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64f8105980 0x7f64f819c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f7400640 1 -- 172.21.15.79:0/623386528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f819dba0 con 0x7f64f8106a10 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f7e00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64f8105980 0x7f64f819c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:28:56.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f7400640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f8106a10 0x7f64f819c7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f64e400ea60 tx=0x7f64e400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:28:56.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f4c00640 1 -- 172.21.15.79:0/623386528 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e400cde0 con 0x7f64f8106a10 2024-09-21T02:28:56.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f4c00640 1 -- 172.21.15.79:0/623386528 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64e40035f0 con 0x7f64f8106a10 2024-09-21T02:28:56.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f819de90 con 0x7f64f8106a10 2024-09-21T02:28:56.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64f4c00640 1 -- 172.21.15.79:0/623386528 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4010690 con 0x7f64f8106a10 2024-09-21T02:28:56.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.310+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f81a4590 con 0x7f64f8106a10 2024-09-21T02:28:56.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.312+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f810cb40 con 0x7f64f8106a10 2024-09-21T02:28:56.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.315+0000 7f64f4c00640 1 -- 172.21.15.79:0/623386528 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f64e40037a0 con 0x7f64f8106a10 2024-09-21T02:28:56.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.316+0000 7f64f4c00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64dc0b6510 0x7f64dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:28:56.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.316+0000 7f64f4c00640 1 -- 172.21.15.79:0/623386528 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7f64e40e67d0 con 0x7f64f8106a10 2024-09-21T02:28:56.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.316+0000 7f64f7e00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64dc0b6510 0x7f64dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:28:56.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.317+0000 7f64f7e00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64dc0b6510 0x7f64dc0b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009fc0 tx=0x7f64e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:28:56.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.320+0000 7f64f4c00640 1 -- 172.21.15.79:0/623386528 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64e40ade60 con 0x7f64f8106a10 2024-09-21T02:28:56.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:28:56.524+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f64f8063800 con 0x7f64dc0b6510 2024-09-21T02:28:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:28:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:28:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi148 2024-09-21T02:28:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T02:28:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] boot 2024-09-21T02:28:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:28:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:56 smithi079 ceph-mon[30788]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi148 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] boot 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:56 smithi148 ceph-mon[34626]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:28:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:28:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:28:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi148 2024-09-21T02:28:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T02:28:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:28:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: osd.5 [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] boot 2024-09-21T02:28:56.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:28:56.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:28:56.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:56 smithi098 ceph-mon[34832]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:28:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:57 smithi079 ceph-mon[30788]: from='client.14481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:57 smithi079 ceph-mon[30788]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:28:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:28:57 smithi079 ceph-mon[30788]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T02:28:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:57 smithi148 ceph-mon[34626]: from='client.14481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:57 smithi148 ceph-mon[34626]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:28:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:28:57 smithi148 ceph-mon[34626]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T02:28:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:57 smithi098 ceph-mon[34832]: from='client.14481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:28:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:28:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:28:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:57 smithi098 ceph-mon[34832]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:28:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:28:57 smithi098 ceph-mon[34832]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T02:29:00.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:00 smithi098 ceph-mon[34832]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T02:29:00.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:00 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1452142557' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6873243a-bb31-4cea-a715-e58b6a9a0141"} : dispatch 2024-09-21T02:29:00.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:00 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1452142557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6873243a-bb31-4cea-a715-e58b6a9a0141"}]': finished 2024-09-21T02:29:00.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:00 smithi098 ceph-mon[34832]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:29:00.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:00 smithi079 ceph-mon[30788]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T02:29:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:00 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1452142557' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6873243a-bb31-4cea-a715-e58b6a9a0141"} : dispatch 2024-09-21T02:29:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:00 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1452142557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6873243a-bb31-4cea-a715-e58b6a9a0141"}]': finished 2024-09-21T02:29:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:00 smithi079 ceph-mon[30788]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:29:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:00 smithi148 ceph-mon[34626]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T02:29:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:00 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1452142557' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6873243a-bb31-4cea-a715-e58b6a9a0141"} : dispatch 2024-09-21T02:29:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:00 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1452142557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6873243a-bb31-4cea-a715-e58b6a9a0141"}]': finished 2024-09-21T02:29:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:00 smithi148 ceph-mon[34626]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:29:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:01.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:01 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4282462117' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:01.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:01 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4282462117' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:01.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:01 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4282462117' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:02.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:02 smithi079 ceph-mon[30788]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T02:29:02.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:02 smithi148 ceph-mon[34626]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T02:29:02.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:02 smithi098 ceph-mon[34832]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T02:29:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:04 smithi079 ceph-mon[30788]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T02:29:04.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:04 smithi148 ceph-mon[34626]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T02:29:04.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:04 smithi098 ceph-mon[34832]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T02:29:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:06 smithi079 ceph-mon[30788]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:29:06.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:06 smithi148 ceph-mon[34626]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:29:06.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:06 smithi098 ceph-mon[34832]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:29:08.620 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:08 smithi079 ceph-mon[30788]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:29:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:08 smithi148 ceph-mon[34626]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:29:08.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:08 smithi098 ceph-mon[34832]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:29:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:09 smithi079 ceph-mon[30788]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:09 smithi148 ceph-mon[34626]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:09.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:09 smithi098 ceph-mon[34832]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:10.597 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:29:10.597 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:10.597 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:10 smithi079 ceph-mon[30788]: Deploying daemon osd.6 on smithi079 2024-09-21T02:29:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:29:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:10 smithi148 ceph-mon[34626]: Deploying daemon osd.6 on smithi079 2024-09-21T02:29:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:29:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:10 smithi098 ceph-mon[34832]: Deploying daemon osd.6 on smithi079 2024-09-21T02:29:11.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:11 smithi079 ceph-mon[30788]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:11.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:11 smithi148 ceph-mon[34626]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:11 smithi098 ceph-mon[34832]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:14.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:14 smithi098 ceph-mon[34832]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:14.683 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:14 smithi079 ceph-mon[30788]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:14 smithi148 ceph-mon[34626]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:16.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:16 smithi079 ceph-mon[30788]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:16.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:16 smithi098 ceph-mon[34832]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:16.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:16 smithi148 ceph-mon[34626]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:18 smithi098 ceph-mon[34832]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:18 smithi079 ceph-mon[30788]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:18.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:18 smithi148 ceph-mon[34626]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:18.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:18.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:18.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:20.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:20 smithi079 ceph-mon[30788]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:20.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:20 smithi148 ceph-mon[34626]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:20.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:20 smithi098 ceph-mon[34832]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:22 smithi079 ceph-mon[30788]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:22 smithi148 ceph-mon[34626]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:22 smithi098 ceph-mon[34832]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:23.687 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 6 on host 'smithi079' 2024-09-21T02:29:23.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.685+0000 7f64f4c00640 1 -- 172.21.15.79:0/623386528 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f64f8063800 con 0x7f64dc0b6510 2024-09-21T02:29:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.688+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64dc0b6510 msgr2=0x7f64dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.688+0000 7f64fea00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64dc0b6510 0x7f64dc0b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009fc0 tx=0x7f64e8005f90 comp rx=0 tx=0).stop 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.688+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f8106a10 msgr2=0x7f64f819c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.688+0000 7f64fea00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f8106a10 0x7f64f819c7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f64e400ea60 tx=0x7f64e400ef20 comp rx=0 tx=0).stop 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 shutdown_connections 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64dc0b6510 0x7f64dc0b8a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f81073b0 0x7f64f819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f8106a10 0x7f64f819c7e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 --2- 172.21.15.79:0/623386528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64f8105980 0x7f64f819c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 >> 172.21.15.79:0/623386528 conn(0x7f64f81012f0 msgr2=0x7f64f8109d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:29:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 shutdown_connections 2024-09-21T02:29:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:29:23.689+0000 7f64fea00640 1 -- 172.21.15.79:0/623386528 wait complete. 2024-09-21T02:29:24.555 DEBUG:teuthology.orchestra.run.smithi079:osd.6> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T02:29:24.561 INFO:tasks.cephadm:Deploying osd.7 on smithi098 with /dev/vg_nvme/lv_2... 2024-09-21T02:29:24.562 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:29:24.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:24 smithi079 ceph-mon[30788]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:24.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:24.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:24.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:24.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:24 smithi079 ceph-mon[30788]: from='osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:29:24.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:24 smithi079 ceph-mon[30788]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:29:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:24 smithi148 ceph-mon[34626]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:24 smithi148 ceph-mon[34626]: from='osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:29:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:24 smithi148 ceph-mon[34626]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:29:24.820 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:29:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:24 smithi098 ceph-mon[34832]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:24 smithi098 ceph-mon[34832]: from='osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:29:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:24 smithi098 ceph-mon[34832]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:29:25.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-mon[30788]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:29:25.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-mon[30788]: from='osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:29:25.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-mon[30788]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:29:25.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:25.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-mon[30788]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:29:25.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-mon[30788]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:25.841 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:29:25.710+0000 7fe3d8e00640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T02:29:25.841 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:29:25 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:29:25.721+0000 7fe3d3e00640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:29:26.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:25 smithi148 ceph-mon[34626]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:29:26.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:25 smithi148 ceph-mon[34626]: from='osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:29:26.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:25 smithi148 ceph-mon[34626]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:29:26.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:25 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:26.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:25 smithi148 ceph-mon[34626]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:29:26.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:25 smithi148 ceph-mon[34626]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:26.138 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:25 smithi098 ceph-mon[34832]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:29:26.138 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:25 smithi098 ceph-mon[34832]: from='osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:29:26.138 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:25 smithi098 ceph-mon[34832]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:29:26.138 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:26.138 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:25 smithi098 ceph-mon[34832]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:29:26.138 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:25 smithi098 ceph-mon[34832]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:29:26.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:26 smithi079 ceph-mon[30788]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:29:26.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:26 smithi079 ceph-mon[30788]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T02:29:26.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:26.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:26.989 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:26 smithi098 ceph-mon[34832]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:29:26.989 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:26 smithi098 ceph-mon[34832]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T02:29:26.989 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:26.989 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:26 smithi148 ceph-mon[34626]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:29:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:26 smithi148 ceph-mon[34626]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T02:29:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:27.628 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:29:27.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-09-21T02:29:27.902 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:29:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:27 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:29:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:27 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:29:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:27 smithi098 ceph-mon[34832]: osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] boot 2024-09-21T02:29:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:27 smithi098 ceph-mon[34832]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:29:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:27 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:27 smithi098 ceph-mon[34832]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:27.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:27 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:29:27.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:27 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:29:27.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:27 smithi079 ceph-mon[30788]: osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] boot 2024-09-21T02:29:27.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:27 smithi079 ceph-mon[30788]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:29:27.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:27 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:27.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:27 smithi079 ceph-mon[30788]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:28.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:27 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:29:28.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:27 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:29:28.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:27 smithi148 ceph-mon[34626]: osd.6 [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] boot 2024-09-21T02:29:28.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:27 smithi148 ceph-mon[34626]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:29:28.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:27 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:29:28.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:27 smithi148 ceph-mon[34626]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 -- 172.21.15.98:0/321082209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f04103710 msgr2=0x7f7f04103b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/321082209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f04103710 0x7f7f04103b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009900 tx=0x7f7ef802a480 comp rx=0 tx=0).stop 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 -- 172.21.15.98:0/321082209 shutdown_connections 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/321082209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f041040b0 0x7f7f0410aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/321082209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f04103710 0x7f7f04103b20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/321082209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f04102680 0x7f7f04102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 -- 172.21.15.98:0/321082209 >> 172.21.15.98:0/321082209 conn(0x7f7f040fdff0 msgr2=0x7f7f041004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 -- 172.21.15.98:0/321082209 shutdown_connections 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.378+0000 7f7f09d9b640 1 -- 172.21.15.98:0/321082209 wait complete. 2024-09-21T02:29:28.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 Processor -- start 2024-09-21T02:29:28.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 -- start start 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f04102680 0x7f7f0419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f04103710 0x7f7f0419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f041040b0 0x7f7f0419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0410e350 con 0x7f7f04102680 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0410e1d0 con 0x7f7f041040b0 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f09d9b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0410e4d0 con 0x7f7f04103710 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f041040b0 0x7f7f0419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f041040b0 0x7f7f0419b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44320/0 (socket says 172.21.15.98:44320) 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.379+0000 7f7f03fff640 1 -- 172.21.15.98:0/487334219 learned_addr learned my addr 172.21.15.98:0/487334219 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f02ffd640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f04103710 0x7f7f0419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:29:28.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f037fe640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f04102680 0x7f7f0419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f03fff640 1 -- 172.21.15.98:0/487334219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f04103710 msgr2=0x7f7f0419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f03fff640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f04103710 0x7f7f0419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f03fff640 1 -- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f04102680 msgr2=0x7f7f0419a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f03fff640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f04102680 0x7f7f0419a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f03fff640 1 -- 172.21.15.98:0/487334219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0419ba40 con 0x7f7f041040b0 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f037fe640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f04102680 0x7f7f0419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f03fff640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f041040b0 0x7f7f0419b220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009fd0 tx=0x7f7efc00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f00ff9640 1 -- 172.21.15.98:0/487334219 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc011830 con 0x7f7f041040b0 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0419bd30 con 0x7f7f041040b0 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f00ff9640 1 -- 172.21.15.98:0/487334219 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7efc016070 con 0x7f7f041040b0 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f00ff9640 1 -- 172.21.15.98:0/487334219 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc010de0 con 0x7f7f041040b0 2024-09-21T02:29:28.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.380+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f041a2430 con 0x7f7f041040b0 2024-09-21T02:29:28.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.381+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f041a2660 con 0x7f7f041040b0 2024-09-21T02:29:28.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.383+0000 7f7f00ff9640 1 -- 172.21.15.98:0/487334219 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f7efc0119d0 con 0x7f7f041040b0 2024-09-21T02:29:28.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.384+0000 7f7f00ff9640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6510 0x7f7eec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:28.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.384+0000 7f7f00ff9640 1 -- 172.21.15.98:0/487334219 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f7efc0e6270 con 0x7f7f041040b0 2024-09-21T02:29:28.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.384+0000 7f7f037fe640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6510 0x7f7eec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:29:28.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.384+0000 7f7f037fe640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6510 0x7f7eec0b8a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005fd0 tx=0x7f7ef4009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:29:28.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.387+0000 7f7f00ff9640 1 -- 172.21.15.98:0/487334219 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7efc0ad810 con 0x7f7f041040b0 2024-09-21T02:29:28.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:28.574+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7f040fffa0 con 0x7f7eec0b6510 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi079 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi079 to 5696M 2024-09-21T02:29:28.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:28.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:28.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:29:28.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:29:28.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:28.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T02:29:28.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi079 2024-09-21T02:29:28.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi079 to 5696M 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:29:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi079 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi079 to 5696M 2024-09-21T02:29:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:29.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:29.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:29.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:29.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:29:29.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:29:29.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:29.969 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:29 smithi098 ceph-mon[34832]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:29.969 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:29 smithi098 ceph-mon[34832]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:29.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:29 smithi079 ceph-mon[30788]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:29.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:29 smithi079 ceph-mon[30788]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:30.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:29 smithi148 ceph-mon[34626]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:30.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:29 smithi148 ceph-mon[34626]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:31.358 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:31 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/2888188610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"} : dispatch 2024-09-21T02:29:31.358 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:31 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"} : dispatch 2024-09-21T02:29:31.358 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:31 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"}]': finished 2024-09-21T02:29:31.359 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:31 smithi098 ceph-mon[34832]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:29:31.359 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:31.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:31 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/2888188610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"} : dispatch 2024-09-21T02:29:31.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:31 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"} : dispatch 2024-09-21T02:29:31.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:31 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"}]': finished 2024-09-21T02:29:31.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:31 smithi079 ceph-mon[30788]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:29:31.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:31 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/2888188610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"} : dispatch 2024-09-21T02:29:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:31 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"} : dispatch 2024-09-21T02:29:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:31 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ed3149d-a298-4054-98cd-4eead484fcec"}]': finished 2024-09-21T02:29:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:31 smithi148 ceph-mon[34626]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:29:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:32.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:32 smithi098 ceph-mon[34832]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:32.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:32 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/2630887947' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:32 smithi079 ceph-mon[30788]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:32.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:32 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/2630887947' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:32.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:32 smithi148 ceph-mon[34626]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:32.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:32 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/2630887947' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:34 smithi098 ceph-mon[34832]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:34.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:34 smithi079 ceph-mon[30788]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:34.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:34 smithi148 ceph-mon[34626]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:36 smithi098 ceph-mon[34832]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:36 smithi079 ceph-mon[30788]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:36 smithi148 ceph-mon[34626]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:38.495 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:38 smithi098 ceph-mon[34832]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:38.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:38 smithi079 ceph-mon[30788]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:38 smithi148 ceph-mon[34626]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:40.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:40 smithi098 ceph-mon[34832]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:40.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:40 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:29:40.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:40 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:40 smithi079 ceph-mon[30788]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:40 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:29:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:40 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:40.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:40 smithi148 ceph-mon[34626]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:40.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:40 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:29:40.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:40 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:41.515 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:41 smithi098 ceph-mon[34832]: Deploying daemon osd.7 on smithi098 2024-09-21T02:29:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:41 smithi079 ceph-mon[30788]: Deploying daemon osd.7 on smithi098 2024-09-21T02:29:41.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:41 smithi148 ceph-mon[34626]: Deploying daemon osd.7 on smithi098 2024-09-21T02:29:42.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:42 smithi098 ceph-mon[34832]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:42 smithi079 ceph-mon[30788]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:42.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:42 smithi148 ceph-mon[34626]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:43.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:43 smithi098 ceph-mon[34832]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:43 smithi079 ceph-mon[30788]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:43 smithi148 ceph-mon[34626]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:46.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:46 smithi098 ceph-mon[34832]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:46.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:46 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:46.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:46 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:46.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:46 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:46 smithi079 ceph-mon[30788]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:46 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:46 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:46 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:46.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:46 smithi148 ceph-mon[34626]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:46.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:46 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:46.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:46 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:46.796 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:46 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:48.484 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:48 smithi098 ceph-mon[34832]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:48 smithi079 ceph-mon[30788]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:48.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:48 smithi148 ceph-mon[34626]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:49.821 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:49 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:49.821 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:49 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:49.821 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:49 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:49.821 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:49 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:49.821 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:49 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:49.821 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:49 smithi098 ceph-mon[34832]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:49.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.876+0000 7f7f00ff9640 1 -- 172.21.15.98:0/487334219 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7f040fffa0 con 0x7f7eec0b6510 2024-09-21T02:29:49.878 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 7 on host 'smithi098' 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6510 msgr2=0x7f7eec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6510 0x7f7eec0b8a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005fd0 tx=0x7f7ef4009520 comp rx=0 tx=0).stop 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f041040b0 msgr2=0x7f7f0419b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f041040b0 0x7f7f0419b220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009fd0 tx=0x7f7efc00b8e0 comp rx=0 tx=0).stop 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 shutdown_connections 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6510 0x7f7eec0b8a20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f041040b0 0x7f7f0419b220 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f04103710 0x7f7f0419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 --2- 172.21.15.98:0/487334219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f04102680 0x7f7f0419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 >> 172.21.15.98:0/487334219 conn(0x7f7f040fdff0 msgr2=0x7f7f040ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:29:49.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 shutdown_connections 2024-09-21T02:29:49.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:29:49.879+0000 7f7f09d9b640 1 -- 172.21.15.98:0/487334219 wait complete. 2024-09-21T02:29:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:49.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:49 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:49.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:49 smithi079 ceph-mon[30788]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:49 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:49 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:49 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:49 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:49 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:49 smithi148 ceph-mon[34626]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:50.554 DEBUG:teuthology.orchestra.run.smithi098:osd.7> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T02:29:50.556 INFO:tasks.cephadm:Deploying osd.8 on smithi148 with /dev/vg_nvme/lv_2... 2024-09-21T02:29:50.557 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:29:50.814 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:29:50.832 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:50.832 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.832 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.934 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:50.934 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.935 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:29:50.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:50.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:51 smithi079 ceph-mon[30788]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:52.044 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:51 smithi098 ceph-mon[34832]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:52.044 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:29:51 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:29:51.901+0000 7fd330b66640 -1 osd.7 0 log_to_monitors true 2024-09-21T02:29:52.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:51 smithi148 ceph-mon[34626]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:52.952 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:52 smithi098 ceph-mon[34832]: from='osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:29:52.952 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:52 smithi098 ceph-mon[34832]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:29:52.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:52 smithi079 ceph-mon[30788]: from='osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:29:52.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:52 smithi079 ceph-mon[30788]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:29:53.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:52 smithi148 ceph-mon[34626]: from='osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:29:53.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:52 smithi148 ceph-mon[34626]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:29:53.521 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:29:53.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_2 2024-09-21T02:29:53.794 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:29:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:53 smithi148 ceph-mon[34626]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:29:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:53 smithi148 ceph-mon[34626]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:29:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:53 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:53 smithi148 ceph-mon[34626]: from='osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:29:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:53 smithi148 ceph-mon[34626]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:29:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:53 smithi148 ceph-mon[34626]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:53 smithi079 ceph-mon[30788]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:29:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:53 smithi079 ceph-mon[30788]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:29:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:53 smithi079 ceph-mon[30788]: from='osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:29:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:53 smithi079 ceph-mon[30788]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:29:53.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:53 smithi079 ceph-mon[30788]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-mon[34832]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:29:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-mon[34832]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:29:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-mon[34832]: from='osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:29:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-mon[34832]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:29:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-mon[34832]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:29:54.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:29:53.715+0000 7fd32cae8640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T02:29:54.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:29:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:29:53.727+0000 7fd3288e6640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:29:54.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.272+0000 7faf67464640 1 -- 172.21.15.148:0/686949513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf601036d0 msgr2=0x7faf60103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:54.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.272+0000 7faf67464640 1 --2- 172.21.15.148:0/686949513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf601036d0 0x7faf60103ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faf54009900 tx=0x7faf5402a480 comp rx=0 tx=0).stop 2024-09-21T02:29:54.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.272+0000 7faf67464640 1 -- 172.21.15.148:0/686949513 shutdown_connections 2024-09-21T02:29:54.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.272+0000 7faf67464640 1 --2- 172.21.15.148:0/686949513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf60104070 0x7faf6010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:54.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.272+0000 7faf67464640 1 --2- 172.21.15.148:0/686949513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf601036d0 0x7faf60103ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:54.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.272+0000 7faf67464640 1 --2- 172.21.15.148:0/686949513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf60102640 0x7faf60102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.272+0000 7faf67464640 1 -- 172.21.15.148:0/686949513 >> 172.21.15.148:0/686949513 conn(0x7faf600fdfb0 msgr2=0x7faf60100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 -- 172.21.15.148:0/686949513 shutdown_connections 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 -- 172.21.15.148:0/686949513 wait complete. 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 Processor -- start 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 -- start start 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf60102640 0x7faf6006b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf601036d0 0x7faf6019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf60104070 0x7faf601a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faf6010e290 con 0x7faf601036d0 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faf6010e110 con 0x7faf60104070 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.273+0000 7faf67464640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faf6010e410 con 0x7faf60102640 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf60102640 0x7faf6006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:29:54.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf60102640 0x7faf6006b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58040/0 (socket says 172.21.15.148:58040) 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 -- 172.21.15.148:0/3757833951 learned_addr learned my addr 172.21.15.148:0/3757833951 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 -- 172.21.15.148:0/3757833951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf60104070 msgr2=0x7faf601a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf60104070 0x7faf601a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 -- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf601036d0 msgr2=0x7faf6019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf601036d0 0x7faf6019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 -- 172.21.15.148:0/3757833951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf601a1a90 con 0x7faf60102640 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf65200640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf60102640 0x7faf6006b700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf5800cce0 tx=0x7faf5800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf5e7fc640 1 -- 172.21.15.148:0/3757833951 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58004b20 con 0x7faf60102640 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf5e7fc640 1 -- 172.21.15.148:0/3757833951 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf58004cc0 con 0x7faf60102640 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf601a1d80 con 0x7faf60102640 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf5e7fc640 1 -- 172.21.15.148:0/3757833951 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5800f6b0 con 0x7faf60102640 2024-09-21T02:29:54.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.274+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf601a2260 con 0x7faf60102640 2024-09-21T02:29:54.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.275+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf60109800 con 0x7faf60102640 2024-09-21T02:29:54.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.277+0000 7faf5e7fc640 1 -- 172.21.15.148:0/3757833951 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7faf5800f8f0 con 0x7faf60102640 2024-09-21T02:29:54.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.278+0000 7faf5e7fc640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faf480b6510 0x7faf480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:29:54.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.278+0000 7faf5e7fc640 1 -- 172.21.15.148:0/3757833951 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7faf580e6ba0 con 0x7faf60102640 2024-09-21T02:29:54.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.278+0000 7faf649ff640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faf480b6510 0x7faf480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:29:54.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.279+0000 7faf649ff640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faf480b6510 0x7faf480b8a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf54031500 tx=0x7faf54031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:29:54.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.281+0000 7faf5e7fc640 1 -- 172.21.15.148:0/3757833951 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf58014030 con 0x7faf60102640 2024-09-21T02:29:54.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:29:54.467+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7faf60063800 con 0x7faf480b6510 2024-09-21T02:29:54.718 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi098 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:54.719 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:54.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:29:54.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi098 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:29:54.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:29:54.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:29:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:29:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:29:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T02:29:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi098 2024-09-21T02:29:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:29:55.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:29:55.953 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:55 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:29:55.954 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:55 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:29:55.954 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:55 smithi148 ceph-mon[34626]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:55.954 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:55 smithi148 ceph-mon[34626]: osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] boot 2024-09-21T02:29:55.954 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:55 smithi148 ceph-mon[34626]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:29:55.954 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:55.954 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:55 smithi148 ceph-mon[34626]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:29:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:55 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:29:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:55 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:29:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:55 smithi079 ceph-mon[30788]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:55 smithi079 ceph-mon[30788]: osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] boot 2024-09-21T02:29:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:55 smithi079 ceph-mon[30788]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:29:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:55 smithi079 ceph-mon[30788]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:29:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:55 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:29:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:55 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:29:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:55 smithi098 ceph-mon[34832]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:55 smithi098 ceph-mon[34832]: osd.7 [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] boot 2024-09-21T02:29:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:55 smithi098 ceph-mon[34832]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:29:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:29:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:55 smithi098 ceph-mon[34832]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:29:56.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:56 smithi079 ceph-mon[30788]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T02:29:57.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:56 smithi148 ceph-mon[34626]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T02:29:57.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:56 smithi098 ceph-mon[34832]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/3661139677' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"} : dispatch 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"} : dispatch 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"}]': finished 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: pgmap v204: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:29:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:57 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/2709134246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/3661139677' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"} : dispatch 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"} : dispatch 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"}]': finished 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: pgmap v204: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:29:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:57 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/2709134246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:58.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T02:29:58.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/3661139677' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"} : dispatch 2024-09-21T02:29:58.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"} : dispatch 2024-09-21T02:29:58.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a779fd91-38a2-419c-922e-2103f448b87c"}]': finished 2024-09-21T02:29:58.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:29:58.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:29:58.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: pgmap v204: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:29:58.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:57 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/2709134246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:29:59.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:58 smithi148 ceph-mon[34626]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-21T02:29:59.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:58 smithi098 ceph-mon[34832]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-21T02:29:59.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:58 smithi079 ceph-mon[30788]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-21T02:30:00.025 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:29:59 smithi148 ceph-mon[34626]: pgmap v205: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:00.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:29:59 smithi098 ceph-mon[34832]: pgmap v205: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:00.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:29:59 smithi079 ceph-mon[30788]: pgmap v205: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:01.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:00 smithi148 ceph-mon[34626]: Health detail: HEALTH_WARN Reduced data availability: 1 pg inactive 2024-09-21T02:30:01.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:00 smithi148 ceph-mon[34626]: [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg inactive 2024-09-21T02:30:01.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:00 smithi148 ceph-mon[34626]: pg 1.0 is stuck inactive for 64s, current state remapped, last acting [5,2,1] 2024-09-21T02:30:01.130 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:00 smithi079 ceph-mon[30788]: Health detail: HEALTH_WARN Reduced data availability: 1 pg inactive 2024-09-21T02:30:01.130 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:00 smithi079 ceph-mon[30788]: [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg inactive 2024-09-21T02:30:01.130 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:00 smithi079 ceph-mon[30788]: pg 1.0 is stuck inactive for 64s, current state remapped, last acting [5,2,1] 2024-09-21T02:30:01.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:00 smithi098 ceph-mon[34832]: Health detail: HEALTH_WARN Reduced data availability: 1 pg inactive 2024-09-21T02:30:01.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:00 smithi098 ceph-mon[34832]: [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg inactive 2024-09-21T02:30:01.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:00 smithi098 ceph-mon[34832]: pg 1.0 is stuck inactive for 64s, current state remapped, last acting [5,2,1] 2024-09-21T02:30:02.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:01 smithi148 ceph-mon[34626]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:02.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:01 smithi098 ceph-mon[34832]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:02.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:01 smithi079 ceph-mon[30788]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:02.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:02 smithi148 ceph-mon[34626]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-21T02:30:02.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:02 smithi148 ceph-mon[34626]: Cluster is now healthy 2024-09-21T02:30:03.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:02 smithi098 ceph-mon[34832]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-21T02:30:03.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:02 smithi098 ceph-mon[34832]: Cluster is now healthy 2024-09-21T02:30:03.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:02 smithi079 ceph-mon[30788]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-21T02:30:03.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:02 smithi079 ceph-mon[30788]: Cluster is now healthy 2024-09-21T02:30:04.061 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:03 smithi148 ceph-mon[34626]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-21T02:30:04.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:03 smithi098 ceph-mon[34832]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-21T02:30:04.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:03 smithi079 ceph-mon[30788]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-21T02:30:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:06 smithi148 ceph-mon[34626]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-21T02:30:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:30:06.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:06 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:06.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:06 smithi079 ceph-mon[30788]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-21T02:30:06.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:30:06.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:06 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:06.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:06 smithi098 ceph-mon[34832]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-21T02:30:06.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:30:06.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:06 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:07.557 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:07 smithi148 ceph-mon[34626]: Deploying daemon osd.8 on smithi148 2024-09-21T02:30:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:07 smithi079 ceph-mon[30788]: Deploying daemon osd.8 on smithi148 2024-09-21T02:30:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:07 smithi098 ceph-mon[34832]: Deploying daemon osd.8 on smithi148 2024-09-21T02:30:08.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:08 smithi148 ceph-mon[34626]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T02:30:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:08 smithi079 ceph-mon[30788]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T02:30:08.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:08 smithi098 ceph-mon[34832]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T02:30:10.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:10 smithi079 ceph-mon[30788]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:10 smithi148 ceph-mon[34626]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:10 smithi098 ceph-mon[34832]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:11.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:11 smithi148 ceph-mon[34626]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:11 smithi098 ceph-mon[34832]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:11.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:11 smithi079 ceph-mon[30788]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:30:12.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:12.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:12.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:12.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:12.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:12.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:13 smithi148 ceph-mon[34626]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:13 smithi098 ceph-mon[34832]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:13.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:13 smithi079 ceph-mon[30788]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:16.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.178+0000 7faf5e7fc640 1 -- 172.21.15.148:0/3757833951 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faf60063800 con 0x7faf480b6510 2024-09-21T02:30:16.179 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 8 on host 'smithi148' 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.180+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faf480b6510 msgr2=0x7faf480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.180+0000 7faf67464640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faf480b6510 0x7faf480b8a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf54031500 tx=0x7faf54031400 comp rx=0 tx=0).stop 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.180+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf60102640 msgr2=0x7faf6006b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.180+0000 7faf67464640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf60102640 0x7faf6006b700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf5800cce0 tx=0x7faf5800a620 comp rx=0 tx=0).stop 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 shutdown_connections 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faf480b6510 0x7faf480b8a20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf60104070 0x7faf601a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf601036d0 0x7faf6019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:16.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 --2- 172.21.15.148:0/3757833951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf60102640 0x7faf6006b700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:16.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 >> 172.21.15.148:0/3757833951 conn(0x7faf600fdfb0 msgr2=0x7faf601069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:30:16.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 shutdown_connections 2024-09-21T02:30:16.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:30:16.181+0000 7faf67464640 1 -- 172.21.15.148:0/3757833951 wait complete. 2024-09-21T02:30:16.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:16.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:16.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:16 smithi148 ceph-mon[34626]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:16.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:16.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:16.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:16 smithi098 ceph-mon[34832]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:16.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:16.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:16.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:16.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:16 smithi079 ceph-mon[30788]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:16.802 DEBUG:teuthology.orchestra.run.smithi148:osd.8> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T02:30:16.804 INFO:tasks.cephadm:Deploying osd.9 on smithi079 with /dev/vg_nvme/lv_1... 2024-09-21T02:30:16.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:30:17.184 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:30:17.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:17.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:17.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:17.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:17.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:17.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:17.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:17.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:17.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:18.206 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:18 smithi148 ceph-mon[34626]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:18.206 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:18 smithi148 ceph-mon[34626]: from='osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:30:18.206 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:18 smithi148 ceph-mon[34626]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:30:18.206 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:30:18 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:30:17.999+0000 7fdba0b64640 -1 osd.8 0 log_to_monitors true 2024-09-21T02:30:18.378 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:18 smithi079 ceph-mon[30788]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:18.378 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:18 smithi079 ceph-mon[30788]: from='osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:30:18.378 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:18 smithi079 ceph-mon[30788]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:30:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:18 smithi098 ceph-mon[34832]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:18 smithi098 ceph-mon[34832]: from='osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:30:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:18 smithi098 ceph-mon[34832]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:30:19.261 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:19 smithi148 ceph-mon[34626]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:30:19.262 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:19 smithi148 ceph-mon[34626]: from='osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:30:19.262 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:19 smithi148 ceph-mon[34626]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T02:30:19.262 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:19 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:19.262 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:19 smithi148 ceph-mon[34626]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:30:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:19 smithi098 ceph-mon[34832]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:30:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:19 smithi098 ceph-mon[34832]: from='osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:30:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:19 smithi098 ceph-mon[34832]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T02:30:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:19 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:19 smithi098 ceph-mon[34832]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:30:19.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:19 smithi079 ceph-mon[30788]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:30:19.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:19 smithi079 ceph-mon[30788]: from='osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:30:19.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:19 smithi079 ceph-mon[30788]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T02:30:19.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:19 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:19.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:19 smithi079 ceph-mon[30788]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:30:20.062 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:30:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:30:19.762+0000 7fdb9cae6640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T02:30:20.062 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:30:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:30:19.774+0000 7fdb948dc640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:20.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:20.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='osd.8 ' entity='osd.8' 2024-09-21T02:30:20.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] boot 2024-09-21T02:30:20.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:30:20.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:30:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T02:30:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='osd.8 ' entity='osd.8' 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] boot 2024-09-21T02:30:20.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:30:20.407 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:30:20.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T02:30:20.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='osd.8 ' entity='osd.8' 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: osd.8 [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] boot 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:30:20.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:30:20.564 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:30:20.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_1 2024-09-21T02:30:20.958 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:30:21.326 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:21 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:30:21.326 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:21 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:30:21.326 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:21 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi148 2024-09-21T02:30:21.326 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:21 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T02:30:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:21 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:30:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:21 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:30:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:21 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi148 2024-09-21T02:30:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:21 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T02:30:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:21 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:30:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:21 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:30:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:21 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi148 2024-09-21T02:30:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:21 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 -- 172.21.15.79:0/1047745216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b90106a10 msgr2=0x7f6b90106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 --2- 172.21.15.79:0/1047745216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b90106a10 0x7f6b90106e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009900 tx=0x7f6b7c02a480 comp rx=0 tx=0).stop 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 -- 172.21.15.79:0/1047745216 shutdown_connections 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 --2- 172.21.15.79:0/1047745216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b901073b0 0x7f6b9010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 --2- 172.21.15.79:0/1047745216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b90106a10 0x7f6b90106e20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 --2- 172.21.15.79:0/1047745216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 0x7f6b90105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 -- 172.21.15.79:0/1047745216 >> 172.21.15.79:0/1047745216 conn(0x7f6b901012f0 msgr2=0x7f6b901037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 -- 172.21.15.79:0/1047745216 shutdown_connections 2024-09-21T02:30:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.569+0000 7f6b95400640 1 -- 172.21.15.79:0/1047745216 wait complete. 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.570+0000 7f6b95400640 1 Processor -- start 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.570+0000 7f6b95400640 1 -- start start 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b95400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 0x7f6b9019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b95400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90106a10 0x7f6b9019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b95400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b901073b0 0x7f6b9019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b95400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901115d0 con 0x7f6b901073b0 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b95400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90111450 con 0x7f6b90105980 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b95400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90111750 con 0x7f6b90106a10 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 0x7f6b9019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:21.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 0x7f6b9019c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50108/0 (socket says 172.21.15.79:50108) 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 -- 172.21.15.79:0/1532308579 learned_addr learned my addr 172.21.15.79:0/1532308579 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8f200640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b901073b0 0x7f6b9019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8de00640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90106a10 0x7f6b9019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 -- 172.21.15.79:0/1532308579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90106a10 msgr2=0x7f6b9019c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90106a10 0x7f6b9019c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 -- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b901073b0 msgr2=0x7f6b9019d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b901073b0 0x7f6b9019d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.571+0000 7f6b8e800640 1 -- 172.21.15.79:0/1532308579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9019dc20 con 0x7f6b90105980 2024-09-21T02:30:21.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.572+0000 7f6b8e800640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 0x7f6b9019c1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000ea60 tx=0x7f6b8000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:30:21.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.572+0000 7f6b87400640 1 -- 172.21.15.79:0/1532308579 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8000cde0 con 0x7f6b90105980 2024-09-21T02:30:21.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.572+0000 7f6b87400640 1 -- 172.21.15.79:0/1532308579 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b800035f0 con 0x7f6b90105980 2024-09-21T02:30:21.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.572+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9019df10 con 0x7f6b90105980 2024-09-21T02:30:21.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.572+0000 7f6b87400640 1 -- 172.21.15.79:0/1532308579 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80010690 con 0x7f6b90105980 2024-09-21T02:30:21.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.572+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b901a4610 con 0x7f6b90105980 2024-09-21T02:30:21.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.573+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9010cb40 con 0x7f6b90105980 2024-09-21T02:30:21.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.576+0000 7f6b87400640 1 -- 172.21.15.79:0/1532308579 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6b800037a0 con 0x7f6b90105980 2024-09-21T02:30:21.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.577+0000 7f6b87400640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6b740b6590 0x7f6b740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.578+0000 7f6b87400640 1 -- 172.21.15.79:0/1532308579 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5829+0+0 (secure 0 0 0) 0x7f6b800e6f50 con 0x7f6b90105980 2024-09-21T02:30:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.578+0000 7f6b8de00640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6b740b6590 0x7f6b740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.578+0000 7f6b8de00640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6b740b6590 0x7f6b740b8aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c031440 tx=0x7f6b7c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:30:21.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.579+0000 7f6b87400640 1 -- 172.21.15.79:0/1532308579 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b80056710 con 0x7f6b90105980 2024-09-21T02:30:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:21.779+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6b90063800 con 0x7f6b740b6590 2024-09-21T02:30:22.073 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:22 smithi079 ceph-mon[30788]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T02:30:22.073 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:22 smithi079 ceph-mon[30788]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:22.073 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:30:22.337 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:30:22.337 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:22.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:22 smithi098 ceph-mon[34832]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T02:30:22.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:22 smithi098 ceph-mon[34832]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:22.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:30:22.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:30:22.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:22.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:22 smithi148 ceph-mon[34626]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T02:30:22.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:22 smithi148 ceph-mon[34626]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:22.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:30:22.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:30:22.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:23.341 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:23 smithi079 ceph-mon[30788]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:23.342 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:23 smithi079 ceph-mon[30788]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T02:30:23.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:23 smithi098 ceph-mon[34832]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:23.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:23 smithi098 ceph-mon[34832]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T02:30:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:23 smithi148 ceph-mon[34626]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:23 smithi148 ceph-mon[34626]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T02:30:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:24 smithi098 ceph-mon[34832]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:24.414 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:24 smithi079 ceph-mon[30788]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:24 smithi148 ceph-mon[34626]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:25.343 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:25 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/171584609' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"} : dispatch 2024-09-21T02:30:25.343 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:25 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"} : dispatch 2024-09-21T02:30:25.343 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:25 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"}]': finished 2024-09-21T02:30:25.343 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:25 smithi079 ceph-mon[30788]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:30:25.343 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:25 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:25 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/171584609' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"} : dispatch 2024-09-21T02:30:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:25 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"} : dispatch 2024-09-21T02:30:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:25 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"}]': finished 2024-09-21T02:30:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:25 smithi098 ceph-mon[34832]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:30:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:25 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/171584609' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"} : dispatch 2024-09-21T02:30:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:25 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"} : dispatch 2024-09-21T02:30:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:25 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23af2a6a-e9f6-46b4-97ce-cb34126eae65"}]': finished 2024-09-21T02:30:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:25 smithi148 ceph-mon[34626]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:30:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:25 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:26.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:26 smithi098 ceph-mon[34832]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T02:30:26.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:26 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3098578007' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:30:26.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:26 smithi079 ceph-mon[30788]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T02:30:26.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:26 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3098578007' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:30:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:26 smithi148 ceph-mon[34626]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T02:30:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:26 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3098578007' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:30:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:28 smithi079 ceph-mon[30788]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T02:30:28.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:28 smithi148 ceph-mon[34626]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T02:30:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:28 smithi098 ceph-mon[34832]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T02:30:30.699 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:30 smithi079 ceph-mon[30788]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:30:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:30 smithi148 ceph-mon[34626]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:30:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:30 smithi098 ceph-mon[34832]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:30:32.647 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:32 smithi079 ceph-mon[30788]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T02:30:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:32 smithi148 ceph-mon[34626]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T02:30:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:32 smithi098 ceph-mon[34832]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T02:30:34.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:34 smithi079 ceph-mon[30788]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:30:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:34 smithi148 ceph-mon[34626]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:30:34.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:34 smithi098 ceph-mon[34832]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:30:35.581 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:30:35.581 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:35.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:30:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:30:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:36 smithi079 ceph-mon[30788]: Deploying daemon osd.9 on smithi079 2024-09-21T02:30:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:36 smithi079 ceph-mon[30788]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:36.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:36 smithi148 ceph-mon[34626]: Deploying daemon osd.9 on smithi079 2024-09-21T02:30:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:36 smithi148 ceph-mon[34626]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:36 smithi098 ceph-mon[34832]: Deploying daemon osd.9 on smithi079 2024-09-21T02:30:36.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:36 smithi098 ceph-mon[34832]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:37.696 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:37 smithi079 ceph-mon[30788]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:37.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:37 smithi148 ceph-mon[34626]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:37 smithi098 ceph-mon[34832]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:40 smithi079 ceph-mon[30788]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:40.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:40 smithi148 ceph-mon[34626]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:40.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:40 smithi098 ceph-mon[34832]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:42.524 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:42 smithi079 ceph-mon[30788]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:42 smithi148 ceph-mon[34626]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:42 smithi098 ceph-mon[34832]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:43.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:43.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:43.681 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:43.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:44 smithi079 ceph-mon[30788]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:44.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:44 smithi148 ceph-mon[34626]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:44 smithi098 ceph-mon[34832]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:46.707 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:46 smithi098 ceph-mon[34832]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:46.707 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:46 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:46.707 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:46 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:46 smithi079 ceph-mon[30788]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:46 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:46 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:46.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:46 smithi148 ceph-mon[34626]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:46.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:46 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:46.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:46 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:47.666 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:47.666 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:47.666 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:47.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:47.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:47.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:48.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.177+0000 7f6b87400640 1 -- 172.21.15.79:0/1532308579 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6b90063800 con 0x7f6b740b6590 2024-09-21T02:30:48.179 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 9 on host 'smithi079' 2024-09-21T02:30:48.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6b740b6590 msgr2=0x7f6b740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:48.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6b740b6590 0x7f6b740b8aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c031440 tx=0x7f6b7c0314a0 comp rx=0 tx=0).stop 2024-09-21T02:30:48.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 msgr2=0x7f6b9019c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:48.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 0x7f6b9019c1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000ea60 tx=0x7f6b8000ef20 comp rx=0 tx=0).stop 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 shutdown_connections 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6b740b6590 0x7f6b740b8aa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b901073b0 0x7f6b9019d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90106a10 0x7f6b9019c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 --2- 172.21.15.79:0/1532308579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90105980 0x7f6b9019c1f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 >> 172.21.15.79:0/1532308579 conn(0x7f6b901012f0 msgr2=0x7f6b90109d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 shutdown_connections 2024-09-21T02:30:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:30:48.180+0000 7f6b95400640 1 -- 172.21.15.79:0/1532308579 wait complete. 2024-09-21T02:30:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:48 smithi079 ceph-mon[30788]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:48 smithi148 ceph-mon[34626]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:48 smithi098 ceph-mon[34832]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:30:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:49.008 DEBUG:teuthology.orchestra.run.smithi079:osd.9> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T02:30:49.012 INFO:tasks.cephadm:Deploying osd.10 on smithi098 with /dev/vg_nvme/lv_1... 2024-09-21T02:30:49.012 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:30:49.270 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:30:49.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:49 smithi098 ceph-mon[34832]: from='osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:30:49.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:49 smithi098 ceph-mon[34832]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:30:49.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:49 smithi079 ceph-mon[30788]: from='osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:30:49.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:49 smithi079 ceph-mon[30788]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:30:49.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:49 smithi148 ceph-mon[34626]: from='osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:30:49.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:49 smithi148 ceph-mon[34626]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:30:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:50 smithi079 ceph-mon[30788]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:50 smithi079 ceph-mon[30788]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:30:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:50 smithi079 ceph-mon[30788]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T02:30:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:50 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:50 smithi079 ceph-mon[30788]: from='osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:30:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:50 smithi079 ceph-mon[30788]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:30:50.738 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:50 smithi098 ceph-mon[34832]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:50.738 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:50 smithi098 ceph-mon[34832]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:30:50.738 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:50 smithi098 ceph-mon[34832]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T02:30:50.738 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:50 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:50.738 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:50 smithi098 ceph-mon[34832]: from='osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:30:50.738 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:50 smithi098 ceph-mon[34832]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:30:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:50 smithi148 ceph-mon[34626]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:50 smithi148 ceph-mon[34626]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:30:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:50 smithi148 ceph-mon[34626]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T02:30:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:50 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:50 smithi148 ceph-mon[34626]: from='osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:30:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:50 smithi148 ceph-mon[34626]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T02:30:51.411 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:30:51.281+0000 7f9410e00640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T02:30:51.411 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:30:51.306+0000 7f9406e00640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:30:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:51 smithi098 ceph-mon[34832]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:30:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:51 smithi098 ceph-mon[34832]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T02:30:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:51.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:51.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:51 smithi098 ceph-mon[34832]: from='osd.9 ' entity='osd.9' 2024-09-21T02:30:51.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:51 smithi098 ceph-mon[34832]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-mon[30788]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:30:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-mon[30788]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T02:30:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-mon[30788]: from='osd.9 ' entity='osd.9' 2024-09-21T02:30:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:51 smithi079 ceph-mon[30788]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:51 smithi148 ceph-mon[34626]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T02:30:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:51 smithi148 ceph-mon[34626]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T02:30:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:51 smithi148 ceph-mon[34626]: from='osd.9 ' entity='osd.9' 2024-09-21T02:30:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:51 smithi148 ceph-mon[34626]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:30:52.086 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T02:30:52.112 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_1 2024-09-21T02:30:52.364 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:30:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:52 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:30:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:52 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:30:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:52 smithi079 ceph-mon[30788]: osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] boot 2024-09-21T02:30:52.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:52 smithi079 ceph-mon[30788]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T02:30:52.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:52.796 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:52 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:30:52.796 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:52 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:30:52.796 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:52.796 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:52 smithi098 ceph-mon[34832]: osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] boot 2024-09-21T02:30:52.796 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:52 smithi098 ceph-mon[34832]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T02:30:52.796 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:52 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:30:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:52 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:30:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:52 smithi148 ceph-mon[34626]: osd.9 [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] boot 2024-09-21T02:30:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:52 smithi148 ceph-mon[34626]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T02:30:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 -- 172.21.15.98:0/2110286977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274105180 msgr2=0x7ff27410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 --2- 172.21.15.98:0/2110286977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274105180 0x7ff27410bb20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009ca0 tx=0x7ff26c02a950 comp rx=0 tx=0).stop 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 -- 172.21.15.98:0/2110286977 shutdown_connections 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 --2- 172.21.15.98:0/2110286977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff274105180 0x7ff27410bb20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 --2- 172.21.15.98:0/2110286977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2741047e0 0x7ff274104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 --2- 172.21.15.98:0/2110286977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff274103750 0x7ff274103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 -- 172.21.15.98:0/2110286977 >> 172.21.15.98:0/2110286977 conn(0x7ff2740ff0c0 msgr2=0x7ff274101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 -- 172.21.15.98:0/2110286977 shutdown_connections 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 -- 172.21.15.98:0/2110286977 wait complete. 2024-09-21T02:30:52.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.889+0000 7ff27b928640 1 Processor -- start 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff27b928640 1 -- start start 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff27b928640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff274103750 0x7ff274199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff27b928640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2741047e0 0x7ff27419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff27b928640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff274105180 0x7ff27419b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff27b928640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff27410f380 con 0x7ff274103750 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff27b928640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff27410f200 con 0x7ff2741047e0 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff27b928640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff27410f500 con 0x7ff274105180 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2741047e0 0x7ff27419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2741047e0 0x7ff27419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54010/0 (socket says 172.21.15.98:54010) 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 -- 172.21.15.98:0/3583843187 learned_addr learned my addr 172.21.15.98:0/3583843187 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff279ec5640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff274105180 0x7ff27419b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff2796c4640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff274103750 0x7ff274199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:52.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 -- 172.21.15.98:0/3583843187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff274105180 msgr2=0x7ff27419b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff274105180 0x7ff27419b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 -- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff274103750 msgr2=0x7ff274199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff274103750 0x7ff274199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 -- 172.21.15.98:0/3583843187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27419b980 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff2796c4640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff274103750 0x7ff274199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.890+0000 7ff278ec3640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2741047e0 0x7ff27419a5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d950 tx=0x7ff26400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.891+0000 7ff26a7fc640 1 -- 172.21.15.98:0/3583843187 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264017070 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.891+0000 7ff26a7fc640 1 -- 172.21.15.98:0/3583843187 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff264009c30 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.891+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27419bc70 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.891+0000 7ff26a7fc640 1 -- 172.21.15.98:0/3583843187 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26400f620 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.891+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2741a2370 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.892+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27410a910 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.893+0000 7ff26a7fc640 1 -- 172.21.15.98:0/3583843187 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7ff264010460 con 0x7ff2741047e0 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.894+0000 7ff26a7fc640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff2600b6510 0x7ff2600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:30:52.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.894+0000 7ff26a7fc640 1 -- 172.21.15.98:0/3583843187 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6261+0+0 (secure 0 0 0) 0x7ff2640e67c0 con 0x7ff2741047e0 2024-09-21T02:30:52.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.895+0000 7ff2796c4640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff2600b6510 0x7ff2600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:30:52.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.895+0000 7ff2796c4640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff2600b6510 0x7ff2600b8a20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff2700058c0 tx=0x7ff270005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:30:52.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:52.898+0000 7ff26a7fc640 1 -- 172.21.15.98:0/3583843187 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2640ad7b0 con 0x7ff2741047e0 2024-09-21T02:30:53.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:30:53.089+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff274063800 con 0x7ff2600b6510 2024-09-21T02:30:54.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi079 2024-09-21T02:30:54.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi079 to 4272M 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='client.24524 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:54.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:54 smithi148 ceph-mon[34626]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T02:30:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi079 2024-09-21T02:30:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi079 to 4272M 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='client.24524 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:54 smithi098 ceph-mon[34832]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T02:30:54.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi079 2024-09-21T02:30:54.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi079 to 4272M 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='client.24524 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:30:54.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:54.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:54.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:54 smithi079 ceph-mon[30788]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T02:30:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:56 smithi098 ceph-mon[34832]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:56 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/519697340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"} : dispatch 2024-09-21T02:30:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:56 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"} : dispatch 2024-09-21T02:30:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:56 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"}]': finished 2024-09-21T02:30:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:56 smithi098 ceph-mon[34832]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:30:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:30:56.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:56 smithi098 ceph-mon[34832]: from='client.? 172.21.15.98:0/2132368288' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:30:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:56 smithi079 ceph-mon[30788]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:56 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/519697340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"} : dispatch 2024-09-21T02:30:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:56 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"} : dispatch 2024-09-21T02:30:56.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:56 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"}]': finished 2024-09-21T02:30:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:56 smithi079 ceph-mon[30788]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:30:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:30:56.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:56 smithi079 ceph-mon[30788]: from='client.? 172.21.15.98:0/2132368288' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:30:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:56 smithi148 ceph-mon[34626]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:56 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/519697340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"} : dispatch 2024-09-21T02:30:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:56 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"} : dispatch 2024-09-21T02:30:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:56 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c22ae343-edd0-4ed8-861d-f2ca54d92b5a"}]': finished 2024-09-21T02:30:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:56 smithi148 ceph-mon[34626]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:30:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:30:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:56 smithi148 ceph-mon[34626]: from='client.? 172.21.15.98:0/2132368288' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:30:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:30:58 smithi079 ceph-mon[30788]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:58.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:30:58 smithi148 ceph-mon[34626]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:30:58.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:30:58 smithi098 ceph-mon[34832]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:00 smithi079 ceph-mon[30788]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:00 smithi148 ceph-mon[34626]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:00.874 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:00 smithi098 ceph-mon[34832]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:02.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:02 smithi098 ceph-mon[34832]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:02.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:02 smithi079 ceph-mon[30788]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:02.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:02 smithi148 ceph-mon[34626]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:03.610 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:03 smithi098 ceph-mon[34832]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:03 smithi148 ceph-mon[34626]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:03.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:03 smithi079 ceph-mon[30788]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:31:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:04 smithi098 ceph-mon[34832]: Deploying daemon osd.10 on smithi098 2024-09-21T02:31:04.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:31:04.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:04.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:04 smithi148 ceph-mon[34626]: Deploying daemon osd.10 on smithi098 2024-09-21T02:31:04.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:31:04.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:04.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:04 smithi079 ceph-mon[30788]: Deploying daemon osd.10 on smithi098 2024-09-21T02:31:05.776 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:05 smithi098 ceph-mon[34832]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:05 smithi148 ceph-mon[34626]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:05.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:05 smithi079 ceph-mon[30788]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:08.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:08 smithi079 ceph-mon[30788]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:08.744 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:08 smithi098 ceph-mon[34832]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:08 smithi148 ceph-mon[34626]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:10.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:10 smithi098 ceph-mon[34832]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:10.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:10 smithi079 ceph-mon[30788]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:10 smithi148 ceph-mon[34626]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:11.586 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:11 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:11.586 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:11 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:11.586 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:11 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:11.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:11 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:11.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:11 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:11.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:11 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:11 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:11 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:11 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:12.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:12 smithi098 ceph-mon[34832]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:12.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:12 smithi079 ceph-mon[30788]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:12.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:12 smithi148 ceph-mon[34626]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:14.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.140+0000 7ff26a7fc640 1 -- 172.21.15.98:0/3583843187 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff274063800 con 0x7ff2600b6510 2024-09-21T02:31:14.143 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 10 on host 'smithi098' 2024-09-21T02:31:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff2600b6510 msgr2=0x7ff2600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff2600b6510 0x7ff2600b8a20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff2700058c0 tx=0x7ff270005850 comp rx=0 tx=0).stop 2024-09-21T02:31:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2741047e0 msgr2=0x7ff27419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2741047e0 0x7ff27419a5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d950 tx=0x7ff26400de10 comp rx=0 tx=0).stop 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 shutdown_connections 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff2600b6510 0x7ff2600b8a20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff274105180 0x7ff27419b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2741047e0 0x7ff27419a5c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 --2- 172.21.15.98:0/3583843187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff274103750 0x7ff274199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 >> 172.21.15.98:0/3583843187 conn(0x7ff2740ff0c0 msgr2=0x7ff274107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 shutdown_connections 2024-09-21T02:31:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T02:31:14.143+0000 7ff27b928640 1 -- 172.21.15.98:0/3583843187 wait complete. 2024-09-21T02:31:14.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:14.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:14.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:14.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:14.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:14 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:14 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:14.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:14.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:14.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:14.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:14 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:14.839 DEBUG:teuthology.orchestra.run.smithi098:osd.10> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T02:31:14.841 INFO:tasks.cephadm:Deploying osd.11 on smithi148 with /dev/vg_nvme/lv_1... 2024-09-21T02:31:14.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:31:15.100 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:31:16.307 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:31:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:31:16.259+0000 7f1b57329640 -1 osd.10 0 log_to_monitors true 2024-09-21T02:31:16.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:16 smithi148 ceph-mon[34626]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:16.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:16 smithi148 ceph-mon[34626]: from='osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:31:16.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:16 smithi148 ceph-mon[34626]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:31:16.574 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:16 smithi098 ceph-mon[34832]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:16.574 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:16 smithi098 ceph-mon[34832]: from='osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:31:16.574 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:16 smithi098 ceph-mon[34832]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:31:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:16 smithi079 ceph-mon[30788]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:16 smithi079 ceph-mon[30788]: from='osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:31:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:16 smithi079 ceph-mon[30788]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:31:17.655 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:31:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:31:17.449+0000 7f1b532ab640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T02:31:17.655 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:31:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:31:17.465+0000 7f1b4f0a9640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:31:17.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:17 smithi098 ceph-mon[34832]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:31:17.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:17 smithi098 ceph-mon[34832]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T02:31:17.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:17 smithi098 ceph-mon[34832]: from='osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:31:17.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:17.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:17 smithi098 ceph-mon[34832]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:31:17.710 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:17 smithi148 ceph-mon[34626]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:31:17.710 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:17 smithi148 ceph-mon[34626]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T02:31:17.710 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:17 smithi148 ceph-mon[34626]: from='osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:31:17.710 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:17.710 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:17 smithi148 ceph-mon[34626]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:31:17.712 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T02:31:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:17 smithi079 ceph-mon[30788]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:31:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:17 smithi079 ceph-mon[30788]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T02:31:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:17 smithi079 ceph-mon[30788]: from='osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:31:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:17.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:17 smithi079 ceph-mon[30788]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T02:31:17.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_1 2024-09-21T02:31:18.004 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:31:18.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 -- 172.21.15.148:0/1762093068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 msgr2=0x7f7fc010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 --2- 172.21.15.148:0/1762093068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc010aa10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009ca0 tx=0x7f7fb802a950 comp rx=0 tx=0).stop 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 -- 172.21.15.148:0/1762093068 shutdown_connections 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 --2- 172.21.15.148:0/1762093068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc010aa10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 --2- 172.21.15.148:0/1762093068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc01036d0 0x7f7fc0103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 --2- 172.21.15.148:0/1762093068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fc0102640 0x7f7fc0102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 -- 172.21.15.148:0/1762093068 >> 172.21.15.148:0/1762093068 conn(0x7f7fc00fdfb0 msgr2=0x7f7fc0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 -- 172.21.15.148:0/1762093068 shutdown_connections 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.507+0000 7f7fc5539640 1 -- 172.21.15.148:0/1762093068 wait complete. 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 Processor -- start 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 -- start start 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc0102640 0x7f7fc006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:18.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fc01036d0 0x7f7fc019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc01a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc010e290 con 0x7f7fc01036d0 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc010e110 con 0x7f7fc0102640 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.508+0000 7f7fc5539640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc010e410 con 0x7f7fc0104070 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc01a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc0102640 0x7f7fc006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc01a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59136/0 (socket says 172.21.15.148:59136) 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 -- 172.21.15.148:0/3925001773 learned_addr learned my addr 172.21.15.148:0/3925001773 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc0102640 0x7f7fc006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.148:59880/0 (socket says 172.21.15.148:59880) 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fb7fff640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fc01036d0 0x7f7fc019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 -- 172.21.15.148:0/3925001773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc0102640 msgr2=0x7f7fc006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc0102640 0x7f7fc006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:18.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 -- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fc01036d0 msgr2=0x7f7fc019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fc01036d0 0x7f7fc019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 -- 172.21.15.148:0/3925001773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc01a1a50 con 0x7f7fc0104070 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbeffd640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc0102640 0x7f7fc006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbf7fe640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc01a1230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8006010 tx=0x7f7fb802fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbcff9640 1 -- 172.21.15.148:0/3925001773 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8034040 con 0x7f7fc0104070 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbcff9640 1 -- 172.21.15.148:0/3925001773 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb80308f0 con 0x7f7fc0104070 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc01a1ce0 con 0x7f7fc0104070 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.509+0000 7f7fbcff9640 1 -- 172.21.15.148:0/3925001773 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8039450 con 0x7f7fc0104070 2024-09-21T02:31:18.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.510+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc01a21c0 con 0x7f7fc0104070 2024-09-21T02:31:18.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.511+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc0109800 con 0x7f7fc0104070 2024-09-21T02:31:18.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.513+0000 7f7fbcff9640 1 -- 172.21.15.148:0/3925001773 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f7fb8037020 con 0x7f7fc0104070 2024-09-21T02:31:18.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.513+0000 7f7fbcff9640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7fac0b6590 0x7f7fac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:18.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.513+0000 7f7fbcff9640 1 -- 172.21.15.148:0/3925001773 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6727+0+0 (secure 0 0 0) 0x7f7fb8107e70 con 0x7f7fc0104070 2024-09-21T02:31:18.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.514+0000 7f7fbeffd640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7fac0b6590 0x7f7fac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:18.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.514+0000 7f7fbeffd640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7fac0b6590 0x7f7fac0b8aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00058c0 tx=0x7f7fb000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:18.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.517+0000 7f7fbcff9640 1 -- 172.21.15.148:0/3925001773 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fb80ced30 con 0x7f7fc0104070 2024-09-21T02:31:18.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:18.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:31:18.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T02:31:18.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi098 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:18.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.666 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] boot 2024-09-21T02:31:18.666 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:31:18.666 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:18.701+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7fc0063800 con 0x7f7fac0b6590 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi098 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] boot 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:31:18.704 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi098 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: osd.10 [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] boot 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:31:18.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:31:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:31:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:31:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:31:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:31:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:19.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T02:31:19.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:19 smithi079 ceph-mon[30788]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:19.794 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:31:19.794 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:31:19.794 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:19.794 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:31:19.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:31:19.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:19.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T02:31:19.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:19 smithi148 ceph-mon[34626]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T02:31:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:19 smithi098 ceph-mon[34832]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:21 smithi148 ceph-mon[34626]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T02:31:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:21 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/1223363980' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"} : dispatch 2024-09-21T02:31:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:21 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"} : dispatch 2024-09-21T02:31:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:21 smithi148 ceph-mon[34626]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"}]': finished 2024-09-21T02:31:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:21 smithi148 ceph-mon[34626]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:31:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:21 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:21 smithi098 ceph-mon[34832]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T02:31:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:21 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/1223363980' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"} : dispatch 2024-09-21T02:31:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:21 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"} : dispatch 2024-09-21T02:31:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:21 smithi098 ceph-mon[34832]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"}]': finished 2024-09-21T02:31:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:21 smithi098 ceph-mon[34832]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:31:21.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:21 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:21 smithi079 ceph-mon[30788]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T02:31:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:21 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/1223363980' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"} : dispatch 2024-09-21T02:31:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:21 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"} : dispatch 2024-09-21T02:31:21.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:21 smithi079 ceph-mon[30788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9592a1c-5ad9-4b3a-8161-c213cf18a3cf"}]': finished 2024-09-21T02:31:21.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:21 smithi079 ceph-mon[30788]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:31:21.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:21 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:22.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:22 smithi148 ceph-mon[34626]: pgmap v263: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:22.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:22 smithi148 ceph-mon[34626]: from='client.? 172.21.15.148:0/3351826487' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:31:22.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:22 smithi098 ceph-mon[34832]: pgmap v263: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:22.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:22 smithi098 ceph-mon[34832]: from='client.? 172.21.15.148:0/3351826487' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:31:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:22 smithi079 ceph-mon[30788]: pgmap v263: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:22.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:22 smithi079 ceph-mon[30788]: from='client.? 172.21.15.148:0/3351826487' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:31:24.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:24 smithi079 ceph-mon[30788]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:24 smithi148 ceph-mon[34626]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:24 smithi098 ceph-mon[34832]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:26.696 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:26 smithi148 ceph-mon[34626]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T02:31:26.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:26 smithi079 ceph-mon[30788]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T02:31:26.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:26 smithi098 ceph-mon[34832]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T02:31:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:28 smithi098 ceph-mon[34832]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:31:28.723 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:28 smithi148 ceph-mon[34626]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:31:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:28 smithi079 ceph-mon[30788]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:31:29.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:29 smithi148 ceph-mon[34626]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:31:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:29 smithi098 ceph-mon[34832]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:31:29.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:29 smithi079 ceph-mon[30788]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:31:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:31:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:30 smithi148 ceph-mon[34626]: Deploying daemon osd.11 on smithi148 2024-09-21T02:31:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:31:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:30 smithi098 ceph-mon[34832]: Deploying daemon osd.11 on smithi148 2024-09-21T02:31:30.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:31:30.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:30.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:30 smithi079 ceph-mon[30788]: Deploying daemon osd.11 on smithi148 2024-09-21T02:31:31.639 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:31 smithi148 ceph-mon[34626]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T02:31:31.879 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:31 smithi079 ceph-mon[30788]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T02:31:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:31 smithi098 ceph-mon[34832]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T02:31:34.445 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:34 smithi148 ceph-mon[34626]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:31:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:34 smithi098 ceph-mon[34832]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:31:34.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:34 smithi079 ceph-mon[30788]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:31:36.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:36 smithi148 ceph-mon[34626]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:31:36.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:36 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:36.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:36 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:36.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:36 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:36 smithi079 ceph-mon[30788]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:31:36.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:36 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:36.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:36 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:36.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:36 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:36 smithi098 ceph-mon[34832]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:31:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:36 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:36 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:36 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:38.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:38 smithi079 ceph-mon[30788]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:38.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:38 smithi148 ceph-mon[34626]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:38.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:38 smithi098 ceph-mon[34832]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.519+0000 7f7fbcff9640 1 -- 172.21.15.148:0/3925001773 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f7fc0063800 con 0x7f7fac0b6590 2024-09-21T02:31:39.520 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 11 on host 'smithi148' 2024-09-21T02:31:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.521+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7fac0b6590 msgr2=0x7f7fac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7fac0b6590 0x7f7fac0b8aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00058c0 tx=0x7f7fb000a2d0 comp rx=0 tx=0).stop 2024-09-21T02:31:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 msgr2=0x7f7fc01a1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc01a1230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8006010 tx=0x7f7fb802fc20 comp rx=0 tx=0).stop 2024-09-21T02:31:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 shutdown_connections 2024-09-21T02:31:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7fac0b6590 0x7f7fac0b8aa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fc0104070 0x7f7fc01a1230 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fc01036d0 0x7f7fc019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 --2- 172.21.15.148:0/3925001773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fc0102640 0x7f7fc006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 >> 172.21.15.148:0/3925001773 conn(0x7f7fc00fdfb0 msgr2=0x7f7fc01069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 shutdown_connections 2024-09-21T02:31:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:39.522+0000 7f7fc5539640 1 -- 172.21.15.148:0/3925001773 wait complete. 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:40.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:40.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:40.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:40.171 DEBUG:teuthology.orchestra.run.smithi148:osd.11> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T02:31:40.173 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T02:31:40.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:31:40.548 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 -- 172.21.15.79:0/1194200850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0079640 msgr2=0x7f86e0079fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1194200850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0079640 0x7f86e0079fb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009ca0 tx=0x7f86d802a950 comp rx=0 tx=0).stop 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 -- 172.21.15.79:0/1194200850 shutdown_connections 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1194200850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0079640 0x7f86e0079fb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1194200850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e0078ca0 0x7f86e00790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1194200850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86e0077c10 0x7f86e0078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 -- 172.21.15.79:0/1194200850 >> 172.21.15.79:0/1194200850 conn(0x7f86e01012f0 msgr2=0x7f86e01037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 -- 172.21.15.79:0/1194200850 shutdown_connections 2024-09-21T02:31:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.182+0000 7f86e7a00640 1 -- 172.21.15.79:0/1194200850 wait complete. 2024-09-21T02:31:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 Processor -- start 2024-09-21T02:31:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 -- start start 2024-09-21T02:31:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e0077c10 0x7f86e01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0078ca0 0x7f86e01a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86e0079640 0x7f86e01a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0115a50 con 0x7f86e0078ca0 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01158d0 con 0x7f86e0079640 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.183+0000 7f86e7a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0115bd0 con 0x7f86e0077c10 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0078ca0 0x7f86e01a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0078ca0 0x7f86e01a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41592/0 (socket says 172.21.15.79:41592) 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 -- 172.21.15.79:0/1494117583 learned_addr learned my addr 172.21.15.79:0/1494117583 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86e5000640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e0077c10 0x7f86e01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86e5a00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86e0079640 0x7f86e01a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 -- 172.21.15.79:0/1494117583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e0077c10 msgr2=0x7f86e01a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e0077c10 0x7f86e01a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 -- 172.21.15.79:0/1494117583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86e0079640 msgr2=0x7f86e01a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86e0079640 0x7f86e01a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86dfe00640 1 -- 172.21.15.79:0/1494117583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e01a1fb0 con 0x7f86e0078ca0 2024-09-21T02:31:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.184+0000 7f86e5000640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e0077c10 0x7f86e01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:31:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.185+0000 7f86dfe00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0078ca0 0x7f86e01a0bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00e9f0 tx=0x7f86cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.185+0000 7f86dd600640 1 -- 172.21.15.79:0/1494117583 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc00cd80 con 0x7f86e0078ca0 2024-09-21T02:31:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.185+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e01a22a0 con 0x7f86e0078ca0 2024-09-21T02:31:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.185+0000 7f86dd600640 1 -- 172.21.15.79:0/1494117583 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86cc0108e0 con 0x7f86e0078ca0 2024-09-21T02:31:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.185+0000 7f86dd600640 1 -- 172.21.15.79:0/1494117583 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc018980 con 0x7f86e0078ca0 2024-09-21T02:31:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.185+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e01a89a0 con 0x7f86e0078ca0 2024-09-21T02:31:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.186+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e01124b0 con 0x7f86e0078ca0 2024-09-21T02:31:41.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.191+0000 7f86dd600640 1 -- 172.21.15.79:0/1494117583 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f86cc010430 con 0x7f86e0078ca0 2024-09-21T02:31:41.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.193+0000 7f86dd600640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86c80b6590 0x7f86c80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:41.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.193+0000 7f86dd600640 1 -- 172.21.15.79:0/1494117583 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6809+0+0 (secure 0 0 0) 0x7f86cc0e7420 con 0x7f86e0078ca0 2024-09-21T02:31:41.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.193+0000 7f86e5000640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86c80b6590 0x7f86c80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:41.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.194+0000 7f86e5000640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86c80b6590 0x7f86c80b8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86d4005d00 tx=0x7f86d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:41.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.194+0000 7f86dd600640 1 -- 172.21.15.79:0/1494117583 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86cc0b25d0 con 0x7f86e0078ca0 2024-09-21T02:31:41.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.382+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f86e0063fc0 con 0x7f86e0078ca0 2024-09-21T02:31:41.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.383+0000 7f86dd600640 1 -- 172.21.15.79:0/1494117583 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f86cc0b7510 con 0x7f86e0078ca0 2024-09-21T02:31:41.384 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:31:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86c80b6590 msgr2=0x7f86c80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86c80b6590 0x7f86c80b8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86d4005d00 tx=0x7f86d400b410 comp rx=0 tx=0).stop 2024-09-21T02:31:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0078ca0 msgr2=0x7f86e01a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0078ca0 0x7f86e01a0bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00e9f0 tx=0x7f86cc00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 shutdown_connections 2024-09-21T02:31:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86c80b6590 0x7f86c80b8aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86e0079640 0x7f86e01a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86e0078ca0 0x7f86e01a0bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 --2- 172.21.15.79:0/1494117583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e0077c10 0x7f86e01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 >> 172.21.15.79:0/1494117583 conn(0x7f86e01012f0 msgr2=0x7f86e0103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 shutdown_connections 2024-09-21T02:31:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:41.386+0000 7f86e7a00640 1 -- 172.21.15.79:0/1494117583 wait complete. 2024-09-21T02:31:41.673 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:41 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1494117583' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:41.673 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:31:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:31:41.483+0000 7f475ef1c640 -1 osd.11 0 log_to_monitors true 2024-09-21T02:31:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:41 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1494117583' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:41 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1494117583' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:42.194 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726885878,"num_in_osds":12,"osd_in_since":1726885881,"num_remapped_pgs":0} 2024-09-21T02:31:42.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:42 smithi148 ceph-mon[34626]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:42.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:42 smithi148 ceph-mon[34626]: from='osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:31:42.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:42 smithi148 ceph-mon[34626]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:31:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:42 smithi079 ceph-mon[30788]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:42.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:42 smithi079 ceph-mon[30788]: from='osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:31:42.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:42 smithi079 ceph-mon[30788]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:31:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:42 smithi098 ceph-mon[34832]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:42 smithi098 ceph-mon[34832]: from='osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:31:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:42 smithi098 ceph-mon[34832]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:31:43.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:31:43.588 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: Detected new or changed devices on smithi148 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T02:31:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:43.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:43.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:43 smithi079 ceph-mon[30788]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: Detected new or changed devices on smithi148 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:43 smithi148 ceph-mon[34626]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:31:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: Detected new or changed devices on smithi148 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:43.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T02:31:43.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:43.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:43.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:43.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:43 smithi098 ceph-mon[34832]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.271+0000 7ff073200640 1 -- 172.21.15.79:0/3805096027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104fa0 msgr2=0x7ff07410b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.271+0000 7ff073200640 1 --2- 172.21.15.79:0/3805096027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104fa0 0x7ff07410b940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009ca0 tx=0x7ff06c02a950 comp rx=0 tx=0).stop 2024-09-21T02:31:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.271+0000 7ff073200640 1 -- 172.21.15.79:0/3805096027 shutdown_connections 2024-09-21T02:31:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.271+0000 7ff073200640 1 --2- 172.21.15.79:0/3805096027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104fa0 0x7ff07410b940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.271+0000 7ff073200640 1 --2- 172.21.15.79:0/3805096027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074104600 0x7ff074104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.271+0000 7ff073200640 1 --2- 172.21.15.79:0/3805096027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff074103570 0x7ff0741039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.271+0000 7ff073200640 1 -- 172.21.15.79:0/3805096027 >> 172.21.15.79:0/3805096027 conn(0x7ff0740feec0 msgr2=0x7ff074101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:44.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.272+0000 7ff073200640 1 -- 172.21.15.79:0/3805096027 shutdown_connections 2024-09-21T02:31:44.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.272+0000 7ff073200640 1 -- 172.21.15.79:0/3805096027 wait complete. 2024-09-21T02:31:44.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 Processor -- start 2024-09-21T02:31:44.553 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:31:44 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:31:44.185+0000 7f475ae9e640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T02:31:44.554 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:31:44 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:31:44.197+0000 7f4752c94640 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 -- start start 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074103570 0x7ff074076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104600 0x7ff074075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff074104fa0 0x7ff074075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff07410f1c0 con 0x7ff074103570 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff07410f040 con 0x7ff074104fa0 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff073200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff07410f340 con 0x7ff074104600 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.273+0000 7ff071e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074103570 0x7ff074076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074103570 0x7ff074076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35464/0 (socket says 172.21.15.79:35464) 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071e00640 1 -- 172.21.15.79:0/4194390358 learned_addr learned my addr 172.21.15.79:0/4194390358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:31:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071400640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104600 0x7ff074075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff072800640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff074104fa0 0x7ff074075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071400640 1 -- 172.21.15.79:0/4194390358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff074104fa0 msgr2=0x7ff074075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071400640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff074104fa0 0x7ff074075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071400640 1 -- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074103570 msgr2=0x7ff074076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071400640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074103570 0x7ff074076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071400640 1 -- 172.21.15.79:0/4194390358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff074076350 con 0x7ff074104600 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071e00640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074103570 0x7ff074076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.274+0000 7ff071400640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104600 0x7ff074075710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff06000e9f0 tx=0x7ff06000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.275+0000 7ff06aa00640 1 -- 172.21.15.79:0/4194390358 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06000ccc0 con 0x7ff074104600 2024-09-21T02:31:44.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.275+0000 7ff06aa00640 1 -- 172.21.15.79:0/4194390358 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0600108e0 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.275+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0741a3e40 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.275+0000 7ff06aa00640 1 -- 172.21.15.79:0/4194390358 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060018880 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.275+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0741a41e0 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.276+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07410a750 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.278+0000 7ff06aa00640 1 -- 172.21.15.79:0/4194390358 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7ff060010430 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.280+0000 7ff06aa00640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0580b6510 0x7ff0580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.280+0000 7ff06aa00640 1 -- 172.21.15.79:0/4194390358 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6847+0+0 (secure 0 0 0) 0x7ff0600e7290 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.280+0000 7ff071e00640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0580b6510 0x7ff0580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.281+0000 7ff071e00640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0580b6510 0x7ff0580b8a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff064011500 tx=0x7ff064005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.281+0000 7ff06aa00640 1 -- 172.21.15.79:0/4194390358 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0600b2420 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.480+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff074063fc0 con 0x7ff074104600 2024-09-21T02:31:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.480+0000 7ff06aa00640 1 -- 172.21.15.79:0/4194390358 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7ff0600b7360 con 0x7ff074104600 2024-09-21T02:31:44.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:31:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0580b6510 msgr2=0x7ff0580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0580b6510 0x7ff0580b8a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff064011500 tx=0x7ff064005f90 comp rx=0 tx=0).stop 2024-09-21T02:31:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104600 msgr2=0x7ff074075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104600 0x7ff074075710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff06000e9f0 tx=0x7ff06000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 shutdown_connections 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0580b6510 0x7ff0580b8a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff074104fa0 0x7ff074075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff074104600 0x7ff074075710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 --2- 172.21.15.79:0/4194390358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff074103570 0x7ff074076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 >> 172.21.15.79:0/4194390358 conn(0x7ff0740feec0 msgr2=0x7ff074107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 shutdown_connections 2024-09-21T02:31:44.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:44.483+0000 7ff073200640 1 -- 172.21.15.79:0/4194390358 wait complete. 2024-09-21T02:31:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:44 smithi079 ceph-mon[30788]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:31:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:44 smithi079 ceph-mon[30788]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T02:31:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:44 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:44 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:44 smithi079 ceph-mon[30788]: from='osd.11 ' entity='osd.11' 2024-09-21T02:31:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:44 smithi148 ceph-mon[34626]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:31:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:44 smithi148 ceph-mon[34626]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T02:31:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:44 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:44 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:44 smithi148 ceph-mon[34626]: from='osd.11 ' entity='osd.11' 2024-09-21T02:31:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:44 smithi098 ceph-mon[34832]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T02:31:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:44 smithi098 ceph-mon[34832]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T02:31:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:44 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:44 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:44 smithi098 ceph-mon[34832]: from='osd.11 ' entity='osd.11' 2024-09-21T02:31:45.231 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726885878,"num_in_osds":12,"osd_in_since":1726885881,"num_remapped_pgs":0} 2024-09-21T02:31:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: purged_snaps scrub starts 2024-09-21T02:31:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: purged_snaps scrub ok 2024-09-21T02:31:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4194390358' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:45.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] boot 2024-09-21T02:31:45.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:31:45.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:45.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:45 smithi079 ceph-mon[30788]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: purged_snaps scrub starts 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: purged_snaps scrub ok 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4194390358' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] boot 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:45 smithi148 ceph-mon[34626]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: purged_snaps scrub starts 2024-09-21T02:31:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: purged_snaps scrub ok 2024-09-21T02:31:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4194390358' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: osd.11 [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] boot 2024-09-21T02:31:45.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:31:45.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:31:45.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:45 smithi098 ceph-mon[34832]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:31:46.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:31:46.602 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 -- 172.21.15.79:0/1727807627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e806c680 msgr2=0x7f89e8104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 --2- 172.21.15.79:0/1727807627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e806c680 0x7f89e8104190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009be0 tx=0x7f89d802a6c0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 -- 172.21.15.79:0/1727807627 shutdown_connections 2024-09-21T02:31:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 --2- 172.21.15.79:0/1727807627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e8107270 0x7f89e8107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 --2- 172.21.15.79:0/1727807627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e81046d0 0x7f89e8106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 --2- 172.21.15.79:0/1727807627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e806c680 0x7f89e8104190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 -- 172.21.15.79:0/1727807627 >> 172.21.15.79:0/1727807627 conn(0x7f89e80fdfe0 msgr2=0x7f89e8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:47.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 -- 172.21.15.79:0/1727807627 shutdown_connections 2024-09-21T02:31:47.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.244+0000 7f89ee400640 1 -- 172.21.15.79:0/1727807627 wait complete. 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.245+0000 7f89ee400640 1 Processor -- start 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.245+0000 7f89ee400640 1 -- start start 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89ee400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e806c680 0x7f89e81a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89ee400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e81046d0 0x7f89e81a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89ee400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e8107270 0x7f89e81a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89ee400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89e8115990 con 0x7f89e81046d0 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89ee400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f89e8115810 con 0x7f89e806c680 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89ee400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f89e8115b10 con 0x7f89e8107270 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89e6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e81046d0 0x7f89e81a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:47.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89e6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e81046d0 0x7f89e81a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35472/0 (socket says 172.21.15.79:35472) 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89e6a00640 1 -- 172.21.15.79:0/3193512327 learned_addr learned my addr 172.21.15.79:0/3193512327 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89e7400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e806c680 0x7f89e81a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.246+0000 7f89e7e00640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e8107270 0x7f89e81a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89e7400640 1 -- 172.21.15.79:0/3193512327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e8107270 msgr2=0x7f89e81a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89e7400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e8107270 0x7f89e81a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89e7400640 1 -- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e81046d0 msgr2=0x7f89e81a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89e7400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e81046d0 0x7f89e81a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89e7400640 1 -- 172.21.15.79:0/3193512327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e81a2010 con 0x7f89e806c680 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89e7e00640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e8107270 0x7f89e81a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:31:47.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89e7400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e806c680 0x7f89e81a05e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89d802abe0 tx=0x7f89d8030d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:47.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89dfe00640 1 -- 172.21.15.79:0/3193512327 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8041020 con 0x7f89e806c680 2024-09-21T02:31:47.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89dfe00640 1 -- 172.21.15.79:0/3193512327 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89d80318f0 con 0x7f89e806c680 2024-09-21T02:31:47.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e81a22a0 con 0x7f89e806c680 2024-09-21T02:31:47.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89dfe00640 1 -- 172.21.15.79:0/3193512327 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8036040 con 0x7f89e806c680 2024-09-21T02:31:47.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.247+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e81a8830 con 0x7f89e806c680 2024-09-21T02:31:47.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.248+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e80ffb00 con 0x7f89e806c680 2024-09-21T02:31:47.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.251+0000 7f89dfe00640 1 -- 172.21.15.79:0/3193512327 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f89d8044020 con 0x7f89e806c680 2024-09-21T02:31:47.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.252+0000 7f89dfe00640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f89cc0b6510 0x7f89cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:47.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.252+0000 7f89dfe00640 1 -- 172.21.15.79:0/3193512327 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f89d8107f20 con 0x7f89e806c680 2024-09-21T02:31:47.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.252+0000 7f89e6a00640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f89cc0b6510 0x7f89cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:47.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.253+0000 7f89e6a00640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f89cc0b6510 0x7f89cc0b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009c90 tx=0x7f89d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:47.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.254+0000 7f89dfe00640 1 -- 172.21.15.79:0/3193512327 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89d804b020 con 0x7f89e806c680 2024-09-21T02:31:47.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.440+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f89e8063fc0 con 0x7f89e806c680 2024-09-21T02:31:47.442 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:47 smithi079 ceph-mon[30788]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:31:47.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.441+0000 7f89dfe00640 1 -- 172.21.15.79:0/3193512327 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f89d80cebb0 con 0x7f89e806c680 2024-09-21T02:31:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:31:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f89cc0b6510 msgr2=0x7f89cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f89cc0b6510 0x7f89cc0b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009c90 tx=0x7f89d4005f90 comp rx=0 tx=0).stop 2024-09-21T02:31:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e806c680 msgr2=0x7f89e81a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e806c680 0x7f89e81a05e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89d802abe0 tx=0x7f89d8030d00 comp rx=0 tx=0).stop 2024-09-21T02:31:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 shutdown_connections 2024-09-21T02:31:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f89cc0b6510 0x7f89cc0b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e8107270 0x7f89e81a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89e81046d0 0x7f89e81a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 --2- 172.21.15.79:0/3193512327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89e806c680 0x7f89e81a05e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 >> 172.21.15.79:0/3193512327 conn(0x7f89e80fdfe0 msgr2=0x7f89e8105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 shutdown_connections 2024-09-21T02:31:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:47.444+0000 7f89ee400640 1 -- 172.21.15.79:0/3193512327 wait complete. 2024-09-21T02:31:47.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:47 smithi148 ceph-mon[34626]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:31:47.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:47 smithi098 ceph-mon[34832]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:31:48.139 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1726885905,"num_in_osds":12,"osd_in_since":1726885881,"num_remapped_pgs":0} 2024-09-21T02:31:48.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:31:48.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:48 smithi079 ceph-mon[30788]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:48.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:48 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3193512327' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:48.508 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:48.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:48 smithi148 ceph-mon[34626]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:48 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3193512327' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:48 smithi098 ceph-mon[34832]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:48 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3193512327' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 -- 172.21.15.79:0/4199888757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb410c020 msgr2=0x7f2bb4112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/4199888757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb410c020 0x7f2bb4112850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009ca0 tx=0x7f2bac02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 -- 172.21.15.79:0/4199888757 shutdown_connections 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/4199888757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb410c020 0x7f2bb4112850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/4199888757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb410b6d0 0x7f2bb410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/4199888757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb4105d90 0x7f2bb41061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 -- 172.21.15.79:0/4199888757 >> 172.21.15.79:0/4199888757 conn(0x7f2bb4101860 msgr2=0x7f2bb4103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 -- 172.21.15.79:0/4199888757 shutdown_connections 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.154+0000 7f2bbaa00640 1 -- 172.21.15.79:0/4199888757 wait complete. 2024-09-21T02:31:49.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 Processor -- start 2024-09-21T02:31:49.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 -- start start 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb4105d90 0x7f2bb419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb410b6d0 0x7f2bb419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb410c020 0x7f2bb41a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb4115ce0 con 0x7f2bb4105d90 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb4115b60 con 0x7f2bb410b6d0 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.155+0000 7f2bbaa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb4115e60 con 0x7f2bb410c020 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb4105d90 0x7f2bb419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:49.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb410c020 0x7f2bb41a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb4105d90 0x7f2bb419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35490/0 (socket says 172.21.15.79:35490) 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 -- 172.21.15.79:0/2848846360 learned_addr learned my addr 172.21.15.79:0/2848846360 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3400640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb410b6d0 0x7f2bb419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 -- 172.21.15.79:0/2848846360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb410c020 msgr2=0x7f2bb41a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb410c020 0x7f2bb41a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 -- 172.21.15.79:0/2848846360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb410b6d0 msgr2=0x7f2bb419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb410b6d0 0x7f2bb419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 -- 172.21.15.79:0/2848846360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb41a2600 con 0x7f2bb4105d90 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.156+0000 7f2bb3e00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb4105d90 0x7f2bb419c690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400e9f0 tx=0x7f2ba400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.157+0000 7f2bb0c00640 1 -- 172.21.15.79:0/2848846360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400cd80 con 0x7f2bb4105d90 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.157+0000 7f2bb0c00640 1 -- 172.21.15.79:0/2848846360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ba40108e0 con 0x7f2bb4105d90 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.157+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb41a28f0 con 0x7f2bb4105d90 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.157+0000 7f2bb0c00640 1 -- 172.21.15.79:0/2848846360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4018980 con 0x7f2bb4105d90 2024-09-21T02:31:49.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.157+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb41a9050 con 0x7f2bb4105d90 2024-09-21T02:31:49.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.158+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb41061a0 con 0x7f2bb4105d90 2024-09-21T02:31:49.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.160+0000 7f2bb0c00640 1 -- 172.21.15.79:0/2848846360 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f2ba4010430 con 0x7f2bb4105d90 2024-09-21T02:31:49.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.161+0000 7f2bb0c00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b980b6510 0x7f2b980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:49.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.162+0000 7f2bb0c00640 1 -- 172.21.15.79:0/2848846360 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f2ba40e76a0 con 0x7f2bb4105d90 2024-09-21T02:31:49.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.162+0000 7f2bb3400640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b980b6510 0x7f2b980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:49.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.162+0000 7f2bb3400640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b980b6510 0x7f2b980b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2bb41050b0 tx=0x7f2ba0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:49.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.163+0000 7f2bb0c00640 1 -- 172.21.15.79:0/2848846360 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ba40b2710 con 0x7f2bb4105d90 2024-09-21T02:31:49.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.351+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bb419d7c0 con 0x7f2bb4105d90 2024-09-21T02:31:49.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.353+0000 7f2bb0c00640 1 -- 172.21.15.79:0/2848846360 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18421 (secure 0 0 0) 0x7f2ba40b7650 con 0x7f2bb4105d90 2024-09-21T02:31:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:31:49.355 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:31:46.192111+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b980b6510 msgr2=0x7f2b980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b980b6510 0x7f2b980b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2bb41050b0 tx=0x7f2ba0005f90 comp rx=0 tx=0).stop 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb4105d90 msgr2=0x7f2bb419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb4105d90 0x7f2bb419c690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400e9f0 tx=0x7f2ba400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 shutdown_connections 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b980b6510 0x7f2b980b8a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb410c020 0x7f2bb41a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb410b6d0 0x7f2bb419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 --2- 172.21.15.79:0/2848846360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb4105d90 0x7f2bb419c690 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.355+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 >> 172.21.15.79:0/2848846360 conn(0x7f2bb4101860 msgr2=0x7f2bb410ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.356+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 shutdown_connections 2024-09-21T02:31:49.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:49.356+0000 7f2bbaa00640 1 -- 172.21.15.79:0/2848846360 wait complete. 2024-09-21T02:31:49.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:49 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2848846360' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:31:49.791 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:49 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2848846360' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:31:49.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:49 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2848846360' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:31:50.109 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T02:27:31.612693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T02:31:50.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T02:31:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:50 smithi079 ceph-mon[30788]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:50 smithi148 ceph-mon[34626]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:50.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:50 smithi098 ceph-mon[34832]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 -- 172.21.15.79:0/1475084421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 msgr2=0x7f55741098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 --2- 172.21.15.79:0/1475084421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 0x7f55741098d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5560009900 tx=0x7f556002a410 comp rx=0 tx=0).stop 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 -- 172.21.15.79:0/1475084421 shutdown_connections 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 --2- 172.21.15.79:0/1475084421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5574109e10 0x7f5574110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 --2- 172.21.15.79:0/1475084421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 0x7f55741098d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 --2- 172.21.15.79:0/1475084421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5574103b80 0x7f5574103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 -- 172.21.15.79:0/1475084421 >> 172.21.15.79:0/1475084421 conn(0x7f55740ff610 msgr2=0x7f5574101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 -- 172.21.15.79:0/1475084421 shutdown_connections 2024-09-21T02:31:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.116+0000 7f557c400640 1 -- 172.21.15.79:0/1475084421 wait complete. 2024-09-21T02:31:51.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.117+0000 7f557c400640 1 Processor -- start 2024-09-21T02:31:51.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.117+0000 7f557c400640 1 -- start start 2024-09-21T02:31:51.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f557c400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5574103b80 0x7f557419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:51.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f557c400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 0x7f557419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:51.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f557c400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5574109e10 0x7f557419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f557c400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5574113ad0 con 0x7f55741094c0 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f557c400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5574113950 con 0x7f5574109e10 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f557c400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5574113c50 con 0x7f5574103b80 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f5579000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 0x7f557419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f5579a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5574103b80 0x7f557419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f5579000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 0x7f557419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35510/0 (socket says 172.21.15.79:35510) 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f5579000640 1 -- 172.21.15.79:0/4139839684 learned_addr learned my addr 172.21.15.79:0/4139839684 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:31:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.118+0000 7f557a400640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5574109e10 0x7f557419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5579a00640 1 -- 172.21.15.79:0/4139839684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5574109e10 msgr2=0x7f557419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5579a00640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5574109e10 0x7f557419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5579a00640 1 -- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 msgr2=0x7f557419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5579a00640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 0x7f557419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5579a00640 1 -- 172.21.15.79:0/4139839684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55741a03f0 con 0x7f5574103b80 2024-09-21T02:31:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5579a00640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5574103b80 0x7f557419a480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5568005fd0 tx=0x7f556800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5572000640 1 -- 172.21.15.79:0/4139839684 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568009c30 con 0x7f5574103b80 2024-09-21T02:31:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55741a06e0 con 0x7f5574103b80 2024-09-21T02:31:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5572000640 1 -- 172.21.15.79:0/4139839684 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5568009dd0 con 0x7f5574103b80 2024-09-21T02:31:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.119+0000 7f5572000640 1 -- 172.21.15.79:0/4139839684 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568003e20 con 0x7f5574103b80 2024-09-21T02:31:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.120+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55741a6e40 con 0x7f5574103b80 2024-09-21T02:31:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.121+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5574104e00 con 0x7f5574103b80 2024-09-21T02:31:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.123+0000 7f5572000640 1 -- 172.21.15.79:0/4139839684 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5568004000 con 0x7f5574103b80 2024-09-21T02:31:51.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.124+0000 7f5572000640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f555c0b6510 0x7f555c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:51.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.125+0000 7f5572000640 1 -- 172.21.15.79:0/4139839684 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f55680e69b0 con 0x7f5574103b80 2024-09-21T02:31:51.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.125+0000 7f5579000640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f555c0b6510 0x7f555c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:51.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.125+0000 7f5579000640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f555c0b6510 0x7f555c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5574106e30 tx=0x7f5560009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:51.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.127+0000 7f5572000640 1 -- 172.21.15.79:0/4139839684 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5568017020 con 0x7f5574103b80 2024-09-21T02:31:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.312+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f557419b5b0 con 0x7f5574103b80 2024-09-21T02:31:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.313+0000 7f5572000640 1 -- 172.21.15.79:0/4139839684 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f55680b1a20 con 0x7f5574103b80 2024-09-21T02:31:51.314 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-09-21T02:31:51.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f555c0b6510 msgr2=0x7f555c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f555c0b6510 0x7f555c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5574106e30 tx=0x7f5560009560 comp rx=0 tx=0).stop 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5574103b80 msgr2=0x7f557419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5574103b80 0x7f557419a480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5568005fd0 tx=0x7f556800dde0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 shutdown_connections 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f555c0b6510 0x7f555c0b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5574109e10 0x7f557419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55741094c0 0x7f557419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 --2- 172.21.15.79:0/4139839684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5574103b80 0x7f557419a480 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 >> 172.21.15.79:0/4139839684 conn(0x7f55740ff610 msgr2=0x7f5574101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 shutdown_connections 2024-09-21T02:31:51.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:51.315+0000 7f557c400640 1 -- 172.21.15.79:0/4139839684 wait complete. 2024-09-21T02:31:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:51 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4139839684' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:31:51.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:51 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4139839684' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:31:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:51 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4139839684' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:31:52.213 INFO:tasks.cephadm:Adding mds.a on smithi079 2024-09-21T02:31:52.213 INFO:tasks.cephadm:Adding mds.d on smithi079 2024-09-21T02:31:52.213 INFO:tasks.cephadm:Adding mds.g on smithi079 2024-09-21T02:31:52.214 INFO:tasks.cephadm:Adding mds.j on smithi079 2024-09-21T02:31:52.214 INFO:tasks.cephadm:Adding mds.b on smithi098 2024-09-21T02:31:52.214 INFO:tasks.cephadm:Adding mds.e on smithi098 2024-09-21T02:31:52.214 INFO:tasks.cephadm:Adding mds.h on smithi098 2024-09-21T02:31:52.214 INFO:tasks.cephadm:Adding mds.k on smithi098 2024-09-21T02:31:52.214 INFO:tasks.cephadm:Adding mds.c on smithi148 2024-09-21T02:31:52.215 INFO:tasks.cephadm:Adding mds.f on smithi148 2024-09-21T02:31:52.215 INFO:tasks.cephadm:Adding mds.i on smithi148 2024-09-21T02:31:52.215 INFO:tasks.cephadm:Adding mds.l on smithi148 2024-09-21T02:31:52.215 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l' 2024-09-21T02:31:52.478 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:31:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:52 smithi148 ceph-mon[34626]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:52 smithi079 ceph-mon[30788]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:52.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:52 smithi098 ceph-mon[34832]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.924+0000 7fb069387640 1 -- 172.21.15.148:0/2808469441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0641036d0 msgr2=0x7fb064103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.924+0000 7fb069387640 1 --2- 172.21.15.148:0/2808469441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0641036d0 0x7fb064103ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009900 tx=0x7fb04c02a480 comp rx=0 tx=0).stop 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 -- 172.21.15.148:0/2808469441 shutdown_connections 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 --2- 172.21.15.148:0/2808469441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb064104070 0x7fb06410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 --2- 172.21.15.148:0/2808469441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0641036d0 0x7fb064103ae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 --2- 172.21.15.148:0/2808469441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb064102640 0x7fb064102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 -- 172.21.15.148:0/2808469441 >> 172.21.15.148:0/2808469441 conn(0x7fb0640fdfb0 msgr2=0x7fb064100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 -- 172.21.15.148:0/2808469441 shutdown_connections 2024-09-21T02:31:52.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 -- 172.21.15.148:0/2808469441 wait complete. 2024-09-21T02:31:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 Processor -- start 2024-09-21T02:31:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 -- start start 2024-09-21T02:31:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.925+0000 7fb069387640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb064102640 0x7fb06406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb069387640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0641036d0 0x7fb06419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb069387640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb064104070 0x7fb0641a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb069387640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb06410e310 con 0x7fb0641036d0 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb069387640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb06410e190 con 0x7fb064102640 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb069387640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb06410e490 con 0x7fb064104070 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb064104070 0x7fb0641a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb064104070 0x7fb0641a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53538/0 (socket says 172.21.15.148:53538) 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 -- 172.21.15.148:0/4250574201 learned_addr learned my addr 172.21.15.148:0/4250574201 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb062ffd640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb064102640 0x7fb06406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb05bfff640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0641036d0 0x7fb06419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 -- 172.21.15.148:0/4250574201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb064102640 msgr2=0x7fb06406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb064102640 0x7fb06406b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 -- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0641036d0 msgr2=0x7fb06419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0641036d0 0x7fb06419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 -- 172.21.15.148:0/4250574201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0641a1b10 con 0x7fb064104070 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb0637fe640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb064104070 0x7fb0641a1310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00b970 tx=0x7fb05c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb060ff9640 1 -- 172.21.15.148:0/4250574201 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c019070 con 0x7fb064104070 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb060ff9640 1 -- 172.21.15.148:0/4250574201 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb05c014440 con 0x7fb064104070 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0641a1e00 con 0x7fb064104070 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb060ff9640 1 -- 172.21.15.148:0/4250574201 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c0075d0 con 0x7fb064104070 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.926+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0641a22e0 con 0x7fb064104070 2024-09-21T02:31:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.927+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb064109820 con 0x7fb064104070 2024-09-21T02:31:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.929+0000 7fb060ff9640 1 -- 172.21.15.148:0/4250574201 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb05c01c070 con 0x7fb064104070 2024-09-21T02:31:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.930+0000 7fb060ff9640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb0500b6510 0x7fb0500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.930+0000 7fb060ff9640 1 -- 172.21.15.148:0/4250574201 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fb05c0e67c0 con 0x7fb064104070 2024-09-21T02:31:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.930+0000 7fb062ffd640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb0500b6510 0x7fb0500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:52.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.931+0000 7fb062ffd640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb0500b6510 0x7fb0500b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb054005fd0 tx=0x7fb05400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:52.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:52.933+0000 7fb060ff9640 1 -- 172.21.15.148:0/4250574201 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb05c0b18d0 con 0x7fb064104070 2024-09-21T02:31:53.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.123+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}) -- 0x7fb064063900 con 0x7fb0500b6510 2024-09-21T02:31:53.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.132+0000 7fb060ff9640 1 -- 172.21.15.148:0/4250574201 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fb064063900 con 0x7fb0500b6510 2024-09-21T02:31:53.133 INFO:teuthology.orchestra.run.smithi148.stdout:Scheduled mds.all update... 2024-09-21T02:31:53.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb0500b6510 msgr2=0x7fb0500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb0500b6510 0x7fb0500b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb054005fd0 tx=0x7fb05400b390 comp rx=0 tx=0).stop 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb064104070 msgr2=0x7fb0641a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb064104070 0x7fb0641a1310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00b970 tx=0x7fb05c00be30 comp rx=0 tx=0).stop 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 shutdown_connections 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb0500b6510 0x7fb0500b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb064104070 0x7fb0641a1310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0641036d0 0x7fb06419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 --2- 172.21.15.148:0/4250574201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb064102640 0x7fb06406b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 >> 172.21.15.148:0/4250574201 conn(0x7fb0640fdfb0 msgr2=0x7fb0641069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 shutdown_connections 2024-09-21T02:31:53.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T02:31:53.134+0000 7fb069387640 1 -- 172.21.15.148:0/4250574201 wait complete. 2024-09-21T02:31:53.842 DEBUG:teuthology.orchestra.run.smithi079:mds.a> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T02:31:53.846 DEBUG:teuthology.orchestra.run.smithi079:mds.d> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T02:31:53.893 DEBUG:teuthology.orchestra.run.smithi079:mds.g> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T02:31:53.938 DEBUG:teuthology.orchestra.run.smithi079:mds.j> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T02:31:53.984 DEBUG:teuthology.orchestra.run.smithi098:mds.b> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T02:31:53.988 DEBUG:teuthology.orchestra.run.smithi098:mds.e> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T02:31:54.031 DEBUG:teuthology.orchestra.run.smithi098:mds.h> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T02:31:54.074 DEBUG:teuthology.orchestra.run.smithi098:mds.k> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T02:31:54.118 DEBUG:teuthology.orchestra.run.smithi148:mds.c> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T02:31:54.120 DEBUG:teuthology.orchestra.run.smithi148:mds.f> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T02:31:54.163 DEBUG:teuthology.orchestra.run.smithi148:mds.i> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T02:31:54.206 DEBUG:teuthology.orchestra.run.smithi148:mds.l> sudo journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T02:31:54.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:54.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: Saving service mds.all spec with placement smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T02:31:54.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:54.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:54.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:54.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:54.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:54.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:54.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:31:54.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:31:54.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:54.249 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T02:31:54.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:31:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: Saving service mds.all spec with placement smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T02:31:54.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:31:54.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:54.465 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: Saving service mds.all spec with placement smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:31:54.466 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:54.611 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 -- 172.21.15.79:0/2977999310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc006c0e0 msgr2=0x7facc006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 --2- 172.21.15.79:0/2977999310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc006c0e0 0x7facc006c4f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7facac009900 tx=0x7facac02a410 comp rx=0 tx=0).stop 2024-09-21T02:31:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 -- 172.21.15.79:0/2977999310 shutdown_connections 2024-09-21T02:31:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 --2- 172.21.15.79:0/2977999310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc0110040 0x7facc0112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 --2- 172.21.15.79:0/2977999310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc006c0e0 0x7facc006c4f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 --2- 172.21.15.79:0/2977999310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc01046a0 0x7facc006bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 -- 172.21.15.79:0/2977999310 >> 172.21.15.79:0/2977999310 conn(0x7facc00799a0 msgr2=0x7facc0079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:55.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 -- 172.21.15.79:0/2977999310 shutdown_connections 2024-09-21T02:31:55.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.260+0000 7facc8400640 1 -- 172.21.15.79:0/2977999310 wait complete. 2024-09-21T02:31:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.261+0000 7facc8400640 1 Processor -- start 2024-09-21T02:31:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.261+0000 7facc8400640 1 -- start start 2024-09-21T02:31:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc8400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc006c0e0 0x7facc019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc8400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc01046a0 0x7facc019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc8400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc0110040 0x7facc01a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc8400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facc0115cc0 con 0x7facc01046a0 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc8400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7facc0115b40 con 0x7facc0110040 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc8400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7facc0115e40 con 0x7facc006c0e0 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc006c0e0 0x7facc019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc006c0e0 0x7facc019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40988/0 (socket says 172.21.15.79:40988) 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 -- 172.21.15.79:0/1278836624 learned_addr learned my addr 172.21.15.79:0/1278836624 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5000640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc01046a0 0x7facc019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc6400640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc0110040 0x7facc01a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 -- 172.21.15.79:0/1278836624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc0110040 msgr2=0x7facc01a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc0110040 0x7facc01a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 -- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc01046a0 msgr2=0x7facc019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc01046a0 0x7facc019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.262+0000 7facc5a00640 1 -- 172.21.15.79:0/1278836624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc01a2640 con 0x7facc006c0e0 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.263+0000 7facc5a00640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc006c0e0 0x7facc019c6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7facb400e9f0 tx=0x7facb400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.263+0000 7facbe000640 1 -- 172.21.15.79:0/1278836624 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb400cd80 con 0x7facc006c0e0 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.263+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc01a2930 con 0x7facc006c0e0 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.263+0000 7facbe000640 1 -- 172.21.15.79:0/1278836624 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb40054d0 con 0x7facc006c0e0 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.263+0000 7facbe000640 1 -- 172.21.15.79:0/1278836624 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4010690 con 0x7facc006c0e0 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.263+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc01a9090 con 0x7facc006c0e0 2024-09-21T02:31:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.264+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc006c4f0 con 0x7facc006c0e0 2024-09-21T02:31:55.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.267+0000 7facbe000640 1 -- 172.21.15.79:0/1278836624 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7facb4004e30 con 0x7facc006c0e0 2024-09-21T02:31:55.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.268+0000 7facbe000640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faca80b6510 0x7faca80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:55.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.268+0000 7facbe000640 1 -- 172.21.15.79:0/1278836624 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7facb40e74a0 con 0x7facc006c0e0 2024-09-21T02:31:55.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.268+0000 7facc5000640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faca80b6510 0x7faca80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.269+0000 7facc5000640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faca80b6510 0x7faca80b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7facac009230 tx=0x7facac031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.270+0000 7facbe000640 1 -- 172.21.15.79:0/1278836624 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facb40ae130 con 0x7facc006c0e0 2024-09-21T02:31:55.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:55 smithi098 ceph-mon[34832]: Deploying daemon mds.l on smithi148 2024-09-21T02:31:55.460 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:55 smithi148 ceph-mon[34626]: Deploying daemon mds.l on smithi148 2024-09-21T02:31:55.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:55 smithi079 ceph-mon[30788]: Deploying daemon mds.l on smithi148 2024-09-21T02:31:55.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.494+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facc019d800 con 0x7facc006c0e0 2024-09-21T02:31:55.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.495+0000 7facbe000640 1 -- 172.21.15.79:0/1278836624 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7facc019d800 con 0x7facc006c0e0 2024-09-21T02:31:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:31:55.496 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"btime":"2024-09-21T02:23:32:342373+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T02:31:55.496 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 1 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faca80b6510 msgr2=0x7faca80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faca80b6510 0x7faca80b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7facac009230 tx=0x7facac031400 comp rx=0 tx=0).stop 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc006c0e0 msgr2=0x7facc019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc006c0e0 0x7facc019c6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7facb400e9f0 tx=0x7facb400edf0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 shutdown_connections 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7faca80b6510 0x7faca80b8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc0110040 0x7facc01a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc01046a0 0x7facc019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 --2- 172.21.15.79:0/1278836624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc006c0e0 0x7facc019c6d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:55.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.497+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 >> 172.21.15.79:0/1278836624 conn(0x7facc00799a0 msgr2=0x7facc01014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:55.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.498+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 shutdown_connections 2024-09-21T02:31:55.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:55.498+0000 7facc8400640 1 -- 172.21.15.79:0/1278836624 wait complete. 2024-09-21T02:31:55.813 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:55 smithi148 systemd[1]: Starting Ceph mds.l for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:31:56.117 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:55 smithi148 podman[62073]: 2024-09-21 02:31:55.755713391 +0000 UTC m=+0.016189590 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:31:56.117 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:55 smithi148 podman[62073]: 2024-09-21 02:31:55.880624213 +0000 UTC m=+0.141100402 container create 93fb027e6ddd60e8a7c80803d077b0a462db63c667189d71151b1342a10fc617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T02:31:56.117 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:56 smithi148 podman[62073]: 2024-09-21 02:31:56.116979343 +0000 UTC m=+0.377455543 container init 93fb027e6ddd60e8a7c80803d077b0a462db63c667189d71151b1342a10fc617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T02:31:56.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:56 smithi079 ceph-mon[30788]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:56.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:56 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1278836624' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:31:56.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:56 smithi098 ceph-mon[34832]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:56.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:56 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1278836624' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:31:56.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:56 smithi148 ceph-mon[34626]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:56.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:56 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1278836624' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:31:56.563 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:56 smithi148 podman[62073]: 2024-09-21 02:31:56.119860656 +0000 UTC m=+0.380336845 container start 93fb027e6ddd60e8a7c80803d077b0a462db63c667189d71151b1342a10fc617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:31:56.563 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:56 smithi148 ceph-mds[62092]: -- 172.21.15.148:0/2750649579 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56015fd05860 con 0x560163ead180 2024-09-21T02:31:56.563 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l[62088]: starting mds.l at 2024-09-21T02:31:56.563 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:56 smithi148 bash[62073]: 93fb027e6ddd60e8a7c80803d077b0a462db63c667189d71151b1342a10fc617 2024-09-21T02:31:56.563 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:31:56 smithi148 systemd[1]: Started Ceph mds.l for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:31:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.148:6832/4025923803,v1:172.21.15.148:6833/4025923803] up:boot 2024-09-21T02:31:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: fsmap 1 up:standby 2024-09-21T02:31:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:31:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:31:57.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:31:57.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:57.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:57 smithi098 ceph-mon[34832]: Deploying daemon mds.k on smithi098 2024-09-21T02:31:57.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.148:6832/4025923803,v1:172.21.15.148:6833/4025923803] up:boot 2024-09-21T02:31:57.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: fsmap 1 up:standby 2024-09-21T02:31:57.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:31:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:31:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:31:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:57 smithi079 ceph-mon[30788]: Deploying daemon mds.k on smithi098 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.148:6832/4025923803,v1:172.21.15.148:6833/4025923803] up:boot 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: fsmap 1 up:standby 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:31:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:31:57.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:57.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:57 smithi148 ceph-mon[34626]: Deploying daemon mds.k on smithi098 2024-09-21T02:31:58.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:31:58.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:31:58 smithi079 ceph-mon[30788]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:58.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:31:58 smithi148 ceph-mon[34626]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:58.585 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:31:58 smithi098 ceph-mon[34832]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:31:58.708 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:59.155 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 21 02:31:58 smithi098 systemd[1]: Started Ceph mds.k for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 -- 172.21.15.79:0/2269006040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 msgr2=0x7efcf4109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 --2- 172.21.15.79:0/2269006040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 0x7efcf4109700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efce0009900 tx=0x7efce002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 -- 172.21.15.79:0/2269006040 shutdown_connections 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 --2- 172.21.15.79:0/2269006040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf4109c40 0x7efcf4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 --2- 172.21.15.79:0/2269006040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 0x7efcf4109700 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 --2- 172.21.15.79:0/2269006040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf41039b0 0x7efcf4103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 -- 172.21.15.79:0/2269006040 >> 172.21.15.79:0/2269006040 conn(0x7efcf40ff440 msgr2=0x7efcf4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 -- 172.21.15.79:0/2269006040 shutdown_connections 2024-09-21T02:31:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.321+0000 7efcf9e00640 1 -- 172.21.15.79:0/2269006040 wait complete. 2024-09-21T02:31:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.322+0000 7efcf9e00640 1 Processor -- start 2024-09-21T02:31:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf9e00640 1 -- start start 2024-09-21T02:31:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf9e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf41039b0 0x7efcf419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf9e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 0x7efcf419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf4109c40 0x7efcf41a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf9e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efcf4115b20 con 0x7efcf41092f0 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf9e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efcf41159a0 con 0x7efcf41039b0 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf9e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efcf4115ca0 con 0x7efcf4109c40 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf41039b0 0x7efcf419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 0x7efcf419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf41039b0 0x7efcf419c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51746/0 (socket says 172.21.15.79:51746) 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.323+0000 7efcf8a00640 1 -- 172.21.15.79:0/1347415420 learned_addr learned my addr 172.21.15.79:0/1347415420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:31:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.324+0000 7efcf9400640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf4109c40 0x7efcf41a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.324+0000 7efcf8a00640 1 -- 172.21.15.79:0/1347415420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf4109c40 msgr2=0x7efcf41a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.324+0000 7efcf8a00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf4109c40 0x7efcf41a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.324+0000 7efcf8a00640 1 -- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 msgr2=0x7efcf419caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.324+0000 7efcf8a00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 0x7efcf419caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.324+0000 7efcf8a00640 1 -- 172.21.15.79:0/1347415420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf41a2400 con 0x7efcf41039b0 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.325+0000 7efcf8a00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf41039b0 0x7efcf419c550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efce800e9f0 tx=0x7efce800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.325+0000 7efcf1600640 1 -- 172.21.15.79:0/1347415420 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce800cd80 con 0x7efcf41039b0 2024-09-21T02:31:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.325+0000 7efcf1600640 1 -- 172.21.15.79:0/1347415420 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efce80054d0 con 0x7efcf41039b0 2024-09-21T02:31:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.325+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf41a26f0 con 0x7efcf41039b0 2024-09-21T02:31:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.325+0000 7efcf1600640 1 -- 172.21.15.79:0/1347415420 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce8010690 con 0x7efcf41039b0 2024-09-21T02:31:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.325+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf41a8f10 con 0x7efcf41039b0 2024-09-21T02:31:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.327+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf4103dc0 con 0x7efcf41039b0 2024-09-21T02:31:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.329+0000 7efcf1600640 1 -- 172.21.15.79:0/1347415420 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7efce8004e50 con 0x7efcf41039b0 2024-09-21T02:31:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.331+0000 7efcf1600640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efcdc0b65c0 0x7efcdc0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:31:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.331+0000 7efcf1600640 1 -- 172.21.15.79:0/1347415420 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7efce80e7590 con 0x7efcf41039b0 2024-09-21T02:31:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.331+0000 7efcf3e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efcdc0b65c0 0x7efcdc0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:31:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.332+0000 7efcf3e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efcdc0b65c0 0x7efcdc0b8ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efce0009230 tx=0x7efce0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:31:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.332+0000 7efcf1600640 1 -- 172.21.15.79:0/1347415420 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efce80ae220 con 0x7efcf41039b0 2024-09-21T02:31:59.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.569+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcf410ba70 con 0x7efcf41039b0 2024-09-21T02:31:59.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.570+0000 7efcf1600640 1 -- 172.21.15.79:0/1347415420 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7efce80b2600 con 0x7efcf41039b0 2024-09-21T02:31:59.572 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:31:59.572 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"btime":"2024-09-21T02:31:59:172990+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T02:31:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2024-09-21T02:31:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.572+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efcdc0b65c0 msgr2=0x7efcdc0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.572+0000 7efcf9e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efcdc0b65c0 0x7efcdc0b8ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efce0009230 tx=0x7efce0031400 comp rx=0 tx=0).stop 2024-09-21T02:31:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.572+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf41039b0 msgr2=0x7efcf419c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:31:59.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.572+0000 7efcf9e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf41039b0 0x7efcf419c550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efce800e9f0 tx=0x7efce800edf0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 shutdown_connections 2024-09-21T02:31:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efcdc0b65c0 0x7efcdc0b8ad0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf4109c40 0x7efcf41a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf41092f0 0x7efcf419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 --2- 172.21.15.79:0/1347415420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcf41039b0 0x7efcf419c550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:31:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 >> 172.21.15.79:0/1347415420 conn(0x7efcf40ff440 msgr2=0x7efcf4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:31:59.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 shutdown_connections 2024-09-21T02:31:59.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:31:59.573+0000 7efcf9e00640 1 -- 172.21.15.79:0/1347415420 wait complete. 2024-09-21T02:32:00.281 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: Deploying daemon mds.j on smithi079 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.98:6832/2247079967,v1:172.21.15.98:6833/2247079967] up:boot 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: fsmap 2 up:standby 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:00.282 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:00 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1347415420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: Deploying daemon mds.j on smithi079 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.98:6832/2247079967,v1:172.21.15.98:6833/2247079967] up:boot 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: fsmap 2 up:standby 2024-09-21T02:32:00.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:32:00.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:00.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:00 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1347415420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:00.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: Deploying daemon mds.j on smithi079 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.98:6832/2247079967,v1:172.21.15.98:6833/2247079967] up:boot 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: fsmap 2 up:standby 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:00.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:00 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1347415420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:02.322 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 systemd[1]: Starting Ceph mds.j for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:32:02.622 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:02 smithi079 ceph-mon[30788]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:02.622 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 podman[70595]: 2024-09-21 02:32:02.225313163 +0000 UTC m=+0.027536677 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:02.622 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 podman[70595]: 2024-09-21 02:32:02.384509784 +0000 UTC m=+0.186733293 container create 03a9d34197bd0dc2d78fc7d0c64ba3b36a452a4977ebceb7c296cd9b95f1832b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T02:32:02.622 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 podman[70595]: 2024-09-21 02:32:02.621637373 +0000 UTC m=+0.423860902 container init 03a9d34197bd0dc2d78fc7d0c64ba3b36a452a4977ebceb7c296cd9b95f1832b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-21T02:32:02.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:02 smithi148 ceph-mon[34626]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:02.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:02.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:02 smithi098 ceph-mon[34832]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:02.951 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 podman[70595]: 2024-09-21 02:32:02.629840593 +0000 UTC m=+0.432064100 container start 03a9d34197bd0dc2d78fc7d0c64ba3b36a452a4977ebceb7c296cd9b95f1832b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T02:32:02.952 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 ceph-mds[70615]: -- 172.21.15.79:0/1626987461 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581f1f45860 con 0x5581f60ed180 2024-09-21T02:32:02.952 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j[70610]: starting mds.j at 2024-09-21T02:32:02.952 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 bash[70595]: 03a9d34197bd0dc2d78fc7d0c64ba3b36a452a4977ebceb7c296cd9b95f1832b 2024-09-21T02:32:02.952 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:32:02 smithi079 systemd[1]: Started Ceph mds.j for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:03.309 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: Deploying daemon mds.d on smithi079 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.79:6834/209829654,v1:172.21.15.79:6835/209829654] up:boot 2024-09-21T02:32:04.060 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: fsmap 3 up:standby 2024-09-21T02:32:04.061 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:03 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:32:04.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:04.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:04.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:04.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: Deploying daemon mds.d on smithi079 2024-09-21T02:32:04.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:04.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.79:6834/209829654,v1:172.21.15.79:6835/209829654] up:boot 2024-09-21T02:32:04.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: fsmap 3 up:standby 2024-09-21T02:32:04.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:03 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:32:04.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:04.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:04.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:04.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:04.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: Deploying daemon mds.d on smithi079 2024-09-21T02:32:04.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:04.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.79:6834/209829654,v1:172.21.15.79:6835/209829654] up:boot 2024-09-21T02:32:04.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: fsmap 3 up:standby 2024-09-21T02:32:04.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:03 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:32:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 -- 172.21.15.79:0/1007975640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0114750 msgr2=0x7fdda0116b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 --2- 172.21.15.79:0/1007975640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0114750 0x7fdda0116b70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009be0 tx=0x7fdd9802a6c0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 -- 172.21.15.79:0/1007975640 shutdown_connections 2024-09-21T02:32:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 --2- 172.21.15.79:0/1007975640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0114750 0x7fdda0116b70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 --2- 172.21.15.79:0/1007975640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 0x7fdda0114210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 --2- 172.21.15.79:0/1007975640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda0077940 0x7fdda0077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 -- 172.21.15.79:0/1007975640 >> 172.21.15.79:0/1007975640 conn(0x7fdda0101860 msgr2=0x7fdda0103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 -- 172.21.15.79:0/1007975640 shutdown_connections 2024-09-21T02:32:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.350+0000 7fdda6800640 1 -- 172.21.15.79:0/1007975640 wait complete. 2024-09-21T02:32:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 Processor -- start 2024-09-21T02:32:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 -- start start 2024-09-21T02:32:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0077940 0x7fdda01a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 0x7fdda01a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda0114750 0x7fdda01a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdda011a0d0 con 0x7fdda0078290 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0119f50 con 0x7fdda0077940 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdda6800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdda011a250 con 0x7fdda0114750 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.352+0000 7fdd9ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 0x7fdda01a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 0x7fdda01a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45360/0 (socket says 172.21.15.79:45360) 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9ea00640 1 -- 172.21.15.79:0/1537027444 learned_addr learned my addr 172.21.15.79:0/1537027444 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9fe00640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda0114750 0x7fdda01a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9f400640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0077940 0x7fdda01a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9fe00640 1 -- 172.21.15.79:0/1537027444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0077940 msgr2=0x7fdda01a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9fe00640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0077940 0x7fdda01a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9fe00640 1 -- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 msgr2=0x7fdda01a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9fe00640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 0x7fdda01a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9fe00640 1 -- 172.21.15.79:0/1537027444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda01a69d0 con 0x7fdda0114750 2024-09-21T02:32:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9ea00640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 0x7fdda01a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.353+0000 7fdd9fe00640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda0114750 0x7fdda01a62a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009b30 tx=0x7fdd98003b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.354+0000 7fdd97e00640 1 -- 172.21.15.79:0/1537027444 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98041020 con 0x7fdda0114750 2024-09-21T02:32:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.354+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda01a6c60 con 0x7fdda0114750 2024-09-21T02:32:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.354+0000 7fdd97e00640 1 -- 172.21.15.79:0/1537027444 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd980318f0 con 0x7fdda0114750 2024-09-21T02:32:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.354+0000 7fdd97e00640 1 -- 172.21.15.79:0/1537027444 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98036040 con 0x7fdda0114750 2024-09-21T02:32:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.354+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda01ad420 con 0x7fdda0114750 2024-09-21T02:32:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.355+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda0077d50 con 0x7fdda0114750 2024-09-21T02:32:05.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.357+0000 7fdd97e00640 1 -- 172.21.15.79:0/1537027444 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fdd98044020 con 0x7fdda0114750 2024-09-21T02:32:05.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.359+0000 7fdd97e00640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd840b6510 0x7fdd840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:05.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.359+0000 7fdd97e00640 1 -- 172.21.15.79:0/1537027444 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fdd98107d50 con 0x7fdda0114750 2024-09-21T02:32:05.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.359+0000 7fdd9f400640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd840b6510 0x7fdd840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:05.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.360+0000 7fdd9f400640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd840b6510 0x7fdd840b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009bd0 tx=0x7fdd90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:05.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.361+0000 7fdd97e00640 1 -- 172.21.15.79:0/1537027444 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdd9804b020 con 0x7fdda0114750 2024-09-21T02:32:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.607+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdda010f8e0 con 0x7fdda0114750 2024-09-21T02:32:05.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.608+0000 7fdd97e00640 1 -- 172.21.15.79:0/1537027444 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fdd980ce9e0 con 0x7fdda0114750 2024-09-21T02:32:05.610 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 4 2024-09-21T02:32:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:05.610 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":4,"btime":"2024-09-21T02:32:03:437725+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T02:32:05.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.610+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd840b6510 msgr2=0x7fdd840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:05.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.610+0000 7fdda6800640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd840b6510 0x7fdd840b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009bd0 tx=0x7fdd90005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:05.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda0114750 msgr2=0x7fdda01a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:05.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda0114750 0x7fdda01a62a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009b30 tx=0x7fdd98003b80 comp rx=0 tx=0).stop 2024-09-21T02:32:05.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 shutdown_connections 2024-09-21T02:32:05.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd840b6510 0x7fdd840b8a20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda0114750 0x7fdda01a62a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdda0078290 0x7fdda01a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 --2- 172.21.15.79:0/1537027444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda0077940 0x7fdda01a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:05.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 >> 172.21.15.79:0/1537027444 conn(0x7fdda0101860 msgr2=0x7fdda01167a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:05.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 shutdown_connections 2024-09-21T02:32:05.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:05.611+0000 7fdda6800640 1 -- 172.21.15.79:0/1537027444 wait complete. 2024-09-21T02:32:06.446 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:32:06 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-d[70993]: starting mds.d at 2024-09-21T02:32:06.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:06 smithi079 ceph-mon[30788]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:06.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:06 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1537027444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:06.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:06 smithi148 ceph-mon[34626]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:06.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:06 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1537027444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:06.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:06 smithi098 ceph-mon[34832]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:06.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:06 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1537027444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.79:6836/4018398914,v1:172.21.15.79:6837/4018398914] up:boot 2024-09-21T02:32:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: fsmap 4 up:standby 2024-09-21T02:32:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: Deploying daemon mds.e on smithi098 2024-09-21T02:32:07.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:07 smithi079 ceph-mon[30788]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.79:6836/4018398914,v1:172.21.15.79:6837/4018398914] up:boot 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: fsmap 4 up:standby 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:07.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: Deploying daemon mds.e on smithi098 2024-09-21T02:32:07.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:07 smithi148 ceph-mon[34626]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.79:6836/4018398914,v1:172.21.15.79:6837/4018398914] up:boot 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: fsmap 4 up:standby 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:07.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:07.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: Deploying daemon mds.e on smithi098 2024-09-21T02:32:07.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:07 smithi098 ceph-mon[34832]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:08.657 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:08 smithi098 systemd[1]: Starting Ceph mds.e for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:32:08.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:08.979 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:08 smithi098 podman[62642]: 2024-09-21 02:32:08.629727892 +0000 UTC m=+0.015620738 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:08.979 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:08 smithi098 podman[62642]: 2024-09-21 02:32:08.759450469 +0000 UTC m=+0.145343360 container create facff1ce114b922dcd56c18e7975611c4a34652e16f01663920454e1533d34ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T02:32:08.979 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:08 smithi098 podman[62642]: 2024-09-21 02:32:08.978655481 +0000 UTC m=+0.364548336 container init facff1ce114b922dcd56c18e7975611c4a34652e16f01663920454e1533d34ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T02:32:09.142 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:09.405 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:08 smithi098 podman[62642]: 2024-09-21 02:32:08.981445209 +0000 UTC m=+0.367338062 container start facff1ce114b922dcd56c18e7975611c4a34652e16f01663920454e1533d34ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T02:32:09.405 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:09 smithi098 ceph-mds[62661]: -- 172.21.15.98:0/130142323 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e580bbf860 con 0x55e584d67a80 2024-09-21T02:32:09.405 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:09 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e[62657]: starting mds.e at 2024-09-21T02:32:09.405 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:09 smithi098 bash[62642]: facff1ce114b922dcd56c18e7975611c4a34652e16f01663920454e1533d34ea 2024-09-21T02:32:09.405 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:32:09 smithi098 systemd[1]: Started Ceph mds.e for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.819+0000 7fa6c1a00640 1 -- 172.21.15.79:0/2737299672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 msgr2=0x7fa6bc10bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/2737299672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 0x7fa6bc10bad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009900 tx=0x7fa6a402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:32:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 -- 172.21.15.79:0/2737299672 shutdown_connections 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/2737299672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6bc10c010 0x7fa6bc112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/2737299672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 0x7fa6bc10bad0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/2737299672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc105d80 0x7fa6bc106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 -- 172.21.15.79:0/2737299672 >> 172.21.15.79:0/2737299672 conn(0x7fa6bc101810 msgr2=0x7fa6bc103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 -- 172.21.15.79:0/2737299672 shutdown_connections 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.820+0000 7fa6c1a00640 1 -- 172.21.15.79:0/2737299672 wait complete. 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.821+0000 7fa6c1a00640 1 Processor -- start 2024-09-21T02:32:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.821+0000 7fa6c1a00640 1 -- start start 2024-09-21T02:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6c1a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc105d80 0x7fa6bc19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6c1a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 0x7fa6bc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6c1a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6bc10c010 0x7fa6bc1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6c1a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc115d20 con 0x7fa6bc10b6c0 2024-09-21T02:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6c1a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc115ba0 con 0x7fa6bc105d80 2024-09-21T02:32:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6c1a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc115ea0 con 0x7fa6bc10c010 2024-09-21T02:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6b2000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 0x7fa6bc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6baa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc105d80 0x7fa6bc19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6b2000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 0x7fa6bc19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45396/0 (socket says 172.21.15.79:45396) 2024-09-21T02:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6b2000640 1 -- 172.21.15.79:0/3256086910 learned_addr learned my addr 172.21.15.79:0/3256086910 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.822+0000 7fa6bb400640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6bc10c010 0x7fa6bc1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6baa00640 1 -- 172.21.15.79:0/3256086910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6bc10c010 msgr2=0x7fa6bc1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6baa00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6bc10c010 0x7fa6bc1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6baa00640 1 -- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 msgr2=0x7fa6bc19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6baa00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 0x7fa6bc19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6baa00640 1 -- 172.21.15.79:0/3256086910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc1a26c0 con 0x7fa6bc105d80 2024-09-21T02:32:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6baa00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc105d80 0x7fa6bc19c750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00e9f0 tx=0x7fa6ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6b3e00640 1 -- 172.21.15.79:0/3256086910 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac00cd80 con 0x7fa6bc105d80 2024-09-21T02:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6bc1a29b0 con 0x7fa6bc105d80 2024-09-21T02:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.823+0000 7fa6b3e00640 1 -- 172.21.15.79:0/3256086910 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6ac0035f0 con 0x7fa6bc105d80 2024-09-21T02:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.824+0000 7fa6b3e00640 1 -- 172.21.15.79:0/3256086910 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac018690 con 0x7fa6bc105d80 2024-09-21T02:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.824+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6bc1a9110 con 0x7fa6bc105d80 2024-09-21T02:32:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.825+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6bc106190 con 0x7fa6bc105d80 2024-09-21T02:32:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.827+0000 7fa6b3e00640 1 -- 172.21.15.79:0/3256086910 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fa6ac004020 con 0x7fa6bc105d80 2024-09-21T02:32:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.828+0000 7fa6b3e00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6a00b6590 0x7fa6a00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.829+0000 7fa6b3e00640 1 -- 172.21.15.79:0/3256086910 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fa6ac0e7420 con 0x7fa6bc105d80 2024-09-21T02:32:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.829+0000 7fa6b2000640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6a00b6590 0x7fa6a00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.829+0000 7fa6b2000640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6a00b6590 0x7fa6a00b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4006010 tx=0x7fa6a4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:09.830+0000 7fa6b3e00640 1 -- 172.21.15.79:0/3256086910 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6ac0ae0b0 con 0x7fa6bc105d80 2024-09-21T02:32:10.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.058+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6bc19d880 con 0x7fa6bc105d80 2024-09-21T02:32:10.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.059+0000 7fa6b3e00640 1 -- 172.21.15.79:0/3256086910 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7fa6ac0b2490 con 0x7fa6bc105d80 2024-09-21T02:32:10.061 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:10.061 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"btime":"2024-09-21T02:32:09:069440+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T02:32:10.061 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-09-21T02:32:10.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.061+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6a00b6590 msgr2=0x7fa6a00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:10.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.061+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6a00b6590 0x7fa6a00b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4006010 tx=0x7fa6a4005a20 comp rx=0 tx=0).stop 2024-09-21T02:32:10.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.061+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc105d80 msgr2=0x7fa6bc19c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.061+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc105d80 0x7fa6bc19c750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00e9f0 tx=0x7fa6ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 shutdown_connections 2024-09-21T02:32:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6a00b6590 0x7fa6a00b8aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6bc10c010 0x7fa6bc1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6bc10b6c0 0x7fa6bc19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 --2- 172.21.15.79:0/3256086910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc105d80 0x7fa6bc19c750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:10.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 >> 172.21.15.79:0/3256086910 conn(0x7fa6bc101810 msgr2=0x7fa6bc10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:10.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 shutdown_connections 2024-09-21T02:32:10.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:10.062+0000 7fa6c1a00640 1 -- 172.21.15.79:0/3256086910 wait complete. 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.98:6834/265425700,v1:172.21.15.98:6835/265425700] up:boot 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: fsmap 5 up:standby 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: Deploying daemon mds.f on smithi148 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:10.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:10 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3256086910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:10.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.98:6834/265425700,v1:172.21.15.98:6835/265425700] up:boot 2024-09-21T02:32:10.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: fsmap 5 up:standby 2024-09-21T02:32:10.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:32:10.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:10.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:10.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:10.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: Deploying daemon mds.f on smithi148 2024-09-21T02:32:10.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:10.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:10 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3256086910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.98:6834/265425700,v1:172.21.15.98:6835/265425700] up:boot 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: fsmap 5 up:standby 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:10.458 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: Deploying daemon mds.f on smithi148 2024-09-21T02:32:10.459 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:10.459 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:10 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3256086910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:11.313 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 systemd[1]: Starting Ceph mds.f for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:32:11.688 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 podman[62342]: 2024-09-21 02:32:11.31275306 +0000 UTC m=+0.015621778 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:11.688 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 podman[62342]: 2024-09-21 02:32:11.444077712 +0000 UTC m=+0.146946414 container create bde048cdf11d15d49933f29b20eb85a6d785142f42901654ada75155726ece8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T02:32:11.688 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 podman[62342]: 2024-09-21 02:32:11.688204874 +0000 UTC m=+0.391073577 container init bde048cdf11d15d49933f29b20eb85a6d785142f42901654ada75155726ece8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T02:32:12.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 podman[62342]: 2024-09-21 02:32:11.691229317 +0000 UTC m=+0.394098025 container start bde048cdf11d15d49933f29b20eb85a6d785142f42901654ada75155726ece8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T02:32:12.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 ceph-mds[62361]: -- 172.21.15.148:0/2932844648 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ec44671860 con 0x55ec48819180 2024-09-21T02:32:12.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f[62357]: starting mds.f at 2024-09-21T02:32:12.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 bash[62342]: bde048cdf11d15d49933f29b20eb85a6d785142f42901654ada75155726ece8f 2024-09-21T02:32:12.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:32:11 smithi148 systemd[1]: Started Ceph mds.f for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:12.534 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:12 smithi148 ceph-mon[34626]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:12.534 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.534 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.534 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.534 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:12.534 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:12.535 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:12 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:12.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:12 smithi079 ceph-mon[30788]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:12.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:12.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:12.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:12 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:12.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:12 smithi098 ceph-mon[34832]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:12.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:12 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:13.240 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:13 smithi148 ceph-mon[34626]: Deploying daemon mds.c on smithi148 2024-09-21T02:32:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:13 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.148:6834/1431054933,v1:172.21.15.148:6835/1431054933] up:boot 2024-09-21T02:32:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:13 smithi148 ceph-mon[34626]: fsmap 6 up:standby 2024-09-21T02:32:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:13 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:32:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:13 smithi148 ceph-mon[34626]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:13.704 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:13 smithi079 ceph-mon[30788]: Deploying daemon mds.c on smithi148 2024-09-21T02:32:13.704 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:13 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.148:6834/1431054933,v1:172.21.15.148:6835/1431054933] up:boot 2024-09-21T02:32:13.705 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:13 smithi079 ceph-mon[30788]: fsmap 6 up:standby 2024-09-21T02:32:13.705 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:13 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:32:13.705 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:13 smithi079 ceph-mon[30788]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:13.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.874+0000 7f8ba6e00640 1 -- 172.21.15.79:0/363753729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba0102d30 msgr2=0x7f8ba010fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:13.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.874+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/363753729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba0102d30 0x7f8ba010fa50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009900 tx=0x7f8b8c02a480 comp rx=0 tx=0).stop 2024-09-21T02:32:13.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.874+0000 7f8ba6e00640 1 -- 172.21.15.79:0/363753729 shutdown_connections 2024-09-21T02:32:13.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.875+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/363753729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ba010ff90 0x7f8ba01123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:13.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.875+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/363753729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba0102d30 0x7f8ba010fa50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:13.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.875+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/363753729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba01023e0 0x7f8ba01027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:13.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.875+0000 7f8ba6e00640 1 -- 172.21.15.79:0/363753729 >> 172.21.15.79:0/363753729 conn(0x7f8ba00fe2c0 msgr2=0x7f8ba0100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:13.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.875+0000 7f8ba6e00640 1 -- 172.21.15.79:0/363753729 shutdown_connections 2024-09-21T02:32:13.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.875+0000 7f8ba6e00640 1 -- 172.21.15.79:0/363753729 wait complete. 2024-09-21T02:32:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 Processor -- start 2024-09-21T02:32:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 -- start start 2024-09-21T02:32:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01023e0 0x7f8ba019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ba0102d30 0x7f8ba019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba010ff90 0x7f8ba01a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0115a80 con 0x7f8ba01023e0 2024-09-21T02:32:13.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0115900 con 0x7f8ba010ff90 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.876+0000 7f8ba6e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0115c00 con 0x7f8ba0102d30 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01023e0 0x7f8ba019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01023e0 0x7f8ba019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34844/0 (socket says 172.21.15.79:34844) 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 -- 172.21.15.79:0/95856330 learned_addr learned my addr 172.21.15.79:0/95856330 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5000640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ba0102d30 0x7f8ba019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba6400640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba010ff90 0x7f8ba01a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 -- 172.21.15.79:0/95856330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ba0102d30 msgr2=0x7f8ba019ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ba0102d30 0x7f8ba019ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 -- 172.21.15.79:0/95856330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba010ff90 msgr2=0x7f8ba01a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba010ff90 0x7f8ba01a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 -- 172.21.15.79:0/95856330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba01a2400 con 0x7f8ba01023e0 2024-09-21T02:32:13.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.877+0000 7f8ba5a00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01023e0 0x7f8ba019c490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400e9f0 tx=0x7f8b9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.878+0000 7f8b9e000640 1 -- 172.21.15.79:0/95856330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400cd80 con 0x7f8ba01023e0 2024-09-21T02:32:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.878+0000 7f8b9e000640 1 -- 172.21.15.79:0/95856330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b940108e0 con 0x7f8ba01023e0 2024-09-21T02:32:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.878+0000 7f8b9e000640 1 -- 172.21.15.79:0/95856330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94018980 con 0x7f8ba01023e0 2024-09-21T02:32:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.878+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba01a26f0 con 0x7f8ba01023e0 2024-09-21T02:32:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.878+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba01a8e50 con 0x7f8ba01023e0 2024-09-21T02:32:13.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.879+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba01027f0 con 0x7f8ba01023e0 2024-09-21T02:32:13.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.882+0000 7f8b9e000640 1 -- 172.21.15.79:0/95856330 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f8b94010430 con 0x7f8ba01023e0 2024-09-21T02:32:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.884+0000 7f8b9e000640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b880b6590 0x7f8b880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:13.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.884+0000 7f8b9e000640 1 -- 172.21.15.79:0/95856330 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f8b940e7620 con 0x7f8ba01023e0 2024-09-21T02:32:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.884+0000 7f8ba5000640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b880b6590 0x7f8b880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:13.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.885+0000 7f8ba5000640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b880b6590 0x7f8b880b8aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c031440 tx=0x7f8b8c009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:13.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:13.886+0000 7f8b9e000640 1 -- 172.21.15.79:0/95856330 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b940b2690 con 0x7f8ba01023e0 2024-09-21T02:32:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:13 smithi098 ceph-mon[34832]: Deploying daemon mds.c on smithi148 2024-09-21T02:32:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:13 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.148:6834/1431054933,v1:172.21.15.148:6835/1431054933] up:boot 2024-09-21T02:32:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:13 smithi098 ceph-mon[34832]: fsmap 6 up:standby 2024-09-21T02:32:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:13 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:32:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:13 smithi098 ceph-mon[34832]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:14.002 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:13 smithi148 systemd[1]: Starting Ceph mds.c for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:32:14.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.112+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ba019d5c0 con 0x7f8ba01023e0 2024-09-21T02:32:14.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.113+0000 7f8b9e000640 1 -- 172.21.15.79:0/95856330 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7f8b940b75d0 con 0x7f8ba01023e0 2024-09-21T02:32:14.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:14.115 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":7,"btime":"2024-09-21T02:32:12:438963+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T02:32:14.115 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 7 2024-09-21T02:32:14.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b880b6590 msgr2=0x7f8b880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:14.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b880b6590 0x7f8b880b8aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c031440 tx=0x7f8b8c009560 comp rx=0 tx=0).stop 2024-09-21T02:32:14.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01023e0 msgr2=0x7f8ba019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01023e0 0x7f8ba019c490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400e9f0 tx=0x7f8b9400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 shutdown_connections 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b880b6590 0x7f8b880b8aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba010ff90 0x7f8ba01a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ba0102d30 0x7f8ba019ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 --2- 172.21.15.79:0/95856330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ba01023e0 0x7f8ba019c490 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.115+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 >> 172.21.15.79:0/95856330 conn(0x7f8ba00fe2c0 msgr2=0x7f8ba0112180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:14.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.116+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 shutdown_connections 2024-09-21T02:32:14.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:14.116+0000 7f8ba6e00640 1 -- 172.21.15.79:0/95856330 wait complete. 2024-09-21T02:32:14.310 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 podman[62611]: 2024-09-21 02:32:13.905050664 +0000 UTC m=+0.016426261 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:14.310 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 podman[62611]: 2024-09-21 02:32:14.056861608 +0000 UTC m=+0.168237244 container create 315e4d7f6a754c882b99216083e8d1a8c2e21dcc0f3d65a0c58eca0e3c6275b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T02:32:14.310 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 podman[62611]: 2024-09-21 02:32:14.309437958 +0000 UTC m=+0.420813552 container init 315e4d7f6a754c882b99216083e8d1a8c2e21dcc0f3d65a0c58eca0e3c6275b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T02:32:14.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:14 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/95856330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:14.563 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 podman[62611]: 2024-09-21 02:32:14.312356927 +0000 UTC m=+0.423732528 container start 315e4d7f6a754c882b99216083e8d1a8c2e21dcc0f3d65a0c58eca0e3c6275b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:32:14.563 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 ceph-mds[62630]: -- 172.21.15.148:0/444736070 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f788d71860 con 0x55f78cf19180 2024-09-21T02:32:14.564 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c[62626]: starting mds.c at 2024-09-21T02:32:14.564 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 bash[62611]: 315e4d7f6a754c882b99216083e8d1a8c2e21dcc0f3d65a0c58eca0e3c6275b7 2024-09-21T02:32:14.564 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:32:14 smithi148 systemd[1]: Started Ceph mds.c for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:14.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:14 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/95856330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:14.894 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:14 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/95856330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.148:6836/4145654738,v1:172.21.15.148:6837/4145654738] up:boot 2024-09-21T02:32:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: fsmap 7 up:standby 2024-09-21T02:32:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: Deploying daemon mds.h on smithi098 2024-09-21T02:32:15.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:15 smithi079 ceph-mon[30788]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.148:6836/4145654738,v1:172.21.15.148:6837/4145654738] up:boot 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: fsmap 7 up:standby 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: Deploying daemon mds.h on smithi098 2024-09-21T02:32:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:15 smithi148 ceph-mon[34626]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:15.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.148:6836/4145654738,v1:172.21.15.148:6837/4145654738] up:boot 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: fsmap 7 up:standby 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: Deploying daemon mds.h on smithi098 2024-09-21T02:32:15.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:15 smithi098 ceph-mon[34832]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:16.616 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:16 smithi098 systemd[1]: Starting Ceph mds.h for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:32:16.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:16.902 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:16 smithi098 podman[62911]: 2024-09-21 02:32:16.615531683 +0000 UTC m=+0.110027651 container create 33becbff2747f7eb5c1e4800550d12058e30d3c78a44547f2a2f67bfaa819475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T02:32:16.903 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:16 smithi098 podman[62911]: 2024-09-21 02:32:16.521202504 +0000 UTC m=+0.015698492 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:16.903 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:16 smithi098 podman[62911]: 2024-09-21 02:32:16.901982552 +0000 UTC m=+0.396478521 container init 33becbff2747f7eb5c1e4800550d12058e30d3c78a44547f2a2f67bfaa819475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:32:17.155 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:16 smithi098 podman[62911]: 2024-09-21 02:32:16.90474343 +0000 UTC m=+0.399239410 container start 33becbff2747f7eb5c1e4800550d12058e30d3c78a44547f2a2f67bfaa819475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:32:17.155 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:16 smithi098 ceph-mds[62930]: -- 172.21.15.98:0/2678838073 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648a0e1f860 con 0x5648a4fc7600 2024-09-21T02:32:17.155 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: starting mds.h at 2024-09-21T02:32:17.156 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:17 smithi098 bash[62911]: 33becbff2747f7eb5c1e4800550d12058e30d3c78a44547f2a2f67bfaa819475 2024-09-21T02:32:17.156 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:32:17 smithi098 systemd[1]: Started Ceph mds.h for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:17.307 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.975+0000 7fc6f7000640 1 -- 172.21.15.79:0/3117523390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f01049d0 msgr2=0x7fc6f0104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.975+0000 7fc6f7000640 1 --2- 172.21.15.79:0/3117523390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f01049d0 0x7fc6f0104de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009900 tx=0x7fc6e002a410 comp rx=0 tx=0).stop 2024-09-21T02:32:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.976+0000 7fc6f7000640 1 -- 172.21.15.79:0/3117523390 shutdown_connections 2024-09-21T02:32:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.976+0000 7fc6f7000640 1 --2- 172.21.15.79:0/3117523390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f010de30 0x7fc6f0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.976+0000 7fc6f7000640 1 --2- 172.21.15.79:0/3117523390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f0105320 0x7fc6f010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.976+0000 7fc6f7000640 1 --2- 172.21.15.79:0/3117523390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f01049d0 0x7fc6f0104de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.976+0000 7fc6f7000640 1 -- 172.21.15.79:0/3117523390 >> 172.21.15.79:0/3117523390 conn(0x7fc6f0079740 msgr2=0x7fc6f0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.976+0000 7fc6f7000640 1 -- 172.21.15.79:0/3117523390 shutdown_connections 2024-09-21T02:32:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.976+0000 7fc6f7000640 1 -- 172.21.15.79:0/3117523390 wait complete. 2024-09-21T02:32:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.977+0000 7fc6f7000640 1 Processor -- start 2024-09-21T02:32:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.977+0000 7fc6f7000640 1 -- start start 2024-09-21T02:32:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f7000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f01049d0 0x7fc6f0102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f7000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f0105320 0x7fc6f0102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f7000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f010de30 0x7fc6f0103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f7000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f0113ab0 con 0x7fc6f01049d0 2024-09-21T02:32:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f7000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f0113930 con 0x7fc6f0105320 2024-09-21T02:32:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f7000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f0113c30 con 0x7fc6f010de30 2024-09-21T02:32:17.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f5000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f010de30 0x7fc6f0103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:17.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6efe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f01049d0 0x7fc6f0102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f5000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f010de30 0x7fc6f0103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:60094/0 (socket says 172.21.15.79:60094) 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6f5000640 1 -- 172.21.15.79:0/563209740 learned_addr learned my addr 172.21.15.79:0/563209740 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.978+0000 7fc6ef400640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f0105320 0x7fc6f0102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f5000640 1 -- 172.21.15.79:0/563209740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f0105320 msgr2=0x7fc6f0102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f5000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f0105320 0x7fc6f0102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f5000640 1 -- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f01049d0 msgr2=0x7fc6f0102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f5000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f01049d0 0x7fc6f0102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f5000640 1 -- 172.21.15.79:0/563209740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f01a87e0 con 0x7fc6f010de30 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f5000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f010de30 0x7fc6f0103190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800efd0 tx=0x7fc6e800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6ecc00640 1 -- 172.21.15.79:0/563209740 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8003b70 con 0x7fc6f010de30 2024-09-21T02:32:17.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6ecc00640 1 -- 172.21.15.79:0/563209740 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e8003d10 con 0x7fc6f010de30 2024-09-21T02:32:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f01a8ad0 con 0x7fc6f010de30 2024-09-21T02:32:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6ecc00640 1 -- 172.21.15.79:0/563209740 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80108a0 con 0x7fc6f010de30 2024-09-21T02:32:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.979+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f01a8fc0 con 0x7fc6f010de30 2024-09-21T02:32:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.980+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f006c240 con 0x7fc6f010de30 2024-09-21T02:32:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.983+0000 7fc6ecc00640 1 -- 172.21.15.79:0/563209740 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc6e8004b40 con 0x7fc6f010de30 2024-09-21T02:32:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.984+0000 7fc6ecc00640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc6d40b6510 0x7fc6d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.984+0000 7fc6ecc00640 1 -- 172.21.15.79:0/563209740 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fc6e80e7290 con 0x7fc6f010de30 2024-09-21T02:32:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.984+0000 7fc6efe00640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc6d40b6510 0x7fc6d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.985+0000 7fc6efe00640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc6d40b6510 0x7fc6d40b8a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009230 tx=0x7fc6e0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:17.986+0000 7fc6ecc00640 1 -- 172.21.15.79:0/563209740 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6e80adfb0 con 0x7fc6f010de30 2024-09-21T02:32:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.218+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6f0103a10 con 0x7fc6f010de30 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.98:6836/2031151027,v1:172.21.15.98:6837/2031151027] up:boot 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: fsmap 8 up:standby 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:18.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: Deploying daemon mds.i on smithi148 2024-09-21T02:32:18.221 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:17 smithi079 ceph-mon[30788]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:18.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.219+0000 7fc6ecc00640 1 -- 172.21.15.79:0/563209740 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7fc6e80b2390 con 0x7fc6f010de30 2024-09-21T02:32:18.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:18.221 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"btime":"2024-09-21T02:32:16:993522+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T02:32:18.221 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2024-09-21T02:32:18.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.221+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc6d40b6510 msgr2=0x7fc6d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:18.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.221+0000 7fc6f7000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc6d40b6510 0x7fc6d40b8a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009230 tx=0x7fc6e0031400 comp rx=0 tx=0).stop 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.221+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f010de30 msgr2=0x7fc6f0103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.221+0000 7fc6f7000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f010de30 0x7fc6f0103190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800efd0 tx=0x7fc6e800c6a0 comp rx=0 tx=0).stop 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 shutdown_connections 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc6d40b6510 0x7fc6d40b8a20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6f010de30 0x7fc6f0103190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f0105320 0x7fc6f0102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 --2- 172.21.15.79:0/563209740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6f01049d0 0x7fc6f0102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 >> 172.21.15.79:0/563209740 conn(0x7fc6f0079740 msgr2=0x7fc6f01007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 shutdown_connections 2024-09-21T02:32:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:18.222+0000 7fc6f7000640 1 -- 172.21.15.79:0/563209740 wait complete. 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.98:6836/2031151027,v1:172.21.15.98:6837/2031151027] up:boot 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: fsmap 8 up:standby 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: Deploying daemon mds.i on smithi148 2024-09-21T02:32:18.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:17 smithi148 ceph-mon[34626]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.98:6836/2031151027,v1:172.21.15.98:6837/2031151027] up:boot 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: fsmap 8 up:standby 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:18.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:18.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: Deploying daemon mds.i on smithi148 2024-09-21T02:32:18.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:17 smithi098 ceph-mon[34832]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:19.292 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:19 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/563209740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:19.381 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:19 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/563209740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:19.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:19 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/563209740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:20.064 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 02:32:19 smithi148 systemd[1]: Started Ceph mds.i for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:20 smithi098 ceph-mon[34832]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:20.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:20 smithi079 ceph-mon[30788]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:20.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:20.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:20.408 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:20 smithi148 ceph-mon[34626]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:21.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:21 smithi098 ceph-mon[34832]: Deploying daemon mds.g on smithi079 2024-09-21T02:32:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:21 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.148:6838/566296306,v1:172.21.15.148:6839/566296306] up:boot 2024-09-21T02:32:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:21 smithi098 ceph-mon[34832]: fsmap 9 up:standby 2024-09-21T02:32:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:21 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:32:21.422 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:21 smithi079 ceph-mon[30788]: Deploying daemon mds.g on smithi079 2024-09-21T02:32:21.422 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:21 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.148:6838/566296306,v1:172.21.15.148:6839/566296306] up:boot 2024-09-21T02:32:21.422 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:21 smithi079 ceph-mon[30788]: fsmap 9 up:standby 2024-09-21T02:32:21.422 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:21 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:32:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:21 smithi148 ceph-mon[34626]: Deploying daemon mds.g on smithi079 2024-09-21T02:32:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:21 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.148:6838/566296306,v1:172.21.15.148:6839/566296306] up:boot 2024-09-21T02:32:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:21 smithi148 ceph-mon[34626]: fsmap 9 up:standby 2024-09-21T02:32:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:21 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:32:21.602 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:22.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:22 smithi098 ceph-mon[34832]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:22.413 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:22 smithi079 ceph-mon[30788]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:22.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.481+0000 7f8b25400640 1 -- 172.21.15.79:0/891048608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 msgr2=0x7f8b20105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:22.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.481+0000 7f8b25400640 1 --2- 172.21.15.79:0/891048608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b20105fc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009900 tx=0x7f8b1002a410 comp rx=0 tx=0).stop 2024-09-21T02:32:22.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.481+0000 7f8b25400640 1 -- 172.21.15.79:0/891048608 shutdown_connections 2024-09-21T02:32:22.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.482+0000 7f8b25400640 1 --2- 172.21.15.79:0/891048608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b2010be40 0x7f8b20112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.482+0000 7f8b25400640 1 --2- 172.21.15.79:0/891048608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b2010b4f0 0x7f8b2010b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.482+0000 7f8b25400640 1 --2- 172.21.15.79:0/891048608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b20105fc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.482+0000 7f8b25400640 1 -- 172.21.15.79:0/891048608 >> 172.21.15.79:0/891048608 conn(0x7f8b20101680 msgr2=0x7f8b20103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:22.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.482+0000 7f8b25400640 1 -- 172.21.15.79:0/891048608 shutdown_connections 2024-09-21T02:32:22.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.482+0000 7f8b25400640 1 -- 172.21.15.79:0/891048608 wait complete. 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 Processor -- start 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 -- start start 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b2019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b2010b4f0 0x7f8b2019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b2010be40 0x7f8b201a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20115b00 con 0x7f8b20105bb0 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20115980 con 0x7f8b2010be40 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b25400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20115c80 con 0x7f8b2010b4f0 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b1fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b2019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b1fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b2019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34874/0 (socket says 172.21.15.79:34874) 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.483+0000 7f8b1fe00640 1 -- 172.21.15.79:0/628375932 learned_addr learned my addr 172.21.15.79:0/628375932 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:22.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b1f400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b2010b4f0 0x7f8b2019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:22.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b24a00640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b2010be40 0x7f8b201a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:22.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b1fe00640 1 -- 172.21.15.79:0/628375932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b2010b4f0 msgr2=0x7f8b2019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:22.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b1fe00640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b2010b4f0 0x7f8b2019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b1fe00640 1 -- 172.21.15.79:0/628375932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b2010be40 msgr2=0x7f8b201a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b1fe00640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b2010be40 0x7f8b201a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b1fe00640 1 -- 172.21.15.79:0/628375932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b201a2480 con 0x7f8b20105bb0 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.484+0000 7f8b1fe00640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b2019c510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005940 tx=0x7f8b100040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.485+0000 7f8b1cc00640 1 -- 172.21.15.79:0/628375932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1003f030 con 0x7f8b20105bb0 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.485+0000 7f8b1cc00640 1 -- 172.21.15.79:0/628375932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b100044c0 con 0x7f8b20105bb0 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.485+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b201a2710 con 0x7f8b20105bb0 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.485+0000 7f8b1cc00640 1 -- 172.21.15.79:0/628375932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10035070 con 0x7f8b20105bb0 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.485+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b201a8ed0 con 0x7f8b20105bb0 2024-09-21T02:32:22.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.486+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b20106e30 con 0x7f8b20105bb0 2024-09-21T02:32:22.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.488+0000 7f8b1cc00640 1 -- 172.21.15.79:0/628375932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f8b10042030 con 0x7f8b20105bb0 2024-09-21T02:32:22.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.489+0000 7f8b1cc00640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b040b6510 0x7f8b040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:22.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.490+0000 7f8b1cc00640 1 -- 172.21.15.79:0/628375932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f8b10107250 con 0x7f8b20105bb0 2024-09-21T02:32:22.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.490+0000 7f8b1f400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b040b6510 0x7f8b040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:22.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.491+0000 7f8b1f400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b040b6510 0x7f8b040b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0095f0 tx=0x7f8b0c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.494+0000 7f8b1cc00640 1 -- 172.21.15.79:0/628375932 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b100d22c0 con 0x7f8b20105bb0 2024-09-21T02:32:22.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:22 smithi148 ceph-mon[34626]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:22.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.731+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b2010dc40 con 0x7f8b20105bb0 2024-09-21T02:32:22.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.732+0000 7f8b1cc00640 1 -- 172.21.15.79:0/628375932 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8040 (secure 0 0 0) 0x7f8b100d7200 con 0x7f8b20105bb0 2024-09-21T02:32:22.733 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:22.733 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"btime":"2024-09-21T02:32:20:091271+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T02:32:22.734 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 10 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b040b6510 msgr2=0x7f8b040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b040b6510 0x7f8b040b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0095f0 tx=0x7f8b0c005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 msgr2=0x7f8b2019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b2019c510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005940 tx=0x7f8b100040c0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 shutdown_connections 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b040b6510 0x7f8b040b8a20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b2010be40 0x7f8b201a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b2010b4f0 0x7f8b2019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 --2- 172.21.15.79:0/628375932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b20105bb0 0x7f8b2019c510 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 >> 172.21.15.79:0/628375932 conn(0x7f8b20101680 msgr2=0x7f8b20103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 shutdown_connections 2024-09-21T02:32:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:22.735+0000 7f8b25400640 1 -- 172.21.15.79:0/628375932 wait complete. 2024-09-21T02:32:23.389 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:23 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/628375932' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:23.389 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:32:23 smithi079 podman[71693]: 2024-09-21 02:32:23.292053458 +0000 UTC m=+0.655010793 container start bc562a0740aa779b8c4580f39fd69965c9763c7b6370b9eb7f990b559ae4bd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-21T02:32:23.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:23 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/628375932' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:23 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/628375932' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:23.728 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:32:23 smithi079 ceph-mds[71728]: -- 172.21.15.79:0/3307125786 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55573a179860 con 0x55573e321180 2024-09-21T02:32:23.728 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:32:23 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g[71722]: starting mds.g at 2024-09-21T02:32:23.728 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:32:23 smithi079 bash[71693]: bc562a0740aa779b8c4580f39fd69965c9763c7b6370b9eb7f990b559ae4bd22 2024-09-21T02:32:23.728 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:32:23 smithi079 systemd[1]: Started Ceph mds.g for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:24.157 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:24 smithi079 ceph-mon[30788]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:24.157 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.157 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.157 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.157 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:24.158 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:24.158 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:24 smithi098 ceph-mon[34832]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:24 smithi148 ceph-mon[34626]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:25.339 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:25 smithi079 ceph-mon[30788]: Deploying daemon mds.a on smithi079 2024-09-21T02:32:25.339 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:25 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.79:6838/3299395115,v1:172.21.15.79:6839/3299395115] up:boot 2024-09-21T02:32:25.339 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:25 smithi079 ceph-mon[30788]: fsmap 10 up:standby 2024-09-21T02:32:25.340 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:25 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:32:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:25 smithi098 ceph-mon[34832]: Deploying daemon mds.a on smithi079 2024-09-21T02:32:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:25 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.79:6838/3299395115,v1:172.21.15.79:6839/3299395115] up:boot 2024-09-21T02:32:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:25 smithi098 ceph-mon[34832]: fsmap 10 up:standby 2024-09-21T02:32:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:32:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:25 smithi148 ceph-mon[34626]: Deploying daemon mds.a on smithi079 2024-09-21T02:32:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:25 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.79:6838/3299395115,v1:172.21.15.79:6839/3299395115] up:boot 2024-09-21T02:32:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:25 smithi148 ceph-mon[34626]: fsmap 10 up:standby 2024-09-21T02:32:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:25 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:32:25.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:26.192 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:26 smithi079 ceph-mon[30788]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:26.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:26 smithi098 ceph-mon[34832]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:26.478 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 systemd[1]: Starting Ceph mds.a for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:32:26.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:26 smithi148 ceph-mon[34626]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:26.829 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 podman[72002]: 2024-09-21 02:32:26.444412541 +0000 UTC m=+0.030111916 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:26.829 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 podman[72002]: 2024-09-21 02:32:26.57766275 +0000 UTC m=+0.163362103 container create 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T02:32:26.829 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 podman[72002]: 2024-09-21 02:32:26.828443835 +0000 UTC m=+0.414143208 container init 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:32:27.016 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:27.159 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 podman[72002]: 2024-09-21 02:32:26.834848263 +0000 UTC m=+0.420547616 container start 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T02:32:27.159 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 ceph-mds[72040]: -- 172.21.15.79:0/662392972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578e4b53860 con 0x5578e8cfb180 2024-09-21T02:32:27.159 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a[72033]: starting mds.a at 2024-09-21T02:32:27.159 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 bash[72002]: 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 2024-09-21T02:32:27.159 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:32:26 smithi079 systemd[1]: Started Ceph mds.a for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:27.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.691+0000 7f28a6e00640 1 -- 172.21.15.79:0/3416867584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a00757b0 msgr2=0x7f28a0075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:27.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.691+0000 7f28a6e00640 1 --2- 172.21.15.79:0/3416867584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a00757b0 0x7f28a0075bc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2894009900 tx=0x7f289402a410 comp rx=0 tx=0).stop 2024-09-21T02:32:27.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.691+0000 7f28a6e00640 1 -- 172.21.15.79:0/3416867584 shutdown_connections 2024-09-21T02:32:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.691+0000 7f28a6e00640 1 --2- 172.21.15.79:0/3416867584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28a010fef0 0x7f28a0112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.691+0000 7f28a6e00640 1 --2- 172.21.15.79:0/3416867584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 0x7f28a010f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.691+0000 7f28a6e00640 1 --2- 172.21.15.79:0/3416867584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a00757b0 0x7f28a0075bc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.691+0000 7f28a6e00640 1 -- 172.21.15.79:0/3416867584 >> 172.21.15.79:0/3416867584 conn(0x7f28a00ff3e0 msgr2=0x7f28a0101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.692+0000 7f28a6e00640 1 -- 172.21.15.79:0/3416867584 shutdown_connections 2024-09-21T02:32:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.692+0000 7f28a6e00640 1 -- 172.21.15.79:0/3416867584 wait complete. 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 Processor -- start 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 -- start start 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28a00757b0 0x7f28a019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 0x7f28a019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a010fef0 0x7f28a01a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0115af0 con 0x7f28a010fef0 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0115970 con 0x7f28a0076100 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.693+0000 7f28a6e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0115c70 con 0x7f28a00757b0 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 0x7f28a019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 0x7f28a019caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55092/0 (socket says 172.21.15.79:55092) 2024-09-21T02:32:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 -- 172.21.15.79:0/943322561 learned_addr learned my addr 172.21.15.79:0/943322561 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5a00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28a00757b0 0x7f28a019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a6400640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a010fef0 0x7f28a01a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 -- 172.21.15.79:0/943322561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28a00757b0 msgr2=0x7f28a019c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28a00757b0 0x7f28a019c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 -- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a010fef0 msgr2=0x7f28a01a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a010fef0 0x7f28a01a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 -- 172.21.15.79:0/943322561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a01a2470 con 0x7f28a0076100 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a6400640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a010fef0 0x7f28a01a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.694+0000 7f28a5000640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 0x7f28a019caa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f288c00e9c0 tx=0x7f288c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.695+0000 7f289e000640 1 -- 172.21.15.79:0/943322561 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c00cd80 con 0x7f28a0076100 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.695+0000 7f289e000640 1 -- 172.21.15.79:0/943322561 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f288c0035f0 con 0x7f28a0076100 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.695+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01a2760 con 0x7f28a0076100 2024-09-21T02:32:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.695+0000 7f289e000640 1 -- 172.21.15.79:0/943322561 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c010690 con 0x7f28a0076100 2024-09-21T02:32:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.695+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a01a8ec0 con 0x7f28a0076100 2024-09-21T02:32:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.696+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a0075bc0 con 0x7f28a0076100 2024-09-21T02:32:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.698+0000 7f289e000640 1 -- 172.21.15.79:0/943322561 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f288c0037a0 con 0x7f28a0076100 2024-09-21T02:32:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.699+0000 7f289e000640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28880b6510 0x7f28880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.699+0000 7f289e000640 1 -- 172.21.15.79:0/943322561 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f288c0e7230 con 0x7f28a0076100 2024-09-21T02:32:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.700+0000 7f28a5a00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28880b6510 0x7f28880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:27.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.700+0000 7f28a5a00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28880b6510 0x7f28880b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2894005ab0 tx=0x7f2894005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:27.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.705+0000 7f289e000640 1 -- 172.21.15.79:0/943322561 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f288c0adec0 con 0x7f28a0076100 2024-09-21T02:32:27.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.934+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28a01a91a0 con 0x7f28a0076100 2024-09-21T02:32:27.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.935+0000 7f289e000640 1 -- 172.21.15.79:0/943322561 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f288c0b22a0 con 0x7f28a0076100 2024-09-21T02:32:27.937 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:27.937 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"btime":"2024-09-21T02:32:27:123341+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T02:32:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-09-21T02:32:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28880b6510 msgr2=0x7f28880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28880b6510 0x7f28880b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2894005ab0 tx=0x7f2894005a20 comp rx=0 tx=0).stop 2024-09-21T02:32:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 msgr2=0x7f28a019caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 0x7f28a019caa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f288c00e9c0 tx=0x7f288c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 shutdown_connections 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f28880b6510 0x7f28880b8a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28a010fef0 0x7f28a01a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28a0076100 0x7f28a019caa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 --2- 172.21.15.79:0/943322561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28a00757b0 0x7f28a019c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 >> 172.21.15.79:0/943322561 conn(0x7f28a00ff3e0 msgr2=0x7f28a0109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 shutdown_connections 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:27.938+0000 7f28a6e00640 1 -- 172.21.15.79:0/943322561 wait complete. 2024-09-21T02:32:28.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:28.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:28.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:28.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: Deploying daemon mds.b on smithi098 2024-09-21T02:32:28.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.79:6840/1013037631,v1:172.21.15.79:6841/1013037631] up:boot 2024-09-21T02:32:28.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: fsmap 11 up:standby 2024-09-21T02:32:28.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:32:28.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:28.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:28 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/943322561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: Deploying daemon mds.b on smithi098 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.79:6840/1013037631,v1:172.21.15.79:6841/1013037631] up:boot 2024-09-21T02:32:28.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: fsmap 11 up:standby 2024-09-21T02:32:28.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:32:28.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:28.314 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:28 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/943322561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:32:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:32:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: Deploying daemon mds.b on smithi098 2024-09-21T02:32:28.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.79:6840/1013037631,v1:172.21.15.79:6841/1013037631] up:boot 2024-09-21T02:32:28.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: fsmap 11 up:standby 2024-09-21T02:32:28.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:32:28.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:28.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:28 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/943322561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:29.143 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:28 smithi098 systemd[1]: Starting Ceph mds.b for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:32:29.405 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 podman[63192]: 2024-09-21 02:32:29.045649175 +0000 UTC m=+0.015840143 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:29.406 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 podman[63192]: 2024-09-21 02:32:29.222016425 +0000 UTC m=+0.192207382 container create 6189e3c1b5a954ad9e6f0e75a1b28d596f715a1b5a54d8f0fcde2520aaf26629 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:32:29.905 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 podman[63192]: 2024-09-21 02:32:29.458663765 +0000 UTC m=+0.428854718 container init 6189e3c1b5a954ad9e6f0e75a1b28d596f715a1b5a54d8f0fcde2520aaf26629 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:32:29.906 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 podman[63192]: 2024-09-21 02:32:29.461964854 +0000 UTC m=+0.432155809 container start 6189e3c1b5a954ad9e6f0e75a1b28d596f715a1b5a54d8f0fcde2520aaf26629 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T02:32:29.906 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 ceph-mds[63211]: -- 172.21.15.98:0/2702030356 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55921f9ad860 con 0x559223b55600 2024-09-21T02:32:29.906 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b[63207]: starting mds.b at 2024-09-21T02:32:29.906 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 bash[63192]: 6189e3c1b5a954ad9e6f0e75a1b28d596f715a1b5a54d8f0fcde2520aaf26629 2024-09-21T02:32:29.906 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:29 smithi098 systemd[1]: Started Ceph mds.b for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:32:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:30 smithi148 ceph-mon[34626]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:30 smithi098 ceph-mon[34832]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:30 smithi079 ceph-mon[30788]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:30.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:30.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:31.223 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:31.572 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] up:boot 2024-09-21T02:32:31.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: fsmap 12 up:standby 2024-09-21T02:32:31.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:32:31.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:31 smithi079 ceph-mon[30788]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] up:boot 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: fsmap 12 up:standby 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:31 smithi148 ceph-mon[34626]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] up:boot 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: fsmap 12 up:standby 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:31 smithi098 ceph-mon[34832]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:31.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.934+0000 7f61e9a00640 1 -- 172.21.15.79:0/2904406694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e41094b0 msgr2=0x7f61e41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:31.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.934+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2904406694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e41094b0 0x7f61e41098c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009900 tx=0x7f61d002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:32:31.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.934+0000 7f61e9a00640 1 -- 172.21.15.79:0/2904406694 shutdown_connections 2024-09-21T02:32:31.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.934+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2904406694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61e4109e00 0x7f61e4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:31.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.934+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2904406694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e41094b0 0x7f61e41098c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:31.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.934+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2904406694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e4103b70 0x7f61e4103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:31.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.934+0000 7f61e9a00640 1 -- 172.21.15.79:0/2904406694 >> 172.21.15.79:0/2904406694 conn(0x7f61e40ff5e0 msgr2=0x7f61e4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:31.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.935+0000 7f61e9a00640 1 -- 172.21.15.79:0/2904406694 shutdown_connections 2024-09-21T02:32:31.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.935+0000 7f61e9a00640 1 -- 172.21.15.79:0/2904406694 wait complete. 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 Processor -- start 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 -- start start 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61e4103b70 0x7f61e419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e41094b0 0x7f61e419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e4109e00 0x7f61e41a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4113b10 con 0x7f61e4103b70 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4113990 con 0x7f61e4109e00 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.936+0000 7f61e9a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4113c90 con 0x7f61e41094b0 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e4109e00 0x7f61e41a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61e4103b70 0x7f61e419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e4109e00 0x7f61e41a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55112/0 (socket says 172.21.15.79:55112) 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 -- 172.21.15.79:0/2331071616 learned_addr learned my addr 172.21.15.79:0/2331071616 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:31.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e2000640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e41094b0 0x7f61e419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:31.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 -- 172.21.15.79:0/2331071616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e41094b0 msgr2=0x7f61e419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:31.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e41094b0 0x7f61e419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:31.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 -- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61e4103b70 msgr2=0x7f61e419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:31.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61e4103b70 0x7f61e419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 -- 172.21.15.79:0/2331071616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e41a2650 con 0x7f61e4109e00 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.937+0000 7f61e3400640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e4109e00 0x7f61e41a1f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00efd0 tx=0x7f61dc00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.938+0000 7f61db400640 1 -- 172.21.15.79:0/2331071616 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc010630 con 0x7f61e4109e00 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.938+0000 7f61db400640 1 -- 172.21.15.79:0/2331071616 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61dc010c80 con 0x7f61e4109e00 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.938+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e41a2940 con 0x7f61e4109e00 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.938+0000 7f61db400640 1 -- 172.21.15.79:0/2331071616 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc018cb0 con 0x7f61e4109e00 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.938+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41a90a0 con 0x7f61e4109e00 2024-09-21T02:32:31.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.939+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e4103f80 con 0x7f61e4109e00 2024-09-21T02:32:31.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.941+0000 7f61db400640 1 -- 172.21.15.79:0/2331071616 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f61dc01f020 con 0x7f61e4109e00 2024-09-21T02:32:31.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.943+0000 7f61db400640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f61c80b6590 0x7f61c80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:31.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.943+0000 7f61db400640 1 -- 172.21.15.79:0/2331071616 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f61dc0e71b0 con 0x7f61e4109e00 2024-09-21T02:32:31.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.943+0000 7f61e2a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f61c80b6590 0x7f61c80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:31.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.944+0000 7f61e2a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f61c80b6590 0x7f61c80b8aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009bd0 tx=0x7f61d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:31.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:31.946+0000 7f61db400640 1 -- 172.21.15.79:0/2331071616 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61dc0ade40 con 0x7f61e4109e00 2024-09-21T02:32:32.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.224+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61e41a9380 con 0x7f61e4109e00 2024-09-21T02:32:32.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.225+0000 7f61db400640 1 -- 172.21.15.79:0/2331071616 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7f61dc0b2220 con 0x7f61e4109e00 2024-09-21T02:32:32.227 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:32.227 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":13,"btime":"2024-09-21T02:32:30:442927+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T02:32:32.227 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 13 2024-09-21T02:32:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f61c80b6590 msgr2=0x7f61c80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f61c80b6590 0x7f61c80b8aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009bd0 tx=0x7f61d4005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e4109e00 msgr2=0x7f61e41a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e4109e00 0x7f61e41a1f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00efd0 tx=0x7f61dc00c6a0 comp rx=0 tx=0).stop 2024-09-21T02:32:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 shutdown_connections 2024-09-21T02:32:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f61c80b6590 0x7f61c80b8aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61e4109e00 0x7f61e41a1f20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e41094b0 0x7f61e419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 --2- 172.21.15.79:0/2331071616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61e4103b70 0x7f61e419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 >> 172.21.15.79:0/2331071616 conn(0x7f61e40ff5e0 msgr2=0x7f61e4106ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 shutdown_connections 2024-09-21T02:32:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:32.228+0000 7f61e9a00640 1 -- 172.21.15.79:0/2331071616 wait complete. 2024-09-21T02:32:33.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T02:32:33.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:33 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2331071616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:33.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:33 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2331071616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:33.606 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:33 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2331071616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 -- 172.21.15.79:0/1687691855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 msgr2=0x7fdcc8112390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/1687691855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 0x7fdcc8112390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009ca0 tx=0x7fdcc002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 -- 172.21.15.79:0/1687691855 shutdown_connections 2024-09-21T02:32:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/1687691855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 0x7fdcc8112390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/1687691855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc80760a0 0x7fdcc810fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/1687691855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc8075750 0x7fdcc8075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 -- 172.21.15.79:0/1687691855 >> 172.21.15.79:0/1687691855 conn(0x7fdcc80ff400 msgr2=0x7fdcc8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 -- 172.21.15.79:0/1687691855 shutdown_connections 2024-09-21T02:32:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.268+0000 7fdcc7e00640 1 -- 172.21.15.79:0/1687691855 wait complete. 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 Processor -- start 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 -- start start 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc8075750 0x7fdcc819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80760a0 0x7fdcc819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 0x7fdcc81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8115b30 con 0x7fdcc810ff70 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc81159b0 con 0x7fdcc80760a0 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.269+0000 7fdcc7e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8115cb0 con 0x7fdcc8075750 2024-09-21T02:32:34.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc8075750 0x7fdcc819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc8075750 0x7fdcc819c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52262/0 (socket says 172.21.15.79:52262) 2024-09-21T02:32:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 -- 172.21.15.79:0/707759865 learned_addr learned my addr 172.21.15.79:0/707759865 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6000640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80760a0 0x7fdcc819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc7400640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 0x7fdcc81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:34.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 -- 172.21.15.79:0/707759865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80760a0 msgr2=0x7fdcc819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80760a0 0x7fdcc819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 -- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 msgr2=0x7fdcc81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 0x7fdcc81a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.270+0000 7fdcc6a00640 1 -- 172.21.15.79:0/707759865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc81a23f0 con 0x7fdcc8075750 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.271+0000 7fdcc6a00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc8075750 0x7fdcc819c480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800ea60 tx=0x7fdcb800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.271+0000 7fdcbf400640 1 -- 172.21.15.79:0/707759865 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800cde0 con 0x7fdcc8075750 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.271+0000 7fdcbf400640 1 -- 172.21.15.79:0/707759865 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcb80035f0 con 0x7fdcc8075750 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.271+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc81a26e0 con 0x7fdcc8075750 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.271+0000 7fdcbf400640 1 -- 172.21.15.79:0/707759865 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8010690 con 0x7fdcc8075750 2024-09-21T02:32:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.271+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc81a8e40 con 0x7fdcc8075750 2024-09-21T02:32:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.272+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc8075b60 con 0x7fdcc8075750 2024-09-21T02:32:34.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.274+0000 7fdcbf400640 1 -- 172.21.15.79:0/707759865 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fdcb80037a0 con 0x7fdcc8075750 2024-09-21T02:32:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.276+0000 7fdcbf400640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcac0b6590 0x7fdcac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.276+0000 7fdcbf400640 1 -- 172.21.15.79:0/707759865 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fdcb80e7120 con 0x7fdcc8075750 2024-09-21T02:32:34.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.276+0000 7fdcc6000640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcac0b6590 0x7fdcac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:34.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.277+0000 7fdcc6000640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcac0b6590 0x7fdcac0b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8112360 tx=0x7fdcb4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:34.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.279+0000 7fdcbf400640 1 -- 172.21.15.79:0/707759865 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcb80addb0 con 0x7fdcc8075750 2024-09-21T02:32:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.511+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdcc819d5b0 con 0x7fdcc8075750 2024-09-21T02:32:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.511+0000 7fdcbf400640 1 -- 172.21.15.79:0/707759865 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fdcb80b2190 con 0x7fdcc8075750 2024-09-21T02:32:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-09-21T02:32:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:32:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-09-21T02:32:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-09-21T02:32:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:32:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-09-21T02:32:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcac0b6590 msgr2=0x7fdcac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcac0b6590 0x7fdcac0b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8112360 tx=0x7fdcb4005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc8075750 msgr2=0x7fdcc819c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc8075750 0x7fdcc819c480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800ea60 tx=0x7fdcb800ef20 comp rx=0 tx=0).stop 2024-09-21T02:32:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 shutdown_connections 2024-09-21T02:32:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcac0b6590 0x7fdcac0b8aa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcc810ff70 0x7fdcc81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80760a0 0x7fdcc819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 --2- 172.21.15.79:0/707759865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcc8075750 0x7fdcc819c480 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 >> 172.21.15.79:0/707759865 conn(0x7fdcc80ff400 msgr2=0x7fdcc8109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 shutdown_connections 2024-09-21T02:32:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:34.514+0000 7fdcc7e00640 1 -- 172.21.15.79:0/707759865 wait complete. 2024-09-21T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:34 smithi098 ceph-mon[34832]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:34 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:34.710 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:34 smithi079 ceph-mon[30788]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:34.710 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.710 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.710 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:34.710 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:34.710 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.710 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:34 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:34 smithi148 ceph-mon[34626]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:34 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:35 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/707759865' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:32:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:35 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/707759865' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:32:35.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.713 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T02:32:35.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T02:32:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:35 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/707759865' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:32:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:35.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:36.143 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:36.580 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:36 smithi079 ceph-mon[30788]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:36 smithi098 ceph-mon[34832]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:36.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 -- 172.21.15.79:0/1989790157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd60105110 msgr2=0x7efd6010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 --2- 172.21.15.79:0/1989790157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd60105110 0x7efd6010d660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009900 tx=0x7efd4c02a410 comp rx=0 tx=0).stop 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 -- 172.21.15.79:0/1989790157 shutdown_connections 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 --2- 172.21.15.79:0/1989790157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd6010dc20 0x7efd60110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 --2- 172.21.15.79:0/1989790157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd60105110 0x7efd6010d660 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 --2- 172.21.15.79:0/1989790157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd601047c0 0x7efd60104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 -- 172.21.15.79:0/1989790157 >> 172.21.15.79:0/1989790157 conn(0x7efd600fe2c0 msgr2=0x7efd60100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 -- 172.21.15.79:0/1989790157 shutdown_connections 2024-09-21T02:32:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.778+0000 7efd66200640 1 -- 172.21.15.79:0/1989790157 wait complete. 2024-09-21T02:32:36.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.779+0000 7efd66200640 1 Processor -- start 2024-09-21T02:32:36.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.779+0000 7efd66200640 1 -- start start 2024-09-21T02:32:36.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd66200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd601047c0 0x7efd6019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:36.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd66200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd60105110 0x7efd6019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:36.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd66200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd6010dc20 0x7efd601a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:36.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd66200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd601138d0 con 0x7efd601047c0 2024-09-21T02:32:36.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd66200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd60113750 con 0x7efd60105110 2024-09-21T02:32:36.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd66200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efd60113a50 con 0x7efd6010dc20 2024-09-21T02:32:36.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd64e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd601047c0 0x7efd6019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:36.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd64e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd601047c0 0x7efd6019c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49420/0 (socket says 172.21.15.79:49420) 2024-09-21T02:32:36.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd64e00640 1 -- 172.21.15.79:0/3035843482 learned_addr learned my addr 172.21.15.79:0/3035843482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:36.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd5fe00640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd60105110 0x7efd6019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:36.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd65800640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd6010dc20 0x7efd601a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.780+0000 7efd64e00640 1 -- 172.21.15.79:0/3035843482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd6010dc20 msgr2=0x7efd601a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd64e00640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd6010dc20 0x7efd601a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd64e00640 1 -- 172.21.15.79:0/3035843482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd60105110 msgr2=0x7efd6019caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd64e00640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd60105110 0x7efd6019caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd64e00640 1 -- 172.21.15.79:0/3035843482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd601a2470 con 0x7efd601047c0 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd5fe00640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd60105110 0x7efd6019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd64e00640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd601047c0 0x7efd6019c500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd5400ea60 tx=0x7efd5400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd5d600640 1 -- 172.21.15.79:0/3035843482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5400cde0 con 0x7efd601047c0 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd601a2760 con 0x7efd601047c0 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd601a8ec0 con 0x7efd601047c0 2024-09-21T02:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd5d600640 1 -- 172.21.15.79:0/3035843482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd540035f0 con 0x7efd601047c0 2024-09-21T02:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.781+0000 7efd5d600640 1 -- 172.21.15.79:0/3035843482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54010690 con 0x7efd601047c0 2024-09-21T02:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.782+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd60104bd0 con 0x7efd601047c0 2024-09-21T02:32:36.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.785+0000 7efd5d600640 1 -- 172.21.15.79:0/3035843482 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7efd540037a0 con 0x7efd601047c0 2024-09-21T02:32:36.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.786+0000 7efd5d600640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efd480b6590 0x7efd480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.787+0000 7efd5d600640 1 -- 172.21.15.79:0/3035843482 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7efd540e7550 con 0x7efd601047c0 2024-09-21T02:32:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.787+0000 7efd5fe00640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efd480b6590 0x7efd480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.787+0000 7efd5fe00640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efd480b6590 0x7efd480b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efd4c02aa00 tx=0x7efd4c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:36.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:36.793+0000 7efd5d600640 1 -- 172.21.15.79:0/3035843482 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd540ae1e0 con 0x7efd601047c0 2024-09-21T02:32:36.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:36 smithi148 ceph-mon[34626]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:37.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.000+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efd601a9200 con 0x7efd601047c0 2024-09-21T02:32:37.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.410+0000 7efd5d600640 1 -- 172.21.15.79:0/3035843482 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7efd540b25c0 con 0x7efd601047c0 2024-09-21T02:32:37.411 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-09-21T02:32:37.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efd480b6590 msgr2=0x7efd480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:37.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efd480b6590 0x7efd480b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efd4c02aa00 tx=0x7efd4c005a20 comp rx=0 tx=0).stop 2024-09-21T02:32:37.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd601047c0 msgr2=0x7efd6019c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:37.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd601047c0 0x7efd6019c500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd5400ea60 tx=0x7efd5400ef20 comp rx=0 tx=0).stop 2024-09-21T02:32:37.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 shutdown_connections 2024-09-21T02:32:37.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efd480b6590 0x7efd480b8aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:37.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd6010dc20 0x7efd601a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:37.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd60105110 0x7efd6019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:37.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 --2- 172.21.15.79:0/3035843482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd601047c0 0x7efd6019c500 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:37.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 >> 172.21.15.79:0/3035843482 conn(0x7efd600fe2c0 msgr2=0x7efd6010cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:37.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 shutdown_connections 2024-09-21T02:32:37.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:37.413+0000 7efd66200640 1 -- 172.21.15.79:0/3035843482 wait complete. 2024-09-21T02:32:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:37 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3035843482' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:32:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:37 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3035843482' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:32:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:37 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3035843482' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:32:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:32:38.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T02:32:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:38 smithi079 ceph-mon[30788]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:38 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3035843482' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:32:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:38 smithi079 ceph-mon[30788]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:32:38.621 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:38 smithi148 ceph-mon[34626]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:38 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3035843482' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:32:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:38 smithi148 ceph-mon[34626]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:32:38.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:38 smithi098 ceph-mon[34832]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:38.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:38 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3035843482' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:32:38.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:38 smithi098 ceph-mon[34832]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:32:39.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 -- 172.21.15.79:0/911475747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67681047d0 msgr2=0x7f6768104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:39.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 --2- 172.21.15.79:0/911475747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67681047d0 0x7f6768104be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6758009900 tx=0x7f675802a410 comp rx=0 tx=0).stop 2024-09-21T02:32:39.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 -- 172.21.15.79:0/911475747 shutdown_connections 2024-09-21T02:32:39.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 --2- 172.21.15.79:0/911475747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f676810dc30 0x7f6768110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:39.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 --2- 172.21.15.79:0/911475747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6768105120 0x7f676810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:39.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 --2- 172.21.15.79:0/911475747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67681047d0 0x7f6768104be0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:39.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 -- 172.21.15.79:0/911475747 >> 172.21.15.79:0/911475747 conn(0x7f67680fe2d0 msgr2=0x7f6768100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:39.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 -- 172.21.15.79:0/911475747 shutdown_connections 2024-09-21T02:32:39.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.251+0000 7f676e600640 1 -- 172.21.15.79:0/911475747 wait complete. 2024-09-21T02:32:39.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.252+0000 7f676e600640 1 Processor -- start 2024-09-21T02:32:39.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.252+0000 7f676e600640 1 -- start start 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.252+0000 7f676e600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67681047d0 0x7f676819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.252+0000 7f676e600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6768105120 0x7f676819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f676810dc30 0x7f676819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676e600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67681138b0 con 0x7f6768105120 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676e600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6768113730 con 0x7f676810dc30 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676e600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6768113a30 con 0x7f67681047d0 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67681047d0 0x7f676819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:39.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f675fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6768105120 0x7f676819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:39.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67681047d0 0x7f676819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52306/0 (socket says 172.21.15.79:52306) 2024-09-21T02:32:39.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 -- 172.21.15.79:0/1517985289 learned_addr learned my addr 172.21.15.79:0/1517985289 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:39.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676dc00640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f676810dc30 0x7f676819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:39.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 -- 172.21.15.79:0/1517985289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f676810dc30 msgr2=0x7f676819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f676810dc30 0x7f676819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 -- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6768105120 msgr2=0x7f676819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6768105120 0x7f676819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f676d200640 1 -- 172.21.15.79:0/1517985289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67681a0290 con 0x7f67681047d0 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.253+0000 7f675fe00640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6768105120 0x7f676819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.254+0000 7f676d200640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67681047d0 0x7f676819a320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6758005940 tx=0x7f67580040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.254+0000 7f6766000640 1 -- 172.21.15.79:0/1517985289 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675803f030 con 0x7f67681047d0 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.254+0000 7f6766000640 1 -- 172.21.15.79:0/1517985289 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67580044c0 con 0x7f67681047d0 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.254+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67681a0520 con 0x7f67681047d0 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.254+0000 7f6766000640 1 -- 172.21.15.79:0/1517985289 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758035070 con 0x7f67681047d0 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.254+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67681a6ce0 con 0x7f67681047d0 2024-09-21T02:32:39.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.255+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6768104be0 con 0x7f67681047d0 2024-09-21T02:32:39.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.258+0000 7f6766000640 1 -- 172.21.15.79:0/1517985289 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6758042030 con 0x7f67681047d0 2024-09-21T02:32:39.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.259+0000 7f6766000640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f674c0b6590 0x7f674c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:39.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.260+0000 7f6766000640 1 -- 172.21.15.79:0/1517985289 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7497+0+0 (secure 0 0 0) 0x7f6758107630 con 0x7f67681047d0 2024-09-21T02:32:39.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.260+0000 7f675fe00640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f674c0b6590 0x7f674c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:39.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.260+0000 7f675fe00640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f674c0b6590 0x7f674c0b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6768110200 tx=0x7f6750005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:39.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.262+0000 7f6766000640 1 -- 172.21.15.79:0/1517985289 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67580d2530 con 0x7f67681047d0 2024-09-21T02:32:39.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:39.452+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f67681a6f10 con 0x7f67681047d0 2024-09-21T02:32:39.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:39 smithi079 ceph-mon[30788]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:32:39.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:39 smithi148 ceph-mon[34626]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:32:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:39 smithi098 ceph-mon[34832]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:32:40.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.445+0000 7f6766000640 1 -- 172.21.15.79:0/1517985289 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v75) ==== 171+0+0 (secure 0 0 0) 0x7f67580d7470 con 0x7f67681047d0 2024-09-21T02:32:40.450 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f674c0b6590 msgr2=0x7f674c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f674c0b6590 0x7f674c0b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6768110200 tx=0x7f6750005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67681047d0 msgr2=0x7f676819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67681047d0 0x7f676819a320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6758005940 tx=0x7f67580040c0 comp rx=0 tx=0).stop 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 shutdown_connections 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f674c0b6590 0x7f674c0b8aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f676810dc30 0x7f676819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6768105120 0x7f676819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 --2- 172.21.15.79:0/1517985289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67681047d0 0x7f676819a320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:40.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.450+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 >> 172.21.15.79:0/1517985289 conn(0x7f67680fe2d0 msgr2=0x7f6768107790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:40.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.451+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 shutdown_connections 2024-09-21T02:32:40.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:40.451+0000 7f676e600640 1 -- 172.21.15.79:0/1517985289 wait complete. 2024-09-21T02:32:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:40 smithi079 ceph-mon[30788]: pgmap v308: 33 pgs: 1 creating+activating, 5 creating+peering, 23 unknown, 4 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:40 smithi079 ceph-mon[30788]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:32:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:40 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1517985289' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:32:40.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:40 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:32:40.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:40 smithi148 ceph-mon[34626]: pgmap v308: 33 pgs: 1 creating+activating, 5 creating+peering, 23 unknown, 4 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:40.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:40 smithi148 ceph-mon[34626]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:32:40.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:40 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1517985289' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:32:40.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:40 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:32:40.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:40 smithi098 ceph-mon[34832]: pgmap v308: 33 pgs: 1 creating+activating, 5 creating+peering, 23 unknown, 4 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:40.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:40 smithi098 ceph-mon[34832]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:32:40.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:40 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1517985289' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:32:40.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:40 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:32:41.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T02:32:41.587 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:41.726 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:41 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:32:41.726 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:41 smithi079 ceph-mon[30788]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:32:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:41 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:32:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:41 smithi148 ceph-mon[34626]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:32:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:41 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:32:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:41 smithi098 ceph-mon[34832]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:32:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 -- 172.21.15.79:0/418859977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 msgr2=0x7f3bd8075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 --2- 172.21.15.79:0/418859977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 0x7f3bd8075bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009900 tx=0x7f3bcc02a410 comp rx=0 tx=0).stop 2024-09-21T02:32:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 -- 172.21.15.79:0/418859977 shutdown_connections 2024-09-21T02:32:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 --2- 172.21.15.79:0/418859977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd81100d0 0x7f3bd8112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 --2- 172.21.15.79:0/418859977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd8076100 0x7f3bd810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 --2- 172.21.15.79:0/418859977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 0x7f3bd8075bc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 -- 172.21.15.79:0/418859977 >> 172.21.15.79:0/418859977 conn(0x7f3bd80ff5e0 msgr2=0x7f3bd8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:42.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.233+0000 7f3be0600640 1 -- 172.21.15.79:0/418859977 shutdown_connections 2024-09-21T02:32:42.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.234+0000 7f3be0600640 1 -- 172.21.15.79:0/418859977 wait complete. 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 Processor -- start 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 -- start start 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 0x7f3bd819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd8076100 0x7f3bd819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd81100d0 0x7f3bd81a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8115c80 con 0x7f3bd80757b0 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8115b00 con 0x7f3bd81100d0 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.235+0000 7f3be0600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8115e00 con 0x7f3bd8076100 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bddc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 0x7f3bd819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bdd200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd8076100 0x7f3bd819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bde600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd81100d0 0x7f3bd81a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:42.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bdd200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd8076100 0x7f3bd819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52314/0 (socket says 172.21.15.79:52314) 2024-09-21T02:32:42.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bdd200640 1 -- 172.21.15.79:0/3455028981 learned_addr learned my addr 172.21.15.79:0/3455028981 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:42.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bde600640 1 -- 172.21.15.79:0/3455028981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd8076100 msgr2=0x7f3bd819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:42.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bde600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd8076100 0x7f3bd819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:42.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bde600640 1 -- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 msgr2=0x7f3bd819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:42.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bde600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 0x7f3bd819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.236+0000 7f3bde600640 1 -- 172.21.15.79:0/3455028981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd81a25c0 con 0x7f3bd81100d0 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.237+0000 7f3bde600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd81100d0 0x7f3bd81a1e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fd0 tx=0x7f3bd000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.237+0000 7f3bd6000640 1 -- 172.21.15.79:0/3455028981 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000ce20 con 0x7f3bd81100d0 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.237+0000 7f3bd6000640 1 -- 172.21.15.79:0/3455028981 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bd0005020 con 0x7f3bd81100d0 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.237+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd81a28b0 con 0x7f3bd81100d0 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.237+0000 7f3bd6000640 1 -- 172.21.15.79:0/3455028981 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0010690 con 0x7f3bd81100d0 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.237+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd81a9010 con 0x7f3bd81100d0 2024-09-21T02:32:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.238+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd8075bc0 con 0x7f3bd81100d0 2024-09-21T02:32:42.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.241+0000 7f3bd6000640 1 -- 172.21.15.79:0/3455028981 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f3bd00054d0 con 0x7f3bd81100d0 2024-09-21T02:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.242+0000 7f3bd6000640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3bc00b6590 0x7f3bc00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.242+0000 7f3bd6000640 1 -- 172.21.15.79:0/3455028981 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7879+0+0 (secure 0 0 0) 0x7f3bd00e7890 con 0x7f3bd81100d0 2024-09-21T02:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.242+0000 7f3bddc00640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3bc00b6590 0x7f3bc00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:42.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.243+0000 7f3bddc00640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3bc00b6590 0x7f3bc00b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc031440 tx=0x7f3bcc009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:42.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.246+0000 7f3bd6000640 1 -- 172.21.15.79:0/3455028981 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3bd00ae230 con 0x7f3bd81100d0 2024-09-21T02:32:42.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:42.476+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3bd819d780 con 0x7f3bd81100d0 2024-09-21T02:32:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:42 smithi079 ceph-mon[30788]: pgmap v311: 97 pgs: 1 creating+activating, 17 creating+peering, 58 unknown, 21 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:42 smithi079 ceph-mon[30788]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:32:42.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:42 smithi148 ceph-mon[34626]: pgmap v311: 97 pgs: 1 creating+activating, 17 creating+peering, 58 unknown, 21 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:42 smithi148 ceph-mon[34626]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:32:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:42 smithi098 ceph-mon[34832]: pgmap v311: 97 pgs: 1 creating+activating, 17 creating+peering, 58 unknown, 21 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:42 smithi098 ceph-mon[34832]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:32:43.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.473+0000 7f3bd6000640 1 -- 172.21.15.79:0/3455028981 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f3bd00b2610 con 0x7f3bd81100d0 2024-09-21T02:32:43.474 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T02:32:43.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3bc00b6590 msgr2=0x7f3bc00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:43.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3bc00b6590 0x7f3bc00b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc031440 tx=0x7f3bcc009560 comp rx=0 tx=0).stop 2024-09-21T02:32:43.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd81100d0 msgr2=0x7f3bd81a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:43.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd81100d0 0x7f3bd81a1e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fd0 tx=0x7f3bd000ef10 comp rx=0 tx=0).stop 2024-09-21T02:32:43.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 shutdown_connections 2024-09-21T02:32:43.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3bc00b6590 0x7f3bc00b8aa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd81100d0 0x7f3bd81a1e90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd8076100 0x7f3bd819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 --2- 172.21.15.79:0/3455028981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd80757b0 0x7f3bd819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.476+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 >> 172.21.15.79:0/3455028981 conn(0x7f3bd80ff5e0 msgr2=0x7f3bd8109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:43.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.477+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 shutdown_connections 2024-09-21T02:32:43.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:43.477+0000 7f3be0600640 1 -- 172.21.15.79:0/3455028981 wait complete. 2024-09-21T02:32:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:43 smithi079 ceph-mon[30788]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:32:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:43 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3455028981' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:32:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:43 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:32:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:43 smithi079 ceph-mon[30788]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:32:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:43 smithi079 ceph-mon[30788]: pgmap v314: 97 pgs: 1 creating+activating, 12 creating+peering, 32 unknown, 52 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:43.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:43 smithi148 ceph-mon[34626]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:32:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:43 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3455028981' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:32:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:43 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:32:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:43 smithi148 ceph-mon[34626]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:32:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:43 smithi148 ceph-mon[34626]: pgmap v314: 97 pgs: 1 creating+activating, 12 creating+peering, 32 unknown, 52 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:43 smithi098 ceph-mon[34832]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:32:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:43 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3455028981' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:32:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:43 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:32:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:43 smithi098 ceph-mon[34832]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:32:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:43 smithi098 ceph-mon[34832]: pgmap v314: 97 pgs: 1 creating+activating, 12 creating+peering, 32 unknown, 52 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:44.351 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T02:32:44.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T02:32:44.727 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:44 smithi079 ceph-mon[30788]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:32:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:44 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:32:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:44 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:32:44.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:44 smithi079 ceph-mon[30788]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:32:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:44 smithi148 ceph-mon[34626]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:32:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:44 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:32:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:44 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:32:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:44 smithi148 ceph-mon[34626]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:32:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:44 smithi098 ceph-mon[34832]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:32:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:44 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:32:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:44 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:32:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:44 smithi098 ceph-mon[34832]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 -- 172.21.15.79:0/207024775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 msgr2=0x7f554c103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 --2- 172.21.15.79:0/207024775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 0x7f554c103f80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5540009860 tx=0x7f554002a340 comp rx=0 tx=0).stop 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 -- 172.21.15.79:0/207024775 shutdown_connections 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 --2- 172.21.15.79:0/207024775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f554c109e00 0x7f554c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 --2- 172.21.15.79:0/207024775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c1094b0 0x7f554c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 --2- 172.21.15.79:0/207024775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 0x7f554c103f80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 -- 172.21.15.79:0/207024775 >> 172.21.15.79:0/207024775 conn(0x7f554c0ff5e0 msgr2=0x7f554c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 -- 172.21.15.79:0/207024775 shutdown_connections 2024-09-21T02:32:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.369+0000 7f5554600640 1 -- 172.21.15.79:0/207024775 wait complete. 2024-09-21T02:32:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.370+0000 7f5554600640 1 Processor -- start 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.370+0000 7f5554600640 1 -- start start 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5554600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 0x7f554c077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5554600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c1094b0 0x7f554c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5554600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f554c109e00 0x7f554c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5554600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f554c113ac0 con 0x7f554c1094b0 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5554600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f554c113940 con 0x7f554c109e00 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5554600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f554c113c40 con 0x7f554c103b70 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5551200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c1094b0 0x7f554c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5551c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 0x7f554c077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5551200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c1094b0 0x7f554c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36486/0 (socket says 172.21.15.79:36486) 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5551200640 1 -- 172.21.15.79:0/1179856068 learned_addr learned my addr 172.21.15.79:0/1179856068 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.371+0000 7f5552600640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f554c109e00 0x7f554c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f5551c00640 1 -- 172.21.15.79:0/1179856068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f554c109e00 msgr2=0x7f554c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f5551c00640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f554c109e00 0x7f554c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f5551c00640 1 -- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c1094b0 msgr2=0x7f554c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f5551c00640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c1094b0 0x7f554c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f5551c00640 1 -- 172.21.15.79:0/1179856068 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c076470 con 0x7f554c103b70 2024-09-21T02:32:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f5551c00640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 0x7f554c077120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5540035040 tx=0x7f5540032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f554a000640 1 -- 172.21.15.79:0/1179856068 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540040020 con 0x7f554c103b70 2024-09-21T02:32:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f554a000640 1 -- 172.21.15.79:0/1179856068 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5540030e10 con 0x7f554c103b70 2024-09-21T02:32:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554c1ace10 con 0x7f554c103b70 2024-09-21T02:32:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.372+0000 7f554a000640 1 -- 172.21.15.79:0/1179856068 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540037040 con 0x7f554c103b70 2024-09-21T02:32:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.373+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554c1ad260 con 0x7f554c103b70 2024-09-21T02:32:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.374+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554c103f80 con 0x7f554c103b70 2024-09-21T02:32:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.379+0000 7f554a000640 1 -- 172.21.15.79:0/1179856068 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5540043020 con 0x7f554c103b70 2024-09-21T02:32:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.380+0000 7f554a000640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55340b6590 0x7f55340b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.380+0000 7f554a000640 1 -- 172.21.15.79:0/1179856068 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f5540106d80 con 0x7f554c103b70 2024-09-21T02:32:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.380+0000 7f5551200640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55340b6590 0x7f55340b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.381+0000 7f554a000640 1 -- 172.21.15.79:0/1179856068 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55400cd740 con 0x7f554c103b70 2024-09-21T02:32:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.381+0000 7f5551200640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55340b6590 0x7f55340b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f554c108fd0 tx=0x7f5538005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:45.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:45.590+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f554c02e6d0 con 0x7f554c103b70 2024-09-21T02:32:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:45 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] up:active 2024-09-21T02:32:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:45 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:45 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:45 smithi079 ceph-mon[30788]: pgmap v316: 97 pgs: 12 creating+peering, 2 unknown, 83 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 206 B/s wr, 4 op/s 2024-09-21T02:32:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:45 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] up:active 2024-09-21T02:32:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:45 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:45 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:45 smithi148 ceph-mon[34626]: pgmap v316: 97 pgs: 12 creating+peering, 2 unknown, 83 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 206 B/s wr, 4 op/s 2024-09-21T02:32:45.905 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:32:45 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b[63207]: 2024-09-21T02:32:45.458+0000 7fe3f66dd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T02:32:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:45 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] up:active 2024-09-21T02:32:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:45 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:45 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:45 smithi098 ceph-mon[34832]: pgmap v316: 97 pgs: 12 creating+peering, 2 unknown, 83 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 206 B/s wr, 4 op/s 2024-09-21T02:32:46.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.498+0000 7f554a000640 1 -- 172.21.15.79:0/1179856068 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v79) ==== 157+0+0 (secure 0 0 0) 0x7f554009a9b0 con 0x7f554c103b70 2024-09-21T02:32:46.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55340b6590 msgr2=0x7f55340b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55340b6590 0x7f55340b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f554c108fd0 tx=0x7f5538005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 msgr2=0x7f554c077120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 0x7f554c077120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5540035040 tx=0x7f5540032d50 comp rx=0 tx=0).stop 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 shutdown_connections 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55340b6590 0x7f55340b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f554c109e00 0x7f554c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c1094b0 0x7f554c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 --2- 172.21.15.79:0/1179856068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f554c103b70 0x7f554c077120 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 >> 172.21.15.79:0/1179856068 conn(0x7f554c0ff5e0 msgr2=0x7f554c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 shutdown_connections 2024-09-21T02:32:46.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:46.500+0000 7f5554600640 1 -- 172.21.15.79:0/1179856068 wait complete. 2024-09-21T02:32:46.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:46 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1179856068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:32:46.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:46 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:32:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:46 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1179856068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:32:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:46 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:32:46.925 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:46 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1179856068' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:32:46.925 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:46 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:32:47.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T02:32:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:47 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:32:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:47 smithi079 ceph-mon[30788]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:32:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:47 smithi079 ceph-mon[30788]: pgmap v318: 97 pgs: 97 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T02:32:47.800 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:47 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:32:47.807 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:47 smithi098 ceph-mon[34832]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:32:47.807 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:47 smithi098 ceph-mon[34832]: pgmap v318: 97 pgs: 97 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T02:32:47.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:47 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:32:47.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:47 smithi148 ceph-mon[34626]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:32:47.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:47 smithi148 ceph-mon[34626]: pgmap v318: 97 pgs: 97 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 -- 172.21.15.79:0/2991115214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 msgr2=0x7f2eb4112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 --2- 172.21.15.79:0/2991115214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 0x7f2eb4112840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009ca0 tx=0x7f2eac02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 -- 172.21.15.79:0/2991115214 shutdown_connections 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 --2- 172.21.15.79:0/2991115214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 0x7f2eb4112840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 --2- 172.21.15.79:0/2991115214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eb410b6c0 0x7f2eb410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 --2- 172.21.15.79:0/2991115214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eb4105d80 0x7f2eb4106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 -- 172.21.15.79:0/2991115214 >> 172.21.15.79:0/2991115214 conn(0x7f2eb41017d0 msgr2=0x7f2eb4103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 -- 172.21.15.79:0/2991115214 shutdown_connections 2024-09-21T02:32:48.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.411+0000 7f2ebc400640 1 -- 172.21.15.79:0/2991115214 wait complete. 2024-09-21T02:32:48.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.412+0000 7f2ebc400640 1 Processor -- start 2024-09-21T02:32:48.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.412+0000 7f2ebc400640 1 -- start start 2024-09-21T02:32:48.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2ebc400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eb4105d80 0x7f2eb419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2ebc400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eb410b6c0 0x7f2eb419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2ebc400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 0x7f2eb41a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2ebc400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4115cd0 con 0x7f2eb4105d80 2024-09-21T02:32:48.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2ebc400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4115b50 con 0x7f2eb410c010 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2ebc400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4115e50 con 0x7f2eb410b6c0 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eb4105d80 0x7f2eb419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eba400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 0x7f2eb41a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eb410b6c0 0x7f2eb419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eb4105d80 0x7f2eb419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36502/0 (socket says 172.21.15.79:36502) 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9a00640 1 -- 172.21.15.79:0/3667254618 learned_addr learned my addr 172.21.15.79:0/3667254618 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9000640 1 -- 172.21.15.79:0/3667254618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 msgr2=0x7f2eb41a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9000640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 0x7f2eb41a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9000640 1 -- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eb4105d80 msgr2=0x7f2eb419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9000640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eb4105d80 0x7f2eb419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eb9000640 1 -- 172.21.15.79:0/3667254618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb41a2630 con 0x7f2eb410b6c0 2024-09-21T02:32:48.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.413+0000 7f2eba400640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 0x7f2eb41a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:48.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.414+0000 7f2eb9000640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eb410b6c0 0x7f2eb419cc60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2eb406ca20 tx=0x7f2ea000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:48.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.414+0000 7f2eb2000640 1 -- 172.21.15.79:0/3667254618 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000cc40 con 0x7f2eb410b6c0 2024-09-21T02:32:48.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.414+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb41a2920 con 0x7f2eb410b6c0 2024-09-21T02:32:48.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.414+0000 7f2eb2000640 1 -- 172.21.15.79:0/3667254618 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea000cde0 con 0x7f2eb410b6c0 2024-09-21T02:32:48.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.414+0000 7f2eb2000640 1 -- 172.21.15.79:0/3667254618 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0018760 con 0x7f2eb410b6c0 2024-09-21T02:32:48.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.414+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb41a9080 con 0x7f2eb410b6c0 2024-09-21T02:32:48.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.415+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb4106190 con 0x7f2eb410b6c0 2024-09-21T02:32:48.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.418+0000 7f2eb2000640 1 -- 172.21.15.79:0/3667254618 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f2ea0010a90 con 0x7f2eb410b6c0 2024-09-21T02:32:48.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.419+0000 7f2eb2000640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.420+0000 7f2eb2000640 1 -- 172.21.15.79:0/3667254618 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8277+0+0 (secure 0 0 0) 0x7f2ea00e7a10 con 0x7f2eb410b6c0 2024-09-21T02:32:48.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.420+0000 7f2eb9a00640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.420+0000 7f2eb9a00640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009cd0 tx=0x7f2ea8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:48.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.421+0000 7f2eb2000640 1 -- 172.21.15.79:0/3667254618 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ea00b25f0 con 0x7f2eb410b6c0 2024-09-21T02:32:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:48.607+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2eb419d7f0 con 0x7f2eb410b6c0 2024-09-21T02:32:48.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:48 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3667254618' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:32:48.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:48 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:32:48.988 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:48 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3667254618' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:32:48.988 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:48 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:32:49.025 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:48 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3667254618' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:32:49.026 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:48 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:32:49.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.668+0000 7f2eb2000640 1 -- 172.21.15.79:0/3667254618 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v81) ==== 228+0+0 (secure 0 0 0) 0x7f2ea00b7530 con 0x7f2eb410b6c0 2024-09-21T02:32:49.671 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data_ec' created 2024-09-21T02:32:49.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e9c0b6510 msgr2=0x7f2e9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:49.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009cd0 tx=0x7f2ea8005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:49.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eb410b6c0 msgr2=0x7f2eb419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:49.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eb410b6c0 0x7f2eb419cc60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2eb406ca20 tx=0x7f2ea000ee50 comp rx=0 tx=0).stop 2024-09-21T02:32:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 shutdown_connections 2024-09-21T02:32:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2eb410c010 0x7f2eb41a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eb410b6c0 0x7f2eb419cc60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 --2- 172.21.15.79:0/3667254618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2eb4105d80 0x7f2eb419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.674+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 >> 172.21.15.79:0/3667254618 conn(0x7f2eb41017d0 msgr2=0x7f2eb4108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.675+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 shutdown_connections 2024-09-21T02:32:49.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:49.676+0000 7f2ebc400640 1 -- 172.21.15.79:0/3667254618 wait complete. 2024-09-21T02:32:49.966 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:49 smithi148 ceph-mon[34626]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:32:49.966 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:49 smithi148 ceph-mon[34626]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T02:32:49.966 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:49 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:32:49.966 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:49 smithi148 ceph-mon[34626]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:32:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:49 smithi079 ceph-mon[30788]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:32:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:49 smithi079 ceph-mon[30788]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T02:32:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:49 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:32:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:49 smithi079 ceph-mon[30788]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:32:50.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:49 smithi098 ceph-mon[34832]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:32:50.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:49 smithi098 ceph-mon[34832]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T02:32:50.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:49 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:32:50.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:49 smithi098 ceph-mon[34832]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:32:50.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T02:32:50.797 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 -- 172.21.15.79:0/1992620550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 msgr2=0x7f5c04104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 --2- 172.21.15.79:0/1992620550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c04104de0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009900 tx=0x7f5bf402a410 comp rx=0 tx=0).stop 2024-09-21T02:32:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 -- 172.21.15.79:0/1992620550 shutdown_connections 2024-09-21T02:32:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 --2- 172.21.15.79:0/1992620550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c0410de30 0x7f5c04110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 --2- 172.21.15.79:0/1992620550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c04105320 0x7f5c0410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 --2- 172.21.15.79:0/1992620550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c04104de0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 -- 172.21.15.79:0/1992620550 >> 172.21.15.79:0/1992620550 conn(0x7f5c04079740 msgr2=0x7f5c04079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 -- 172.21.15.79:0/1992620550 shutdown_connections 2024-09-21T02:32:51.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.431+0000 7f5c09800640 1 -- 172.21.15.79:0/1992620550 wait complete. 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.432+0000 7f5c09800640 1 Processor -- start 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.432+0000 7f5c09800640 1 -- start start 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c09800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c0419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c09800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c04105320 0x7f5c0419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c09800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0410de30 0x7f5c0419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c09800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04113a90 con 0x7f5c041049d0 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c09800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04113910 con 0x7f5c04105320 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c09800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04113c10 con 0x7f5c0410de30 2024-09-21T02:32:51.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c02a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c0419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c02a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c0419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36518/0 (socket says 172.21.15.79:36518) 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c02a00640 1 -- 172.21.15.79:0/3019269809 learned_addr learned my addr 172.21.15.79:0/3019269809 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c02000640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c04105320 0x7f5c0419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.433+0000 7f5c03400640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0410de30 0x7f5c0419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c02a00640 1 -- 172.21.15.79:0/3019269809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0410de30 msgr2=0x7f5c0419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c02a00640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0410de30 0x7f5c0419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c02a00640 1 -- 172.21.15.79:0/3019269809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c04105320 msgr2=0x7f5c0419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c02a00640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c04105320 0x7f5c0419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c02a00640 1 -- 172.21.15.79:0/3019269809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c041a0430 con 0x7f5c041049d0 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c03400640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0410de30 0x7f5c0419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c02000640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c04105320 0x7f5c0419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c02a00640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c0419a4c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4032fd0 tx=0x7f5bf4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:51.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5bfb400640 1 -- 172.21.15.79:0/3019269809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf403f030 con 0x7f5c041049d0 2024-09-21T02:32:51.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5bfb400640 1 -- 172.21.15.79:0/3019269809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bf4004490 con 0x7f5c041049d0 2024-09-21T02:32:51.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5bfb400640 1 -- 172.21.15.79:0/3019269809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4035070 con 0x7f5c041049d0 2024-09-21T02:32:51.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c041a06c0 con 0x7f5c041049d0 2024-09-21T02:32:51.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.434+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c041a6e80 con 0x7f5c041049d0 2024-09-21T02:32:51.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.436+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0406c240 con 0x7f5c041049d0 2024-09-21T02:32:51.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.438+0000 7f5bfb400640 1 -- 172.21.15.79:0/3019269809 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5bf4042030 con 0x7f5c041049d0 2024-09-21T02:32:51.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.441+0000 7f5bfb400640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5be80b6590 0x7f5be80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.441+0000 7f5bfb400640 1 -- 172.21.15.79:0/3019269809 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8770+0+0 (secure 0 0 0) 0x7f5bf4107c50 con 0x7f5c041049d0 2024-09-21T02:32:51.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.441+0000 7f5c02000640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5be80b6590 0x7f5be80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.442+0000 7f5c02000640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5be80b6590 0x7f5be80b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c0407a080 tx=0x7f5bf0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:51.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.444+0000 7f5bfb400640 1 -- 172.21.15.79:0/3019269809 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bf40ce260 con 0x7f5c041049d0 2024-09-21T02:32:51.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.638+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f5c04104de0 con 0x7f5c041049d0 2024-09-21T02:32:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.673+0000 7f5bfb400640 1 -- 172.21.15.79:0/3019269809 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v83) ==== 169+0+0 (secure 0 0 0) 0x7f5c04104de0 con 0x7f5c041049d0 2024-09-21T02:32:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.675+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5be80b6590 msgr2=0x7f5be80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.675+0000 7f5c09800640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5be80b6590 0x7f5be80b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c0407a080 tx=0x7f5bf0005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.675+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 msgr2=0x7f5c0419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.675+0000 7f5c09800640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c0419a4c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4032fd0 tx=0x7f5bf4031a20 comp rx=0 tx=0).stop 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.675+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 shutdown_connections 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.675+0000 7f5c09800640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5be80b6590 0x7f5be80b8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.675+0000 7f5c09800640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0410de30 0x7f5c0419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.676+0000 7f5c09800640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c04105320 0x7f5c0419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.676+0000 7f5c09800640 1 --2- 172.21.15.79:0/3019269809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c041049d0 0x7f5c0419a4c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.676+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 >> 172.21.15.79:0/3019269809 conn(0x7f5c04079740 msgr2=0x7f5c041007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:51.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.676+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 shutdown_connections 2024-09-21T02:32:51.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:51.676+0000 7f5c09800640 1 -- 172.21.15.79:0/3019269809 wait complete. 2024-09-21T02:32:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:51 smithi079 ceph-mon[30788]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:32:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:51 smithi079 ceph-mon[30788]: pgmap v323: 129 pgs: 18 creating+peering, 14 unknown, 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-21T02:32:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:51 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3019269809' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:32:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:51 smithi148 ceph-mon[34626]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:32:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:51 smithi148 ceph-mon[34626]: pgmap v323: 129 pgs: 18 creating+peering, 14 unknown, 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-21T02:32:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:51 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3019269809' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:32:52.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:51 smithi098 ceph-mon[34832]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:32:52.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:51 smithi098 ceph-mon[34832]: pgmap v323: 129 pgs: 18 creating+peering, 14 unknown, 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-21T02:32:52.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:51 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3019269809' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:32:52.580 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T02:32:52.948 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:52.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:52 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3019269809' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:32:52.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:52 smithi079 ceph-mon[30788]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T02:32:53.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:52 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3019269809' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:32:53.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:52 smithi148 ceph-mon[34626]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T02:32:53.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:52 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3019269809' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:32:53.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:52 smithi098 ceph-mon[34832]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T02:32:53.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 -- 172.21.15.79:0/2122720963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 msgr2=0x7fda1c116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 --2- 172.21.15.79:0/2122720963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c116b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda14009ca0 tx=0x7fda1402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 -- 172.21.15.79:0/2122720963 shutdown_connections 2024-09-21T02:32:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 --2- 172.21.15.79:0/2122720963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c116b60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 --2- 172.21.15.79:0/2122720963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda1c078290 0x7fda1c114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 --2- 172.21.15.79:0/2122720963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda1c077940 0x7fda1c077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 -- 172.21.15.79:0/2122720963 >> 172.21.15.79:0/2122720963 conn(0x7fda1c101810 msgr2=0x7fda1c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 -- 172.21.15.79:0/2122720963 shutdown_connections 2024-09-21T02:32:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.579+0000 7fda23800640 1 -- 172.21.15.79:0/2122720963 wait complete. 2024-09-21T02:32:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.580+0000 7fda23800640 1 Processor -- start 2024-09-21T02:32:53.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.580+0000 7fda23800640 1 -- start start 2024-09-21T02:32:53.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.580+0000 7fda23800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda1c077940 0x7fda1c1a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda23800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda1c078290 0x7fda1c1a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda23800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c1a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda23800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c11a120 con 0x7fda1c114740 2024-09-21T02:32:53.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda23800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c119fa0 con 0x7fda1c078290 2024-09-21T02:32:53.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda23800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c11a2a0 con 0x7fda1c077940 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c1a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c1a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36542/0 (socket says 172.21.15.79:36542) 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 -- 172.21.15.79:0/3482602128 learned_addr learned my addr 172.21.15.79:0/3482602128 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda1be00640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda1c078290 0x7fda1c1a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda20e00640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda1c077940 0x7fda1c1a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 -- 172.21.15.79:0/3482602128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda1c077940 msgr2=0x7fda1c1a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda1c077940 0x7fda1c1a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 -- 172.21.15.79:0/3482602128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda1c078290 msgr2=0x7fda1c1a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda1c078290 0x7fda1c1a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.581+0000 7fda21800640 1 -- 172.21.15.79:0/3482602128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c1a69c0 con 0x7fda1c114740 2024-09-21T02:32:53.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.582+0000 7fda21800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c1a6290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda14009430 tx=0x7fda140319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:53.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.582+0000 7fda19600640 1 -- 172.21.15.79:0/3482602128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14003c30 con 0x7fda1c114740 2024-09-21T02:32:53.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.582+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1c1a6c50 con 0x7fda1c114740 2024-09-21T02:32:53.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.582+0000 7fda19600640 1 -- 172.21.15.79:0/3482602128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda14003dd0 con 0x7fda1c114740 2024-09-21T02:32:53.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.582+0000 7fda19600640 1 -- 172.21.15.79:0/3482602128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1402faa0 con 0x7fda1c114740 2024-09-21T02:32:53.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.582+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c1ad410 con 0x7fda1c114740 2024-09-21T02:32:53.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.583+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1c077d50 con 0x7fda1c114740 2024-09-21T02:32:53.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.586+0000 7fda19600640 1 -- 172.21.15.79:0/3482602128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fda1402fc40 con 0x7fda1c114740 2024-09-21T02:32:53.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.587+0000 7fda19600640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fda000b6510 0x7fda000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.588+0000 7fda19600640 1 -- 172.21.15.79:0/3482602128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7fda141089a0 con 0x7fda1c114740 2024-09-21T02:32:53.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.588+0000 7fda20e00640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fda000b6510 0x7fda000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.588+0000 7fda20e00640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fda000b6510 0x7fda000b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda0c005d00 tx=0x7fda0c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:53.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.590+0000 7fda19600640 1 -- 172.21.15.79:0/3482602128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda140cf010 con 0x7fda1c114740 2024-09-21T02:32:53.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:53.819+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fda1c1a1b80 con 0x7fda1c114740 2024-09-21T02:32:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:53 smithi079 ceph-mon[30788]: pgmap v325: 129 pgs: 18 creating+peering, 1 unknown, 110 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:54.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:53 smithi148 ceph-mon[34626]: pgmap v325: 129 pgs: 18 creating+peering, 1 unknown, 110 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:53 smithi098 ceph-mon[34832]: pgmap v325: 129 pgs: 18 creating+peering, 1 unknown, 110 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:54.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.694+0000 7fda19600640 1 -- 172.21.15.79:0/3482602128 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fda1c1a1b80 con 0x7fda1c114740 2024-09-21T02:32:54.696 INFO:teuthology.orchestra.run.smithi079.stderr:added data pool 4 to fsmap 2024-09-21T02:32:54.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fda000b6510 msgr2=0x7fda000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:54.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fda000b6510 0x7fda000b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda0c005d00 tx=0x7fda0c00b410 comp rx=0 tx=0).stop 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 msgr2=0x7fda1c1a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c1a6290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda14009430 tx=0x7fda140319f0 comp rx=0 tx=0).stop 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 shutdown_connections 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fda000b6510 0x7fda000b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda1c114740 0x7fda1c1a6290 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda1c078290 0x7fda1c1a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 --2- 172.21.15.79:0/3482602128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda1c077940 0x7fda1c1a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 >> 172.21.15.79:0/3482602128 conn(0x7fda1c101810 msgr2=0x7fda1c116720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 shutdown_connections 2024-09-21T02:32:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:54.697+0000 7fda23800640 1 -- 172.21.15.79:0/3482602128 wait complete. 2024-09-21T02:32:54.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:54 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3482602128' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:32:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:54 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3482602128' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:32:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:54 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3482602128' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:32:55.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:32:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:55 smithi079 ceph-mon[30788]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T02:32:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:55 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3482602128' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:32:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:55 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:55 smithi079 ceph-mon[30788]: pgmap v327: 129 pgs: 14 creating+peering, 115 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:55.989 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:56.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:55 smithi148 ceph-mon[34626]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T02:32:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:55 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3482602128' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:32:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:55 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:55 smithi148 ceph-mon[34626]: pgmap v327: 129 pgs: 14 creating+peering, 115 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:55 smithi098 ceph-mon[34832]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T02:32:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:55 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3482602128' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:32:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:55 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:32:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:55 smithi098 ceph-mon[34832]: pgmap v327: 129 pgs: 14 creating+peering, 115 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.645+0000 7fb389c00640 1 -- 172.21.15.79:0/3751403580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 msgr2=0x7fb384112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.645+0000 7fb389c00640 1 --2- 172.21.15.79:0/3751403580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb384112870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009ca0 tx=0x7fb37c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.646+0000 7fb389c00640 1 -- 172.21.15.79:0/3751403580 shutdown_connections 2024-09-21T02:32:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.646+0000 7fb389c00640 1 --2- 172.21.15.79:0/3751403580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb384112870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.646+0000 7fb389c00640 1 --2- 172.21.15.79:0/3751403580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb38410b6f0 0x7fb38410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.646+0000 7fb389c00640 1 --2- 172.21.15.79:0/3751403580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb384105db0 0x7fb3841061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.646+0000 7fb389c00640 1 -- 172.21.15.79:0/3751403580 >> 172.21.15.79:0/3751403580 conn(0x7fb3841017e0 msgr2=0x7fb384103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.646+0000 7fb389c00640 1 -- 172.21.15.79:0/3751403580 shutdown_connections 2024-09-21T02:32:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.646+0000 7fb389c00640 1 -- 172.21.15.79:0/3751403580 wait complete. 2024-09-21T02:32:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 Processor -- start 2024-09-21T02:32:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 -- start start 2024-09-21T02:32:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb384105db0 0x7fb38419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb38410b6f0 0x7fb38419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb3841a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb384115d50 con 0x7fb38410c040 2024-09-21T02:32:56.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb384115bd0 con 0x7fb38410b6f0 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.647+0000 7fb389c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb384115ed0 con 0x7fb384105db0 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb383400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb3841a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb382a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb384105db0 0x7fb38419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb383400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb3841a1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59936/0 (socket says 172.21.15.79:59936) 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb383400640 1 -- 172.21.15.79:0/2611059178 learned_addr learned my addr 172.21.15.79:0/2611059178 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb37a000640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb38410b6f0 0x7fb38419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb382a00640 1 -- 172.21.15.79:0/2611059178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb38410b6f0 msgr2=0x7fb38419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb382a00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb38410b6f0 0x7fb38419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb382a00640 1 -- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 msgr2=0x7fb3841a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb382a00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb3841a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb382a00640 1 -- 172.21.15.79:0/2611059178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3841a2690 con 0x7fb384105db0 2024-09-21T02:32:56.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb383400640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb3841a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:56.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.648+0000 7fb382a00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb384105db0 0x7fb38419c720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb37400d6d0 tx=0x7fb37400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:56.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.649+0000 7fb37be00640 1 -- 172.21.15.79:0/2611059178 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374017070 con 0x7fb384105db0 2024-09-21T02:32:56.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.649+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3841a2980 con 0x7fb384105db0 2024-09-21T02:32:56.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.649+0000 7fb37be00640 1 -- 172.21.15.79:0/2611059178 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb374009820 con 0x7fb384105db0 2024-09-21T02:32:56.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.649+0000 7fb37be00640 1 -- 172.21.15.79:0/2611059178 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374004c40 con 0x7fb384105db0 2024-09-21T02:32:56.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.649+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3841a90e0 con 0x7fb384105db0 2024-09-21T02:32:56.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.650+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3841061c0 con 0x7fb384105db0 2024-09-21T02:32:56.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.653+0000 7fb37be00640 1 -- 172.21.15.79:0/2611059178 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb374005220 con 0x7fb384105db0 2024-09-21T02:32:56.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.654+0000 7fb37be00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3680b6510 0x7fb3680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.654+0000 7fb37be00640 1 -- 172.21.15.79:0/2611059178 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fb3740e73e0 con 0x7fb384105db0 2024-09-21T02:32:56.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.654+0000 7fb37a000640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3680b6510 0x7fb3680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.655+0000 7fb37a000640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3680b6510 0x7fb3680b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb384105030 tx=0x7fb36c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:56.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.656+0000 7fb37be00640 1 -- 172.21.15.79:0/2611059178 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3740b1db0 con 0x7fb384105db0 2024-09-21T02:32:56.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.881+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb38402e640 con 0x7fb384105db0 2024-09-21T02:32:56.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.882+0000 7fb37be00640 1 -- 172.21.15.79:0/2611059178 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11833 (secure 0 0 0) 0x7fb3740b6cf0 con 0x7fb384105db0 2024-09-21T02:32:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:56.885 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"btime":"2024-09-21T02:32:54:683536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:32:53.821088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:32:56.885 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2024-09-21T02:32:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.885+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3680b6510 msgr2=0x7fb3680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.885+0000 7fb389c00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3680b6510 0x7fb3680b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb384105030 tx=0x7fb36c00b390 comp rx=0 tx=0).stop 2024-09-21T02:32:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.885+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb384105db0 msgr2=0x7fb38419c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.885+0000 7fb389c00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb384105db0 0x7fb38419c720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb37400d6d0 tx=0x7fb37400db90 comp rx=0 tx=0).stop 2024-09-21T02:32:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 shutdown_connections 2024-09-21T02:32:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3680b6510 0x7fb3680b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb38410c040 0x7fb3841a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb38410b6f0 0x7fb38419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 --2- 172.21.15.79:0/2611059178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb384105db0 0x7fb38419c720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 >> 172.21.15.79:0/2611059178 conn(0x7fb3841017e0 msgr2=0x7fb38410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 shutdown_connections 2024-09-21T02:32:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:56.886+0000 7fb389c00640 1 -- 172.21.15.79:0/2611059178 wait complete. 2024-09-21T02:32:57.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:56 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2611059178' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:57.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:56 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2611059178' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:56 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2611059178' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:32:57.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:32:58.202 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:58.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:57 smithi079 ceph-mon[30788]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:58.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:57 smithi148 ceph-mon[34626]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:58.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:57 smithi098 ceph-mon[34832]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:32:58.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 -- 172.21.15.79:0/1741720595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532410c010 msgr2=0x7f5324112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 --2- 172.21.15.79:0/1741720595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532410c010 0x7f5324112840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f531c009ca0 tx=0x7f531c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 -- 172.21.15.79:0/1741720595 shutdown_connections 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 --2- 172.21.15.79:0/1741720595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532410c010 0x7f5324112840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 --2- 172.21.15.79:0/1741720595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532410b6c0 0x7f532410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 --2- 172.21.15.79:0/1741720595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5324105d80 0x7f5324106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 -- 172.21.15.79:0/1741720595 >> 172.21.15.79:0/1741720595 conn(0x7f5324101810 msgr2=0x7f5324103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 -- 172.21.15.79:0/1741720595 shutdown_connections 2024-09-21T02:32:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.865+0000 7f5328c00640 1 -- 172.21.15.79:0/1741720595 wait complete. 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.866+0000 7f5328c00640 1 Processor -- start 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.866+0000 7f5328c00640 1 -- start start 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5328c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324105d80 0x7f532419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5328c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532410b6c0 0x7f532419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5328c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532410c010 0x7f53241a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5328c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5324115cd0 con 0x7f5324105d80 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5328c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5324115b50 con 0x7f532410b6c0 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5328c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5324115e50 con 0x7f532410c010 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5321e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324105d80 0x7f532419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5321e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324105d80 0x7f532419c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59960/0 (socket says 172.21.15.79:59960) 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5321e00640 1 -- 172.21.15.79:0/1723670799 learned_addr learned my addr 172.21.15.79:0/1723670799 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5319400640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532410b6c0 0x7f532419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.867+0000 7f5322800640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532410c010 0x7f53241a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5321e00640 1 -- 172.21.15.79:0/1723670799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532410c010 msgr2=0x7f53241a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5321e00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532410c010 0x7f53241a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5321e00640 1 -- 172.21.15.79:0/1723670799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532410b6c0 msgr2=0x7f532419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5321e00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532410b6c0 0x7f532419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5321e00640 1 -- 172.21.15.79:0/1723670799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53241a25d0 con 0x7f5324105d80 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5322800640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532410c010 0x7f53241a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:32:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5321e00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324105d80 0x7f532419c660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f531400e9f0 tx=0x7f531400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:58.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f531b400640 1 -- 172.21.15.79:0/1723670799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531400cd80 con 0x7f5324105d80 2024-09-21T02:32:58.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f531b400640 1 -- 172.21.15.79:0/1723670799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53140054d0 con 0x7f5324105d80 2024-09-21T02:32:58.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53241a28c0 con 0x7f5324105d80 2024-09-21T02:32:58.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f531b400640 1 -- 172.21.15.79:0/1723670799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5314010690 con 0x7f5324105d80 2024-09-21T02:32:58.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.868+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53241a9020 con 0x7f5324105d80 2024-09-21T02:32:58.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.869+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5324106190 con 0x7f5324105d80 2024-09-21T02:32:58.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.872+0000 7f531b400640 1 -- 172.21.15.79:0/1723670799 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5314004e30 con 0x7f5324105d80 2024-09-21T02:32:58.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.873+0000 7f531b400640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f53080b6510 0x7f53080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:58.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.873+0000 7f531b400640 1 -- 172.21.15.79:0/1723670799 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f53140e7bf0 con 0x7f5324105d80 2024-09-21T02:32:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.874+0000 7f5319400640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f53080b6510 0x7f53080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.874+0000 7f5319400640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f53080b6510 0x7f53080b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5324105060 tx=0x7f530c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:58.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:58.876+0000 7f531b400640 1 -- 172.21.15.79:0/1723670799 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5314056710 con 0x7f5324105d80 2024-09-21T02:32:59.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.071+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f532419d790 con 0x7f5324105d80 2024-09-21T02:32:59.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.072+0000 7f531b400640 1 -- 172.21.15.79:0/1723670799 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24165 (secure 0 0 0) 0x7f53140ae1e0 con 0x7f5324105d80 2024-09-21T02:32:59.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:32:59.074 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:32:53.820868+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:32:59.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f53080b6510 msgr2=0x7f53080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:59.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f53080b6510 0x7f53080b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5324105060 tx=0x7f530c00b410 comp rx=0 tx=0).stop 2024-09-21T02:32:59.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324105d80 msgr2=0x7f532419c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:59.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324105d80 0x7f532419c660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f531400e9f0 tx=0x7f531400edf0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 shutdown_connections 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f53080b6510 0x7f53080b8a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f532410c010 0x7f53241a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532410b6c0 0x7f532419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 --2- 172.21.15.79:0/1723670799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324105d80 0x7f532419c660 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 >> 172.21.15.79:0/1723670799 conn(0x7f5324101810 msgr2=0x7f5324108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 shutdown_connections 2024-09-21T02:32:59.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:32:59.075+0000 7f5328c00640 1 -- 172.21.15.79:0/1723670799 wait complete. 2024-09-21T02:32:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:32:59 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1723670799' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:32:59.462 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:32:59 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1723670799' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:32:59.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:32:59 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1723670799' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:32:59.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:33:00.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:00 smithi079 ceph-mon[30788]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:00.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:00 smithi148 ceph-mon[34626]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:00.356 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:00.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:00 smithi098 ceph-mon[34832]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 -- 172.21.15.79:0/2667990325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4075730 msgr2=0x7f07c4075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 --2- 172.21.15.79:0/2667990325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4075730 0x7f07c4075b40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009900 tx=0x7f07b402a410 comp rx=0 tx=0).stop 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 -- 172.21.15.79:0/2667990325 shutdown_connections 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 --2- 172.21.15.79:0/2667990325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c4110140 0x7f07c4112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 --2- 172.21.15.79:0/2667990325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07c4076080 0x7f07c410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 --2- 172.21.15.79:0/2667990325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4075730 0x7f07c4075b40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 -- 172.21.15.79:0/2667990325 >> 172.21.15.79:0/2667990325 conn(0x7f07c407b850 msgr2=0x7f07c407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 -- 172.21.15.79:0/2667990325 shutdown_connections 2024-09-21T02:33:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.950+0000 7f07cba00640 1 -- 172.21.15.79:0/2667990325 wait complete. 2024-09-21T02:33:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.951+0000 7f07cba00640 1 Processor -- start 2024-09-21T02:33:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.951+0000 7f07cba00640 1 -- start start 2024-09-21T02:33:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07cba00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07c4075730 0x7f07c419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07cba00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4076080 0x7f07c419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07cba00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c4110140 0x7f07c41a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07cba00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4115ca0 con 0x7f07c4076080 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07cba00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4115b20 con 0x7f07c4110140 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07cba00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4115e20 con 0x7f07c4075730 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07c3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4076080 0x7f07c419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07c3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4076080 0x7f07c419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59978/0 (socket says 172.21.15.79:59978) 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07c3e00640 1 -- 172.21.15.79:0/1815953323 learned_addr learned my addr 172.21.15.79:0/1815953323 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07c9000640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07c4075730 0x7f07c419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.952+0000 7f07c9a00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c4110140 0x7f07c41a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c9000640 1 -- 172.21.15.79:0/1815953323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c4110140 msgr2=0x7f07c41a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c9000640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c4110140 0x7f07c41a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c9000640 1 -- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4076080 msgr2=0x7f07c419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c9000640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4076080 0x7f07c419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c9000640 1 -- 172.21.15.79:0/1815953323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c41a2600 con 0x7f07c4075730 2024-09-21T02:33:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c3e00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4076080 0x7f07c419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c9000640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07c4075730 0x7f07c419c690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07b4006010 tx=0x7f07b4004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c1600640 1 -- 172.21.15.79:0/1815953323 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b403f070 con 0x7f07c4075730 2024-09-21T02:33:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c41a2890 con 0x7f07c4075730 2024-09-21T02:33:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c1600640 1 -- 172.21.15.79:0/1815953323 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b4003ca0 con 0x7f07c4075730 2024-09-21T02:33:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.953+0000 7f07c1600640 1 -- 172.21.15.79:0/1815953323 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4035070 con 0x7f07c4075730 2024-09-21T02:33:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.954+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c41a9050 con 0x7f07c4075730 2024-09-21T02:33:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.955+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c4075b40 con 0x7f07c4075730 2024-09-21T02:33:00.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.957+0000 7f07c1600640 1 -- 172.21.15.79:0/1815953323 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f07b403b460 con 0x7f07c4075730 2024-09-21T02:33:00.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.959+0000 7f07c1600640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07a80b6510 0x7f07a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:00.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.959+0000 7f07c1600640 1 -- 172.21.15.79:0/1815953323 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f07b4107cb0 con 0x7f07c4075730 2024-09-21T02:33:00.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.959+0000 7f07c3e00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07a80b6510 0x7f07a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:00.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.960+0000 7f07c3e00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07a80b6510 0x7f07a80b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07c41034f0 tx=0x7f07b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:00.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:00.961+0000 7f07c1600640 1 -- 172.21.15.79:0/1815953323 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07b40d2680 con 0x7f07c4075730 2024-09-21T02:33:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.149+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07c410b2f0 con 0x7f07c4075730 2024-09-21T02:33:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.151+0000 7f07c1600640 1 -- 172.21.15.79:0/1815953323 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24165 (secure 0 0 0) 0x7f07b40d75c0 con 0x7f07c4075730 2024-09-21T02:33:01.153 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:32:53.820868+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:33:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07a80b6510 msgr2=0x7f07a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07a80b6510 0x7f07a80b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07c41034f0 tx=0x7f07b0005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07c4075730 msgr2=0x7f07c419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07c4075730 0x7f07c419c690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07b4006010 tx=0x7f07b4004060 comp rx=0 tx=0).stop 2024-09-21T02:33:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 shutdown_connections 2024-09-21T02:33:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07a80b6510 0x7f07a80b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c4110140 0x7f07c41a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07c4076080 0x7f07c419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 --2- 172.21.15.79:0/1815953323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07c4075730 0x7f07c419c690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 >> 172.21.15.79:0/1815953323 conn(0x7f07c407b850 msgr2=0x7f07c4101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 shutdown_connections 2024-09-21T02:33:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:01.154+0000 7f07cba00640 1 -- 172.21.15.79:0/1815953323 wait complete. 2024-09-21T02:33:01.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:01 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1815953323' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:01 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1815953323' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:01.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:01 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1815953323' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:02.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:33:02.455 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:02.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:02 smithi079 ceph-mon[30788]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:02.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:02 smithi148 ceph-mon[34626]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:02.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:02 smithi098 ceph-mon[34832]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 -- 172.21.15.79:0/942984383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 msgr2=0x7f3b5c103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 --2- 172.21.15.79:0/942984383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c103dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009900 tx=0x7f3b4c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 -- 172.21.15.79:0/942984383 shutdown_connections 2024-09-21T02:33:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 --2- 172.21.15.79:0/942984383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5c109c40 0x7f3b5c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 --2- 172.21.15.79:0/942984383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b5c1092f0 0x7f3b5c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 --2- 172.21.15.79:0/942984383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c103dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 -- 172.21.15.79:0/942984383 >> 172.21.15.79:0/942984383 conn(0x7f3b5c0ff440 msgr2=0x7f3b5c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 -- 172.21.15.79:0/942984383 shutdown_connections 2024-09-21T02:33:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.131+0000 7f3b5be00640 1 -- 172.21.15.79:0/942984383 wait complete. 2024-09-21T02:33:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.132+0000 7f3b5be00640 1 Processor -- start 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5be00640 1 -- start start 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b5c1092f0 0x7f3b5c19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5c109c40 0x7f3b5c1a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5be00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c113950 con 0x7f3b5c1039b0 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5be00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1137d0 con 0x7f3b5c1092f0 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5be00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c113ad0 con 0x7f3b5c109c40 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c19c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59992/0 (socket says 172.21.15.79:59992) 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5aa00640 1 -- 172.21.15.79:0/2566216308 learned_addr learned my addr 172.21.15.79:0/2566216308 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b53e00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b5c1092f0 0x7f3b5c19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.133+0000 7f3b5b400640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5c109c40 0x7f3b5c1a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:03.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b5aa00640 1 -- 172.21.15.79:0/2566216308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5c109c40 msgr2=0x7f3b5c1a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b5aa00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5c109c40 0x7f3b5c1a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b5aa00640 1 -- 172.21.15.79:0/2566216308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b5c1092f0 msgr2=0x7f3b5c19cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b5aa00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b5c1092f0 0x7f3b5c19cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b5aa00640 1 -- 172.21.15.79:0/2566216308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c1a2490 con 0x7f3b5c1039b0 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b5aa00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c19c520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005ab0 tx=0x7f3b4c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b53400640 1 -- 172.21.15.79:0/2566216308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c03f070 con 0x7f3b5c1039b0 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b53400640 1 -- 172.21.15.79:0/2566216308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c031d60 con 0x7f3b5c1039b0 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b53400640 1 -- 172.21.15.79:0/2566216308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c035030 con 0x7f3b5c1039b0 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.134+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c1a2720 con 0x7f3b5c1039b0 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.135+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c1a8ee0 con 0x7f3b5c1039b0 2024-09-21T02:33:03.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.136+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c103dc0 con 0x7f3b5c1039b0 2024-09-21T02:33:03.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.138+0000 7f3b53400640 1 -- 172.21.15.79:0/2566216308 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f3b4c042070 con 0x7f3b5c1039b0 2024-09-21T02:33:03.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.140+0000 7f3b53400640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b400b6590 0x7f3b400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:03.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.140+0000 7f3b53400640 1 -- 172.21.15.79:0/2566216308 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f3b4c107e90 con 0x7f3b5c1039b0 2024-09-21T02:33:03.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.140+0000 7f3b53e00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b400b6590 0x7f3b400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:03.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.141+0000 7f3b53e00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b400b6590 0x7f3b400b8aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c109ad0 tx=0x7f3b4400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:03.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.145+0000 7f3b53400640 1 -- 172.21.15.79:0/2566216308 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b4c0ce480 con 0x7f3b5c1039b0 2024-09-21T02:33:03.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.369+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b5c1a9110 con 0x7f3b5c1039b0 2024-09-21T02:33:03.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.370+0000 7f3b53400640 1 -- 172.21.15.79:0/2566216308 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11833 (secure 0 0 0) 0x7f3b4c0d2860 con 0x7f3b5c1039b0 2024-09-21T02:33:03.372 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:03.372 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"btime":"2024-09-21T02:32:54:683536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:32:53.821088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:33:03.372 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b400b6590 msgr2=0x7f3b400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b400b6590 0x7f3b400b8aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c109ad0 tx=0x7f3b4400b390 comp rx=0 tx=0).stop 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 msgr2=0x7f3b5c19c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c19c520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005ab0 tx=0x7f3b4c003cd0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 shutdown_connections 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b400b6590 0x7f3b400b8aa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5c109c40 0x7f3b5c1a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b5c1092f0 0x7f3b5c19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 --2- 172.21.15.79:0/2566216308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b5c1039b0 0x7f3b5c19c520 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.373+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 >> 172.21.15.79:0/2566216308 conn(0x7f3b5c0ff440 msgr2=0x7f3b5c108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.374+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 shutdown_connections 2024-09-21T02:33:03.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:03.374+0000 7f3b5be00640 1 -- 172.21.15.79:0/2566216308 wait complete. 2024-09-21T02:33:03.716 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:03 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2566216308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:33:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:03 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2566216308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:33:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:03 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2566216308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:33:04.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:33:04.600 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:04.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:04 smithi079 ceph-mon[30788]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:04.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:04 smithi148 ceph-mon[34626]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:04.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:04 smithi098 ceph-mon[34832]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 -- 172.21.15.79:0/2641219699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec3810c010 msgr2=0x7fec38112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 --2- 172.21.15.79:0/2641219699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec3810c010 0x7fec38112840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec30009ca0 tx=0x7fec3002a8b0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 -- 172.21.15.79:0/2641219699 shutdown_connections 2024-09-21T02:33:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 --2- 172.21.15.79:0/2641219699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec3810c010 0x7fec38112840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 --2- 172.21.15.79:0/2641219699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec3810b6c0 0x7fec3810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 --2- 172.21.15.79:0/2641219699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec38105d80 0x7fec38106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 -- 172.21.15.79:0/2641219699 >> 172.21.15.79:0/2641219699 conn(0x7fec381017f0 msgr2=0x7fec38103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:05.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 -- 172.21.15.79:0/2641219699 shutdown_connections 2024-09-21T02:33:05.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.234+0000 7fec3d200640 1 -- 172.21.15.79:0/2641219699 wait complete. 2024-09-21T02:33:05.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.235+0000 7fec3d200640 1 Processor -- start 2024-09-21T02:33:05.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.235+0000 7fec3d200640 1 -- start start 2024-09-21T02:33:05.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec3d200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec38105d80 0x7fec3819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:05.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec3d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3810b6c0 0x7fec3819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:05.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec3d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec3810c010 0x7fec381a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:05.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec3d200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec38115d20 con 0x7fec38105d80 2024-09-21T02:33:05.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec3d200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec38115ba0 con 0x7fec3810b6c0 2024-09-21T02:33:05.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec3d200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec38115ea0 con 0x7fec3810c010 2024-09-21T02:33:05.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec35e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec38105d80 0x7fec3819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:05.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec35e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec38105d80 0x7fec3819c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60116/0 (socket says 172.21.15.79:60116) 2024-09-21T02:33:05.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec35e00640 1 -- 172.21.15.79:0/2302723466 learned_addr learned my addr 172.21.15.79:0/2302723466 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:05.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec35400640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3810b6c0 0x7fec3819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:05.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec36800640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec3810c010 0x7fec381a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec35e00640 1 -- 172.21.15.79:0/2302723466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec3810c010 msgr2=0x7fec381a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.236+0000 7fec35e00640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec3810c010 0x7fec381a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec35e00640 1 -- 172.21.15.79:0/2302723466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3810b6c0 msgr2=0x7fec3819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec35e00640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3810b6c0 0x7fec3819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec35e00640 1 -- 172.21.15.79:0/2302723466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec381a25c0 con 0x7fec38105d80 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec35e00640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec38105d80 0x7fec3819c650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec2800d950 tx=0x7fec2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec2ea00640 1 -- 172.21.15.79:0/2302723466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28017030 con 0x7fec38105d80 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec2ea00640 1 -- 172.21.15.79:0/2302723466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec28004020 con 0x7fec38105d80 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec381a28b0 con 0x7fec38105d80 2024-09-21T02:33:05.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec2ea00640 1 -- 172.21.15.79:0/2302723466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec280047a0 con 0x7fec38105d80 2024-09-21T02:33:05.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.237+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec381a9010 con 0x7fec38105d80 2024-09-21T02:33:05.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.238+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec38106190 con 0x7fec38105d80 2024-09-21T02:33:05.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.241+0000 7fec2ea00640 1 -- 172.21.15.79:0/2302723466 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fec28009a30 con 0x7fec38105d80 2024-09-21T02:33:05.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.242+0000 7fec2ea00640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fec1c0b6510 0x7fec1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:05.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.243+0000 7fec2ea00640 1 -- 172.21.15.79:0/2302723466 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fec280e7680 con 0x7fec38105d80 2024-09-21T02:33:05.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.243+0000 7fec35400640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fec1c0b6510 0x7fec1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:05.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.243+0000 7fec35400640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fec1c0b6510 0x7fec1c0b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec38105040 tx=0x7fec2400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:05.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.245+0000 7fec2ea00640 1 -- 172.21.15.79:0/2302723466 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec280adcd0 con 0x7fec38105d80 2024-09-21T02:33:05.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.432+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec3810d870 con 0x7fec38105d80 2024-09-21T02:33:05.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.434+0000 7fec2ea00640 1 -- 172.21.15.79:0/2302723466 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24165 (secure 0 0 0) 0x7fec280b20b0 con 0x7fec38105d80 2024-09-21T02:33:05.436 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:05.436 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:32:53.820868+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:33:05.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fec1c0b6510 msgr2=0x7fec1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fec1c0b6510 0x7fec1c0b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec38105040 tx=0x7fec2400b410 comp rx=0 tx=0).stop 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec38105d80 msgr2=0x7fec3819c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec38105d80 0x7fec3819c650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec2800d950 tx=0x7fec2800de10 comp rx=0 tx=0).stop 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 shutdown_connections 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fec1c0b6510 0x7fec1c0b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec3810c010 0x7fec381a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3810b6c0 0x7fec3819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 --2- 172.21.15.79:0/2302723466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec38105d80 0x7fec3819c650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 >> 172.21.15.79:0/2302723466 conn(0x7fec381017f0 msgr2=0x7fec3810acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 shutdown_connections 2024-09-21T02:33:05.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:05.437+0000 7fec3d200640 1 -- 172.21.15.79:0/2302723466 wait complete. 2024-09-21T02:33:05.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:05 smithi079 ceph-mon[30788]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:05.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:05 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2302723466' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:05 smithi148 ceph-mon[34626]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:05 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2302723466' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:05 smithi098 ceph-mon[34832]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:05 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2302723466' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:06.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T02:32:42.479233+0000', 'modified': '2024-09-21T02:32:53.821088+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.98:6839/413408652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 413408652}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 413408652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24704, 'qdb_cluster': [24704]} 2024-09-21T02:33:06.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T02:33:06.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:33:06.573 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:07.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.268+0000 7f336f800640 1 -- 172.21.15.79:0/1660025937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 msgr2=0x7f3368106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.268+0000 7f336f800640 1 --2- 172.21.15.79:0/1660025937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f3368106190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3358009900 tx=0x7f335802a410 comp rx=0 tx=0).stop 2024-09-21T02:33:07.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.269+0000 7f336f800640 1 -- 172.21.15.79:0/1660025937 shutdown_connections 2024-09-21T02:33:07.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.269+0000 7f336f800640 1 --2- 172.21.15.79:0/1660025937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f336810c010 0x7f3368112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.269+0000 7f336f800640 1 --2- 172.21.15.79:0/1660025937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f336810b6c0 0x7f336810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.269+0000 7f336f800640 1 --2- 172.21.15.79:0/1660025937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f3368106190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.269+0000 7f336f800640 1 -- 172.21.15.79:0/1660025937 >> 172.21.15.79:0/1660025937 conn(0x7f33681017d0 msgr2=0x7f3368103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:07.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.269+0000 7f336f800640 1 -- 172.21.15.79:0/1660025937 shutdown_connections 2024-09-21T02:33:07.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.269+0000 7f336f800640 1 -- 172.21.15.79:0/1660025937 wait complete. 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 Processor -- start 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 -- start start 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f336819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f336810b6c0 0x7f336819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f336810c010 0x7f33681a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3368115d20 con 0x7f3368105d80 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3368115ba0 con 0x7f336810b6c0 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.270+0000 7f336f800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3368115ea0 con 0x7f336810c010 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f336819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f336819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60134/0 (socket says 172.21.15.79:60134) 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 -- 172.21.15.79:0/908264699 learned_addr learned my addr 172.21.15.79:0/908264699 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336d800640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f336810c010 0x7f33681a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f335fe00640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f336810b6c0 0x7f336819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 -- 172.21.15.79:0/908264699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f336810c010 msgr2=0x7f33681a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f336810c010 0x7f33681a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 -- 172.21.15.79:0/908264699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f336810b6c0 msgr2=0x7f336819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f336810b6c0 0x7f336819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 -- 172.21.15.79:0/908264699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33681a2640 con 0x7f3368105d80 2024-09-21T02:33:07.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.271+0000 7f336ce00640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f336819c6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3358005ab0 tx=0x7f3358003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:07.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.272+0000 7f3366000640 1 -- 172.21.15.79:0/908264699 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335803f070 con 0x7f3368105d80 2024-09-21T02:33:07.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.272+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33681a28d0 con 0x7f3368105d80 2024-09-21T02:33:07.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.272+0000 7f3366000640 1 -- 172.21.15.79:0/908264699 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3358031b60 con 0x7f3368105d80 2024-09-21T02:33:07.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.272+0000 7f3366000640 1 -- 172.21.15.79:0/908264699 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358035030 con 0x7f3368105d80 2024-09-21T02:33:07.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.272+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33681a9090 con 0x7f3368105d80 2024-09-21T02:33:07.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.275+0000 7f3376462740 1 Processor -- start 2024-09-21T02:33:07.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.275+0000 7f3376462740 1 -- start start 2024-09-21T02:33:07.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f3366000640 1 -- 172.21.15.79:0/908264699 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f3358042070 con 0x7f3368105d80 2024-09-21T02:33:07.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f3376462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c43490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f3376462740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c439d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f3376462740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c43f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f3376462740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557fd4bbad50 con 0x557fd487c280 2024-09-21T02:33:07.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f3376462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557fd4baa180 con 0x557fd489cf60 2024-09-21T02:33:07.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f3376462740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557fd4badf90 con 0x557fd48740a0 2024-09-21T02:33:07.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f336d800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c43490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f336d800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c43490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:49330/0 (socket says 172.21.15.79:49330) 2024-09-21T02:33:07.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f336d800640 1 -- 172.21.15.79:0/4224816157 learned_addr learned my addr 172.21.15.79:0/4224816157 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:07.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f335fe00640 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c43f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.276+0000 7f336ce00640 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f336d800640 1 -- 172.21.15.79:0/4224816157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 msgr2=0x557fd4c439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f336d800640 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f336d800640 1 -- 172.21.15.79:0/4224816157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 msgr2=0x557fd4c43f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f336d800640 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c43f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f336d800640 1 -- 172.21.15.79:0/4224816157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd4b74a70 con 0x557fd489cf60 2024-09-21T02:33:07.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f336d800640 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c43490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3360009fd0 tx=0x7f33600118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd6dbe536a2194ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:07.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f335e000640 1 -- 172.21.15.79:0/4224816157 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360004d20 con 0x557fd489cf60 2024-09-21T02:33:07.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f335e000640 1 -- 172.21.15.79:0/4224816157 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3360004050 con 0x557fd489cf60 2024-09-21T02:33:07.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.277+0000 7f335e000640 1 -- 172.21.15.79:0/4224816157 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360005280 con 0x557fd489cf60 2024-09-21T02:33:07.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.278+0000 7f3366000640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f334c0b6510 0x7f334c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.278+0000 7f336ce00640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f334c0b6510 0x7f334c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.278+0000 7f3366000640 1 -- 172.21.15.79:0/908264699 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f3358107cc0 con 0x7f3368105d80 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.278+0000 7f3376462740 1 -- 172.21.15.79:0/4224816157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 msgr2=0x557fd4c43490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.278+0000 7f3376462740 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c43490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3360009fd0 tx=0x7f33600118d0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 -- 172.21.15.79:0/4224816157 shutdown_connections 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c43f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 --2- 172.21.15.79:0/4224816157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c43490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 -- 172.21.15.79:0/4224816157 >> 172.21.15.79:0/4224816157 conn(0x557fd4891350 msgr2=0x557fd4c41380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 -- 172.21.15.79:0/4224816157 shutdown_connections 2024-09-21T02:33:07.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 -- 172.21.15.79:0/4224816157 wait complete. 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f336ce00640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f334c0b6510 0x7f334c0b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f335802a9d0 tx=0x7f3358031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 -- start start 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.279+0000 7f3376462740 1 Processor -- start 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f3376462740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c4f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f3376462740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c4f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f3376462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c5af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f3376462740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557fd4a0b5f0 con 0x557fd487c280 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f3376462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557fd4b45460 con 0x557fd489cf60 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f3376462740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557fd4c51c70 con 0x557fd48740a0 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f3376462740 10 client.0 _ll_register_callbacks cb 0x557fd4b55210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:33:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f335fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c4f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f336d800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c5af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f335fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c4f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60152/0 (socket says 172.21.15.79:60152) 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f335fe00640 1 -- 172.21.15.79:0/3081814989 learned_addr learned my addr 172.21.15.79:0/3081814989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.280+0000 7f336d800640 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c4f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f335fe00640 1 -- 172.21.15.79:0/3081814989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 msgr2=0x557fd4c4f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f335fe00640 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c4f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f335fe00640 1 -- 172.21.15.79:0/3081814989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 msgr2=0x557fd4c5af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f335fe00640 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c5af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f335fe00640 1 -- 172.21.15.79:0/3081814989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd4908540 con 0x557fd487c280 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f335fe00640 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c4f560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3350012700 tx=0x7f3350012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af0013c5a041756 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f3356a00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f3356a00640 1 -- 172.21.15.79:0/3081814989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335000f920 con 0x557fd487c280 2024-09-21T02:33:07.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f3356a00640 1 -- 172.21.15.79:0/3081814989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f335000fac0 con 0x557fd487c280 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.281+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557fd4b47a70 con 0x557fd487c280 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3356a00640 1 -- 172.21.15.79:0/3081814989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f335000fcc0 con 0x557fd487c280 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 10 client.14790 fetch_fsmap learned FSMap version 17 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x557fd4b626f0 con 0x557fd487c280 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3356a00640 1 -- 172.21.15.79:0/3081814989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557fd4b47a70 con 0x557fd487c280 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3356a00640 1 -- 172.21.15.79:0/3081814989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f335001b3c0 con 0x557fd487c280 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 10 client.14790 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 10 client.14790 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 20 client.14790 populate_metadata read hostname 'smithi079' 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd485b8e0 0x557fd4c61600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 4 client.14790 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.282+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fd4bbcca0 con 0x557fd485b8e0 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.283+0000 7f336d800640 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd485b8e0 0x557fd4c61600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.283+0000 7f336d800640 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd485b8e0 0x557fd4c61600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8049cab6d84cc34 server_cookie=128d7879418b544e in_seq=0 out_seq=0 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.283+0000 7f3356a00640 10 client.14790 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.284+0000 7f3356a00640 1 -- 172.21.15.79:0/3081814989 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fd4bbcca0 con 0x557fd485b8e0 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.284+0000 7f3356a00640 10 client.14790 handle_command_reply: tid=0 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 client.14790 shutdown 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 msgr2=0x557fd4c4f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c4f560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3350012700 tx=0x7f3350012bc0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 shutdown_connections 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd485b8e0 0x557fd4c61600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd489cf60 0x557fd4c5af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd487c280 0x557fd4c4f560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 --2- 172.21.15.79:0/3081814989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c4f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 >> 172.21.15.79:0/3081814989 conn(0x557fd4891350 msgr2=0x557fd4c46620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3356a00640 0 client.14790 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:33:07.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 shutdown_connections 2024-09-21T02:33:07.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 1 -- 172.21.15.79:0/3081814989 wait complete. 2024-09-21T02:33:07.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.285+0000 7f3376462740 20 client.14790 trim_cache size 0 max 16384 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 Processor -- start 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 -- start start 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c49300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd489cf60 0x557fd4c4f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c4f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557fd4c5f940 con 0x557fd489cf60 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557fd4c60010 con 0x557fd4830c90 2024-09-21T02:33:07.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f3376462740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557fd4c606e0 con 0x557fd48740a0 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f335fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd489cf60 0x557fd4c4f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f335fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd489cf60 0x557fd4c4f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60160/0 (socket says 172.21.15.79:60160) 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f335fe00640 1 -- 172.21.15.79:0/3477082326 learned_addr learned my addr 172.21.15.79:0/3477082326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.304+0000 7f336d800640 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c49300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f336d800640 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c4f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335fe00640 1 -- 172.21.15.79:0/3477082326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 msgr2=0x557fd4c49300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335fe00640 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c49300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335fe00640 1 -- 172.21.15.79:0/3477082326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 msgr2=0x557fd4c4f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335fe00640 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c4f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335fe00640 1 -- 172.21.15.79:0/3477082326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd4c462f0 con 0x557fd489cf60 2024-09-21T02:33:07.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f336d800640 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c4f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:33:07.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335fe00640 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd489cf60 0x557fd4c4f000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3350012040 tx=0x7f3350005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fcaf4fbec2af6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:07.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335d600640 1 -- 172.21.15.79:0/3477082326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335001be40 con 0x557fd489cf60 2024-09-21T02:33:07.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335d600640 1 -- 172.21.15.79:0/3477082326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3350005560 con 0x557fd489cf60 2024-09-21T02:33:07.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.305+0000 7f335d600640 1 -- 172.21.15.79:0/3477082326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335001b3e0 con 0x557fd489cf60 2024-09-21T02:33:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 -- 172.21.15.79:0/3477082326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd489cf60 msgr2=0x557fd4c4f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd489cf60 0x557fd4c4f000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3350012040 tx=0x7f3350005870 comp rx=0 tx=0).stop 2024-09-21T02:33:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 -- 172.21.15.79:0/3477082326 shutdown_connections 2024-09-21T02:33:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c4f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd489cf60 0x557fd4c4f000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 --2- 172.21.15.79:0/3477082326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd48740a0 0x557fd4c49300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 -- 172.21.15.79:0/3477082326 >> 172.21.15.79:0/3477082326 conn(0x557fd4891350 msgr2=0x557fd4c5efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 -- 172.21.15.79:0/3477082326 shutdown_connections 2024-09-21T02:33:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.306+0000 7f3376462740 1 -- 172.21.15.79:0/3477082326 wait complete. 2024-09-21T02:33:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 -- start start 2024-09-21T02:33:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 Processor -- start 2024-09-21T02:33:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c69e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd48740a0 0x557fd4c63340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd489cf60 0x557fd4c63880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557fd4c61480 con 0x557fd48740a0 2024-09-21T02:33:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557fd4c60db0 con 0x557fd4830c90 2024-09-21T02:33:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.307+0000 7f3376462740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557fd4c61b50 con 0x557fd489cf60 2024-09-21T02:33:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f3376462740 10 client.0 _ll_register_callbacks cb 0x7f3350009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:33:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd48740a0 0x557fd4c63340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd48740a0 0x557fd4c63340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60172/0 (socket says 172.21.15.79:60172) 2024-09-21T02:33:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 -- 172.21.15.79:0/4084096713 learned_addr learned my addr 172.21.15.79:0/4084096713 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f336d800640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c69e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f336d800640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd489cf60 0x557fd4c63880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 -- 172.21.15.79:0/4084096713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd489cf60 msgr2=0x557fd4c63880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd489cf60 0x557fd4c63880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 -- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 msgr2=0x557fd4c69e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:33:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c69e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f335fe00640 1 -- 172.21.15.79:0/4084096713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd4c45a50 con 0x557fd48740a0 2024-09-21T02:33:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.308+0000 7f336d800640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd489cf60 0x557fd4c63880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:33:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f335fe00640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd48740a0 0x557fd4c63340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f33500092e0 tx=0x7f335001b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc60c578790fbaf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3356a00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:33:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3356a00640 1 -- 172.21.15.79:0/4084096713 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33500052d0 con 0x557fd48740a0 2024-09-21T02:33:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3356a00640 1 -- 172.21.15.79:0/4084096713 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f335001bb10 con 0x557fd48740a0 2024-09-21T02:33:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3350005560 con 0x557fd48740a0 2024-09-21T02:33:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3356a00640 1 -- 172.21.15.79:0/4084096713 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f335001bd90 con 0x557fd48740a0 2024-09-21T02:33:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3376462740 10 client.14796 fetch_fsmap learned FSMap version 17 2024-09-21T02:33:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x557fd4c69600 con 0x557fd48740a0 2024-09-21T02:33:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.309+0000 7f3356a00640 1 -- 172.21.15.79:0/4084096713 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3350005560 con 0x557fd48740a0 2024-09-21T02:33:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f3356a00640 1 -- 172.21.15.79:0/4084096713 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f335002a070 con 0x557fd48740a0 2024-09-21T02:33:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f3376462740 10 client.14796 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T02:33:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f3376462740 10 client.14796 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:33:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f3376462740 20 client.14796 populate_metadata read hostname 'smithi079' 2024-09-21T02:33:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f3376462740 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd4cce840 0x557fd4ccfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f3376462740 4 client.14796 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:33:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "status"}) -- 0x557fd4bb8750 con 0x557fd4cce840 2024-09-21T02:33:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.310+0000 7f336d800640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd4cce840 0x557fd4ccfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f336d800640 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd4cce840 0x557fd4ccfcb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abfc935376690e3e server_cookie=b417d10fbee0648c in_seq=0 out_seq=0 2024-09-21T02:33:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3356a00640 10 client.14796 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:33:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3356a00640 1 -- 172.21.15.79:0/4084096713 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557fd4bb8750 con 0x557fd4cce840 2024-09-21T02:33:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3356a00640 10 client.14796 handle_command_reply: tid=0 2024-09-21T02:33:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 client.14796 shutdown 2024-09-21T02:33:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd48740a0 msgr2=0x557fd4c63340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd48740a0 0x557fd4c63340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f33500092e0 tx=0x7f335001b610 comp rx=0 tx=0).stop 2024-09-21T02:33:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 shutdown_connections 2024-09-21T02:33:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557fd4cce840 0x557fd4ccfcb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557fd489cf60 0x557fd4c63880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557fd48740a0 0x557fd4c63340 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 --2- 172.21.15.79:0/4084096713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557fd4830c90 0x557fd4c69e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 >> 172.21.15.79:0/4084096713 conn(0x557fd4891350 msgr2=0x557fd4c49fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3356a00640 0 client.14796 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:33:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 shutdown_connections 2024-09-21T02:33:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 1 -- 172.21.15.79:0/4084096713 wait complete. 2024-09-21T02:33:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.311+0000 7f3376462740 20 client.14796 trim_cache size 0 max 16384 2024-09-21T02:33:07.324 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:33:07.324 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "56d10306-77c0-11ef-baf5-efdc52797490", 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24704, 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 23.842683055999998, 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 17, 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 84, 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 37.814305502000003 2024-09-21T02:33:07.325 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:33:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f334c0b6510 msgr2=0x7f334c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f334c0b6510 0x7f334c0b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f335802a9d0 tx=0x7f3358031400 comp rx=0 tx=0).stop 2024-09-21T02:33:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 msgr2=0x7f336819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f336819c6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3358005ab0 tx=0x7f3358003c10 comp rx=0 tx=0).stop 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 shutdown_connections 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f334c0b6510 0x7f334c0b8a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f336810c010 0x7f33681a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f336810b6c0 0x7f336819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 --2- 172.21.15.79:0/908264699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3368105d80 0x7f336819c6d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 >> 172.21.15.79:0/908264699 conn(0x7f33681017d0 msgr2=0x7f3368103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 shutdown_connections 2024-09-21T02:33:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:07.312+0000 7f336f800640 1 -- 172.21.15.79:0/908264699 wait complete. 2024-09-21T02:33:07.782 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:07 smithi079 ceph-mon[30788]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:07.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:07 smithi148 ceph-mon[34626]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:07 smithi098 ceph-mon[34832]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:08.121 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T02:33:08.121 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:08.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T02:33:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:09.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 -- 172.21.15.79:0/3960281324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac078290 msgr2=0x7fc1ac114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 --2- 172.21.15.79:0/3960281324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac078290 0x7fc1ac114210 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc194009900 tx=0x7fc19402a410 comp rx=0 tx=0).stop 2024-09-21T02:33:09.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 -- 172.21.15.79:0/3960281324 shutdown_connections 2024-09-21T02:33:09.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 --2- 172.21.15.79:0/3960281324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac114750 0x7fc1ac116b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 --2- 172.21.15.79:0/3960281324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac078290 0x7fc1ac114210 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 --2- 172.21.15.79:0/3960281324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1ac077940 0x7fc1ac077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 -- 172.21.15.79:0/3960281324 >> 172.21.15.79:0/3960281324 conn(0x7fc1ac1017c0 msgr2=0x7fc1ac103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:09.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 -- 172.21.15.79:0/3960281324 shutdown_connections 2024-09-21T02:33:09.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.153+0000 7fc1b1600640 1 -- 172.21.15.79:0/3960281324 wait complete. 2024-09-21T02:33:09.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.154+0000 7fc1b1600640 1 Processor -- start 2024-09-21T02:33:09.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.154+0000 7fc1b1600640 1 -- start start 2024-09-21T02:33:09.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.154+0000 7fc1b1600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac077940 0x7fc1ac1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1b1600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac078290 0x7fc1ac1a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1b1600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1ac114750 0x7fc1ac1a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1b1600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ac11a0f0 con 0x7fc1ac077940 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1b1600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ac119f70 con 0x7fc1ac114750 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1b1600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ac11a270 con 0x7fc1ac078290 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac077940 0x7fc1ac1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac077940 0x7fc1ac1a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60192/0 (socket says 172.21.15.79:60192) 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 -- 172.21.15.79:0/484296794 learned_addr learned my addr 172.21.15.79:0/484296794 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1a2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac078290 0x7fc1ac1a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1ab400640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1ac114750 0x7fc1ac1a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 -- 172.21.15.79:0/484296794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac078290 msgr2=0x7fc1ac1a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac078290 0x7fc1ac1a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 -- 172.21.15.79:0/484296794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1ac114750 msgr2=0x7fc1ac1a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1ac114750 0x7fc1ac1a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1aaa00640 1 -- 172.21.15.79:0/484296794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ac1a6a30 con 0x7fc1ac077940 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.155+0000 7fc1ab400640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1ac114750 0x7fc1ac1a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.156+0000 7fc1aaa00640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac077940 0x7fc1ac1a0ac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00e9f0 tx=0x7fc19c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.156+0000 7fc1a3e00640 1 -- 172.21.15.79:0/484296794 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00cd80 con 0x7fc1ac077940 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.156+0000 7fc1a3e00640 1 -- 172.21.15.79:0/484296794 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc19c0108e0 con 0x7fc1ac077940 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.156+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ac1a6d20 con 0x7fc1ac077940 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.156+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ac1ad480 con 0x7fc1ac077940 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.156+0000 7fc1a3e00640 1 -- 172.21.15.79:0/484296794 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c018980 con 0x7fc1ac077940 2024-09-21T02:33:09.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.157+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ac077d50 con 0x7fc1ac077940 2024-09-21T02:33:09.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.160+0000 7fc1a3e00640 1 -- 172.21.15.79:0/484296794 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc19c010430 con 0x7fc1ac077940 2024-09-21T02:33:09.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.161+0000 7fc1a3e00640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc1900b6510 0x7fc1900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.161+0000 7fc1a3e00640 1 -- 172.21.15.79:0/484296794 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fc19c0e7d40 con 0x7fc1ac077940 2024-09-21T02:33:09.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.161+0000 7fc1a2000640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc1900b6510 0x7fc1900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.162+0000 7fc1a2000640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc1900b6510 0x7fc1900b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc19402aa00 tx=0x7fc194005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:09.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.163+0000 7fc1a3e00640 1 -- 172.21.15.79:0/484296794 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc19c0b2710 con 0x7fc1ac077940 2024-09-21T02:33:09.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.389+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc1ac02e640 con 0x7fc1ac077940 2024-09-21T02:33:09.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.389+0000 7fc1a3e00640 1 -- 172.21.15.79:0/484296794 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fc19c0b7650 con 0x7fc1ac077940 2024-09-21T02:33:09.390 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T02:33:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc1900b6510 msgr2=0x7fc1900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc1900b6510 0x7fc1900b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc19402aa00 tx=0x7fc194005a20 comp rx=0 tx=0).stop 2024-09-21T02:33:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac077940 msgr2=0x7fc1ac1a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac077940 0x7fc1ac1a0ac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00e9f0 tx=0x7fc19c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 shutdown_connections 2024-09-21T02:33:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc1900b6510 0x7fc1900b8a20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1ac114750 0x7fc1ac1a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1ac078290 0x7fc1ac1a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 --2- 172.21.15.79:0/484296794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1ac077940 0x7fc1ac1a0ac0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 >> 172.21.15.79:0/484296794 conn(0x7fc1ac1017c0 msgr2=0x7fc1ac116720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 shutdown_connections 2024-09-21T02:33:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:09.392+0000 7fc1b1600640 1 -- 172.21.15.79:0/484296794 wait complete. 2024-09-21T02:33:09.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:09 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/484296794' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:33:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:09 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/484296794' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:33:09.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:09 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/484296794' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T02:33:10.157 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T02:33:10.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:10.158 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-09-21T02:33:10.194 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42161sec preferred_lft 42161sec 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link noprefixroute 2024-09-21T02:33:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:33:10.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T02:33:10.196 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:33:10.196 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:33:10.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-09-21T02:33:10.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-09-21T02:33:10.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-09-21T02:33:10.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T02:33:10.196 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:33:10.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:33:10.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:33:10.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:10.618 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T02:33:10.676 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-09-21T02:33:10.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:10.680 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-09-21T02:33:10.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:10 smithi079 ceph-mon[30788]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-09-21T02:33:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T02:33:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T02:33:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T02:33:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T02:33:10.731 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:33:10.731 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:33:10.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T02:33:10.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T02:33:10.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T02:33:10.731 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:33:10.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:33:10.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:10 smithi148 ceph-mon[34626]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:10 smithi098 ceph-mon[34832]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:33:11.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:11.355 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-09-21T02:33:11.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:11.391 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-09-21T02:33:11.467 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:33:11.467 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:33:11.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:33:11.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T02:33:11.468 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:33:11.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:33:11.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:33:11.647 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T02:33:11.647 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:33:11.648 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:33:11.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T02:33:11.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T02:33:11.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T02:33:11.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T02:33:11.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T02:33:11.648 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:33:11.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:33:11.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:33:11.888 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:33:11.888 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:33:11.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-09-21T02:33:11.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T02:33:11.888 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:33:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:33:12.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:33:12.056 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T02:33:12.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:33:12.056 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:12.091 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T02:33:12.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:33:12.092 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:12.169 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-09-21T02:33:12.266 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-09-21T02:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-09-21T02:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-09-21T02:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-09-21T02:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-09-21T02:33:12.302 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-09-21T02:33:12.303 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/a9a5d80dac348821593664f5bb18d6c70c5cbed43439480b0264c36517fc2c64/merged 2024-09-21T02:33:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/ed557e73feb180f9b509fa82a4daf4f1e53eb5638815c9bf1bd50e555d757dc9/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/0 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/6d15c1f298327d111fcbae1663f3dd3a53df00eac3181928e5f8e55421d7ed7b/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/99de055f8139f106f9bd731a64d598409d60c4c48add59087e4484d128b492a0/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/47539596da83f2fc59c60cbeb187a81b05be89d7a1851e02c03ddf9ba1b7b648/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/b5dd4bb60cc70b0e0525b2043f381ee08d9cf7271ee4d19d3d780e1a6ae43ed8/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/f285ce00266c7c9a68cff9738533451f8a925f985a235cacce7e5c3e56552dc8/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/e37ba26ecfcb7915abd1e63455e0064cfaafb0d1fddde9bff32e947a162962f8/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/c6f3d197e779efbcde3bd293cbaa8ba7cfe50295a6783669188210ef5108bd05/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/3af62c2cc458e5d1e3684c5886f1403f7f969e5b225a8c5c0dabbf73d1919074/merged 2024-09-21T02:33:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-09-21T02:33:12.306 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:33:12.306 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:33:12.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:12.307 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-09-21T02:33:12.383 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T02:33:12.383 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T02:33:12.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-09-21T02:33:12.484 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:33:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-09-21T02:33:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-09-21T02:33:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-09-21T02:33:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-09-21T02:33:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-09-21T02:33:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-09-21T02:33:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-09-21T02:33:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/a9a5d80dac348821593664f5bb18d6c70c5cbed43439480b0264c36517fc2c64/merged 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/ed557e73feb180f9b509fa82a4daf4f1e53eb5638815c9bf1bd50e555d757dc9/merged 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/0 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:33:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/6d15c1f298327d111fcbae1663f3dd3a53df00eac3181928e5f8e55421d7ed7b/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/99de055f8139f106f9bd731a64d598409d60c4c48add59087e4484d128b492a0/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/47539596da83f2fc59c60cbeb187a81b05be89d7a1851e02c03ddf9ba1b7b648/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/b5dd4bb60cc70b0e0525b2043f381ee08d9cf7271ee4d19d3d780e1a6ae43ed8/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/f285ce00266c7c9a68cff9738533451f8a925f985a235cacce7e5c3e56552dc8/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/e37ba26ecfcb7915abd1e63455e0064cfaafb0d1fddde9bff32e947a162962f8/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/c6f3d197e779efbcde3bd293cbaa8ba7cfe50295a6783669188210ef5108bd05/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/3af62c2cc458e5d1e3684c5886f1403f7f969e5b225a8c5c0dabbf73d1919074/merged 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:33:12.524 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:33:12.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:12.525 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-09-21T02:33:12.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:2024-09-21T02:33:12.671+0000 7f5a20d04480 -1 init, newargv = 0x7f5a04004df0 newargc=15 2024-09-21T02:33:12.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[75032]: starting ceph client 2024-09-21T02:33:12.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[75032]: starting fuse 2024-09-21T02:33:12.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:12 smithi079 ceph-mon[30788]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:12.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:12 smithi148 ceph-mon[34626]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:12 smithi098 ceph-mon[34832]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:13.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-09-21T02:33:13.762 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:33:13.798 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-09-21T02:33:13.799 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:33:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/a9a5d80dac348821593664f5bb18d6c70c5cbed43439480b0264c36517fc2c64/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/ed557e73feb180f9b509fa82a4daf4f1e53eb5638815c9bf1bd50e555d757dc9/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/0 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/6d15c1f298327d111fcbae1663f3dd3a53df00eac3181928e5f8e55421d7ed7b/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/99de055f8139f106f9bd731a64d598409d60c4c48add59087e4484d128b492a0/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/47539596da83f2fc59c60cbeb187a81b05be89d7a1851e02c03ddf9ba1b7b648/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/b5dd4bb60cc70b0e0525b2043f381ee08d9cf7271ee4d19d3d780e1a6ae43ed8/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/f285ce00266c7c9a68cff9738533451f8a925f985a235cacce7e5c3e56552dc8/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/e37ba26ecfcb7915abd1e63455e0064cfaafb0d1fddde9bff32e947a162962f8/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/c6f3d197e779efbcde3bd293cbaa8ba7cfe50295a6783669188210ef5108bd05/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/3af62c2cc458e5d1e3684c5886f1403f7f969e5b225a8c5c0dabbf73d1919074/merged 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:33:13.801 INFO:teuthology.orchestra.run.smithi079.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:13.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:13.802 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-09-21T02:33:13.878 INFO:teuthology.orchestra.run.smithi079.stdout:120 2024-09-21T02:33:13.878 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-09-21T02:33:13.879 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.admin")) 2024-09-21T02:33:13.880 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-09-21T02:33:14.041 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.admin.75032.asok 2024-09-21T02:33:14.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:33:14.056 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75032.asok 2024-09-21T02:33:14.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:14.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75032.asok status 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "admin", 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T02:33:14.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "75032", 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 14808, 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 14808 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T02:33:14.302 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1300594045 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1300594045 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.14808 192.168.0.1:0/1300594045", 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1300594045", 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 17, 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 84, 2024-09-21T02:33:14.303 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-09-21T02:33:14.304 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-09-21T02:33:14.304 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-09-21T02:33:14.304 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:33:14.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:14.319 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-09-21T02:33:14.319 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:14.355 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-09-21T02:33:14.355 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:14.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:14.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:14.456 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T02:33:14.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:33:14.557 INFO:teuthology.orchestra.run.smithi079.stdout:# file: . 2024-09-21T02:33:14.557 INFO:teuthology.orchestra.run.smithi079.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T02:33:14.557 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:14.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:33:14.565 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:33:14.565 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:33:14.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:33:14.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:14 smithi079 ceph-mon[30788]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:14 smithi148 ceph-mon[34626]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:14.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:14 smithi098 ceph-mon[34832]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:15.016 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.610+0000 7f6df0e00640 1 -- 172.21.15.79:0/2972464485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec10c010 msgr2=0x7f6dec112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.610+0000 7f6df0e00640 1 --2- 172.21.15.79:0/2972464485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec10c010 0x7f6dec112840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009ca0 tx=0x7f6de402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.610+0000 7f6df0e00640 1 -- 172.21.15.79:0/2972464485 shutdown_connections 2024-09-21T02:33:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.610+0000 7f6df0e00640 1 --2- 172.21.15.79:0/2972464485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec10c010 0x7f6dec112840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.610+0000 7f6df0e00640 1 --2- 172.21.15.79:0/2972464485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec10b6c0 0x7f6dec10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.610+0000 7f6df0e00640 1 --2- 172.21.15.79:0/2972464485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec105d80 0x7f6dec106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.610+0000 7f6df0e00640 1 -- 172.21.15.79:0/2972464485 >> 172.21.15.79:0/2972464485 conn(0x7f6dec101810 msgr2=0x7f6dec103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.611+0000 7f6df0e00640 1 -- 172.21.15.79:0/2972464485 shutdown_connections 2024-09-21T02:33:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.611+0000 7f6df0e00640 1 -- 172.21.15.79:0/2972464485 wait complete. 2024-09-21T02:33:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.611+0000 7f6df0e00640 1 Processor -- start 2024-09-21T02:33:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6df0e00640 1 -- start start 2024-09-21T02:33:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6df0e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec105d80 0x7f6dec19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6df0e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec10b6c0 0x7f6dec19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6df0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec10c010 0x7f6dec1a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:15.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6df0e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec115d20 con 0x7f6dec105d80 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6df0e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec115ba0 con 0x7f6dec10b6c0 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6df0e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec115ea0 con 0x7f6dec10c010 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.612+0000 7f6de9e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec105d80 0x7f6dec19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6dea800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec10c010 0x7f6dec1a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec10b6c0 0x7f6dec19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de9e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec105d80 0x7f6dec19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53730/0 (socket says 172.21.15.79:53730) 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de9e00640 1 -- 172.21.15.79:0/1743828367 learned_addr learned my addr 172.21.15.79:0/1743828367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de1400640 1 -- 172.21.15.79:0/1743828367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec10c010 msgr2=0x7f6dec1a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de1400640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec10c010 0x7f6dec1a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de1400640 1 -- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec105d80 msgr2=0x7f6dec19c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de1400640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec105d80 0x7f6dec19c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de1400640 1 -- 172.21.15.79:0/1743828367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec1a25c0 con 0x7f6dec10b6c0 2024-09-21T02:33:15.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de9e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec105d80 0x7f6dec19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.613+0000 7f6de1400640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec10b6c0 0x7f6dec19cbf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dec06caa0 tx=0x7f6dd400db30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.614+0000 7f6de3400640 1 -- 172.21.15.79:0/1743828367 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4017070 con 0x7f6dec10b6c0 2024-09-21T02:33:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.614+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dec1a28b0 con 0x7f6dec10b6c0 2024-09-21T02:33:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.614+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dec1a9010 con 0x7f6dec10b6c0 2024-09-21T02:33:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.614+0000 7f6de3400640 1 -- 172.21.15.79:0/1743828367 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dd4009820 con 0x7f6dec10b6c0 2024-09-21T02:33:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.614+0000 7f6de3400640 1 -- 172.21.15.79:0/1743828367 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4020060 con 0x7f6dec10b6c0 2024-09-21T02:33:15.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.615+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc80052c0 con 0x7f6dec10b6c0 2024-09-21T02:33:15.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.617+0000 7f6de3400640 1 -- 172.21.15.79:0/1743828367 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6dd4004b60 con 0x7f6dec10b6c0 2024-09-21T02:33:15.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.619+0000 7f6de3400640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6dd00b6510 0x7f6dd00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:15.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.619+0000 7f6de3400640 1 -- 172.21.15.79:0/1743828367 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f6dd40e6c00 con 0x7f6dec10b6c0 2024-09-21T02:33:15.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.619+0000 7f6de9e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6dd00b6510 0x7f6dd00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:15.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.620+0000 7f6de9e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6dd00b6510 0x7f6dd00b8a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc011550 tx=0x7f6ddc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:15.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.623+0000 7f6de3400640 1 -- 172.21.15.79:0/1743828367 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6dd40b15d0 con 0x7f6dec10b6c0 2024-09-21T02:33:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.823+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6dc80055b0 con 0x7f6dec10b6c0 2024-09-21T02:33:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.824+0000 7f6de3400640 1 -- 172.21.15.79:0/1743828367 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+591 (secure 0 0 0) 0x7f6dd40b6510 con 0x7f6dec10b6c0 2024-09-21T02:33:15.825 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/4255899352 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:15.825 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1266728310 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/1983375903 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1676746603 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/467580513 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1861363948 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/4027877964 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/1983375903 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/4027877964 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3080648711 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:listed 10 entries 2024-09-21T02:33:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.826+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6dd00b6510 msgr2=0x7f6dd00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6dd00b6510 0x7f6dd00b8a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc011550 tx=0x7f6ddc005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec10b6c0 msgr2=0x7f6dec19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec10b6c0 0x7f6dec19cbf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dec06caa0 tx=0x7f6dd400db30 comp rx=0 tx=0).stop 2024-09-21T02:33:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 shutdown_connections 2024-09-21T02:33:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6dd00b6510 0x7f6dd00b8a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec10c010 0x7f6dec1a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dec10b6c0 0x7f6dec19cbf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 --2- 172.21.15.79:0/1743828367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec105d80 0x7f6dec19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 >> 172.21.15.79:0/1743828367 conn(0x7f6dec101810 msgr2=0x7f6dec10acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 shutdown_connections 2024-09-21T02:33:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:15.827+0000 7f6df0e00640 1 -- 172.21.15.79:0/1743828367 wait complete. 2024-09-21T02:33:16.517 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:33:16.517 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:33:16.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:33:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:16 smithi079 ceph-mon[30788]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:33:16.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:16 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1743828367' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:33:16.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:16 smithi148 ceph-mon[34626]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:33:16.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:16 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1743828367' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:33:16.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:16 smithi098 ceph-mon[34832]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:33:16.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:16 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1743828367' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:33:16.964 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.605+0000 7f0e3a600640 1 -- 172.21.15.79:0/909362428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e34103b80 msgr2=0x7f0e34103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.605+0000 7f0e3a600640 1 --2- 172.21.15.79:0/909362428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e34103b80 0x7f0e34103f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009900 tx=0x7f0e2402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.606+0000 7f0e3a600640 1 -- 172.21.15.79:0/909362428 shutdown_connections 2024-09-21T02:33:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.606+0000 7f0e3a600640 1 --2- 172.21.15.79:0/909362428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34109e10 0x7f0e34110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.606+0000 7f0e3a600640 1 --2- 172.21.15.79:0/909362428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e341094c0 0x7f0e341098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.606+0000 7f0e3a600640 1 --2- 172.21.15.79:0/909362428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e34103b80 0x7f0e34103f90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.606+0000 7f0e3a600640 1 -- 172.21.15.79:0/909362428 >> 172.21.15.79:0/909362428 conn(0x7f0e340ff590 msgr2=0x7f0e341019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.606+0000 7f0e3a600640 1 -- 172.21.15.79:0/909362428 shutdown_connections 2024-09-21T02:33:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.606+0000 7f0e3a600640 1 -- 172.21.15.79:0/909362428 wait complete. 2024-09-21T02:33:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 Processor -- start 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 -- start start 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34103b80 0x7f0e3419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e341094c0 0x7f0e3419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e34109e10 0x7f0e341a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e34113ad0 con 0x7f0e34109e10 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e34113950 con 0x7f0e341094c0 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.607+0000 7f0e3a600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0e34113c50 con 0x7f0e34103b80 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34103b80 0x7f0e3419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e32a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e341094c0 0x7f0e3419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e34109e10 0x7f0e341a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34103b80 0x7f0e3419c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:46190/0 (socket says 172.21.15.79:46190) 2024-09-21T02:33:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 -- 172.21.15.79:0/1337820248 learned_addr learned my addr 172.21.15.79:0/1337820248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:17.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 -- 172.21.15.79:0/1337820248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e341094c0 msgr2=0x7f0e3419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e341094c0 0x7f0e3419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 -- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e34109e10 msgr2=0x7f0e341a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e34109e10 0x7f0e341a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.608+0000 7f0e33400640 1 -- 172.21.15.79:0/1337820248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e341a25f0 con 0x7f0e34103b80 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.609+0000 7f0e33400640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34103b80 0x7f0e3419c680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e24005940 tx=0x7f0e240040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.609+0000 7f0e2be00640 1 -- 172.21.15.79:0/1337820248 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2403f030 con 0x7f0e34103b80 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.609+0000 7f0e2be00640 1 -- 172.21.15.79:0/1337820248 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e240044c0 con 0x7f0e34103b80 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.609+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e341a2880 con 0x7f0e34103b80 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.609+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e341a9040 con 0x7f0e34103b80 2024-09-21T02:33:17.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.609+0000 7f0e2be00640 1 -- 172.21.15.79:0/1337820248 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24035070 con 0x7f0e34103b80 2024-09-21T02:33:17.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.611+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e34103f90 con 0x7f0e34103b80 2024-09-21T02:33:17.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.613+0000 7f0e2be00640 1 -- 172.21.15.79:0/1337820248 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0e24042030 con 0x7f0e34103b80 2024-09-21T02:33:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.614+0000 7f0e2be00640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e180b6510 0x7f0e180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.614+0000 7f0e2be00640 1 -- 172.21.15.79:0/1337820248 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f0e24107920 con 0x7f0e34103b80 2024-09-21T02:33:17.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.614+0000 7f0e32a00640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e180b6510 0x7f0e180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:17.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.615+0000 7f0e32a00640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e180b6510 0x7f0e180b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0e34108ce0 tx=0x7f0e1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:17.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.618+0000 7f0e2be00640 1 -- 172.21.15.79:0/1337820248 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e240d22f0 con 0x7f0e34103b80 2024-09-21T02:33:17.714 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:17 smithi148 ceph-mon[34626]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:33:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:17 smithi079 ceph-mon[30788]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:33:17.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:17 smithi098 ceph-mon[34832]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:33:17.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.844+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0e3402e640 con 0x7f0e34103b80 2024-09-21T02:33:17.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.845+0000 7f0e2be00640 1 -- 172.21.15.79:0/1337820248 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+591 (secure 0 0 0) 0x7f0e240d7230 con 0x7f0e34103b80 2024-09-21T02:33:17.846 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/4255899352 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:17.846 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1266728310 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:17.846 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/1983375903 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:17.846 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1676746603 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:17.847 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/467580513 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:17.847 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1861363948 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:17.847 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/4027877964 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:17.847 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/1983375903 2024-09-22T02:24:29.283557+0000 2024-09-21T02:33:17.847 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/4027877964 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:17.847 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3080648711 2024-09-22T02:23:58.098675+0000 2024-09-21T02:33:17.847 INFO:teuthology.orchestra.run.smithi079.stderr:listed 10 entries 2024-09-21T02:33:17.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e180b6510 msgr2=0x7f0e180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:17.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e180b6510 0x7f0e180b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0e34108ce0 tx=0x7f0e1c005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:17.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34103b80 msgr2=0x7f0e3419c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:17.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34103b80 0x7f0e3419c680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e24005940 tx=0x7f0e240040c0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 shutdown_connections 2024-09-21T02:33:17.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e180b6510 0x7f0e180b8a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e34109e10 0x7f0e341a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e341094c0 0x7f0e3419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 --2- 172.21.15.79:0/1337820248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e34103b80 0x7f0e3419c680 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:17.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 >> 172.21.15.79:0/1337820248 conn(0x7f0e340ff590 msgr2=0x7f0e34102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:17.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 shutdown_connections 2024-09-21T02:33:17.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:17.849+0000 7f0e3a600640 1 -- 172.21.15.79:0/1337820248 wait complete. 2024-09-21T02:33:18.564 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:18 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1337820248' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:33:18.600 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-09-21T02:33:18.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:18.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:33:18.656 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[75032]: fuse finished with error 0 and tester_r 0 2024-09-21T02:33:18.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T02:33:18.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:18 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1337820248' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:33:18.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:18 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1337820248' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:33:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:19 smithi079 ceph-mon[30788]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:19.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:19 smithi148 ceph-mon[34626]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:19 smithi098 ceph-mon[34832]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:21.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:21 smithi148 ceph-mon[34626]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:21.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:21 smithi098 ceph-mon[34832]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:21.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:21 smithi079 ceph-mon[30788]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:24.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:24 smithi098 ceph-mon[34832]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:24.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:24 smithi079 ceph-mon[30788]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:24.763 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:33:24.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:33:24.763 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T02:33:24.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:24 smithi148 ceph-mon[34626]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:33:24.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:33:25.194 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:25.667 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:25 smithi079 ceph-mon[30788]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T02:33:25.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:25 smithi148 ceph-mon[34626]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T02:33:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.839+0000 7fc963200640 1 -- 172.21.15.79:0/3008371795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641039b0 msgr2=0x7fc964103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.839+0000 7fc963200640 1 --2- 172.21.15.79:0/3008371795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641039b0 0x7fc964103dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc954009900 tx=0x7fc95402a410 comp rx=0 tx=0).stop 2024-09-21T02:33:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.840+0000 7fc963200640 1 -- 172.21.15.79:0/3008371795 shutdown_connections 2024-09-21T02:33:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.840+0000 7fc963200640 1 --2- 172.21.15.79:0/3008371795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc964109c40 0x7fc964110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.840+0000 7fc963200640 1 --2- 172.21.15.79:0/3008371795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9641092f0 0x7fc964109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.840+0000 7fc963200640 1 --2- 172.21.15.79:0/3008371795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641039b0 0x7fc964103dc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:25.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.840+0000 7fc963200640 1 -- 172.21.15.79:0/3008371795 >> 172.21.15.79:0/3008371795 conn(0x7fc9640ff440 msgr2=0x7fc964101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.840+0000 7fc963200640 1 -- 172.21.15.79:0/3008371795 shutdown_connections 2024-09-21T02:33:25.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.840+0000 7fc963200640 1 -- 172.21.15.79:0/3008371795 wait complete. 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 Processor -- start 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 -- start start 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9641039b0 0x7fc96419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641092f0 0x7fc96419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc964109c40 0x7fc96419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc964113950 con 0x7fc9641092f0 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641137d0 con 0x7fc9641039b0 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.841+0000 7fc963200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc964113ad0 con 0x7fc964109c40 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641092f0 0x7fc96419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641092f0 0x7fc96419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39478/0 (socket says 172.21.15.79:39478) 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 -- 172.21.15.79:0/728705872 learned_addr learned my addr 172.21.15.79:0/728705872 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:25.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961e00640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9641039b0 0x7fc96419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc962800640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc964109c40 0x7fc96419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 -- 172.21.15.79:0/728705872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc964109c40 msgr2=0x7fc96419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:25.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc964109c40 0x7fc96419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 -- 172.21.15.79:0/728705872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9641039b0 msgr2=0x7fc96419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9641039b0 0x7fc96419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961400640 1 -- 172.21.15.79:0/728705872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9641a0290 con 0x7fc9641092f0 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.842+0000 7fc961e00640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9641039b0 0x7fc96419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.843+0000 7fc961400640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641092f0 0x7fc96419a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc95000e9f0 tx=0x7fc95000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.843+0000 7fc95aa00640 1 -- 172.21.15.79:0/728705872 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95000ccc0 con 0x7fc9641092f0 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.843+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9641a0580 con 0x7fc9641092f0 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.843+0000 7fc95aa00640 1 -- 172.21.15.79:0/728705872 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9500108e0 con 0x7fc9641092f0 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.843+0000 7fc95aa00640 1 -- 172.21.15.79:0/728705872 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950018860 con 0x7fc9641092f0 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.843+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9641a6ce0 con 0x7fc9641092f0 2024-09-21T02:33:25.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.844+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc964103dc0 con 0x7fc9641092f0 2024-09-21T02:33:25.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.847+0000 7fc95aa00640 1 -- 172.21.15.79:0/728705872 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc950010430 con 0x7fc9641092f0 2024-09-21T02:33:25.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.849+0000 7fc95aa00640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9480b6510 0x7fc9480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:25.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.849+0000 7fc95aa00640 1 -- 172.21.15.79:0/728705872 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fc9500e7ca0 con 0x7fc9641092f0 2024-09-21T02:33:25.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.849+0000 7fc961e00640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9480b6510 0x7fc9480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:25.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.850+0000 7fc961e00640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9480b6510 0x7fc9480b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc954005ab0 tx=0x7fc954005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:25.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:25.850+0000 7fc95aa00640 1 -- 172.21.15.79:0/728705872 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9500b2670 con 0x7fc9641092f0 2024-09-21T02:33:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:25 smithi098 ceph-mon[34832]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T02:33:26.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.041+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc96419b450 con 0x7fc9641092f0 2024-09-21T02:33:26.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.043+0000 7fc95aa00640 1 -- 172.21.15.79:0/728705872 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24165 (secure 0 0 0) 0x7fc96419b450 con 0x7fc9641092f0 2024-09-21T02:33:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:26.044 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:32:53.820868+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:33:26.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9480b6510 msgr2=0x7fc9480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:26.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9480b6510 0x7fc9480b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc954005ab0 tx=0x7fc954005a20 comp rx=0 tx=0).stop 2024-09-21T02:33:26.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641092f0 msgr2=0x7fc96419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641092f0 0x7fc96419a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc95000e9f0 tx=0x7fc95000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 shutdown_connections 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9480b6510 0x7fc9480b8a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc964109c40 0x7fc96419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9641092f0 0x7fc96419a8c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 --2- 172.21.15.79:0/728705872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9641039b0 0x7fc96419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 >> 172.21.15.79:0/728705872 conn(0x7fc9640ff440 msgr2=0x7fc964101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 shutdown_connections 2024-09-21T02:33:26.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:26.045+0000 7fc963200640 1 -- 172.21.15.79:0/728705872 wait complete. 2024-09-21T02:33:26.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:26 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/728705872' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:26.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:33:26.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:26 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/728705872' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:26.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:26 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/728705872' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:27.156 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:27.634 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:27 smithi079 ceph-mon[30788]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:33:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.804+0000 7f07ff000640 1 -- 172.21.15.79:0/1856556735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f810c040 msgr2=0x7f07f8112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.804+0000 7f07ff000640 1 --2- 172.21.15.79:0/1856556735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f810c040 0x7f07f8112870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009be0 tx=0x7f07f002a6c0 comp rx=0 tx=0).stop 2024-09-21T02:33:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.805+0000 7f07ff000640 1 -- 172.21.15.79:0/1856556735 shutdown_connections 2024-09-21T02:33:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.805+0000 7f07ff000640 1 --2- 172.21.15.79:0/1856556735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f810c040 0x7f07f8112870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.805+0000 7f07ff000640 1 --2- 172.21.15.79:0/1856556735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f810b6f0 0x7f07f810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.805+0000 7f07ff000640 1 --2- 172.21.15.79:0/1856556735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07f8105db0 0x7f07f81061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.805+0000 7f07ff000640 1 -- 172.21.15.79:0/1856556735 >> 172.21.15.79:0/1856556735 conn(0x7f07f81017e0 msgr2=0x7f07f8103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.805+0000 7f07ff000640 1 -- 172.21.15.79:0/1856556735 shutdown_connections 2024-09-21T02:33:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.805+0000 7f07ff000640 1 -- 172.21.15.79:0/1856556735 wait complete. 2024-09-21T02:33:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 Processor -- start 2024-09-21T02:33:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 -- start start 2024-09-21T02:33:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f8105db0 0x7f07f819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f810b6f0 0x7f07f819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07f810c040 0x7f07f81a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07f8115d00 con 0x7f07f810b6f0 2024-09-21T02:33:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f07f8115b80 con 0x7f07f810c040 2024-09-21T02:33:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.806+0000 7f07ff000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07f8115e80 con 0x7f07f8105db0 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f8105db0 0x7f07f819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f8105db0 0x7f07f819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:46488/0 (socket says 172.21.15.79:46488) 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 -- 172.21.15.79:0/1312918636 learned_addr learned my addr 172.21.15.79:0/1312918636 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07ef400640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f810b6f0 0x7f07f819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07fd000640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07f810c040 0x7f07f81a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 -- 172.21.15.79:0/1312918636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07f810c040 msgr2=0x7f07f81a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07f810c040 0x7f07f81a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 -- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f810b6f0 msgr2=0x7f07f819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f810b6f0 0x7f07f819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 -- 172.21.15.79:0/1312918636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f81a2660 con 0x7f07f8105db0 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.807+0000 7f07f7e00640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f8105db0 0x7f07f819c6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07e800e9f0 tx=0x7f07e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.808+0000 7f07f5600640 1 -- 172.21.15.79:0/1312918636 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e800cd80 con 0x7f07f8105db0 2024-09-21T02:33:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.808+0000 7f07f5600640 1 -- 172.21.15.79:0/1312918636 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e80108e0 con 0x7f07f8105db0 2024-09-21T02:33:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.808+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f81a2950 con 0x7f07f8105db0 2024-09-21T02:33:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.808+0000 7f07f5600640 1 -- 172.21.15.79:0/1312918636 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8018980 con 0x7f07f8105db0 2024-09-21T02:33:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.808+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f81a90b0 con 0x7f07f8105db0 2024-09-21T02:33:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.809+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f81061c0 con 0x7f07f8105db0 2024-09-21T02:33:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.811+0000 7f07f5600640 1 -- 172.21.15.79:0/1312918636 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f07e8010430 con 0x7f07f8105db0 2024-09-21T02:33:27.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:27 smithi148 ceph-mon[34626]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:33:27.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.813+0000 7f07f5600640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07dc0b6590 0x7f07dc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:27.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.813+0000 7f07f5600640 1 -- 172.21.15.79:0/1312918636 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f07e80e7ce0 con 0x7f07f8105db0 2024-09-21T02:33:27.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.813+0000 7f07ef400640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07dc0b6590 0x7f07dc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.814+0000 7f07ef400640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07dc0b6590 0x7f07dc0b8aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07e00096c0 tx=0x7f07e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:27.815+0000 7f07f5600640 1 -- 172.21.15.79:0/1312918636 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07e80b26b0 con 0x7f07f8105db0 2024-09-21T02:33:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:27 smithi098 ceph-mon[34832]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:33:28.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.004+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07f802e640 con 0x7f07f8105db0 2024-09-21T02:33:28.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.006+0000 7f07f5600640 1 -- 172.21.15.79:0/1312918636 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24165 (secure 0 0 0) 0x7f07e80b75f0 con 0x7f07f8105db0 2024-09-21T02:33:28.008 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:28.008 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:32:53.820868+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:33:28.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07dc0b6590 msgr2=0x7f07dc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07dc0b6590 0x7f07dc0b8aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07e00096c0 tx=0x7f07e0009260 comp rx=0 tx=0).stop 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f8105db0 msgr2=0x7f07f819c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f8105db0 0x7f07f819c6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07e800e9f0 tx=0x7f07e800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 shutdown_connections 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f07dc0b6590 0x7f07dc0b8aa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07f810c040 0x7f07f81a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f810b6f0 0x7f07f819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 --2- 172.21.15.79:0/1312918636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07f8105db0 0x7f07f819c6f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 >> 172.21.15.79:0/1312918636 conn(0x7f07f81017e0 msgr2=0x7f07f8108c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.009+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 shutdown_connections 2024-09-21T02:33:28.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:28.010+0000 7f07ff000640 1 -- 172.21.15.79:0/1312918636 wait complete. 2024-09-21T02:33:28.785 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:28 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1312918636' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:28.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T02:33:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:28 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1312918636' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:28 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1312918636' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:29.162 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:29.627 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T02:33:29.627 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 8]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T02:33:29.628 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:29 smithi079 ceph-mon[30788]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:33:29.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 -- 172.21.15.79:0/3580196308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 msgr2=0x7fe234114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 --2- 172.21.15.79:0/3580196308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 0x7fe234114200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009900 tx=0x7fe21c02a410 comp rx=0 tx=0).stop 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 -- 172.21.15.79:0/3580196308 shutdown_connections 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 --2- 172.21.15.79:0/3580196308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe234114740 0x7fe234116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 --2- 172.21.15.79:0/3580196308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 0x7fe234114200 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 --2- 172.21.15.79:0/3580196308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 0x7fe234077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 -- 172.21.15.79:0/3580196308 >> 172.21.15.79:0/3580196308 conn(0x7fe234101810 msgr2=0x7fe234103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 -- 172.21.15.79:0/3580196308 shutdown_connections 2024-09-21T02:33:29.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.800+0000 7fe239a00640 1 -- 172.21.15.79:0/3580196308 wait complete. 2024-09-21T02:33:29.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.801+0000 7fe239a00640 1 Processor -- start 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.801+0000 7fe239a00640 1 -- start start 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe239a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 0x7fe2341a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe239a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 0x7fe2341a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe239a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe234114740 0x7fe2341a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe239a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe23411a0e0 con 0x7fe234078290 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe239a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe234119f60 con 0x7fe234077940 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe239a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe23411a260 con 0x7fe234114740 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 0x7fe2341a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe22a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 0x7fe2341a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 0x7fe2341a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53570/0 (socket says 172.21.15.79:53570) 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 -- 172.21.15.79:0/1156572770 learned_addr learned my addr 172.21.15.79:0/1156572770 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe233400640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe234114740 0x7fe2341a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 -- 172.21.15.79:0/1156572770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe234114740 msgr2=0x7fe2341a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:29.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe234114740 0x7fe2341a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 -- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 msgr2=0x7fe2341a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 0x7fe2341a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.802+0000 7fe232a00640 1 -- 172.21.15.79:0/1156572770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2341a6ac0 con 0x7fe234077940 2024-09-21T02:33:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.803+0000 7fe232a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 0x7fe2341a0b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe22400e9f0 tx=0x7fe22400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.803+0000 7fe22be00640 1 -- 172.21.15.79:0/1156572770 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22400cd80 con 0x7fe234077940 2024-09-21T02:33:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.803+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2341a6db0 con 0x7fe234077940 2024-09-21T02:33:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.803+0000 7fe22be00640 1 -- 172.21.15.79:0/1156572770 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2240108e0 con 0x7fe234077940 2024-09-21T02:33:29.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.803+0000 7fe22be00640 1 -- 172.21.15.79:0/1156572770 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224018980 con 0x7fe234077940 2024-09-21T02:33:29.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.803+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2341ad510 con 0x7fe234077940 2024-09-21T02:33:29.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.804+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe234077d50 con 0x7fe234077940 2024-09-21T02:33:29.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.807+0000 7fe22be00640 1 -- 172.21.15.79:0/1156572770 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fe224010430 con 0x7fe234077940 2024-09-21T02:33:29.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.808+0000 7fe22be00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2180b6510 0x7fe2180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:29.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.808+0000 7fe22be00640 1 -- 172.21.15.79:0/1156572770 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9092+0+0 (secure 0 0 0) 0x7fe2240e7f10 con 0x7fe234077940 2024-09-21T02:33:29.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.808+0000 7fe22a000640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2180b6510 0x7fe2180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:29.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.809+0000 7fe22a000640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2180b6510 0x7fe2180b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe21c02aa00 tx=0x7fe21c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:29.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:29.810+0000 7fe22be00640 1 -- 172.21.15.79:0/1156572770 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2240ae3e0 con 0x7fe234077940 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 8]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T02:33:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-09-21T02:33:29.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T02:33:29.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:29 smithi148 ceph-mon[34626]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:33:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T02:33:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T02:33:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-21T02:33:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T02:33:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T02:33:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T02:33:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 8]} : dispatch 2024-09-21T02:33:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T02:33:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-09-21T02:33:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T02:33:29.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:29 smithi098 ceph-mon[34832]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:33:30.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.034+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe23402e640 con 0x7fe234077940 2024-09-21T02:33:30.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.542+0000 7fe22be00640 1 -- 172.21.15.79:0/1156572770 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fe2240b27c0 con 0x7fe234077940 2024-09-21T02:33:30.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2180b6510 msgr2=0x7fe2180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:30.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2180b6510 0x7fe2180b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe21c02aa00 tx=0x7fe21c005a20 comp rx=0 tx=0).stop 2024-09-21T02:33:30.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 msgr2=0x7fe2341a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:30.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 0x7fe2341a0b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe22400e9f0 tx=0x7fe22400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 shutdown_connections 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2180b6510 0x7fe2180b8a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe234114740 0x7fe2341a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe234078290 0x7fe2341a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 --2- 172.21.15.79:0/1156572770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe234077940 0x7fe2341a0b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 >> 172.21.15.79:0/1156572770 conn(0x7fe234101810 msgr2=0x7fe234116790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 shutdown_connections 2024-09-21T02:33:30.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:30.545+0000 7fe239a00640 1 -- 172.21.15.79:0/1156572770 wait complete. 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 8]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T02:33:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-21T02:33:30.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T02:33:30.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T02:33:30.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1156572770' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:33:30.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:30 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:33:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T02:33:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T02:33:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-21T02:33:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T02:33:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T02:33:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T02:33:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 8]}]': finished 2024-09-21T02:33:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T02:33:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-21T02:33:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T02:33:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T02:33:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1156572770' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:33:30.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:30 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 8]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T02:33:30.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-21T02:33:30.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T02:33:30.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T02:33:30.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1156572770' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:33:30.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:30 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:33:31.305 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T02:33:31.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T02:33:31.675 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:31 smithi079 ceph-mon[30788]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:31 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:31 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:31 smithi079 ceph-mon[30788]: pgmap v347: 129 pgs: 7 peering, 122 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:31 smithi148 ceph-mon[34626]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:31 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:31 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:33:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:31 smithi148 ceph-mon[34626]: pgmap v347: 129 pgs: 7 peering, 122 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T02:33:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:31 smithi098 ceph-mon[34832]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T02:33:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:31 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:33:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:31 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:33:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:31 smithi098 ceph-mon[34832]: pgmap v347: 129 pgs: 7 peering, 122 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 -- 172.21.15.79:0/2478500647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 msgr2=0x7f81681098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 --2- 172.21.15.79:0/2478500647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 0x7f81681098c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8154009900 tx=0x7f815402a410 comp rx=0 tx=0).stop 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 -- 172.21.15.79:0/2478500647 shutdown_connections 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 --2- 172.21.15.79:0/2478500647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8168109e00 0x7f8168110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 --2- 172.21.15.79:0/2478500647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 0x7f81681098c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 --2- 172.21.15.79:0/2478500647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8168103b70 0x7f8168103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 -- 172.21.15.79:0/2478500647 >> 172.21.15.79:0/2478500647 conn(0x7f81680ff5e0 msgr2=0x7f8168101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 -- 172.21.15.79:0/2478500647 shutdown_connections 2024-09-21T02:33:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.331+0000 7f816f000640 1 -- 172.21.15.79:0/2478500647 wait complete. 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.332+0000 7f816f000640 1 Processor -- start 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f816f000640 1 -- start start 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f816f000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8168103b70 0x7f8168075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f816f000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 0x7f8168075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f816f000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8168109e00 0x7f8168076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f816f000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8168113ac0 con 0x7f81681094b0 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f816f000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8168113940 con 0x7f8168103b70 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f816f000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8168113c40 con 0x7f8168109e00 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f8167400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 0x7f8168075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f8167400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 0x7f8168075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39548/0 (socket says 172.21.15.79:39548) 2024-09-21T02:33:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.333+0000 7f8167400640 1 -- 172.21.15.79:0/3490465744 learned_addr learned my addr 172.21.15.79:0/3490465744 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f8167e00640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8168103b70 0x7f8168075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f816d000640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8168109e00 0x7f8168076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f8167e00640 1 -- 172.21.15.79:0/3490465744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8168109e00 msgr2=0x7f8168076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f8167e00640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8168109e00 0x7f8168076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f8167e00640 1 -- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 msgr2=0x7f8168075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f8167e00640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 0x7f8168075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f8167e00640 1 -- 172.21.15.79:0/3490465744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81681a8790 con 0x7f8168103b70 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.334+0000 7f8167e00640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8168103b70 0x7f8168075710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f815800d720 tx=0x7f815800dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.335+0000 7f8164c00640 1 -- 172.21.15.79:0/3490465744 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158017070 con 0x7f8168103b70 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.335+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81681a8a80 con 0x7f8168103b70 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.335+0000 7f8164c00640 1 -- 172.21.15.79:0/3490465744 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815800de30 con 0x7f8168103b70 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.335+0000 7f8164c00640 1 -- 172.21.15.79:0/3490465744 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81580047a0 con 0x7f8168103b70 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.335+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81681a8f70 con 0x7f8168103b70 2024-09-21T02:33:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.336+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8168103f80 con 0x7f8168103b70 2024-09-21T02:33:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.339+0000 7f8164c00640 1 -- 172.21.15.79:0/3490465744 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f81580099d0 con 0x7f8168103b70 2024-09-21T02:33:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.340+0000 7f8164c00640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f814c0b6510 0x7f814c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.340+0000 7f8164c00640 1 -- 172.21.15.79:0/3490465744 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f81580e7720 con 0x7f8168103b70 2024-09-21T02:33:32.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.340+0000 7f8167400640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f814c0b6510 0x7f814c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:32.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.341+0000 7f8167400640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f814c0b6510 0x7f814c0b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8168107000 tx=0x7f8154009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:32.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.342+0000 7f8164c00640 1 -- 172.21.15.79:0/3490465744 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8158020020 con 0x7f8168103b70 2024-09-21T02:33:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.578+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f816802e640 con 0x7f8168103b70 2024-09-21T02:33:32.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.636+0000 7f8164c00640 1 -- 172.21.15.79:0/3490465744 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f81580adbf0 con 0x7f8168103b70 2024-09-21T02:33:32.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f814c0b6510 msgr2=0x7f814c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:32.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f814c0b6510 0x7f814c0b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8168107000 tx=0x7f8154009560 comp rx=0 tx=0).stop 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8168103b70 msgr2=0x7f8168075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8168103b70 0x7f8168075710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f815800d720 tx=0x7f815800dbe0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 shutdown_connections 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f814c0b6510 0x7f814c0b8a20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8168109e00 0x7f8168076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81681094b0 0x7f8168075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 --2- 172.21.15.79:0/3490465744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8168103b70 0x7f8168075710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 >> 172.21.15.79:0/3490465744 conn(0x7f81680ff5e0 msgr2=0x7f8168101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 shutdown_connections 2024-09-21T02:33:32.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:32.640+0000 7f816f000640 1 -- 172.21.15.79:0/3490465744 wait complete. 2024-09-21T02:33:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:32 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3490465744' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:33:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:32 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:33:32.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:32 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3490465744' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:33:32.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:32 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:33:33.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:32 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3490465744' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:33:33.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:32 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:33:33.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T02:33:33.735 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:33 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:33:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:33 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:33:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:33 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T02:33:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:33 smithi098 ceph-mon[34832]: pgmap v348: 129 pgs: 7 peering, 122 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:33.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:33 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:33:33.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:33 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:33:33.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:33 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T02:33:33.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:33 smithi079 ceph-mon[30788]: pgmap v348: 129 pgs: 7 peering, 122 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:33 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:33:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:33 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:33:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:33 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T02:33:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:33 smithi148 ceph-mon[34626]: pgmap v348: 129 pgs: 7 peering, 122 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:33:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 -- 172.21.15.79:0/1208616672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 msgr2=0x7f9dcc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 --2- 172.21.15.79:0/1208616672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 0x7f9dcc1098d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009900 tx=0x7f9db802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 -- 172.21.15.79:0/1208616672 shutdown_connections 2024-09-21T02:33:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 --2- 172.21.15.79:0/1208616672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc109e10 0x7f9dcc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 --2- 172.21.15.79:0/1208616672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 0x7f9dcc1098d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 --2- 172.21.15.79:0/1208616672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc103b80 0x7f9dcc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 -- 172.21.15.79:0/1208616672 >> 172.21.15.79:0/1208616672 conn(0x7f9dcc0ff610 msgr2=0x7f9dcc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:34.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 -- 172.21.15.79:0/1208616672 shutdown_connections 2024-09-21T02:33:34.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.390+0000 7f9dd2200640 1 -- 172.21.15.79:0/1208616672 wait complete. 2024-09-21T02:33:34.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.392+0000 7f9dd2200640 1 Processor -- start 2024-09-21T02:33:34.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.392+0000 7f9dd2200640 1 -- start start 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.392+0000 7f9dd2200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc103b80 0x7f9dcc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dd2200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 0x7f9dcc19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dd2200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc109e10 0x7f9dcc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dd2200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc113ad0 con 0x7f9dcc1094c0 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dd2200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc113950 con 0x7f9dcc109e10 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dd2200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc113c50 con 0x7f9dcc103b80 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc103b80 0x7f9dcc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:34.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc103b80 0x7f9dcc19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:44234/0 (socket says 172.21.15.79:44234) 2024-09-21T02:33:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 -- 172.21.15.79:0/2889735924 learned_addr learned my addr 172.21.15.79:0/2889735924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcaa00640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 0x7f9dcc19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcbe00640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc109e10 0x7f9dcc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 -- 172.21.15.79:0/2889735924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc109e10 msgr2=0x7f9dcc19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc109e10 0x7f9dcc19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 -- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 msgr2=0x7f9dcc19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 0x7f9dcc19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.393+0000 7f9dcb400640 1 -- 172.21.15.79:0/2889735924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc1a0450 con 0x7f9dcc103b80 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.394+0000 7f9dcbe00640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc109e10 0x7f9dcc19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.394+0000 7f9dcb400640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc103b80 0x7f9dcc19a4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e9f0 tx=0x7f9dbc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.394+0000 7f9dc3e00640 1 -- 172.21.15.79:0/2889735924 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00cd80 con 0x7f9dcc103b80 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.394+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc1a0740 con 0x7f9dcc103b80 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.394+0000 7f9dc3e00640 1 -- 172.21.15.79:0/2889735924 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dbc0108e0 con 0x7f9dcc103b80 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.394+0000 7f9dc3e00640 1 -- 172.21.15.79:0/2889735924 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc018980 con 0x7f9dcc103b80 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.394+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc0755f0 con 0x7f9dcc103b80 2024-09-21T02:33:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.395+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc104e00 con 0x7f9dcc103b80 2024-09-21T02:33:34.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.398+0000 7f9dc3e00640 1 -- 172.21.15.79:0/2889735924 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f9dbc010430 con 0x7f9dcc103b80 2024-09-21T02:33:34.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.399+0000 7f9dc3e00640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9db00b6510 0x7f9db00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:34.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.399+0000 7f9dc3e00640 1 -- 172.21.15.79:0/2889735924 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f9dbc0e7e60 con 0x7f9dcc103b80 2024-09-21T02:33:34.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.400+0000 7f9dcaa00640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9db00b6510 0x7f9db00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:34.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.400+0000 7f9dcaa00640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9db00b6510 0x7f9db00b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009230 tx=0x7f9db803c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:34.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.401+0000 7f9dc3e00640 1 -- 172.21.15.79:0/2889735924 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9dbc0b2710 con 0x7f9dcc103b80 2024-09-21T02:33:34.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.628+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9dcc19b610 con 0x7f9dcc103b80 2024-09-21T02:33:34.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.655+0000 7f9dc3e00640 1 -- 172.21.15.79:0/2889735924 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f9dbc0b7650 con 0x7f9dcc103b80 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9db00b6510 msgr2=0x7f9db00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9db00b6510 0x7f9db00b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009230 tx=0x7f9db803c040 comp rx=0 tx=0).stop 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc103b80 msgr2=0x7f9dcc19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc103b80 0x7f9dcc19a4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e9f0 tx=0x7f9dbc00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 shutdown_connections 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9db00b6510 0x7f9db00b8a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc109e10 0x7f9dcc19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dcc1094c0 0x7f9dcc19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 --2- 172.21.15.79:0/2889735924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc103b80 0x7f9dcc19a4e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:34.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 >> 172.21.15.79:0/2889735924 conn(0x7f9dcc0ff610 msgr2=0x7f9dcc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:34.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 shutdown_connections 2024-09-21T02:33:34.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:34.658+0000 7f9dd2200640 1 -- 172.21.15.79:0/2889735924 wait complete. 2024-09-21T02:33:34.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:34 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2889735924' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:33:34.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:34 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:33:34.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:34 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2889735924' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:33:34.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:34 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:33:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:34 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2889735924' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:33:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:34 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:33:35.440 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T02:33:35.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T02:33:35.810 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:35.949 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:35 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:33:35.949 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:35 smithi079 ceph-mon[30788]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T02:33:35.949 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:35 smithi079 ceph-mon[30788]: pgmap v349: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:33:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:35 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:33:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:35 smithi148 ceph-mon[34626]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T02:33:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:35 smithi148 ceph-mon[34626]: pgmap v349: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:33:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:35 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:33:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:35 smithi098 ceph-mon[34832]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T02:33:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:35 smithi098 ceph-mon[34832]: pgmap v349: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:33:36.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 -- 172.21.15.79:0/2766477105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 msgr2=0x7f1f5c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 --2- 172.21.15.79:0/2766477105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 0x7f1f5c1169a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009be0 tx=0x7f1f5402a6c0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 -- 172.21.15.79:0/2766477105 shutdown_connections 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 --2- 172.21.15.79:0/2766477105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 0x7f1f5c1169a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 --2- 172.21.15.79:0/2766477105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 0x7f1f5c114040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 --2- 172.21.15.79:0/2766477105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f5c077940 0x7f1f5c077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 -- 172.21.15.79:0/2766477105 >> 172.21.15.79:0/2766477105 conn(0x7f1f5c101670 msgr2=0x7f1f5c103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 -- 172.21.15.79:0/2766477105 shutdown_connections 2024-09-21T02:33:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.458+0000 7f1f5b200640 1 -- 172.21.15.79:0/2766477105 wait complete. 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.459+0000 7f1f5b200640 1 Processor -- start 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.459+0000 7f1f5b200640 1 -- start start 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f5b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f5c077940 0x7f1f5c1a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f5b200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 0x7f1f5c1a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f5b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 0x7f1f5c1a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f5b200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c119f00 con 0x7f1f5c078290 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f5b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c119d80 con 0x7f1f5c077940 2024-09-21T02:33:36.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f5b200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c11a080 con 0x7f1f5c114580 2024-09-21T02:33:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f59400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 0x7f1f5c1a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f5c077940 0x7f1f5c1a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f59400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 0x7f1f5c1a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44420/0 (socket says 172.21.15.79:44420) 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f59400640 1 -- 172.21.15.79:0/1578563340 learned_addr learned my addr 172.21.15.79:0/1578563340 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.460+0000 7f1f5a800640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 0x7f1f5c1a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f59e00640 1 -- 172.21.15.79:0/1578563340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 msgr2=0x7f1f5c1a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f59e00640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 0x7f1f5c1a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f59e00640 1 -- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 msgr2=0x7f1f5c1a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f59e00640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 0x7f1f5c1a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f59e00640 1 -- 172.21.15.79:0/1578563340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c1a67e0 con 0x7f1f5c077940 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f59400640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 0x7f1f5c1a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f59e00640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f5c077940 0x7f1f5c1a0870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e9f0 tx=0x7f1f4c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f52a00640 1 -- 172.21.15.79:0/1578563340 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00ccc0 con 0x7f1f5c077940 2024-09-21T02:33:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c1a6ad0 con 0x7f1f5c077940 2024-09-21T02:33:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f52a00640 1 -- 172.21.15.79:0/1578563340 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c005020 con 0x7f1f5c077940 2024-09-21T02:33:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f52a00640 1 -- 172.21.15.79:0/1578563340 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c004a00 con 0x7f1f5c077940 2024-09-21T02:33:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.461+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1ad230 con 0x7f1f5c077940 2024-09-21T02:33:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.462+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5c077d50 con 0x7f1f5c077940 2024-09-21T02:33:36.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.465+0000 7f1f52a00640 1 -- 172.21.15.79:0/1578563340 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1f4c004ba0 con 0x7f1f5c077940 2024-09-21T02:33:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.466+0000 7f1f52a00640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f400b6510 0x7f1f400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.467+0000 7f1f52a00640 1 -- 172.21.15.79:0/1578563340 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f1f4c0e76f0 con 0x7f1f5c077940 2024-09-21T02:33:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.467+0000 7f1f59400640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f400b6510 0x7f1f400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.467+0000 7f1f59400640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f400b6510 0x7f1f400b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c07ab60 tx=0x7f1f48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:36.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.468+0000 7f1f52a00640 1 -- 172.21.15.79:0/1578563340 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f4c0adc50 con 0x7f1f5c077940 2024-09-21T02:33:36.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.678+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1f5c063800 con 0x7f1f400b6510 2024-09-21T02:33:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.704+0000 7f1f52a00640 1 -- 172.21.15.79:0/1578563340 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1f5c063800 con 0x7f1f400b6510 2024-09-21T02:33:36.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f400b6510 msgr2=0x7f1f400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:36.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f400b6510 0x7f1f400b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c07ab60 tx=0x7f1f48009260 comp rx=0 tx=0).stop 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f5c077940 msgr2=0x7f1f5c1a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f5c077940 0x7f1f5c1a0870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e9f0 tx=0x7f1f4c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 shutdown_connections 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f400b6510 0x7f1f400b8a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c114580 0x7f1f5c1a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f5c078290 0x7f1f5c1a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 --2- 172.21.15.79:0/1578563340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f5c077940 0x7f1f5c1a0870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 >> 172.21.15.79:0/1578563340 conn(0x7f1f5c101670 msgr2=0x7f1f5c1165d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 shutdown_connections 2024-09-21T02:33:36.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:36.706+0000 7f1f5b200640 1 -- 172.21.15.79:0/1578563340 wait complete. 2024-09-21T02:33:36.978 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:33:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:33:36.686+0000 7fbac8200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:33:36.978 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:33:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:33:36.686+0000 7fbac8200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:33:36.979 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:33:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:33:36.686+0000 7fbac8200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:33:36.979 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:33:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:33:36.686+0000 7fbac8200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:33:36.979 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:33:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:33:36.686+0000 7fbac8200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:33:37.470 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:37 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:37.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T02:33:37.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:37 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:37 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:38 smithi079 ceph-mon[30788]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:38.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:38 smithi079 ceph-mon[30788]: pgmap v350: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:38.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:38 smithi148 ceph-mon[34626]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:38.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:38 smithi148 ceph-mon[34626]: pgmap v350: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:38.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:38 smithi098 ceph-mon[34832]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:38.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:38 smithi098 ceph-mon[34832]: pgmap v350: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:39.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 -- 172.21.15.79:0/55906468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 msgr2=0x7f72c80761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:39.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 --2- 172.21.15.79:0/55906468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 0x7f72c80761e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009860 tx=0x7f72b402a340 comp rx=0 tx=0).stop 2024-09-21T02:33:39.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 -- 172.21.15.79:0/55906468 shutdown_connections 2024-09-21T02:33:39.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 --2- 172.21.15.79:0/55906468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8114440 0x7f72c8116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 --2- 172.21.15.79:0/55906468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 0x7f72c80761e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 --2- 172.21.15.79:0/55906468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8077380 0x7f72c80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 -- 172.21.15.79:0/55906468 >> 172.21.15.79:0/55906468 conn(0x7f72c80ff5e0 msgr2=0x7f72c8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:39.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 -- 172.21.15.79:0/55906468 shutdown_connections 2024-09-21T02:33:39.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.131+0000 7f72ce400640 1 -- 172.21.15.79:0/55906468 wait complete. 2024-09-21T02:33:39.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.133+0000 7f72ce400640 1 Processor -- start 2024-09-21T02:33:39.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.133+0000 7f72ce400640 1 -- start start 2024-09-21T02:33:39.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72ce400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 0x7f72c81a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:39.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72ce400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8077380 0x7f72c81a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:39.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72ce400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8114440 0x7f72c81a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:39.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72ce400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72c811a050 con 0x7f72c8114440 2024-09-21T02:33:39.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72ce400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f72c8119ed0 con 0x7f72c8077380 2024-09-21T02:33:39.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72ce400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72c811a1d0 con 0x7f72c8075dd0 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72c6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8077380 0x7f72c81a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72c6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8077380 0x7f72c81a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:49740/0 (socket says 172.21.15.79:49740) 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72c6a00640 1 -- 172.21.15.79:0/546997748 learned_addr learned my addr 172.21.15.79:0/546997748 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72c7e00640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8114440 0x7f72c81a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.134+0000 7f72c7400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 0x7f72c81a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.135+0000 7f72c7e00640 1 -- 172.21.15.79:0/546997748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 msgr2=0x7f72c81a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.135+0000 7f72c7e00640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 0x7f72c81a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.135+0000 7f72c7e00640 1 -- 172.21.15.79:0/546997748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8077380 msgr2=0x7f72c81a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.135+0000 7f72c7e00640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8077380 0x7f72c81a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.135+0000 7f72c7e00640 1 -- 172.21.15.79:0/546997748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c81a69d0 con 0x7f72c8114440 2024-09-21T02:33:39.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.135+0000 7f72c6a00640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8077380 0x7f72c81a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:39.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.135+0000 7f72c7e00640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8114440 0x7f72c81a62a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009fd0 tx=0x7f72c000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:39.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.136+0000 7f72bfe00640 1 -- 172.21.15.79:0/546997748 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c000cd60 con 0x7f72c8114440 2024-09-21T02:33:39.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.136+0000 7f72bfe00640 1 -- 172.21.15.79:0/546997748 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c0005020 con 0x7f72c8114440 2024-09-21T02:33:39.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.136+0000 7f72bfe00640 1 -- 172.21.15.79:0/546997748 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0010690 con 0x7f72c8114440 2024-09-21T02:33:39.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.136+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c81a6cc0 con 0x7f72c8114440 2024-09-21T02:33:39.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.136+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c81ad420 con 0x7f72c8114440 2024-09-21T02:33:39.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.137+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c80761e0 con 0x7f72c8114440 2024-09-21T02:33:39.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.139+0000 7f72bfe00640 1 -- 172.21.15.79:0/546997748 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f72c00054d0 con 0x7f72c8114440 2024-09-21T02:33:39.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.142+0000 7f72bfe00640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72ac0b6620 0x7f72ac0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:39.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.142+0000 7f72bfe00640 1 -- 172.21.15.79:0/546997748 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f72c00e7ee0 con 0x7f72c8114440 2024-09-21T02:33:39.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.142+0000 7f72c7400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72ac0b6620 0x7f72ac0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:39.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.143+0000 7f72c7400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72ac0b6620 0x7f72ac0b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005fd0 tx=0x7f72b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:39.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.146+0000 7f72bfe00640 1 -- 172.21.15.79:0/546997748 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72c00ae250 con 0x7f72c8114440 2024-09-21T02:33:39.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.385+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f72c8063800 con 0x7f72ac0b6620 2024-09-21T02:33:39.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.414+0000 7f72bfe00640 1 -- 172.21.15.79:0/546997748 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f72c8063800 con 0x7f72ac0b6620 2024-09-21T02:33:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72ac0b6620 msgr2=0x7f72ac0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72ac0b6620 0x7f72ac0b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005fd0 tx=0x7f72b8009260 comp rx=0 tx=0).stop 2024-09-21T02:33:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8114440 msgr2=0x7f72c81a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:39.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8114440 0x7f72c81a62a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009fd0 tx=0x7f72c000ee50 comp rx=0 tx=0).stop 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 shutdown_connections 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72ac0b6620 0x7f72ac0b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c8114440 0x7f72c81a62a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72c8077380 0x7f72c81a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 --2- 172.21.15.79:0/546997748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c8075dd0 0x7f72c81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 >> 172.21.15.79:0/546997748 conn(0x7f72c80ff5e0 msgr2=0x7f72c8110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 shutdown_connections 2024-09-21T02:33:39.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:39.416+0000 7f72ce400640 1 -- 172.21.15.79:0/546997748 wait complete. 2024-09-21T02:33:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:39 smithi079 ceph-mon[30788]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T02:33:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:39 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:39 smithi148 ceph-mon[34626]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T02:33:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:39 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:39 smithi098 ceph-mon[34832]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T02:33:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:39 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:40.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T02:33:40.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:40 smithi079 ceph-mon[30788]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:40.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:40 smithi079 ceph-mon[30788]: pgmap v351: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 932 B/s wr, 2 op/s 2024-09-21T02:33:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:40 smithi148 ceph-mon[34626]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:40 smithi148 ceph-mon[34626]: pgmap v351: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 932 B/s wr, 2 op/s 2024-09-21T02:33:40.615 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:40.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:40 smithi098 ceph-mon[34832]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:40.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:40 smithi098 ceph-mon[34832]: pgmap v351: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 932 B/s wr, 2 op/s 2024-09-21T02:33:41.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 -- 172.21.15.79:0/15156805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 msgr2=0x7f6260075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:41.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 --2- 172.21.15.79:0/15156805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 0x7f6260075bc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6250009900 tx=0x7f625002a410 comp rx=0 tx=0).stop 2024-09-21T02:33:41.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 -- 172.21.15.79:0/15156805 shutdown_connections 2024-09-21T02:33:41.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 --2- 172.21.15.79:0/15156805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62601100d0 0x7f6260112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 --2- 172.21.15.79:0/15156805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 0x7f626010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 --2- 172.21.15.79:0/15156805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 0x7f6260075bc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 -- 172.21.15.79:0/15156805 >> 172.21.15.79:0/15156805 conn(0x7f62600ff5e0 msgr2=0x7f6260101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:41.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 -- 172.21.15.79:0/15156805 shutdown_connections 2024-09-21T02:33:41.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.244+0000 7f6266200640 1 -- 172.21.15.79:0/15156805 wait complete. 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.245+0000 7f6266200640 1 Processor -- start 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.245+0000 7f6266200640 1 -- start start 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f6266200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 0x7f626019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f6266200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 0x7f626019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f6266200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62601100d0 0x7f62601a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f6266200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6260115cd0 con 0x7f62600757b0 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f6266200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6260115b50 con 0x7f62601100d0 2024-09-21T02:33:41.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f6266200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6260115e50 con 0x7f6260076100 2024-09-21T02:33:41.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f625ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 0x7f626019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:41.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f625f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 0x7f626019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:41.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f625ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 0x7f626019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:44306/0 (socket says 172.21.15.79:44306) 2024-09-21T02:33:41.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f625ea00640 1 -- 172.21.15.79:0/4147309610 learned_addr learned my addr 172.21.15.79:0/4147309610 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:41.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.246+0000 7f625fe00640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62601100d0 0x7f62601a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f625ea00640 1 -- 172.21.15.79:0/4147309610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62601100d0 msgr2=0x7f62601a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f625ea00640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62601100d0 0x7f62601a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f625ea00640 1 -- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 msgr2=0x7f626019c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f625ea00640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 0x7f626019c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f625ea00640 1 -- 172.21.15.79:0/4147309610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62601a25f0 con 0x7f6260076100 2024-09-21T02:33:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f625f400640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 0x7f626019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f625ea00640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 0x7f626019cc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f624c00e9c0 tx=0x7f624c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f6257e00640 1 -- 172.21.15.79:0/4147309610 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c00cd80 con 0x7f6260076100 2024-09-21T02:33:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f6257e00640 1 -- 172.21.15.79:0/4147309610 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f624c0035f0 con 0x7f6260076100 2024-09-21T02:33:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.247+0000 7f6257e00640 1 -- 172.21.15.79:0/4147309610 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c010690 con 0x7f6260076100 2024-09-21T02:33:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.248+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62601a28e0 con 0x7f6260076100 2024-09-21T02:33:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.248+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601a9040 con 0x7f6260076100 2024-09-21T02:33:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.249+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6260075bc0 con 0x7f6260076100 2024-09-21T02:33:41.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.255+0000 7f6257e00640 1 -- 172.21.15.79:0/4147309610 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f624c004000 con 0x7f6260076100 2024-09-21T02:33:41.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.256+0000 7f6257e00640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62440b65a0 0x7f62440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.256+0000 7f6257e00640 1 -- 172.21.15.79:0/4147309610 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f624c0e7ff0 con 0x7f6260076100 2024-09-21T02:33:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.256+0000 7f625f400640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62440b65a0 0x7f62440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.257+0000 7f6257e00640 1 -- 172.21.15.79:0/4147309610 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f624c0e84d0 con 0x7f6260076100 2024-09-21T02:33:41.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.257+0000 7f625f400640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62440b65a0 0x7f62440b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6250005ab0 tx=0x7f6250005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:41.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.488+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f626010a2f0 con 0x7f62440b65a0 2024-09-21T02:33:41.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.495+0000 7f6257e00640 1 -- 172.21.15.79:0/4147309610 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f626010a2f0 con 0x7f62440b65a0 2024-09-21T02:33:41.497 INFO:teuthology.orchestra.run.smithi079.stdout:/volumes/qa/sv_0/413b5dee-e178-42cc-8bee-d2f0e6072ce4 2024-09-21T02:33:41.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62440b65a0 msgr2=0x7f62440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:41.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62440b65a0 0x7f62440b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6250005ab0 tx=0x7f6250005a20 comp rx=0 tx=0).stop 2024-09-21T02:33:41.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 msgr2=0x7f626019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:41.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 0x7f626019cc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f624c00e9c0 tx=0x7f624c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 shutdown_connections 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62440b65a0 0x7f62440b8ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62601100d0 0x7f62601a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6260076100 0x7f626019cc20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 --2- 172.21.15.79:0/4147309610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62600757b0 0x7f626019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 >> 172.21.15.79:0/4147309610 conn(0x7f62600ff5e0 msgr2=0x7f6260109be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 shutdown_connections 2024-09-21T02:33:41.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:41.497+0000 7f6266200640 1 -- 172.21.15.79:0/4147309610 wait complete. 2024-09-21T02:33:41.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:41.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:41.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:33:42.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T02:33:42.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:42 smithi098 ceph-mon[34832]: pgmap v352: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 941 B/s wr, 2 op/s 2024-09-21T02:33:42.674 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:42 smithi079 ceph-mon[30788]: pgmap v352: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 941 B/s wr, 2 op/s 2024-09-21T02:33:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:42 smithi148 ceph-mon[34626]: pgmap v352: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 941 B/s wr, 2 op/s 2024-09-21T02:33:43.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.314+0000 7f8249200640 1 -- 172.21.15.79:0/818648037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8244105d80 msgr2=0x7f8244106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:43.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.314+0000 7f8249200640 1 --2- 172.21.15.79:0/818648037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8244105d80 0x7f8244106190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8234009900 tx=0x7f823402a410 comp rx=0 tx=0).stop 2024-09-21T02:33:43.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.314+0000 7f8249200640 1 -- 172.21.15.79:0/818648037 shutdown_connections 2024-09-21T02:33:43.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.314+0000 7f8249200640 1 --2- 172.21.15.79:0/818648037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f824410c010 0x7f8244112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.314+0000 7f8249200640 1 --2- 172.21.15.79:0/818648037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f824410b6c0 0x7f824410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.314+0000 7f8249200640 1 --2- 172.21.15.79:0/818648037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8244105d80 0x7f8244106190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.314+0000 7f8249200640 1 -- 172.21.15.79:0/818648037 >> 172.21.15.79:0/818648037 conn(0x7f8244101810 msgr2=0x7f8244103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:43.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.315+0000 7f8249200640 1 -- 172.21.15.79:0/818648037 shutdown_connections 2024-09-21T02:33:43.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.315+0000 7f8249200640 1 -- 172.21.15.79:0/818648037 wait complete. 2024-09-21T02:33:43.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 Processor -- start 2024-09-21T02:33:43.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 -- start start 2024-09-21T02:33:43.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8244105d80 0x7f824419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f824410b6c0 0x7f824419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f824410c010 0x7f82441a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8244115cd0 con 0x7f824410b6c0 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8244115b50 con 0x7f824410c010 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8249200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8244115e50 con 0x7f8244105d80 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.316+0000 7f8239400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f824410b6c0 0x7f824419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8239400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f824410b6c0 0x7f824419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44486/0 (socket says 172.21.15.79:44486) 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8239400640 1 -- 172.21.15.79:0/4163642869 learned_addr learned my addr 172.21.15.79:0/4163642869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8241e00640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8244105d80 0x7f824419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8242800640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f824410c010 0x7f82441a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8241e00640 1 -- 172.21.15.79:0/4163642869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f824410c010 msgr2=0x7f82441a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8241e00640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f824410c010 0x7f82441a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8241e00640 1 -- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f824410b6c0 msgr2=0x7f824419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8241e00640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f824410b6c0 0x7f824419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8241e00640 1 -- 172.21.15.79:0/4163642869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82441a2630 con 0x7f8244105d80 2024-09-21T02:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8239400640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f824410b6c0 0x7f824419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.317+0000 7f8241e00640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8244105d80 0x7f824419c6c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f823402a930 tx=0x7f8234031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.318+0000 7f823b400640 1 -- 172.21.15.79:0/4163642869 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823403f030 con 0x7f8244105d80 2024-09-21T02:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.318+0000 7f823b400640 1 -- 172.21.15.79:0/4163642869 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8234004490 con 0x7f8244105d80 2024-09-21T02:33:43.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.318+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82441a28c0 con 0x7f8244105d80 2024-09-21T02:33:43.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.318+0000 7f823b400640 1 -- 172.21.15.79:0/4163642869 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234035070 con 0x7f8244105d80 2024-09-21T02:33:43.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.318+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82441a9080 con 0x7f8244105d80 2024-09-21T02:33:43.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.319+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8244106190 con 0x7f8244105d80 2024-09-21T02:33:43.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.321+0000 7f823b400640 1 -- 172.21.15.79:0/4163642869 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8234042030 con 0x7f8244105d80 2024-09-21T02:33:43.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.323+0000 7f823b400640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82280b6620 0x7f82280b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:43.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.323+0000 7f823b400640 1 -- 172.21.15.79:0/4163642869 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f8234107c50 con 0x7f8244105d80 2024-09-21T02:33:43.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.323+0000 7f8239400640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82280b6620 0x7f82280b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:43.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.324+0000 7f8239400640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82280b6620 0x7f82280b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f824410b200 tx=0x7f822c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:43.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.325+0000 7f823b400640 1 -- 172.21.15.79:0/4163642869 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82340d23a0 con 0x7f8244105d80 2024-09-21T02:33:43.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:43 smithi079 ceph-mon[30788]: from='client.24871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:43.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.539+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8244063800 con 0x7f82280b6620 2024-09-21T02:33:43.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.572+0000 7f823b400640 1 -- 172.21.15.79:0/4163642869 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8244063800 con 0x7f82280b6620 2024-09-21T02:33:43.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82280b6620 msgr2=0x7f82280b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82280b6620 0x7f82280b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f824410b200 tx=0x7f822c005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8244105d80 msgr2=0x7f824419c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8244105d80 0x7f824419c6c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f823402a930 tx=0x7f8234031a20 comp rx=0 tx=0).stop 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 shutdown_connections 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82280b6620 0x7f82280b8b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f824410c010 0x7f82441a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f824410b6c0 0x7f824419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 --2- 172.21.15.79:0/4163642869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8244105d80 0x7f824419c6c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 >> 172.21.15.79:0/4163642869 conn(0x7f8244101810 msgr2=0x7f8244103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.574+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 shutdown_connections 2024-09-21T02:33:43.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:43.575+0000 7f8249200640 1 -- 172.21.15.79:0/4163642869 wait complete. 2024-09-21T02:33:43.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:43 smithi098 ceph-mon[34832]: from='client.24871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:43 smithi148 ceph-mon[34626]: from='client.24871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:44.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T02:33:44.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:44 smithi079 ceph-mon[30788]: pgmap v353: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:33:44.635 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:44.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:44 smithi098 ceph-mon[34832]: pgmap v353: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:33:44.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:44 smithi148 ceph-mon[34626]: pgmap v353: 129 pgs: 129 active+clean; 588 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 -- 172.21.15.79:0/3408356563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360406c0e0 msgr2=0x7f360406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 --2- 172.21.15.79:0/3408356563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360406c0e0 0x7f360406c4f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009900 tx=0x7f35f002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 -- 172.21.15.79:0/3408356563 shutdown_connections 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 --2- 172.21.15.79:0/3408356563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3604110040 0x7f3604112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 --2- 172.21.15.79:0/3408356563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360406c0e0 0x7f360406c4f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 --2- 172.21.15.79:0/3408356563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36041046a0 0x7f360406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 -- 172.21.15.79:0/3408356563 >> 172.21.15.79:0/3408356563 conn(0x7f36040799a0 msgr2=0x7f3604079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 -- 172.21.15.79:0/3408356563 shutdown_connections 2024-09-21T02:33:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.375+0000 7f360b000640 1 -- 172.21.15.79:0/3408356563 wait complete. 2024-09-21T02:33:45.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 Processor -- start 2024-09-21T02:33:45.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 -- start start 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360406c0e0 0x7f360419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36041046a0 0x7f360419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3604110040 0x7f36041a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3604115d10 con 0x7f36041046a0 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3604115b90 con 0x7f360406c0e0 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.377+0000 7f360b000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3604115e90 con 0x7f3604110040 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360406c0e0 0x7f360419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36041046a0 0x7f360419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360406c0e0 0x7f360419c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:56070/0 (socket says 172.21.15.79:56070) 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 -- 172.21.15.79:0/1448166555 learned_addr learned my addr 172.21.15.79:0/1448166555 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3609000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3604110040 0x7f36041a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 -- 172.21.15.79:0/1448166555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3604110040 msgr2=0x7f36041a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3604110040 0x7f36041a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 -- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36041046a0 msgr2=0x7f360419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36041046a0 0x7f360419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 -- 172.21.15.79:0/1448166555 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36041a2690 con 0x7f360406c0e0 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3609000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3604110040 0x7f36041a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.378+0000 7f3603e00640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360406c0e0 0x7f360419c720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f35f400e9f0 tx=0x7f35f400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.379+0000 7f3600c00640 1 -- 172.21.15.79:0/1448166555 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f400cd80 con 0x7f360406c0e0 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.379+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36041a2980 con 0x7f360406c0e0 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.379+0000 7f3600c00640 1 -- 172.21.15.79:0/1448166555 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f40108e0 con 0x7f360406c0e0 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.379+0000 7f3600c00640 1 -- 172.21.15.79:0/1448166555 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4018980 con 0x7f360406c0e0 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.379+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36041a90e0 con 0x7f360406c0e0 2024-09-21T02:33:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.380+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f360406c4f0 con 0x7f360406c0e0 2024-09-21T02:33:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.383+0000 7f3600c00640 1 -- 172.21.15.79:0/1448166555 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f35f4010430 con 0x7f360406c0e0 2024-09-21T02:33:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.384+0000 7f3600c00640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35e80b65a0 0x7f35e80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.384+0000 7f3600c00640 1 -- 172.21.15.79:0/1448166555 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f35f40e80c0 con 0x7f360406c0e0 2024-09-21T02:33:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.384+0000 7f3603400640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35e80b65a0 0x7f35e80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.385+0000 7f3603400640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35e80b65a0 0x7f35e80b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f35f002a9e0 tx=0x7f35f0005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:45.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.386+0000 7f3600c00640 1 -- 172.21.15.79:0/1448166555 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35f40ae430 con 0x7f360406c0e0 2024-09-21T02:33:45.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.608+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3604101c00 con 0x7f35e80b65a0 2024-09-21T02:33:45.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.613+0000 7f3600c00640 1 -- 172.21.15.79:0/1448166555 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3604101c00 con 0x7f35e80b65a0 2024-09-21T02:33:45.614 INFO:teuthology.orchestra.run.smithi079.stdout:/volumes/qa/sv_1/269a1161-9dbe-40e4-b6ca-6cedc21ad806 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.615+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35e80b65a0 msgr2=0x7f35e80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.615+0000 7f360b000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35e80b65a0 0x7f35e80b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f35f002a9e0 tx=0x7f35f0005a20 comp rx=0 tx=0).stop 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.615+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360406c0e0 msgr2=0x7f360419c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.615+0000 7f360b000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360406c0e0 0x7f360419c720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f35f400e9f0 tx=0x7f35f400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 shutdown_connections 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35e80b65a0 0x7f35e80b8ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3604110040 0x7f36041a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36041046a0 0x7f360419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 --2- 172.21.15.79:0/1448166555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360406c0e0 0x7f360419c720 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:45.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 >> 172.21.15.79:0/1448166555 conn(0x7f36040799a0 msgr2=0x7f36041014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:45.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 shutdown_connections 2024-09-21T02:33:45.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:45.616+0000 7f360b000640 1 -- 172.21.15.79:0/1448166555 wait complete. 2024-09-21T02:33:45.640 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:45 smithi079 ceph-mon[30788]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:45.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:45 smithi098 ceph-mon[34832]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:45 smithi148 ceph-mon[34626]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:46.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:33:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:46 smithi098 ceph-mon[34832]: pgmap v354: 129 pgs: 129 active+clean; 608 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-21T02:33:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:46 smithi079 ceph-mon[30788]: pgmap v354: 129 pgs: 129 active+clean; 608 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-21T02:33:46.732 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:46.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:46 smithi148 ceph-mon[34626]: pgmap v354: 129 pgs: 129 active+clean; 608 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-21T02:33:47.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 -- 172.21.15.79:0/1198069508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 msgr2=0x7f170c109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:47.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 --2- 172.21.15.79:0/1198069508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c109700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009900 tx=0x7f16f802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 -- 172.21.15.79:0/1198069508 shutdown_connections 2024-09-21T02:33:47.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 --2- 172.21.15.79:0/1198069508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f170c109c40 0x7f170c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 --2- 172.21.15.79:0/1198069508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c109700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 --2- 172.21.15.79:0/1198069508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1039b0 0x7f170c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 -- 172.21.15.79:0/1198069508 >> 172.21.15.79:0/1198069508 conn(0x7f170c0ff440 msgr2=0x7f170c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:47.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 -- 172.21.15.79:0/1198069508 shutdown_connections 2024-09-21T02:33:47.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.392+0000 7f170b200640 1 -- 172.21.15.79:0/1198069508 wait complete. 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.393+0000 7f170b200640 1 Processor -- start 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.393+0000 7f170b200640 1 -- start start 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f170b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1039b0 0x7f170c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f170b200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f170b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f170c109c40 0x7f170c19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f170b200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f170c113950 con 0x7f170c1092f0 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f170b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1137d0 con 0x7f170c109c40 2024-09-21T02:33:47.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f170b200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f170c113ad0 con 0x7f170c1039b0 2024-09-21T02:33:47.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:47.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1039b0 0x7f170c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:47.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33622/0 (socket says 172.21.15.79:33622) 2024-09-21T02:33:47.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1039b0 0x7f170c19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55270/0 (socket says 172.21.15.79:55270) 2024-09-21T02:33:47.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 -- 172.21.15.79:0/628625150 learned_addr learned my addr 172.21.15.79:0/628625150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:47.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f170a800640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f170c109c40 0x7f170c19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 -- 172.21.15.79:0/628625150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1039b0 msgr2=0x7f170c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1039b0 0x7f170c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 -- 172.21.15.79:0/628625150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f170c109c40 msgr2=0x7f170c19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f170c109c40 0x7f170c19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.394+0000 7f1709400640 1 -- 172.21.15.79:0/628625150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c1a02b0 con 0x7f170c1092f0 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.395+0000 7f1709400640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c19a8e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f16f8005ab0 tx=0x7f16f8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.395+0000 7f1702a00640 1 -- 172.21.15.79:0/628625150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f803f070 con 0x7f170c1092f0 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.395+0000 7f1702a00640 1 -- 172.21.15.79:0/628625150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16f8031b50 con 0x7f170c1092f0 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.395+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c1a0540 con 0x7f170c1092f0 2024-09-21T02:33:47.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.395+0000 7f1702a00640 1 -- 172.21.15.79:0/628625150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8035030 con 0x7f170c1092f0 2024-09-21T02:33:47.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.395+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c1a6d00 con 0x7f170c1092f0 2024-09-21T02:33:47.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.397+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170c103dc0 con 0x7f170c1092f0 2024-09-21T02:33:47.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.400+0000 7f1702a00640 1 -- 172.21.15.79:0/628625150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f16f8042070 con 0x7f170c1092f0 2024-09-21T02:33:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.401+0000 7f1702a00640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f16f00b6620 0x7f16f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.402+0000 7f1702a00640 1 -- 172.21.15.79:0/628625150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f16f8107d90 con 0x7f170c1092f0 2024-09-21T02:33:47.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.402+0000 7f1709e00640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f16f00b6620 0x7f16f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:47.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.403+0000 7f1709e00640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f16f00b6620 0x7f16f00b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009bd0 tx=0x7f16fc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:47.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.408+0000 7f1702a00640 1 -- 172.21.15.79:0/628625150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16f810b030 con 0x7f170c1092f0 2024-09-21T02:33:47.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:47 smithi079 ceph-mon[30788]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:47.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:47 smithi098 ceph-mon[34832]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.666+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f170c19b470 con 0x7f170c1092f0 2024-09-21T02:33:47.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.667+0000 7f1702a00640 1 -- 172.21.15.79:0/628625150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f16f80d2540 con 0x7f170c1092f0 2024-09-21T02:33:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:47.668 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:33:47.669 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f16f00b6620 msgr2=0x7f16f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f16f00b6620 0x7f16f00b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009bd0 tx=0x7f16fc005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 msgr2=0x7f170c19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c19a8e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f16f8005ab0 tx=0x7f16f8003b90 comp rx=0 tx=0).stop 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 shutdown_connections 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f16f00b6620 0x7f16f00b8b30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f170c109c40 0x7f170c19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c1092f0 0x7f170c19a8e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 --2- 172.21.15.79:0/628625150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1039b0 0x7f170c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:47.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 >> 172.21.15.79:0/628625150 conn(0x7f170c0ff440 msgr2=0x7f170c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:47.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 shutdown_connections 2024-09-21T02:33:47.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:47.670+0000 7f170b200640 1 -- 172.21.15.79:0/628625150 wait complete. 2024-09-21T02:33:47.714 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:47 smithi148 ceph-mon[34626]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:48.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:33:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:48 smithi079 ceph-mon[30788]: pgmap v355: 129 pgs: 129 active+clean; 608 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-21T02:33:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:48 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/628625150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:33:48.805 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:48.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:48 smithi148 ceph-mon[34626]: pgmap v355: 129 pgs: 129 active+clean; 608 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-21T02:33:48.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:48 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/628625150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:33:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:48 smithi098 ceph-mon[34832]: pgmap v355: 129 pgs: 129 active+clean; 608 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-21T02:33:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:48 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/628625150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:33:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 -- 172.21.15.79:0/2513277623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc10b6c0 msgr2=0x7f6ecc10bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 --2- 172.21.15.79:0/2513277623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc10bad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009900 tx=0x7f6eb402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 -- 172.21.15.79:0/2513277623 shutdown_connections 2024-09-21T02:33:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 --2- 172.21.15.79:0/2513277623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ecc10c010 0x7f6ecc112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 --2- 172.21.15.79:0/2513277623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc10bad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 --2- 172.21.15.79:0/2513277623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc105d80 0x7f6ecc106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 -- 172.21.15.79:0/2513277623 >> 172.21.15.79:0/2513277623 conn(0x7f6ecc101810 msgr2=0x7f6ecc103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 -- 172.21.15.79:0/2513277623 shutdown_connections 2024-09-21T02:33:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.460+0000 7f6ed3200640 1 -- 172.21.15.79:0/2513277623 wait complete. 2024-09-21T02:33:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.461+0000 7f6ed3200640 1 Processor -- start 2024-09-21T02:33:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed3200640 1 -- start start 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed3200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc105d80 0x7f6ecc19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed3200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ecc10c010 0x7f6ecc1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed3200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc115cd0 con 0x7f6ecc105d80 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed3200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc115b50 con 0x7f6ecc10c010 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed3200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc115e50 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ecbe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc105d80 0x7f6ecc19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ec3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ecbe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc105d80 0x7f6ecc19c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33642/0 (socket says 172.21.15.79:33642) 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ec3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55288/0 (socket says 172.21.15.79:55288) 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ecbe00640 1 -- 172.21.15.79:0/1773104855 learned_addr learned my addr 172.21.15.79:0/1773104855 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:49.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.462+0000 7f6ed1200640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ecc10c010 0x7f6ecc1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.463+0000 7f6ec3400640 1 -- 172.21.15.79:0/1773104855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ecc10c010 msgr2=0x7f6ecc1a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.463+0000 7f6ec3400640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ecc10c010 0x7f6ecc1a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.463+0000 7f6ec3400640 1 -- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc105d80 msgr2=0x7f6ecc19c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.463+0000 7f6ec3400640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc105d80 0x7f6ecc19c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.463+0000 7f6ec3400640 1 -- 172.21.15.79:0/1773104855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ecc1a2630 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.463+0000 7f6ec3400640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc19cc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6eb402a910 tx=0x7f6eb4031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.464+0000 7f6ec9600640 1 -- 172.21.15.79:0/1773104855 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb403f070 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.464+0000 7f6ec9600640 1 -- 172.21.15.79:0/1773104855 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6eb4004490 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.464+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ecc1a28c0 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.464+0000 7f6ec9600640 1 -- 172.21.15.79:0/1773104855 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4035070 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.464+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ecc1a9080 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.465+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ecc107000 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.467+0000 7f6ec9600640 1 -- 172.21.15.79:0/1773104855 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f6eb403b460 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.469+0000 7f6ec9600640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6eb00b65a0 0x7f6eb00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.469+0000 7f6ec9600640 1 -- 172.21.15.79:0/1773104855 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f6eb4107d90 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.469+0000 7f6ecbe00640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6eb00b65a0 0x7f6eb00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:49.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.470+0000 7f6ecbe00640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6eb00b65a0 0x7f6eb00b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009cd0 tx=0x7f6ebc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:49.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.473+0000 7f6ec9600640 1 -- 172.21.15.79:0/1773104855 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6eb40d24e0 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.662 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:49 smithi079 ceph-mon[30788]: pgmap v356: 129 pgs: 129 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-21T02:33:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.661+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ecc10de00 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.662+0000 7f6ec9600640 1 -- 172.21.15.79:0/1773104855 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24636 (secure 0 0 0) 0x7f6eb40c9070 con 0x7f6ecc10b6c0 2024-09-21T02:33:49.664 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:49.664 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:33:30.524684+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:33:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6eb00b65a0 msgr2=0x7f6eb00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6eb00b65a0 0x7f6eb00b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009cd0 tx=0x7f6ebc005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc10b6c0 msgr2=0x7f6ecc19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc19cc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6eb402a910 tx=0x7f6eb4031a20 comp rx=0 tx=0).stop 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 shutdown_connections 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6eb00b65a0 0x7f6eb00b8ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ecc10c010 0x7f6ecc1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ecc10b6c0 0x7f6ecc19cc60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 --2- 172.21.15.79:0/1773104855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ecc105d80 0x7f6ecc19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 >> 172.21.15.79:0/1773104855 conn(0x7f6ecc101810 msgr2=0x7f6ecc103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 shutdown_connections 2024-09-21T02:33:49.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:49.665+0000 7f6ed3200640 1 -- 172.21.15.79:0/1773104855 wait complete. 2024-09-21T02:33:49.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:49 smithi148 ceph-mon[34626]: pgmap v356: 129 pgs: 129 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-21T02:33:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:49 smithi098 ceph-mon[34832]: pgmap v356: 129 pgs: 129 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-21T02:33:50.450 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:33:50.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:33:50.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:50 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1773104855' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:50.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:50 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1773104855' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:50.821 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:50.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:50 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1773104855' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 -- 172.21.15.79:0/1277858424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081039b0 msgr2=0x7f0f08103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/1277858424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081039b0 0x7f0f08103dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009900 tx=0x7f0efc02a410 comp rx=0 tx=0).stop 2024-09-21T02:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 -- 172.21.15.79:0/1277858424 shutdown_connections 2024-09-21T02:33:51.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/1277858424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08109c40 0x7f0f08110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/1277858424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081092f0 0x7f0f08109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/1277858424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081039b0 0x7f0f08103dc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 -- 172.21.15.79:0/1277858424 >> 172.21.15.79:0/1277858424 conn(0x7f0f080ff440 msgr2=0x7f0f08101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 -- 172.21.15.79:0/1277858424 shutdown_connections 2024-09-21T02:33:51.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.441+0000 7f0f0ec00640 1 -- 172.21.15.79:0/1277858424 wait complete. 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.442+0000 7f0f0ec00640 1 Processor -- start 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ec00640 1 -- start start 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ec00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081039b0 0x7f0f0819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ec00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081092f0 0x7f0f0819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ec00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08109c40 0x7f0f0819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ec00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08113900 con 0x7f0f081092f0 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ec00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08113780 con 0x7f0f08109c40 2024-09-21T02:33:51.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ec00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08113a80 con 0x7f0f081039b0 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081039b0 0x7f0f0819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081092f0 0x7f0f0819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081039b0 0x7f0f0819a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55304/0 (socket says 172.21.15.79:55304) 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.443+0000 7f0f0d800640 1 -- 172.21.15.79:0/3596920736 learned_addr learned my addr 172.21.15.79:0/3596920736 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0e200640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08109c40 0x7f0f0819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0ce00640 1 -- 172.21.15.79:0/3596920736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081039b0 msgr2=0x7f0f0819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0ce00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081039b0 0x7f0f0819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0ce00640 1 -- 172.21.15.79:0/3596920736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08109c40 msgr2=0x7f0f0819fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0ce00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08109c40 0x7f0f0819fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0ce00640 1 -- 172.21.15.79:0/3596920736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f081a02a0 con 0x7f0f081092f0 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0d800640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081039b0 0x7f0f0819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0ce00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081092f0 0x7f0f0819a8d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0f0806b990 tx=0x7f0ef400db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:51.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f06000640 1 -- 172.21.15.79:0/3596920736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4017070 con 0x7f0f081092f0 2024-09-21T02:33:51.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f06000640 1 -- 172.21.15.79:0/3596920736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ef4009820 con 0x7f0f081092f0 2024-09-21T02:33:51.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.444+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f081a0590 con 0x7f0f081092f0 2024-09-21T02:33:51.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.445+0000 7f0f06000640 1 -- 172.21.15.79:0/3596920736 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4004b90 con 0x7f0f081092f0 2024-09-21T02:33:51.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.445+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f081a6cf0 con 0x7f0f081092f0 2024-09-21T02:33:51.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.446+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f08103dc0 con 0x7f0f081092f0 2024-09-21T02:33:51.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.448+0000 7f0f06000640 1 -- 172.21.15.79:0/3596920736 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f0ef4004d30 con 0x7f0f081092f0 2024-09-21T02:33:51.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.452+0000 7f0f06000640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ef00b65a0 0x7f0ef00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:51.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.452+0000 7f0f06000640 1 -- 172.21.15.79:0/3596920736 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f0ef40e7070 con 0x7f0f081092f0 2024-09-21T02:33:51.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.452+0000 7f0f0d800640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ef00b65a0 0x7f0ef00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:51.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.453+0000 7f0f0d800640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ef00b65a0 0x7f0ef00b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0efc031440 tx=0x7f0efc0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:51.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.454+0000 7f0f06000640 1 -- 172.21.15.79:0/3596920736 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ef40099d0 con 0x7f0f081092f0 2024-09-21T02:33:51.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.640+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f08063800 con 0x7f0ef00b65a0 2024-09-21T02:33:51.642 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:51 smithi079 ceph-mon[30788]: pgmap v357: 129 pgs: 129 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-09-21T02:33:51.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.648+0000 7f0f06000640 1 -- 172.21.15.79:0/3596920736 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340265 (secure 0 0 0) 0x7f0f08063800 con 0x7f0ef00b65a0 2024-09-21T02:33:51.654 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:51.656 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T02:33:51.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.653+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ef00b65a0 msgr2=0x7f0ef00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:51.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.653+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ef00b65a0 0x7f0ef00b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0efc031440 tx=0x7f0efc0058d0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.653+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081092f0 msgr2=0x7f0f0819a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.653+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081092f0 0x7f0f0819a8d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0f0806b990 tx=0x7f0ef400db30 comp rx=0 tx=0).stop 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 shutdown_connections 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0ef00b65a0 0x7f0ef00b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08109c40 0x7f0f0819fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081092f0 0x7f0f0819a8d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 --2- 172.21.15.79:0/3596920736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f081039b0 0x7f0f0819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 >> 172.21.15.79:0/3596920736 conn(0x7f0f080ff440 msgr2=0x7f0f08101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 shutdown_connections 2024-09-21T02:33:51.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:51.654+0000 7f0f0ec00640 1 -- 172.21.15.79:0/3596920736 wait complete. 2024-09-21T02:33:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:51 smithi148 ceph-mon[34626]: pgmap v357: 129 pgs: 129 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-09-21T02:33:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:51 smithi098 ceph-mon[34832]: pgmap v357: 129 pgs: 129 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-09-21T02:33:52.482 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-21T02:33:51.413342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650999,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":120,"num_read_kb":147,"num_write":209,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387584,"kb_used_data":13364,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554240,"statfs":{"total":1151940427776,"available":1151543541760,"internally_reserved":0,"allocated":13684736,"data_stored":7773071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49391,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":59,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003440"},"pg_stats":[{"pgid":"2.1f","version":"78'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535378+0000","last_change":"2024-09-21T02:32:38.433250+0000","last_active":"2024-09-21T02:33:30.535378+0000","last_peered":"2024-09-21T02:33:30.535378+0000","last_clean":"2024-09-21T02:33:30.535378+0000","last_became_active":"2024-09-21T02:32:38.431844+0000","last_became_peered":"2024-09-21T02:32:38.431844+0000","last_unstale":"2024-09-21T02:33:30.535378+0000","last_undegraded":"2024-09-21T02:33:30.535378+0000","last_fullsized":"2024-09-21T02:33:30.535378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:26.741583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531681+0000","last_change":"2024-09-21T02:32:41.473485+0000","last_active":"2024-09-21T02:33:30.531681+0000","last_peered":"2024-09-21T02:33:30.531681+0000","last_clean":"2024-09-21T02:33:30.531681+0000","last_became_active":"2024-09-21T02:32:41.473134+0000","last_became_peered":"2024-09-21T02:32:41.473134+0000","last_unstale":"2024-09-21T02:33:30.531681+0000","last_undegraded":"2024-09-21T02:33:30.531681+0000","last_fullsized":"2024-09-21T02:33:30.531681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818085+0000","last_change":"2024-09-21T02:32:50.687618+0000","last_active":"2024-09-21T02:33:30.818085+0000","last_peered":"2024-09-21T02:33:30.818085+0000","last_clean":"2024-09-21T02:33:30.818085+0000","last_became_active":"2024-09-21T02:32:50.687157+0000","last_became_peered":"2024-09-21T02:32:50.687157+0000","last_unstale":"2024-09-21T02:33:30.818085+0000","last_undegraded":"2024-09-21T02:33:30.818085+0000","last_fullsized":"2024-09-21T02:33:30.818085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:29.247287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532059+0000","last_change":"2024-09-21T02:32:38.512667+0000","last_active":"2024-09-21T02:33:30.532059+0000","last_peered":"2024-09-21T02:33:30.532059+0000","last_clean":"2024-09-21T02:33:30.532059+0000","last_became_active":"2024-09-21T02:32:38.512261+0000","last_became_peered":"2024-09-21T02:32:38.512261+0000","last_unstale":"2024-09-21T02:33:30.532059+0000","last_undegraded":"2024-09-21T02:33:30.532059+0000","last_fullsized":"2024-09-21T02:33:30.532059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:05.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612563+0000","last_change":"2024-09-21T02:32:41.481816+0000","last_active":"2024-09-21T02:33:30.612563+0000","last_peered":"2024-09-21T02:33:30.612563+0000","last_clean":"2024-09-21T02:33:30.612563+0000","last_became_active":"2024-09-21T02:32:41.478295+0000","last_became_peered":"2024-09-21T02:32:41.478295+0000","last_unstale":"2024-09-21T02:33:30.612563+0000","last_undegraded":"2024-09-21T02:33:30.612563+0000","last_fullsized":"2024-09-21T02:33:30.612563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:58.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.529870+0000","last_change":"2024-09-21T02:32:50.692598+0000","last_active":"2024-09-21T02:33:30.529870+0000","last_peered":"2024-09-21T02:33:30.529870+0000","last_clean":"2024-09-21T02:33:30.529870+0000","last_became_active":"2024-09-21T02:32:50.692120+0000","last_became_peered":"2024-09-21T02:32:50.692120+0000","last_unstale":"2024-09-21T02:33:30.529870+0000","last_undegraded":"2024-09-21T02:33:30.529870+0000","last_fullsized":"2024-09-21T02:33:30.529870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:57.642195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537320+0000","last_change":"2024-09-21T02:32:38.435292+0000","last_active":"2024-09-21T02:33:30.537320+0000","last_peered":"2024-09-21T02:33:30.537320+0000","last_clean":"2024-09-21T02:33:30.537320+0000","last_became_active":"2024-09-21T02:32:38.434878+0000","last_became_peered":"2024-09-21T02:32:38.434878+0000","last_unstale":"2024-09-21T02:33:30.537320+0000","last_undegraded":"2024-09-21T02:33:30.537320+0000","last_fullsized":"2024-09-21T02:33:30.537320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:56.827844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039648+0000","last_change":"2024-09-21T02:32:41.467834+0000","last_active":"2024-09-21T02:33:31.039648+0000","last_peered":"2024-09-21T02:33:31.039648+0000","last_clean":"2024-09-21T02:33:31.039648+0000","last_became_active":"2024-09-21T02:32:41.467440+0000","last_became_peered":"2024-09-21T02:32:41.467440+0000","last_unstale":"2024-09-21T02:33:31.039648+0000","last_undegraded":"2024-09-21T02:33:31.039648+0000","last_fullsized":"2024-09-21T02:33:31.039648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:16.857988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.539702+0000","last_change":"2024-09-21T02:33:30.539580+0000","last_active":"2024-09-21T02:33:30.539702+0000","last_peered":"2024-09-21T02:33:30.539702+0000","last_clean":"2024-09-21T02:33:30.539702+0000","last_became_active":"2024-09-21T02:33:30.539088+0000","last_became_peered":"2024-09-21T02:33:30.539088+0000","last_unstale":"2024-09-21T02:33:30.539702+0000","last_undegraded":"2024-09-21T02:33:30.539702+0000","last_fullsized":"2024-09-21T02:33:30.539702+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:42.437535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537393+0000","last_change":"2024-09-21T02:32:38.431645+0000","last_active":"2024-09-21T02:33:30.537393+0000","last_peered":"2024-09-21T02:33:30.537393+0000","last_clean":"2024-09-21T02:33:30.537393+0000","last_became_active":"2024-09-21T02:32:38.431069+0000","last_became_peered":"2024-09-21T02:32:38.431069+0000","last_unstale":"2024-09-21T02:33:30.537393+0000","last_undegraded":"2024-09-21T02:33:30.537393+0000","last_fullsized":"2024-09-21T02:33:30.537393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:34.893292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533334+0000","last_change":"2024-09-21T02:32:41.470506+0000","last_active":"2024-09-21T02:33:30.533334+0000","last_peered":"2024-09-21T02:33:30.533334+0000","last_clean":"2024-09-21T02:33:30.533334+0000","last_became_active":"2024-09-21T02:32:41.470165+0000","last_became_peered":"2024-09-21T02:32:41.470165+0000","last_unstale":"2024-09-21T02:33:30.533334+0000","last_undegraded":"2024-09-21T02:33:30.533334+0000","last_fullsized":"2024-09-21T02:33:30.533334+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.529950+0000","last_change":"2024-09-21T02:32:50.681923+0000","last_active":"2024-09-21T02:33:30.529950+0000","last_peered":"2024-09-21T02:33:30.529950+0000","last_clean":"2024-09-21T02:33:30.529950+0000","last_became_active":"2024-09-21T02:32:50.681374+0000","last_became_peered":"2024-09-21T02:32:50.681374+0000","last_unstale":"2024-09-21T02:33:30.529950+0000","last_undegraded":"2024-09-21T02:33:30.529950+0000","last_fullsized":"2024-09-21T02:33:30.529950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:46.060715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536177+0000","last_change":"2024-09-21T02:32:41.470550+0000","last_active":"2024-09-21T02:33:30.536177+0000","last_peered":"2024-09-21T02:33:30.536177+0000","last_clean":"2024-09-21T02:33:30.536177+0000","last_became_active":"2024-09-21T02:32:41.469282+0000","last_became_peered":"2024-09-21T02:32:41.469282+0000","last_unstale":"2024-09-21T02:33:30.536177+0000","last_undegraded":"2024-09-21T02:33:30.536177+0000","last_fullsized":"2024-09-21T02:33:30.536177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:34.619382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537199+0000","last_change":"2024-09-21T02:32:38.435261+0000","last_active":"2024-09-21T02:33:30.537199+0000","last_peered":"2024-09-21T02:33:30.537199+0000","last_clean":"2024-09-21T02:33:30.537199+0000","last_became_active":"2024-09-21T02:32:38.434795+0000","last_became_peered":"2024-09-21T02:32:38.434795+0000","last_unstale":"2024-09-21T02:33:30.537199+0000","last_undegraded":"2024-09-21T02:33:30.537199+0000","last_fullsized":"2024-09-21T02:33:30.537199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:05.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530106+0000","last_change":"2024-09-21T02:32:50.714657+0000","last_active":"2024-09-21T02:33:30.530106+0000","last_peered":"2024-09-21T02:33:30.530106+0000","last_clean":"2024-09-21T02:33:30.530106+0000","last_became_active":"2024-09-21T02:32:50.714077+0000","last_became_peered":"2024-09-21T02:32:50.714077+0000","last_unstale":"2024-09-21T02:33:30.530106+0000","last_undegraded":"2024-09-21T02:33:30.530106+0000","last_fullsized":"2024-09-21T02:33:30.530106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.812785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531720+0000","last_change":"2024-09-21T02:32:41.473964+0000","last_active":"2024-09-21T02:33:30.531720+0000","last_peered":"2024-09-21T02:33:30.531720+0000","last_clean":"2024-09-21T02:33:30.531720+0000","last_became_active":"2024-09-21T02:32:41.473598+0000","last_became_peered":"2024-09-21T02:32:41.473598+0000","last_unstale":"2024-09-21T02:33:30.531720+0000","last_undegraded":"2024-09-21T02:33:30.531720+0000","last_fullsized":"2024-09-21T02:33:30.531720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818344+0000","last_change":"2024-09-21T02:32:38.435800+0000","last_active":"2024-09-21T02:33:30.818344+0000","last_peered":"2024-09-21T02:33:30.818344+0000","last_clean":"2024-09-21T02:33:30.818344+0000","last_became_active":"2024-09-21T02:32:38.434797+0000","last_became_peered":"2024-09-21T02:32:38.434797+0000","last_unstale":"2024-09-21T02:33:30.818344+0000","last_undegraded":"2024-09-21T02:33:30.818344+0000","last_fullsized":"2024-09-21T02:33:30.818344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:46.540597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530258+0000","last_change":"2024-09-21T02:32:50.693447+0000","last_active":"2024-09-21T02:33:30.530258+0000","last_peered":"2024-09-21T02:33:30.530258+0000","last_clean":"2024-09-21T02:33:30.530258+0000","last_became_active":"2024-09-21T02:32:50.692829+0000","last_became_peered":"2024-09-21T02:32:50.692829+0000","last_unstale":"2024-09-21T02:33:30.530258+0000","last_undegraded":"2024-09-21T02:33:30.530258+0000","last_fullsized":"2024-09-21T02:33:30.530258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:10.958279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536385+0000","last_change":"2024-09-21T02:32:41.478053+0000","last_active":"2024-09-21T02:33:30.536385+0000","last_peered":"2024-09-21T02:33:30.536385+0000","last_clean":"2024-09-21T02:33:30.536385+0000","last_became_active":"2024-09-21T02:32:41.477631+0000","last_became_peered":"2024-09-21T02:32:41.477631+0000","last_unstale":"2024-09-21T02:33:30.536385+0000","last_undegraded":"2024-09-21T02:33:30.536385+0000","last_fullsized":"2024-09-21T02:33:30.536385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:19.548261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531963+0000","last_change":"2024-09-21T02:32:38.425388+0000","last_active":"2024-09-21T02:33:30.531963+0000","last_peered":"2024-09-21T02:33:30.531963+0000","last_clean":"2024-09-21T02:33:30.531963+0000","last_became_active":"2024-09-21T02:32:38.424975+0000","last_became_peered":"2024-09-21T02:32:38.424975+0000","last_unstale":"2024-09-21T02:33:30.531963+0000","last_undegraded":"2024-09-21T02:33:30.531963+0000","last_fullsized":"2024-09-21T02:33:30.531963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:43.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535082+0000","last_change":"2024-09-21T02:32:50.695406+0000","last_active":"2024-09-21T02:33:30.535082+0000","last_peered":"2024-09-21T02:33:30.535082+0000","last_clean":"2024-09-21T02:33:30.535082+0000","last_became_active":"2024-09-21T02:32:50.694958+0000","last_became_peered":"2024-09-21T02:32:50.694958+0000","last_unstale":"2024-09-21T02:33:30.535082+0000","last_undegraded":"2024-09-21T02:33:30.535082+0000","last_fullsized":"2024-09-21T02:33:30.535082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:49.038587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536208+0000","last_change":"2024-09-21T02:32:41.463475+0000","last_active":"2024-09-21T02:33:30.536208+0000","last_peered":"2024-09-21T02:33:30.536208+0000","last_clean":"2024-09-21T02:33:30.536208+0000","last_became_active":"2024-09-21T02:32:41.462950+0000","last_became_peered":"2024-09-21T02:32:41.462950+0000","last_unstale":"2024-09-21T02:33:30.536208+0000","last_undegraded":"2024-09-21T02:33:30.536208+0000","last_fullsized":"2024-09-21T02:33:30.536208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:40.871522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039879+0000","last_change":"2024-09-21T02:32:38.512534+0000","last_active":"2024-09-21T02:33:31.039879+0000","last_peered":"2024-09-21T02:33:31.039879+0000","last_clean":"2024-09-21T02:33:31.039879+0000","last_became_active":"2024-09-21T02:32:38.512162+0000","last_became_peered":"2024-09-21T02:32:38.512162+0000","last_unstale":"2024-09-21T02:33:31.039879+0000","last_undegraded":"2024-09-21T02:33:31.039879+0000","last_fullsized":"2024-09-21T02:33:31.039879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:35.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530084+0000","last_change":"2024-09-21T02:32:50.716000+0000","last_active":"2024-09-21T02:33:30.530084+0000","last_peered":"2024-09-21T02:33:30.530084+0000","last_clean":"2024-09-21T02:33:30.530084+0000","last_became_active":"2024-09-21T02:32:50.715371+0000","last_became_peered":"2024-09-21T02:32:50.715371+0000","last_unstale":"2024-09-21T02:33:30.530084+0000","last_undegraded":"2024-09-21T02:33:30.530084+0000","last_fullsized":"2024-09-21T02:33:30.530084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:54.490957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612525+0000","last_change":"2024-09-21T02:32:41.479797+0000","last_active":"2024-09-21T02:33:30.612525+0000","last_peered":"2024-09-21T02:33:30.612525+0000","last_clean":"2024-09-21T02:33:30.612525+0000","last_became_active":"2024-09-21T02:32:41.479400+0000","last_became_peered":"2024-09-21T02:32:41.479400+0000","last_unstale":"2024-09-21T02:33:30.612525+0000","last_undegraded":"2024-09-21T02:33:30.612525+0000","last_fullsized":"2024-09-21T02:33:30.612525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:34.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530750+0000","last_change":"2024-09-21T02:32:38.748844+0000","last_active":"2024-09-21T02:33:30.530750+0000","last_peered":"2024-09-21T02:33:30.530750+0000","last_clean":"2024-09-21T02:33:30.530750+0000","last_became_active":"2024-09-21T02:32:38.748428+0000","last_became_peered":"2024-09-21T02:32:38.748428+0000","last_unstale":"2024-09-21T02:33:30.530750+0000","last_undegraded":"2024-09-21T02:33:30.530750+0000","last_fullsized":"2024-09-21T02:33:30.530750+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:01.300290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.817778+0000","last_change":"2024-09-21T02:32:50.681667+0000","last_active":"2024-09-21T02:33:30.817778+0000","last_peered":"2024-09-21T02:33:30.817778+0000","last_clean":"2024-09-21T02:33:30.817778+0000","last_became_active":"2024-09-21T02:32:50.681113+0000","last_became_peered":"2024-09-21T02:32:50.681113+0000","last_unstale":"2024-09-21T02:33:30.817778+0000","last_undegraded":"2024-09-21T02:33:30.817778+0000","last_fullsized":"2024-09-21T02:33:30.817778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:20.881199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531891+0000","last_change":"2024-09-21T02:32:41.466320+0000","last_active":"2024-09-21T02:33:30.531891+0000","last_peered":"2024-09-21T02:33:30.531891+0000","last_clean":"2024-09-21T02:33:30.531891+0000","last_became_active":"2024-09-21T02:32:41.462700+0000","last_became_peered":"2024-09-21T02:32:41.462700+0000","last_unstale":"2024-09-21T02:33:30.531891+0000","last_undegraded":"2024-09-21T02:33:30.531891+0000","last_fullsized":"2024-09-21T02:33:30.531891+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:05.324192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'8","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:44.483877+0000","last_change":"2024-09-21T02:32:38.432478+0000","last_active":"2024-09-21T02:33:44.483877+0000","last_peered":"2024-09-21T02:33:44.483877+0000","last_clean":"2024-09-21T02:33:44.483877+0000","last_became_active":"2024-09-21T02:32:38.431107+0000","last_became_peered":"2024-09-21T02:32:38.431107+0000","last_unstale":"2024-09-21T02:33:44.483877+0000","last_undegraded":"2024-09-21T02:33:44.483877+0000","last_fullsized":"2024-09-21T02:33:44.483877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:04.629078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531359+0000","last_change":"2024-09-21T02:32:50.715335+0000","last_active":"2024-09-21T02:33:30.531359+0000","last_peered":"2024-09-21T02:33:30.531359+0000","last_clean":"2024-09-21T02:33:30.531359+0000","last_became_active":"2024-09-21T02:32:50.714117+0000","last_became_peered":"2024-09-21T02:32:50.714117+0000","last_unstale":"2024-09-21T02:33:30.531359+0000","last_undegraded":"2024-09-21T02:33:30.531359+0000","last_fullsized":"2024-09-21T02:33:30.531359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:53.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649521+0000","last_change":"2024-09-21T02:32:41.467613+0000","last_active":"2024-09-21T02:33:30.649521+0000","last_peered":"2024-09-21T02:33:30.649521+0000","last_clean":"2024-09-21T02:33:30.649521+0000","last_became_active":"2024-09-21T02:32:41.467136+0000","last_became_peered":"2024-09-21T02:32:41.467136+0000","last_unstale":"2024-09-21T02:33:30.649521+0000","last_undegraded":"2024-09-21T02:33:30.649521+0000","last_fullsized":"2024-09-21T02:33:30.649521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:16.929257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537449+0000","last_change":"2024-09-21T02:32:38.513591+0000","last_active":"2024-09-21T02:33:30.537449+0000","last_peered":"2024-09-21T02:33:30.537449+0000","last_clean":"2024-09-21T02:33:30.537449+0000","last_became_active":"2024-09-21T02:32:38.513169+0000","last_became_peered":"2024-09-21T02:32:38.513169+0000","last_unstale":"2024-09-21T02:33:30.537449+0000","last_undegraded":"2024-09-21T02:33:30.537449+0000","last_fullsized":"2024-09-21T02:33:30.537449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:24.038894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536091+0000","last_change":"2024-09-21T02:32:50.680165+0000","last_active":"2024-09-21T02:33:30.536091+0000","last_peered":"2024-09-21T02:33:30.536091+0000","last_clean":"2024-09-21T02:33:30.536091+0000","last_became_active":"2024-09-21T02:32:50.679730+0000","last_became_peered":"2024-09-21T02:32:50.679730+0000","last_unstale":"2024-09-21T02:33:30.536091+0000","last_undegraded":"2024-09-21T02:33:30.536091+0000","last_fullsized":"2024-09-21T02:33:30.536091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:25.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533091+0000","last_change":"2024-09-21T02:32:41.483355+0000","last_active":"2024-09-21T02:33:30.533091+0000","last_peered":"2024-09-21T02:33:30.533091+0000","last_clean":"2024-09-21T02:33:30.533091+0000","last_became_active":"2024-09-21T02:32:41.482786+0000","last_became_peered":"2024-09-21T02:32:41.482786+0000","last_unstale":"2024-09-21T02:33:30.533091+0000","last_undegraded":"2024-09-21T02:33:30.533091+0000","last_fullsized":"2024-09-21T02:33:30.533091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:46.277233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534935+0000","last_change":"2024-09-21T02:32:38.515173+0000","last_active":"2024-09-21T02:33:30.534935+0000","last_peered":"2024-09-21T02:33:30.534935+0000","last_clean":"2024-09-21T02:33:30.534935+0000","last_became_active":"2024-09-21T02:32:38.513341+0000","last_became_peered":"2024-09-21T02:32:38.513341+0000","last_unstale":"2024-09-21T02:33:30.534935+0000","last_undegraded":"2024-09-21T02:33:30.534935+0000","last_fullsized":"2024-09-21T02:33:30.534935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.988203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536222+0000","last_change":"2024-09-21T02:32:50.714389+0000","last_active":"2024-09-21T02:33:30.536222+0000","last_peered":"2024-09-21T02:33:30.536222+0000","last_clean":"2024-09-21T02:33:30.536222+0000","last_became_active":"2024-09-21T02:32:50.713859+0000","last_became_peered":"2024-09-21T02:32:50.713859+0000","last_unstale":"2024-09-21T02:33:30.536222+0000","last_undegraded":"2024-09-21T02:33:30.536222+0000","last_fullsized":"2024-09-21T02:33:30.536222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:41.315205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.613637+0000","last_change":"2024-09-21T02:33:30.613550+0000","last_active":"2024-09-21T02:33:30.613637+0000","last_peered":"2024-09-21T02:33:30.613637+0000","last_clean":"2024-09-21T02:33:30.613637+0000","last_became_active":"2024-09-21T02:33:30.613216+0000","last_became_peered":"2024-09-21T02:33:30.613216+0000","last_unstale":"2024-09-21T02:33:30.613637+0000","last_undegraded":"2024-09-21T02:33:30.613637+0000","last_fullsized":"2024-09-21T02:33:30.613637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:11.076824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536393+0000","last_change":"2024-09-21T02:32:38.428428+0000","last_active":"2024-09-21T02:33:30.536393+0000","last_peered":"2024-09-21T02:33:30.536393+0000","last_clean":"2024-09-21T02:33:30.536393+0000","last_became_active":"2024-09-21T02:32:38.428066+0000","last_became_peered":"2024-09-21T02:32:38.428066+0000","last_unstale":"2024-09-21T02:33:30.536393+0000","last_undegraded":"2024-09-21T02:33:30.536393+0000","last_fullsized":"2024-09-21T02:33:30.536393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:45.601916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649329+0000","last_change":"2024-09-21T02:32:50.691139+0000","last_active":"2024-09-21T02:33:30.649329+0000","last_peered":"2024-09-21T02:33:30.649329+0000","last_clean":"2024-09-21T02:33:30.649329+0000","last_became_active":"2024-09-21T02:32:50.690653+0000","last_became_peered":"2024-09-21T02:32:50.690653+0000","last_unstale":"2024-09-21T02:33:30.649329+0000","last_undegraded":"2024-09-21T02:33:30.649329+0000","last_fullsized":"2024-09-21T02:33:30.649329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:43.852916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532961+0000","last_change":"2024-09-21T02:32:41.466857+0000","last_active":"2024-09-21T02:33:30.532961+0000","last_peered":"2024-09-21T02:33:30.532961+0000","last_clean":"2024-09-21T02:33:30.532961+0000","last_became_active":"2024-09-21T02:32:41.466467+0000","last_became_peered":"2024-09-21T02:32:41.466467+0000","last_unstale":"2024-09-21T02:33:30.532961+0000","last_undegraded":"2024-09-21T02:33:30.532961+0000","last_fullsized":"2024-09-21T02:33:30.532961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:29.369150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649089+0000","last_change":"2024-09-21T02:32:38.513999+0000","last_active":"2024-09-21T02:33:30.649089+0000","last_peered":"2024-09-21T02:33:30.649089+0000","last_clean":"2024-09-21T02:33:30.649089+0000","last_became_active":"2024-09-21T02:32:38.513605+0000","last_became_peered":"2024-09-21T02:32:38.513605+0000","last_unstale":"2024-09-21T02:33:30.649089+0000","last_undegraded":"2024-09-21T02:33:30.649089+0000","last_fullsized":"2024-09-21T02:33:30.649089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:45.616961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649395+0000","last_change":"2024-09-21T02:32:50.714830+0000","last_active":"2024-09-21T02:33:30.649395+0000","last_peered":"2024-09-21T02:33:30.649395+0000","last_clean":"2024-09-21T02:33:30.649395+0000","last_became_active":"2024-09-21T02:32:50.714166+0000","last_became_peered":"2024-09-21T02:32:50.714166+0000","last_unstale":"2024-09-21T02:33:30.649395+0000","last_undegraded":"2024-09-21T02:33:30.649395+0000","last_fullsized":"2024-09-21T02:33:30.649395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:35.418689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.648937+0000","last_change":"2024-09-21T02:32:41.468695+0000","last_active":"2024-09-21T02:33:30.648937+0000","last_peered":"2024-09-21T02:33:30.648937+0000","last_clean":"2024-09-21T02:33:30.648937+0000","last_became_active":"2024-09-21T02:32:41.468349+0000","last_became_peered":"2024-09-21T02:32:41.468349+0000","last_unstale":"2024-09-21T02:33:30.648937+0000","last_undegraded":"2024-09-21T02:33:30.648937+0000","last_fullsized":"2024-09-21T02:33:30.648937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:51.935336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535932+0000","last_change":"2024-09-21T02:32:38.431187+0000","last_active":"2024-09-21T02:33:30.535932+0000","last_peered":"2024-09-21T02:33:30.535932+0000","last_clean":"2024-09-21T02:33:30.535932+0000","last_became_active":"2024-09-21T02:32:38.430790+0000","last_became_peered":"2024-09-21T02:32:38.430790+0000","last_unstale":"2024-09-21T02:33:30.535932+0000","last_undegraded":"2024-09-21T02:33:30.535932+0000","last_fullsized":"2024-09-21T02:33:30.535932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:05.004479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533332+0000","last_change":"2024-09-21T02:32:50.715728+0000","last_active":"2024-09-21T02:33:30.533332+0000","last_peered":"2024-09-21T02:33:30.533332+0000","last_clean":"2024-09-21T02:33:30.533332+0000","last_became_active":"2024-09-21T02:32:50.715329+0000","last_became_peered":"2024-09-21T02:32:50.715329+0000","last_unstale":"2024-09-21T02:33:30.533332+0000","last_undegraded":"2024-09-21T02:33:30.533332+0000","last_fullsized":"2024-09-21T02:33:30.533332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.790489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532196+0000","last_change":"2024-09-21T02:32:41.474885+0000","last_active":"2024-09-21T02:33:30.532196+0000","last_peered":"2024-09-21T02:33:30.532196+0000","last_clean":"2024-09-21T02:33:30.532196+0000","last_became_active":"2024-09-21T02:32:41.474599+0000","last_became_peered":"2024-09-21T02:32:41.474599+0000","last_unstale":"2024-09-21T02:33:30.532196+0000","last_undegraded":"2024-09-21T02:33:30.532196+0000","last_fullsized":"2024-09-21T02:33:30.532196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:43.006829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531206+0000","last_change":"2024-09-21T02:32:38.431168+0000","last_active":"2024-09-21T02:33:30.531206+0000","last_peered":"2024-09-21T02:33:30.531206+0000","last_clean":"2024-09-21T02:33:30.531206+0000","last_became_active":"2024-09-21T02:32:38.430743+0000","last_became_peered":"2024-09-21T02:32:38.430743+0000","last_unstale":"2024-09-21T02:33:30.531206+0000","last_undegraded":"2024-09-21T02:33:30.531206+0000","last_fullsized":"2024-09-21T02:33:30.531206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:54.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536632+0000","last_change":"2024-09-21T02:31:20.822638+0000","last_active":"2024-09-21T02:33:30.536632+0000","last_peered":"2024-09-21T02:33:30.536632+0000","last_clean":"2024-09-21T02:33:30.536632+0000","last_became_active":"2024-09-21T02:31:20.816679+0000","last_became_peered":"2024-09-21T02:31:20.816679+0000","last_unstale":"2024-09-21T02:33:30.536632+0000","last_undegraded":"2024-09-21T02:33:30.536632+0000","last_fullsized":"2024-09-21T02:33:30.536632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_clean_scrub_stamp":"2024-09-21T02:27:32.360535+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:51.568101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536788+0000","last_change":"2024-09-21T02:32:50.698437+0000","last_active":"2024-09-21T02:33:30.536788+0000","last_peered":"2024-09-21T02:33:30.536788+0000","last_clean":"2024-09-21T02:33:30.536788+0000","last_became_active":"2024-09-21T02:32:50.697814+0000","last_became_peered":"2024-09-21T02:32:50.697814+0000","last_unstale":"2024-09-21T02:33:30.536788+0000","last_undegraded":"2024-09-21T02:33:30.536788+0000","last_fullsized":"2024-09-21T02:33:30.536788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:51.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536897+0000","last_change":"2024-09-21T02:32:41.469539+0000","last_active":"2024-09-21T02:33:30.536897+0000","last_peered":"2024-09-21T02:33:30.536897+0000","last_clean":"2024-09-21T02:33:30.536897+0000","last_became_active":"2024-09-21T02:32:41.469060+0000","last_became_peered":"2024-09-21T02:32:41.469060+0000","last_unstale":"2024-09-21T02:33:30.536897+0000","last_undegraded":"2024-09-21T02:33:30.536897+0000","last_fullsized":"2024-09-21T02:33:30.536897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:36.699360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818540+0000","last_change":"2024-09-21T02:32:38.748487+0000","last_active":"2024-09-21T02:33:30.818540+0000","last_peered":"2024-09-21T02:33:30.818540+0000","last_clean":"2024-09-21T02:33:30.818540+0000","last_became_active":"2024-09-21T02:32:38.747956+0000","last_became_peered":"2024-09-21T02:32:38.747956+0000","last_unstale":"2024-09-21T02:33:30.818540+0000","last_undegraded":"2024-09-21T02:33:30.818540+0000","last_fullsized":"2024-09-21T02:33:30.818540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:15.745119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039152+0000","last_change":"2024-09-21T02:32:50.687412+0000","last_active":"2024-09-21T02:33:31.039152+0000","last_peered":"2024-09-21T02:33:31.039152+0000","last_clean":"2024-09-21T02:33:31.039152+0000","last_became_active":"2024-09-21T02:32:50.686819+0000","last_became_peered":"2024-09-21T02:32:50.686819+0000","last_unstale":"2024-09-21T02:33:31.039152+0000","last_undegraded":"2024-09-21T02:33:31.039152+0000","last_fullsized":"2024-09-21T02:33:31.039152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:28.830619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536352+0000","last_change":"2024-09-21T02:32:41.467719+0000","last_active":"2024-09-21T02:33:30.536352+0000","last_peered":"2024-09-21T02:33:30.536352+0000","last_clean":"2024-09-21T02:33:30.536352+0000","last_became_active":"2024-09-21T02:32:41.467332+0000","last_became_peered":"2024-09-21T02:32:41.467332+0000","last_unstale":"2024-09-21T02:33:30.536352+0000","last_undegraded":"2024-09-21T02:33:30.536352+0000","last_fullsized":"2024-09-21T02:33:30.536352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:06.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534037+0000","last_change":"2024-09-21T02:32:38.428553+0000","last_active":"2024-09-21T02:33:30.534037+0000","last_peered":"2024-09-21T02:33:30.534037+0000","last_clean":"2024-09-21T02:33:30.534037+0000","last_became_active":"2024-09-21T02:32:38.428159+0000","last_became_peered":"2024-09-21T02:32:38.428159+0000","last_unstale":"2024-09-21T02:33:30.534037+0000","last_undegraded":"2024-09-21T02:33:30.534037+0000","last_fullsized":"2024-09-21T02:33:30.534037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:17.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612641+0000","last_change":"2024-09-21T02:32:50.694290+0000","last_active":"2024-09-21T02:33:30.612641+0000","last_peered":"2024-09-21T02:33:30.612641+0000","last_clean":"2024-09-21T02:33:30.612641+0000","last_became_active":"2024-09-21T02:32:50.693794+0000","last_became_peered":"2024-09-21T02:32:50.693794+0000","last_unstale":"2024-09-21T02:33:30.612641+0000","last_undegraded":"2024-09-21T02:33:30.612641+0000","last_fullsized":"2024-09-21T02:33:30.612641+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:07.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536587+0000","last_change":"2024-09-21T02:32:41.466802+0000","last_active":"2024-09-21T02:33:30.536587+0000","last_peered":"2024-09-21T02:33:30.536587+0000","last_clean":"2024-09-21T02:33:30.536587+0000","last_became_active":"2024-09-21T02:32:41.465348+0000","last_became_peered":"2024-09-21T02:32:41.465348+0000","last_unstale":"2024-09-21T02:33:30.536587+0000","last_undegraded":"2024-09-21T02:33:30.536587+0000","last_fullsized":"2024-09-21T02:33:30.536587+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:23.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649459+0000","last_change":"2024-09-21T02:32:38.435725+0000","last_active":"2024-09-21T02:33:30.649459+0000","last_peered":"2024-09-21T02:33:30.649459+0000","last_clean":"2024-09-21T02:33:30.649459+0000","last_became_active":"2024-09-21T02:32:38.434688+0000","last_became_peered":"2024-09-21T02:32:38.434688+0000","last_unstale":"2024-09-21T02:33:30.649459+0000","last_undegraded":"2024-09-21T02:33:30.649459+0000","last_fullsized":"2024-09-21T02:33:30.649459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:27.829955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.042096+0000","last_change":"2024-09-21T02:33:31.041957+0000","last_active":"2024-09-21T02:33:31.042096+0000","last_peered":"2024-09-21T02:33:31.042096+0000","last_clean":"2024-09-21T02:33:31.042096+0000","last_became_active":"2024-09-21T02:33:31.041160+0000","last_became_peered":"2024-09-21T02:33:31.041160+0000","last_unstale":"2024-09-21T02:33:31.042096+0000","last_undegraded":"2024-09-21T02:33:31.042096+0000","last_fullsized":"2024-09-21T02:33:31.042096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.226199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7,1],"acting":[8,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536819+0000","last_change":"2024-09-21T02:32:41.474796+0000","last_active":"2024-09-21T02:33:30.536819+0000","last_peered":"2024-09-21T02:33:30.536819+0000","last_clean":"2024-09-21T02:33:30.536819+0000","last_became_active":"2024-09-21T02:32:41.474377+0000","last_became_peered":"2024-09-21T02:32:41.474377+0000","last_unstale":"2024-09-21T02:33:30.536819+0000","last_undegraded":"2024-09-21T02:33:30.536819+0000","last_fullsized":"2024-09-21T02:33:30.536819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.538884+0000","last_change":"2024-09-21T02:32:38.431090+0000","last_active":"2024-09-21T02:33:30.538884+0000","last_peered":"2024-09-21T02:33:30.538884+0000","last_clean":"2024-09-21T02:33:30.538884+0000","last_became_active":"2024-09-21T02:32:38.430629+0000","last_became_peered":"2024-09-21T02:32:38.430629+0000","last_unstale":"2024-09-21T02:33:30.538884+0000","last_undegraded":"2024-09-21T02:33:30.538884+0000","last_fullsized":"2024-09-21T02:33:30.538884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:49.977384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532404+0000","last_change":"2024-09-21T02:32:50.685932+0000","last_active":"2024-09-21T02:33:30.532404+0000","last_peered":"2024-09-21T02:33:30.532404+0000","last_clean":"2024-09-21T02:33:30.532404+0000","last_became_active":"2024-09-21T02:32:50.685584+0000","last_became_peered":"2024-09-21T02:32:50.685584+0000","last_unstale":"2024-09-21T02:33:30.532404+0000","last_undegraded":"2024-09-21T02:33:30.532404+0000","last_fullsized":"2024-09-21T02:33:30.532404+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:42.118046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.041646+0000","last_change":"2024-09-21T02:33:31.041507+0000","last_active":"2024-09-21T02:33:31.041646+0000","last_peered":"2024-09-21T02:33:31.041646+0000","last_clean":"2024-09-21T02:33:31.041646+0000","last_became_active":"2024-09-21T02:33:31.040982+0000","last_became_peered":"2024-09-21T02:33:31.040982+0000","last_unstale":"2024-09-21T02:33:31.041646+0000","last_undegraded":"2024-09-21T02:33:31.041646+0000","last_fullsized":"2024-09-21T02:33:31.041646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:17.608426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535426+0000","last_change":"2024-09-21T02:32:38.512557+0000","last_active":"2024-09-21T02:33:30.535426+0000","last_peered":"2024-09-21T02:33:30.535426+0000","last_clean":"2024-09-21T02:33:30.535426+0000","last_became_active":"2024-09-21T02:32:38.512069+0000","last_became_peered":"2024-09-21T02:32:38.512069+0000","last_unstale":"2024-09-21T02:33:30.535426+0000","last_undegraded":"2024-09-21T02:33:30.535426+0000","last_fullsized":"2024-09-21T02:33:30.535426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:55.038548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649448+0000","last_change":"2024-09-21T02:32:50.698539+0000","last_active":"2024-09-21T02:33:30.649448+0000","last_peered":"2024-09-21T02:33:30.649448+0000","last_clean":"2024-09-21T02:33:30.649448+0000","last_became_active":"2024-09-21T02:32:50.698107+0000","last_became_peered":"2024-09-21T02:32:50.698107+0000","last_unstale":"2024-09-21T02:33:30.649448+0000","last_undegraded":"2024-09-21T02:33:30.649448+0000","last_fullsized":"2024-09-21T02:33:30.649448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:43.141885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535693+0000","last_change":"2024-09-21T02:32:41.468472+0000","last_active":"2024-09-21T02:33:30.535693+0000","last_peered":"2024-09-21T02:33:30.535693+0000","last_clean":"2024-09-21T02:33:30.535693+0000","last_became_active":"2024-09-21T02:32:41.468039+0000","last_became_peered":"2024-09-21T02:32:41.468039+0000","last_unstale":"2024-09-21T02:33:30.535693+0000","last_undegraded":"2024-09-21T02:33:30.535693+0000","last_fullsized":"2024-09-21T02:33:30.535693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:00.501173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530705+0000","last_change":"2024-09-21T02:32:38.431613+0000","last_active":"2024-09-21T02:33:30.530705+0000","last_peered":"2024-09-21T02:33:30.530705+0000","last_clean":"2024-09-21T02:33:30.530705+0000","last_became_active":"2024-09-21T02:32:38.431128+0000","last_became_peered":"2024-09-21T02:32:38.431128+0000","last_unstale":"2024-09-21T02:33:30.530705+0000","last_undegraded":"2024-09-21T02:33:30.530705+0000","last_fullsized":"2024-09-21T02:33:30.530705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:09.400651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535120+0000","last_change":"2024-09-21T02:32:50.691401+0000","last_active":"2024-09-21T02:33:30.535120+0000","last_peered":"2024-09-21T02:33:30.535120+0000","last_clean":"2024-09-21T02:33:30.535120+0000","last_became_active":"2024-09-21T02:32:50.688202+0000","last_became_peered":"2024-09-21T02:32:50.688202+0000","last_unstale":"2024-09-21T02:33:30.535120+0000","last_undegraded":"2024-09-21T02:33:30.535120+0000","last_fullsized":"2024-09-21T02:33:30.535120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:42.516887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536499+0000","last_change":"2024-09-21T02:32:41.475760+0000","last_active":"2024-09-21T02:33:30.536499+0000","last_peered":"2024-09-21T02:33:30.536499+0000","last_clean":"2024-09-21T02:33:30.536499+0000","last_became_active":"2024-09-21T02:32:41.475381+0000","last_became_peered":"2024-09-21T02:32:41.475381+0000","last_unstale":"2024-09-21T02:33:30.536499+0000","last_undegraded":"2024-09-21T02:33:30.536499+0000","last_fullsized":"2024-09-21T02:33:30.536499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.070064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532763+0000","last_change":"2024-09-21T02:32:38.424789+0000","last_active":"2024-09-21T02:33:30.532763+0000","last_peered":"2024-09-21T02:33:30.532763+0000","last_clean":"2024-09-21T02:33:30.532763+0000","last_became_active":"2024-09-21T02:32:38.424275+0000","last_became_peered":"2024-09-21T02:32:38.424275+0000","last_unstale":"2024-09-21T02:33:30.532763+0000","last_undegraded":"2024-09-21T02:33:30.532763+0000","last_fullsized":"2024-09-21T02:33:30.532763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:50.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536245+0000","last_change":"2024-09-21T02:32:50.692496+0000","last_active":"2024-09-21T02:33:30.536245+0000","last_peered":"2024-09-21T02:33:30.536245+0000","last_clean":"2024-09-21T02:33:30.536245+0000","last_became_active":"2024-09-21T02:32:50.692055+0000","last_became_peered":"2024-09-21T02:32:50.692055+0000","last_unstale":"2024-09-21T02:33:30.536245+0000","last_undegraded":"2024-09-21T02:33:30.536245+0000","last_fullsized":"2024-09-21T02:33:30.536245+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:25.433298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649109+0000","last_change":"2024-09-21T02:32:41.475732+0000","last_active":"2024-09-21T02:33:30.649109+0000","last_peered":"2024-09-21T02:33:30.649109+0000","last_clean":"2024-09-21T02:33:30.649109+0000","last_became_active":"2024-09-21T02:32:41.475395+0000","last_became_peered":"2024-09-21T02:32:41.475395+0000","last_unstale":"2024-09-21T02:33:30.649109+0000","last_undegraded":"2024-09-21T02:33:30.649109+0000","last_fullsized":"2024-09-21T02:33:30.649109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:26.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818494+0000","last_change":"2024-09-21T02:32:38.434080+0000","last_active":"2024-09-21T02:33:30.818494+0000","last_peered":"2024-09-21T02:33:30.818494+0000","last_clean":"2024-09-21T02:33:30.818494+0000","last_became_active":"2024-09-21T02:32:38.433625+0000","last_became_peered":"2024-09-21T02:32:38.433625+0000","last_unstale":"2024-09-21T02:33:30.818494+0000","last_undegraded":"2024-09-21T02:33:30.818494+0000","last_fullsized":"2024-09-21T02:33:30.818494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:11.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533377+0000","last_change":"2024-09-21T02:32:50.687555+0000","last_active":"2024-09-21T02:33:30.533377+0000","last_peered":"2024-09-21T02:33:30.533377+0000","last_clean":"2024-09-21T02:33:30.533377+0000","last_became_active":"2024-09-21T02:32:50.686979+0000","last_became_peered":"2024-09-21T02:32:50.686979+0000","last_unstale":"2024-09-21T02:33:30.533377+0000","last_undegraded":"2024-09-21T02:33:30.533377+0000","last_fullsized":"2024-09-21T02:33:30.533377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:01.136515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537096+0000","last_change":"2024-09-21T02:32:41.463688+0000","last_active":"2024-09-21T02:33:30.537096+0000","last_peered":"2024-09-21T02:33:30.537096+0000","last_clean":"2024-09-21T02:33:30.537096+0000","last_became_active":"2024-09-21T02:32:41.463306+0000","last_became_peered":"2024-09-21T02:32:41.463306+0000","last_unstale":"2024-09-21T02:33:30.537096+0000","last_undegraded":"2024-09-21T02:33:30.537096+0000","last_fullsized":"2024-09-21T02:33:30.537096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:46.217029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:47.675550+0000","last_change":"2024-09-21T02:32:38.435897+0000","last_active":"2024-09-21T02:33:47.675550+0000","last_peered":"2024-09-21T02:33:47.675550+0000","last_clean":"2024-09-21T02:33:47.675550+0000","last_became_active":"2024-09-21T02:32:38.435397+0000","last_became_peered":"2024-09-21T02:32:38.435397+0000","last_unstale":"2024-09-21T02:33:47.675550+0000","last_undegraded":"2024-09-21T02:33:47.675550+0000","last_fullsized":"2024-09-21T02:33:47.675550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:17.841689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59599,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":77,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.539312+0000","last_change":"2024-09-21T02:33:30.538615+0000","last_active":"2024-09-21T02:33:30.539312+0000","last_peered":"2024-09-21T02:33:30.539312+0000","last_clean":"2024-09-21T02:33:30.539312+0000","last_became_active":"2024-09-21T02:33:30.538046+0000","last_became_peered":"2024-09-21T02:33:30.538046+0000","last_unstale":"2024-09-21T02:33:30.539312+0000","last_undegraded":"2024-09-21T02:33:30.539312+0000","last_fullsized":"2024-09-21T02:33:30.539312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:04.235706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039662+0000","last_change":"2024-09-21T02:32:41.470318+0000","last_active":"2024-09-21T02:33:31.039662+0000","last_peered":"2024-09-21T02:33:31.039662+0000","last_clean":"2024-09-21T02:33:31.039662+0000","last_became_active":"2024-09-21T02:32:41.466804+0000","last_became_peered":"2024-09-21T02:32:41.466804+0000","last_unstale":"2024-09-21T02:33:31.039662+0000","last_undegraded":"2024-09-21T02:33:31.039662+0000","last_fullsized":"2024-09-21T02:33:31.039662+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533609+0000","last_change":"2024-09-21T02:32:38.514901+0000","last_active":"2024-09-21T02:33:30.533609+0000","last_peered":"2024-09-21T02:33:30.533609+0000","last_clean":"2024-09-21T02:33:30.533609+0000","last_became_active":"2024-09-21T02:32:38.514497+0000","last_became_peered":"2024-09-21T02:32:38.514497+0000","last_unstale":"2024-09-21T02:33:30.533609+0000","last_undegraded":"2024-09-21T02:33:30.533609+0000","last_fullsized":"2024-09-21T02:33:30.533609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:02.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.041691+0000","last_change":"2024-09-21T02:33:31.041566+0000","last_active":"2024-09-21T02:33:31.041691+0000","last_peered":"2024-09-21T02:33:31.041691+0000","last_clean":"2024-09-21T02:33:31.041691+0000","last_became_active":"2024-09-21T02:33:31.041041+0000","last_became_peered":"2024-09-21T02:33:31.041041+0000","last_unstale":"2024-09-21T02:33:31.041691+0000","last_undegraded":"2024-09-21T02:33:31.041691+0000","last_fullsized":"2024-09-21T02:33:31.041691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:00.236406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612696+0000","last_change":"2024-09-21T02:32:41.483502+0000","last_active":"2024-09-21T02:33:30.612696+0000","last_peered":"2024-09-21T02:33:30.612696+0000","last_clean":"2024-09-21T02:33:30.612696+0000","last_became_active":"2024-09-21T02:32:41.483116+0000","last_became_peered":"2024-09-21T02:32:41.483116+0000","last_unstale":"2024-09-21T02:33:30.612696+0000","last_undegraded":"2024-09-21T02:33:30.612696+0000","last_fullsized":"2024-09-21T02:33:30.612696+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:39.146202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.041996+0000","last_change":"2024-09-21T02:33:31.041819+0000","last_active":"2024-09-21T02:33:31.041996+0000","last_peered":"2024-09-21T02:33:31.041996+0000","last_clean":"2024-09-21T02:33:31.041996+0000","last_became_active":"2024-09-21T02:33:31.041241+0000","last_became_peered":"2024-09-21T02:33:31.041241+0000","last_unstale":"2024-09-21T02:33:31.041996+0000","last_undegraded":"2024-09-21T02:33:31.041996+0000","last_fullsized":"2024-09-21T02:33:31.041996+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:00.241618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534284+0000","last_change":"2024-09-21T02:32:50.692227+0000","last_active":"2024-09-21T02:33:30.534284+0000","last_peered":"2024-09-21T02:33:30.534284+0000","last_clean":"2024-09-21T02:33:30.534284+0000","last_became_active":"2024-09-21T02:32:50.691787+0000","last_became_peered":"2024-09-21T02:32:50.691787+0000","last_unstale":"2024-09-21T02:33:30.534284+0000","last_undegraded":"2024-09-21T02:33:30.534284+0000","last_fullsized":"2024-09-21T02:33:30.534284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:40.086313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040307+0000","last_change":"2024-09-21T02:32:41.476056+0000","last_active":"2024-09-21T02:33:31.040307+0000","last_peered":"2024-09-21T02:33:31.040307+0000","last_clean":"2024-09-21T02:33:31.040307+0000","last_became_active":"2024-09-21T02:32:41.475525+0000","last_became_peered":"2024-09-21T02:32:41.475525+0000","last_unstale":"2024-09-21T02:33:31.040307+0000","last_undegraded":"2024-09-21T02:33:31.040307+0000","last_fullsized":"2024-09-21T02:33:31.040307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:42.074296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533628+0000","last_change":"2024-09-21T02:32:38.430845+0000","last_active":"2024-09-21T02:33:30.533628+0000","last_peered":"2024-09-21T02:33:30.533628+0000","last_clean":"2024-09-21T02:33:30.533628+0000","last_became_active":"2024-09-21T02:32:38.430372+0000","last_became_peered":"2024-09-21T02:32:38.430372+0000","last_unstale":"2024-09-21T02:33:30.533628+0000","last_undegraded":"2024-09-21T02:33:30.533628+0000","last_fullsized":"2024-09-21T02:33:30.533628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:40.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531494+0000","last_change":"2024-09-21T02:32:50.685481+0000","last_active":"2024-09-21T02:33:30.531494+0000","last_peered":"2024-09-21T02:33:30.531494+0000","last_clean":"2024-09-21T02:33:30.531494+0000","last_became_active":"2024-09-21T02:32:50.685044+0000","last_became_peered":"2024-09-21T02:32:50.685044+0000","last_unstale":"2024-09-21T02:33:30.531494+0000","last_undegraded":"2024-09-21T02:33:30.531494+0000","last_fullsized":"2024-09-21T02:33:30.531494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:33.132966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612402+0000","last_change":"2024-09-21T02:32:50.690447+0000","last_active":"2024-09-21T02:33:30.612402+0000","last_peered":"2024-09-21T02:33:30.612402+0000","last_clean":"2024-09-21T02:33:30.612402+0000","last_became_active":"2024-09-21T02:32:50.690021+0000","last_became_peered":"2024-09-21T02:32:50.690021+0000","last_unstale":"2024-09-21T02:33:30.612402+0000","last_undegraded":"2024-09-21T02:33:30.612402+0000","last_fullsized":"2024-09-21T02:33:30.612402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:44.436690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534458+0000","last_change":"2024-09-21T02:32:41.469186+0000","last_active":"2024-09-21T02:33:30.534458+0000","last_peered":"2024-09-21T02:33:30.534458+0000","last_clean":"2024-09-21T02:33:30.534458+0000","last_became_active":"2024-09-21T02:32:41.468837+0000","last_became_peered":"2024-09-21T02:32:41.468837+0000","last_unstale":"2024-09-21T02:33:30.534458+0000","last_undegraded":"2024-09-21T02:33:30.534458+0000","last_fullsized":"2024-09-21T02:33:30.534458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:02.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533125+0000","last_change":"2024-09-21T02:32:38.426631+0000","last_active":"2024-09-21T02:33:30.533125+0000","last_peered":"2024-09-21T02:33:30.533125+0000","last_clean":"2024-09-21T02:33:30.533125+0000","last_became_active":"2024-09-21T02:32:38.425600+0000","last_became_peered":"2024-09-21T02:32:38.425600+0000","last_unstale":"2024-09-21T02:33:30.533125+0000","last_undegraded":"2024-09-21T02:33:30.533125+0000","last_fullsized":"2024-09-21T02:33:30.533125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.669245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536789+0000","last_change":"2024-09-21T02:32:50.697935+0000","last_active":"2024-09-21T02:33:30.536789+0000","last_peered":"2024-09-21T02:33:30.536789+0000","last_clean":"2024-09-21T02:33:30.536789+0000","last_became_active":"2024-09-21T02:32:50.697537+0000","last_became_peered":"2024-09-21T02:32:50.697537+0000","last_unstale":"2024-09-21T02:33:30.536789+0000","last_undegraded":"2024-09-21T02:33:30.536789+0000","last_fullsized":"2024-09-21T02:33:30.536789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:32.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531545+0000","last_change":"2024-09-21T02:32:41.458640+0000","last_active":"2024-09-21T02:33:30.531545+0000","last_peered":"2024-09-21T02:33:30.531545+0000","last_clean":"2024-09-21T02:33:30.531545+0000","last_became_active":"2024-09-21T02:32:41.458231+0000","last_became_peered":"2024-09-21T02:32:41.458231+0000","last_unstale":"2024-09-21T02:33:30.531545+0000","last_undegraded":"2024-09-21T02:33:30.531545+0000","last_fullsized":"2024-09-21T02:33:30.531545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:26.132979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.648941+0000","last_change":"2024-09-21T02:32:38.430888+0000","last_active":"2024-09-21T02:33:30.648941+0000","last_peered":"2024-09-21T02:33:30.648941+0000","last_clean":"2024-09-21T02:33:30.648941+0000","last_became_active":"2024-09-21T02:32:38.430516+0000","last_became_peered":"2024-09-21T02:32:38.430516+0000","last_unstale":"2024-09-21T02:33:30.648941+0000","last_undegraded":"2024-09-21T02:33:30.648941+0000","last_fullsized":"2024-09-21T02:33:30.648941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:54.671763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533814+0000","last_change":"2024-09-21T02:32:38.434012+0000","last_active":"2024-09-21T02:33:30.533814+0000","last_peered":"2024-09-21T02:33:30.533814+0000","last_clean":"2024-09-21T02:33:30.533814+0000","last_became_active":"2024-09-21T02:32:38.433571+0000","last_became_peered":"2024-09-21T02:32:38.433571+0000","last_unstale":"2024-09-21T02:33:30.533814+0000","last_undegraded":"2024-09-21T02:33:30.533814+0000","last_fullsized":"2024-09-21T02:33:30.533814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:59.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.650975+0000","last_change":"2024-09-21T02:33:30.650855+0000","last_active":"2024-09-21T02:33:30.650975+0000","last_peered":"2024-09-21T02:33:30.650975+0000","last_clean":"2024-09-21T02:33:30.650975+0000","last_became_active":"2024-09-21T02:33:30.650428+0000","last_became_peered":"2024-09-21T02:33:30.650428+0000","last_unstale":"2024-09-21T02:33:30.650975+0000","last_undegraded":"2024-09-21T02:33:30.650975+0000","last_fullsized":"2024-09-21T02:33:30.650975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:55.757861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.817842+0000","last_change":"2024-09-21T02:32:50.698249+0000","last_active":"2024-09-21T02:33:30.817842+0000","last_peered":"2024-09-21T02:33:30.817842+0000","last_clean":"2024-09-21T02:33:30.817842+0000","last_became_active":"2024-09-21T02:32:50.697768+0000","last_became_peered":"2024-09-21T02:32:50.697768+0000","last_unstale":"2024-09-21T02:33:30.817842+0000","last_undegraded":"2024-09-21T02:33:30.817842+0000","last_fullsized":"2024-09-21T02:33:30.817842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.723420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533525+0000","last_change":"2024-09-21T02:32:38.435733+0000","last_active":"2024-09-21T02:33:30.533525+0000","last_peered":"2024-09-21T02:33:30.533525+0000","last_clean":"2024-09-21T02:33:30.533525+0000","last_became_active":"2024-09-21T02:32:38.435288+0000","last_became_peered":"2024-09-21T02:32:38.435288+0000","last_unstale":"2024-09-21T02:33:30.533525+0000","last_undegraded":"2024-09-21T02:33:30.533525+0000","last_fullsized":"2024-09-21T02:33:30.533525+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.430652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536434+0000","last_change":"2024-09-21T02:32:41.468127+0000","last_active":"2024-09-21T02:33:30.536434+0000","last_peered":"2024-09-21T02:33:30.536434+0000","last_clean":"2024-09-21T02:33:30.536434+0000","last_became_active":"2024-09-21T02:32:41.467730+0000","last_became_peered":"2024-09-21T02:32:41.467730+0000","last_unstale":"2024-09-21T02:33:30.536434+0000","last_undegraded":"2024-09-21T02:33:30.536434+0000","last_fullsized":"2024-09-21T02:33:30.536434+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:39.684035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.817856+0000","last_change":"2024-09-21T02:32:50.684115+0000","last_active":"2024-09-21T02:33:30.817856+0000","last_peered":"2024-09-21T02:33:30.817856+0000","last_clean":"2024-09-21T02:33:30.817856+0000","last_became_active":"2024-09-21T02:32:50.683627+0000","last_became_peered":"2024-09-21T02:32:50.683627+0000","last_unstale":"2024-09-21T02:33:30.817856+0000","last_undegraded":"2024-09-21T02:33:30.817856+0000","last_fullsized":"2024-09-21T02:33:30.817856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:10.953943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536548+0000","last_change":"2024-09-21T02:32:41.465744+0000","last_active":"2024-09-21T02:33:30.536548+0000","last_peered":"2024-09-21T02:33:30.536548+0000","last_clean":"2024-09-21T02:33:30.536548+0000","last_became_active":"2024-09-21T02:32:41.465392+0000","last_became_peered":"2024-09-21T02:32:41.465392+0000","last_unstale":"2024-09-21T02:33:30.536548+0000","last_undegraded":"2024-09-21T02:33:30.536548+0000","last_fullsized":"2024-09-21T02:33:30.536548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:54.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818542+0000","last_change":"2024-09-21T02:32:41.470967+0000","last_active":"2024-09-21T02:33:30.818542+0000","last_peered":"2024-09-21T02:33:30.818542+0000","last_clean":"2024-09-21T02:33:30.818542+0000","last_became_active":"2024-09-21T02:32:41.470547+0000","last_became_peered":"2024-09-21T02:32:41.470547+0000","last_unstale":"2024-09-21T02:33:30.818542+0000","last_undegraded":"2024-09-21T02:33:30.818542+0000","last_fullsized":"2024-09-21T02:33:30.818542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:57.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818146+0000","last_change":"2024-09-21T02:32:41.474500+0000","last_active":"2024-09-21T02:33:30.818146+0000","last_peered":"2024-09-21T02:33:30.818146+0000","last_clean":"2024-09-21T02:33:30.818146+0000","last_became_active":"2024-09-21T02:32:41.474117+0000","last_became_peered":"2024-09-21T02:32:41.474117+0000","last_unstale":"2024-09-21T02:33:30.818146+0000","last_undegraded":"2024-09-21T02:33:30.818146+0000","last_fullsized":"2024-09-21T02:33:30.818146+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:43.152503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612731+0000","last_change":"2024-09-21T02:32:41.479123+0000","last_active":"2024-09-21T02:33:30.612731+0000","last_peered":"2024-09-21T02:33:30.612731+0000","last_clean":"2024-09-21T02:33:30.612731+0000","last_became_active":"2024-09-21T02:32:41.478543+0000","last_became_peered":"2024-09-21T02:32:41.478543+0000","last_unstale":"2024-09-21T02:33:30.612731+0000","last_undegraded":"2024-09-21T02:33:30.612731+0000","last_fullsized":"2024-09-21T02:33:30.612731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:39.802425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649480+0000","last_change":"2024-09-21T02:32:41.483334+0000","last_active":"2024-09-21T02:33:30.649480+0000","last_peered":"2024-09-21T02:33:30.649480+0000","last_clean":"2024-09-21T02:33:30.649480+0000","last_became_active":"2024-09-21T02:32:41.482999+0000","last_became_peered":"2024-09-21T02:32:41.482999+0000","last_unstale":"2024-09-21T02:33:30.649480+0000","last_undegraded":"2024-09-21T02:33:30.649480+0000","last_fullsized":"2024-09-21T02:33:30.649480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:16.259647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.539524+0000","last_change":"2024-09-21T02:33:30.539417+0000","last_active":"2024-09-21T02:33:30.539524+0000","last_peered":"2024-09-21T02:33:30.539524+0000","last_clean":"2024-09-21T02:33:30.539524+0000","last_became_active":"2024-09-21T02:33:30.538970+0000","last_became_peered":"2024-09-21T02:33:30.538970+0000","last_unstale":"2024-09-21T02:33:30.539524+0000","last_undegraded":"2024-09-21T02:33:30.539524+0000","last_fullsized":"2024-09-21T02:33:30.539524+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:09.772513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818890+0000","last_change":"2024-09-21T02:32:41.469386+0000","last_active":"2024-09-21T02:33:30.818890+0000","last_peered":"2024-09-21T02:33:30.818890+0000","last_clean":"2024-09-21T02:33:30.818890+0000","last_became_active":"2024-09-21T02:32:41.468982+0000","last_became_peered":"2024-09-21T02:32:41.468982+0000","last_unstale":"2024-09-21T02:33:30.818890+0000","last_undegraded":"2024-09-21T02:33:30.818890+0000","last_fullsized":"2024-09-21T02:33:30.818890+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.644854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531854+0000","last_change":"2024-09-21T02:32:41.467365+0000","last_active":"2024-09-21T02:33:30.531854+0000","last_peered":"2024-09-21T02:33:30.531854+0000","last_clean":"2024-09-21T02:33:30.531854+0000","last_became_active":"2024-09-21T02:32:41.466893+0000","last_became_peered":"2024-09-21T02:32:41.466893+0000","last_unstale":"2024-09-21T02:33:30.531854+0000","last_undegraded":"2024-09-21T02:33:30.531854+0000","last_fullsized":"2024-09-21T02:33:30.531854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532854+0000","last_change":"2024-09-21T02:32:41.473695+0000","last_active":"2024-09-21T02:33:30.532854+0000","last_peered":"2024-09-21T02:33:30.532854+0000","last_clean":"2024-09-21T02:33:30.532854+0000","last_became_active":"2024-09-21T02:32:41.473035+0000","last_became_peered":"2024-09-21T02:32:41.473035+0000","last_unstale":"2024-09-21T02:33:30.532854+0000","last_undegraded":"2024-09-21T02:33:30.532854+0000","last_fullsized":"2024-09-21T02:33:30.532854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:54.343984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531697+0000","last_change":"2024-09-21T02:32:41.473578+0000","last_active":"2024-09-21T02:33:30.531697+0000","last_peered":"2024-09-21T02:33:30.531697+0000","last_clean":"2024-09-21T02:33:30.531697+0000","last_became_active":"2024-09-21T02:32:41.472983+0000","last_became_peered":"2024-09-21T02:32:41.472983+0000","last_unstale":"2024-09-21T02:33:30.531697+0000","last_undegraded":"2024-09-21T02:33:30.531697+0000","last_fullsized":"2024-09-21T02:33:30.531697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.895809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040096+0000","last_change":"2024-09-21T02:32:41.473751+0000","last_active":"2024-09-21T02:33:31.040096+0000","last_peered":"2024-09-21T02:33:31.040096+0000","last_clean":"2024-09-21T02:33:31.040096+0000","last_became_active":"2024-09-21T02:32:41.473367+0000","last_became_peered":"2024-09-21T02:32:41.473367+0000","last_unstale":"2024-09-21T02:33:31.040096+0000","last_undegraded":"2024-09-21T02:33:31.040096+0000","last_fullsized":"2024-09-21T02:33:31.040096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:04.707745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649412+0000","last_change":"2024-09-21T02:32:41.485375+0000","last_active":"2024-09-21T02:33:30.649412+0000","last_peered":"2024-09-21T02:33:30.649412+0000","last_clean":"2024-09-21T02:33:30.649412+0000","last_became_active":"2024-09-21T02:32:41.484845+0000","last_became_peered":"2024-09-21T02:32:41.484845+0000","last_unstale":"2024-09-21T02:33:30.649412+0000","last_undegraded":"2024-09-21T02:33:30.649412+0000","last_fullsized":"2024-09-21T02:33:30.649412+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:58.529747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536661+0000","last_change":"2024-09-21T02:32:41.462925+0000","last_active":"2024-09-21T02:33:30.536661+0000","last_peered":"2024-09-21T02:33:30.536661+0000","last_clean":"2024-09-21T02:33:30.536661+0000","last_became_active":"2024-09-21T02:32:41.462056+0000","last_became_peered":"2024-09-21T02:32:41.462056+0000","last_unstale":"2024-09-21T02:33:30.536661+0000","last_undegraded":"2024-09-21T02:33:30.536661+0000","last_fullsized":"2024-09-21T02:33:30.536661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:05.447554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818777+0000","last_change":"2024-09-21T02:32:41.475111+0000","last_active":"2024-09-21T02:33:30.818777+0000","last_peered":"2024-09-21T02:33:30.818777+0000","last_clean":"2024-09-21T02:33:30.818777+0000","last_became_active":"2024-09-21T02:32:41.474634+0000","last_became_peered":"2024-09-21T02:32:41.474634+0000","last_unstale":"2024-09-21T02:33:30.818777+0000","last_undegraded":"2024-09-21T02:33:30.818777+0000","last_fullsized":"2024-09-21T02:33:30.818777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:07.750970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535309+0000","last_change":"2024-09-21T02:32:41.479702+0000","last_active":"2024-09-21T02:33:30.535309+0000","last_peered":"2024-09-21T02:33:30.535309+0000","last_clean":"2024-09-21T02:33:30.535309+0000","last_became_active":"2024-09-21T02:32:41.479378+0000","last_became_peered":"2024-09-21T02:32:41.479378+0000","last_unstale":"2024-09-21T02:33:30.535309+0000","last_undegraded":"2024-09-21T02:33:30.535309+0000","last_fullsized":"2024-09-21T02:33:30.535309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:56.687641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537214+0000","last_change":"2024-09-21T02:32:41.475567+0000","last_active":"2024-09-21T02:33:30.537214+0000","last_peered":"2024-09-21T02:33:30.537214+0000","last_clean":"2024-09-21T02:33:30.537214+0000","last_became_active":"2024-09-21T02:32:41.475207+0000","last_became_peered":"2024-09-21T02:32:41.475207+0000","last_unstale":"2024-09-21T02:33:30.537214+0000","last_undegraded":"2024-09-21T02:33:30.537214+0000","last_fullsized":"2024-09-21T02:33:30.537214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:33.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040363+0000","last_change":"2024-09-21T02:32:41.483518+0000","last_active":"2024-09-21T02:33:31.040363+0000","last_peered":"2024-09-21T02:33:31.040363+0000","last_clean":"2024-09-21T02:33:31.040363+0000","last_became_active":"2024-09-21T02:32:41.483088+0000","last_became_peered":"2024-09-21T02:32:41.483088+0000","last_unstale":"2024-09-21T02:33:31.040363+0000","last_undegraded":"2024-09-21T02:33:31.040363+0000","last_fullsized":"2024-09-21T02:33:31.040363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:23.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612221+0000","last_change":"2024-09-21T02:32:41.482113+0000","last_active":"2024-09-21T02:33:30.612221+0000","last_peered":"2024-09-21T02:33:30.612221+0000","last_clean":"2024-09-21T02:33:30.612221+0000","last_became_active":"2024-09-21T02:32:41.479123+0000","last_became_peered":"2024-09-21T02:32:41.479123+0000","last_unstale":"2024-09-21T02:33:30.612221+0000","last_undegraded":"2024-09-21T02:33:30.612221+0000","last_fullsized":"2024-09-21T02:33:30.612221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:48.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612164+0000","last_change":"2024-09-21T02:32:41.470429+0000","last_active":"2024-09-21T02:33:30.612164+0000","last_peered":"2024-09-21T02:33:30.612164+0000","last_clean":"2024-09-21T02:33:30.612164+0000","last_became_active":"2024-09-21T02:32:41.469421+0000","last_became_peered":"2024-09-21T02:32:41.469421+0000","last_unstale":"2024-09-21T02:33:30.612164+0000","last_undegraded":"2024-09-21T02:33:30.612164+0000","last_fullsized":"2024-09-21T02:33:30.612164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:00.952030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649290+0000","last_change":"2024-09-21T02:32:41.470361+0000","last_active":"2024-09-21T02:33:30.649290+0000","last_peered":"2024-09-21T02:33:30.649290+0000","last_clean":"2024-09-21T02:33:30.649290+0000","last_became_active":"2024-09-21T02:32:41.469983+0000","last_became_peered":"2024-09-21T02:32:41.469983+0000","last_unstale":"2024-09-21T02:33:30.649290+0000","last_undegraded":"2024-09-21T02:33:30.649290+0000","last_fullsized":"2024-09-21T02:33:30.649290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:02.703688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530484+0000","last_change":"2024-09-21T02:32:41.468975+0000","last_active":"2024-09-21T02:33:30.530484+0000","last_peered":"2024-09-21T02:33:30.530484+0000","last_clean":"2024-09-21T02:33:30.530484+0000","last_became_active":"2024-09-21T02:32:41.468612+0000","last_became_peered":"2024-09-21T02:32:41.468612+0000","last_unstale":"2024-09-21T02:33:30.530484+0000","last_undegraded":"2024-09-21T02:33:30.530484+0000","last_fullsized":"2024-09-21T02:33:30.530484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:04.442257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536851+0000","last_change":"2024-09-21T02:32:41.471444+0000","last_active":"2024-09-21T02:33:30.536851+0000","last_peered":"2024-09-21T02:33:30.536851+0000","last_clean":"2024-09-21T02:33:30.536851+0000","last_became_active":"2024-09-21T02:32:41.470437+0000","last_became_peered":"2024-09-21T02:32:41.470437+0000","last_unstale":"2024-09-21T02:33:30.536851+0000","last_undegraded":"2024-09-21T02:33:30.536851+0000","last_fullsized":"2024-09-21T02:33:30.536851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:13.933069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533687+0000","last_change":"2024-09-21T02:32:41.475397+0000","last_active":"2024-09-21T02:33:30.533687+0000","last_peered":"2024-09-21T02:33:30.533687+0000","last_clean":"2024-09-21T02:33:30.533687+0000","last_became_active":"2024-09-21T02:32:41.475034+0000","last_became_peered":"2024-09-21T02:32:41.475034+0000","last_unstale":"2024-09-21T02:33:30.533687+0000","last_undegraded":"2024-09-21T02:33:30.533687+0000","last_fullsized":"2024-09-21T02:33:30.533687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:24.944289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040408+0000","last_change":"2024-09-21T02:32:41.470297+0000","last_active":"2024-09-21T02:33:31.040408+0000","last_peered":"2024-09-21T02:33:31.040408+0000","last_clean":"2024-09-21T02:33:31.040408+0000","last_became_active":"2024-09-21T02:32:41.469843+0000","last_became_peered":"2024-09-21T02:32:41.469843+0000","last_unstale":"2024-09-21T02:33:31.040408+0000","last_undegraded":"2024-09-21T02:33:31.040408+0000","last_fullsized":"2024-09-21T02:33:31.040408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536267+0000","last_change":"2024-09-21T02:33:30.535828+0000","last_active":"2024-09-21T02:33:30.536267+0000","last_peered":"2024-09-21T02:33:30.536267+0000","last_clean":"2024-09-21T02:33:30.536267+0000","last_became_active":"2024-09-21T02:33:30.535576+0000","last_became_peered":"2024-09-21T02:33:30.535576+0000","last_unstale":"2024-09-21T02:33:30.536267+0000","last_undegraded":"2024-09-21T02:33:30.536267+0000","last_fullsized":"2024-09-21T02:33:30.536267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:05.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535903+0000","last_change":"2024-09-21T02:32:41.466073+0000","last_active":"2024-09-21T02:33:30.535903+0000","last_peered":"2024-09-21T02:33:30.535903+0000","last_clean":"2024-09-21T02:33:30.535903+0000","last_became_active":"2024-09-21T02:32:41.465664+0000","last_became_peered":"2024-09-21T02:32:41.465664+0000","last_unstale":"2024-09-21T02:33:30.535903+0000","last_undegraded":"2024-09-21T02:33:30.535903+0000","last_fullsized":"2024-09-21T02:33:30.535903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:25.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533333+0000","last_change":"2024-09-21T02:32:41.471006+0000","last_active":"2024-09-21T02:33:30.533333+0000","last_peered":"2024-09-21T02:33:30.533333+0000","last_clean":"2024-09-21T02:33:30.533333+0000","last_became_active":"2024-09-21T02:32:41.469780+0000","last_became_peered":"2024-09-21T02:32:41.469780+0000","last_unstale":"2024-09-21T02:33:30.533333+0000","last_undegraded":"2024-09-21T02:33:30.533333+0000","last_fullsized":"2024-09-21T02:33:30.533333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:18.604729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536436+0000","last_change":"2024-09-21T02:32:41.476169+0000","last_active":"2024-09-21T02:33:30.536436+0000","last_peered":"2024-09-21T02:33:30.536436+0000","last_clean":"2024-09-21T02:33:30.536436+0000","last_became_active":"2024-09-21T02:32:41.475754+0000","last_became_peered":"2024-09-21T02:32:41.475754+0000","last_unstale":"2024-09-21T02:33:30.536436+0000","last_undegraded":"2024-09-21T02:33:30.536436+0000","last_fullsized":"2024-09-21T02:33:30.536436+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:18.532122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530343+0000","last_change":"2024-09-21T02:32:41.467078+0000","last_active":"2024-09-21T02:33:30.530343+0000","last_peered":"2024-09-21T02:33:30.530343+0000","last_clean":"2024-09-21T02:33:30.530343+0000","last_became_active":"2024-09-21T02:32:41.466702+0000","last_became_peered":"2024-09-21T02:32:41.466702+0000","last_unstale":"2024-09-21T02:33:30.530343+0000","last_undegraded":"2024-09-21T02:33:30.530343+0000","last_fullsized":"2024-09-21T02:33:30.530343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:43.409390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612400+0000","last_change":"2024-09-21T02:32:41.467476+0000","last_active":"2024-09-21T02:33:30.612400+0000","last_peered":"2024-09-21T02:33:30.612400+0000","last_clean":"2024-09-21T02:33:30.612400+0000","last_became_active":"2024-09-21T02:32:41.466901+0000","last_became_peered":"2024-09-21T02:32:41.466901+0000","last_unstale":"2024-09-21T02:33:30.612400+0000","last_undegraded":"2024-09-21T02:33:30.612400+0000","last_fullsized":"2024-09-21T02:33:30.612400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:46.207507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612499+0000","last_change":"2024-09-21T02:32:41.486528+0000","last_active":"2024-09-21T02:33:30.612499+0000","last_peered":"2024-09-21T02:33:30.612499+0000","last_clean":"2024-09-21T02:33:30.612499+0000","last_became_active":"2024-09-21T02:32:41.484370+0000","last_became_peered":"2024-09-21T02:32:41.484370+0000","last_unstale":"2024-09-21T02:33:30.612499+0000","last_undegraded":"2024-09-21T02:33:30.612499+0000","last_fullsized":"2024-09-21T02:33:30.612499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:28.978540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537134+0000","last_change":"2024-09-21T02:32:41.474525+0000","last_active":"2024-09-21T02:33:30.537134+0000","last_peered":"2024-09-21T02:33:30.537134+0000","last_clean":"2024-09-21T02:33:30.537134+0000","last_became_active":"2024-09-21T02:32:41.474147+0000","last_became_peered":"2024-09-21T02:32:41.474147+0000","last_unstale":"2024-09-21T02:33:30.537134+0000","last_undegraded":"2024-09-21T02:33:30.537134+0000","last_fullsized":"2024-09-21T02:33:30.537134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:26.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60397,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":44,"num_read_kb":83,"num_write":84,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":181191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":486430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1132495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":491108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266731,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":487034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462961,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1081476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":482334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822717,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36884,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708268,"statfs":{"total":95995035648,"available":95957266432,"internally_reserved":0,"allocated":1576960,"data_stored":1076980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986241,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":486452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":482438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":541967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":541933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":970752,"data_stored":482424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:33:52.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:33:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:52 smithi079 ceph-mon[30788]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:33:52.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:52 smithi148 ceph-mon[34626]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:33:52.857 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:52.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:52 smithi098 ceph-mon[34832]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 -- 172.21.15.79:0/4046769109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57381101e0 msgr2=0x7f5738112600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 --2- 172.21.15.79:0/4046769109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57381101e0 0x7f5738112600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5730009ca0 tx=0x7f573002a950 comp rx=0 tx=0).stop 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 -- 172.21.15.79:0/4046769109 shutdown_connections 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 --2- 172.21.15.79:0/4046769109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57381101e0 0x7f5738112600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 --2- 172.21.15.79:0/4046769109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5738102f80 0x7f573810fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 --2- 172.21.15.79:0/4046769109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5738102630 0x7f5738102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 -- 172.21.15.79:0/4046769109 >> 172.21.15.79:0/4046769109 conn(0x7f5738079720 msgr2=0x7f5738079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 -- 172.21.15.79:0/4046769109 shutdown_connections 2024-09-21T02:33:53.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.469+0000 7f573f000640 1 -- 172.21.15.79:0/4046769109 wait complete. 2024-09-21T02:33:53.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 Processor -- start 2024-09-21T02:33:53.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 -- start start 2024-09-21T02:33:53.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5738102630 0x7f573819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:53.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5738102f80 0x7f573819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57381101e0 0x7f57381a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5738115cd0 con 0x7f5738102f80 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5738115b50 con 0x7f57381101e0 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f573f000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5738115e50 con 0x7f5738102630 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.471+0000 7f5737e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5738102630 0x7f573819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f5737400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5738102f80 0x7f573819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f573d000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57381101e0 0x7f57381a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f5737e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5738102630 0x7f573819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55330/0 (socket says 172.21.15.79:55330) 2024-09-21T02:33:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f5737e00640 1 -- 172.21.15.79:0/263194969 learned_addr learned my addr 172.21.15.79:0/263194969 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:53.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f573d000640 1 -- 172.21.15.79:0/263194969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5738102630 msgr2=0x7f573819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:53.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f573d000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5738102630 0x7f573819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f573d000640 1 -- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5738102f80 msgr2=0x7f573819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:53.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f573d000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5738102f80 0x7f573819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f573d000640 1 -- 172.21.15.79:0/263194969 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57381a2570 con 0x7f57381101e0 2024-09-21T02:33:53.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f5737400640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5738102f80 0x7f573819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:53.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.472+0000 7f573d000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57381101e0 0x7f57381a1e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5730005e30 tx=0x7f5730003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:53.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.473+0000 7f5734c00640 1 -- 172.21.15.79:0/263194969 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730034040 con 0x7f57381101e0 2024-09-21T02:33:53.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.473+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57381a2800 con 0x7f57381101e0 2024-09-21T02:33:53.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.473+0000 7f5734c00640 1 -- 172.21.15.79:0/263194969 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5730003e50 con 0x7f57381101e0 2024-09-21T02:33:53.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.473+0000 7f5734c00640 1 -- 172.21.15.79:0/263194969 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300045d0 con 0x7f57381101e0 2024-09-21T02:33:53.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.473+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57381a8fc0 con 0x7f57381101e0 2024-09-21T02:33:53.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.474+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573806bed0 con 0x7f57381101e0 2024-09-21T02:33:53.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.477+0000 7f5734c00640 1 -- 172.21.15.79:0/263194969 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5730037020 con 0x7f57381101e0 2024-09-21T02:33:53.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.478+0000 7f5734c00640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f571c0b65a0 0x7f571c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.479+0000 7f5734c00640 1 -- 172.21.15.79:0/263194969 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f5730108470 con 0x7f57381101e0 2024-09-21T02:33:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.479+0000 7f5737e00640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f571c0b65a0 0x7f571c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.479+0000 7f5737e00640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f571c0b65a0 0x7f571c0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f572800bca0 tx=0x7f572800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:53.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.481+0000 7f5734c00640 1 -- 172.21.15.79:0/263194969 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5730030850 con 0x7f57381101e0 2024-09-21T02:33:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.668+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5738111bf0 con 0x7f571c0b65a0 2024-09-21T02:33:53.670 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:53 smithi079 ceph-mon[30788]: pgmap v358: 129 pgs: 129 active+clean; 636 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T02:33:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.675+0000 7f5734c00640 1 -- 172.21.15.79:0/263194969 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340268 (secure 0 0 0) 0x7f5738111bf0 con 0x7f571c0b65a0 2024-09-21T02:33:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:53.681 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T02:33:53.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f571c0b65a0 msgr2=0x7f571c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:53.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f571c0b65a0 0x7f571c0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f572800bca0 tx=0x7f572800b410 comp rx=0 tx=0).stop 2024-09-21T02:33:53.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57381101e0 msgr2=0x7f57381a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:53.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57381101e0 0x7f57381a1e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5730005e30 tx=0x7f5730003ce0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 shutdown_connections 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f571c0b65a0 0x7f571c0b8ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57381101e0 0x7f57381a1e40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5738102f80 0x7f573819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 --2- 172.21.15.79:0/263194969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5738102630 0x7f573819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 >> 172.21.15.79:0/263194969 conn(0x7f5738079720 msgr2=0x7f57381114e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 shutdown_connections 2024-09-21T02:33:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:53.680+0000 7f573f000640 1 -- 172.21.15.79:0/263194969 wait complete. 2024-09-21T02:33:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:53 smithi148 ceph-mon[34626]: pgmap v358: 129 pgs: 129 active+clean; 636 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T02:33:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:53 smithi098 ceph-mon[34832]: pgmap v358: 129 pgs: 129 active+clean; 636 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T02:33:54.567 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-21T02:33:53.414173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650999,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":120,"num_read_kb":147,"num_write":215,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387588,"kb_used_data":13368,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554236,"statfs":{"total":1151940427776,"available":1151543537664,"internally_reserved":0,"allocated":13688832,"data_stored":7777336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49274,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":59,"num_write":33,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003752"},"pg_stats":[{"pgid":"2.1f","version":"78'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535378+0000","last_change":"2024-09-21T02:32:38.433250+0000","last_active":"2024-09-21T02:33:30.535378+0000","last_peered":"2024-09-21T02:33:30.535378+0000","last_clean":"2024-09-21T02:33:30.535378+0000","last_became_active":"2024-09-21T02:32:38.431844+0000","last_became_peered":"2024-09-21T02:32:38.431844+0000","last_unstale":"2024-09-21T02:33:30.535378+0000","last_undegraded":"2024-09-21T02:33:30.535378+0000","last_fullsized":"2024-09-21T02:33:30.535378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:26.741583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531681+0000","last_change":"2024-09-21T02:32:41.473485+0000","last_active":"2024-09-21T02:33:30.531681+0000","last_peered":"2024-09-21T02:33:30.531681+0000","last_clean":"2024-09-21T02:33:30.531681+0000","last_became_active":"2024-09-21T02:32:41.473134+0000","last_became_peered":"2024-09-21T02:32:41.473134+0000","last_unstale":"2024-09-21T02:33:30.531681+0000","last_undegraded":"2024-09-21T02:33:30.531681+0000","last_fullsized":"2024-09-21T02:33:30.531681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818085+0000","last_change":"2024-09-21T02:32:50.687618+0000","last_active":"2024-09-21T02:33:30.818085+0000","last_peered":"2024-09-21T02:33:30.818085+0000","last_clean":"2024-09-21T02:33:30.818085+0000","last_became_active":"2024-09-21T02:32:50.687157+0000","last_became_peered":"2024-09-21T02:32:50.687157+0000","last_unstale":"2024-09-21T02:33:30.818085+0000","last_undegraded":"2024-09-21T02:33:30.818085+0000","last_fullsized":"2024-09-21T02:33:30.818085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:29.247287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532059+0000","last_change":"2024-09-21T02:32:38.512667+0000","last_active":"2024-09-21T02:33:30.532059+0000","last_peered":"2024-09-21T02:33:30.532059+0000","last_clean":"2024-09-21T02:33:30.532059+0000","last_became_active":"2024-09-21T02:32:38.512261+0000","last_became_peered":"2024-09-21T02:32:38.512261+0000","last_unstale":"2024-09-21T02:33:30.532059+0000","last_undegraded":"2024-09-21T02:33:30.532059+0000","last_fullsized":"2024-09-21T02:33:30.532059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:05.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612563+0000","last_change":"2024-09-21T02:32:41.481816+0000","last_active":"2024-09-21T02:33:30.612563+0000","last_peered":"2024-09-21T02:33:30.612563+0000","last_clean":"2024-09-21T02:33:30.612563+0000","last_became_active":"2024-09-21T02:32:41.478295+0000","last_became_peered":"2024-09-21T02:32:41.478295+0000","last_unstale":"2024-09-21T02:33:30.612563+0000","last_undegraded":"2024-09-21T02:33:30.612563+0000","last_fullsized":"2024-09-21T02:33:30.612563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:58.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.529870+0000","last_change":"2024-09-21T02:32:50.692598+0000","last_active":"2024-09-21T02:33:30.529870+0000","last_peered":"2024-09-21T02:33:30.529870+0000","last_clean":"2024-09-21T02:33:30.529870+0000","last_became_active":"2024-09-21T02:32:50.692120+0000","last_became_peered":"2024-09-21T02:32:50.692120+0000","last_unstale":"2024-09-21T02:33:30.529870+0000","last_undegraded":"2024-09-21T02:33:30.529870+0000","last_fullsized":"2024-09-21T02:33:30.529870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:57.642195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537320+0000","last_change":"2024-09-21T02:32:38.435292+0000","last_active":"2024-09-21T02:33:30.537320+0000","last_peered":"2024-09-21T02:33:30.537320+0000","last_clean":"2024-09-21T02:33:30.537320+0000","last_became_active":"2024-09-21T02:32:38.434878+0000","last_became_peered":"2024-09-21T02:32:38.434878+0000","last_unstale":"2024-09-21T02:33:30.537320+0000","last_undegraded":"2024-09-21T02:33:30.537320+0000","last_fullsized":"2024-09-21T02:33:30.537320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:56.827844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039648+0000","last_change":"2024-09-21T02:32:41.467834+0000","last_active":"2024-09-21T02:33:31.039648+0000","last_peered":"2024-09-21T02:33:31.039648+0000","last_clean":"2024-09-21T02:33:31.039648+0000","last_became_active":"2024-09-21T02:32:41.467440+0000","last_became_peered":"2024-09-21T02:32:41.467440+0000","last_unstale":"2024-09-21T02:33:31.039648+0000","last_undegraded":"2024-09-21T02:33:31.039648+0000","last_fullsized":"2024-09-21T02:33:31.039648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:16.857988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.539702+0000","last_change":"2024-09-21T02:33:30.539580+0000","last_active":"2024-09-21T02:33:30.539702+0000","last_peered":"2024-09-21T02:33:30.539702+0000","last_clean":"2024-09-21T02:33:30.539702+0000","last_became_active":"2024-09-21T02:33:30.539088+0000","last_became_peered":"2024-09-21T02:33:30.539088+0000","last_unstale":"2024-09-21T02:33:30.539702+0000","last_undegraded":"2024-09-21T02:33:30.539702+0000","last_fullsized":"2024-09-21T02:33:30.539702+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:42.437535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537393+0000","last_change":"2024-09-21T02:32:38.431645+0000","last_active":"2024-09-21T02:33:30.537393+0000","last_peered":"2024-09-21T02:33:30.537393+0000","last_clean":"2024-09-21T02:33:30.537393+0000","last_became_active":"2024-09-21T02:32:38.431069+0000","last_became_peered":"2024-09-21T02:32:38.431069+0000","last_unstale":"2024-09-21T02:33:30.537393+0000","last_undegraded":"2024-09-21T02:33:30.537393+0000","last_fullsized":"2024-09-21T02:33:30.537393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:34.893292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533334+0000","last_change":"2024-09-21T02:32:41.470506+0000","last_active":"2024-09-21T02:33:30.533334+0000","last_peered":"2024-09-21T02:33:30.533334+0000","last_clean":"2024-09-21T02:33:30.533334+0000","last_became_active":"2024-09-21T02:32:41.470165+0000","last_became_peered":"2024-09-21T02:32:41.470165+0000","last_unstale":"2024-09-21T02:33:30.533334+0000","last_undegraded":"2024-09-21T02:33:30.533334+0000","last_fullsized":"2024-09-21T02:33:30.533334+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.529950+0000","last_change":"2024-09-21T02:32:50.681923+0000","last_active":"2024-09-21T02:33:30.529950+0000","last_peered":"2024-09-21T02:33:30.529950+0000","last_clean":"2024-09-21T02:33:30.529950+0000","last_became_active":"2024-09-21T02:32:50.681374+0000","last_became_peered":"2024-09-21T02:32:50.681374+0000","last_unstale":"2024-09-21T02:33:30.529950+0000","last_undegraded":"2024-09-21T02:33:30.529950+0000","last_fullsized":"2024-09-21T02:33:30.529950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:46.060715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536177+0000","last_change":"2024-09-21T02:32:41.470550+0000","last_active":"2024-09-21T02:33:30.536177+0000","last_peered":"2024-09-21T02:33:30.536177+0000","last_clean":"2024-09-21T02:33:30.536177+0000","last_became_active":"2024-09-21T02:32:41.469282+0000","last_became_peered":"2024-09-21T02:32:41.469282+0000","last_unstale":"2024-09-21T02:33:30.536177+0000","last_undegraded":"2024-09-21T02:33:30.536177+0000","last_fullsized":"2024-09-21T02:33:30.536177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:34.619382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537199+0000","last_change":"2024-09-21T02:32:38.435261+0000","last_active":"2024-09-21T02:33:30.537199+0000","last_peered":"2024-09-21T02:33:30.537199+0000","last_clean":"2024-09-21T02:33:30.537199+0000","last_became_active":"2024-09-21T02:32:38.434795+0000","last_became_peered":"2024-09-21T02:32:38.434795+0000","last_unstale":"2024-09-21T02:33:30.537199+0000","last_undegraded":"2024-09-21T02:33:30.537199+0000","last_fullsized":"2024-09-21T02:33:30.537199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:05.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530106+0000","last_change":"2024-09-21T02:32:50.714657+0000","last_active":"2024-09-21T02:33:30.530106+0000","last_peered":"2024-09-21T02:33:30.530106+0000","last_clean":"2024-09-21T02:33:30.530106+0000","last_became_active":"2024-09-21T02:32:50.714077+0000","last_became_peered":"2024-09-21T02:32:50.714077+0000","last_unstale":"2024-09-21T02:33:30.530106+0000","last_undegraded":"2024-09-21T02:33:30.530106+0000","last_fullsized":"2024-09-21T02:33:30.530106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.812785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531720+0000","last_change":"2024-09-21T02:32:41.473964+0000","last_active":"2024-09-21T02:33:30.531720+0000","last_peered":"2024-09-21T02:33:30.531720+0000","last_clean":"2024-09-21T02:33:30.531720+0000","last_became_active":"2024-09-21T02:32:41.473598+0000","last_became_peered":"2024-09-21T02:32:41.473598+0000","last_unstale":"2024-09-21T02:33:30.531720+0000","last_undegraded":"2024-09-21T02:33:30.531720+0000","last_fullsized":"2024-09-21T02:33:30.531720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818344+0000","last_change":"2024-09-21T02:32:38.435800+0000","last_active":"2024-09-21T02:33:30.818344+0000","last_peered":"2024-09-21T02:33:30.818344+0000","last_clean":"2024-09-21T02:33:30.818344+0000","last_became_active":"2024-09-21T02:32:38.434797+0000","last_became_peered":"2024-09-21T02:32:38.434797+0000","last_unstale":"2024-09-21T02:33:30.818344+0000","last_undegraded":"2024-09-21T02:33:30.818344+0000","last_fullsized":"2024-09-21T02:33:30.818344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:46.540597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530258+0000","last_change":"2024-09-21T02:32:50.693447+0000","last_active":"2024-09-21T02:33:30.530258+0000","last_peered":"2024-09-21T02:33:30.530258+0000","last_clean":"2024-09-21T02:33:30.530258+0000","last_became_active":"2024-09-21T02:32:50.692829+0000","last_became_peered":"2024-09-21T02:32:50.692829+0000","last_unstale":"2024-09-21T02:33:30.530258+0000","last_undegraded":"2024-09-21T02:33:30.530258+0000","last_fullsized":"2024-09-21T02:33:30.530258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:10.958279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536385+0000","last_change":"2024-09-21T02:32:41.478053+0000","last_active":"2024-09-21T02:33:30.536385+0000","last_peered":"2024-09-21T02:33:30.536385+0000","last_clean":"2024-09-21T02:33:30.536385+0000","last_became_active":"2024-09-21T02:32:41.477631+0000","last_became_peered":"2024-09-21T02:32:41.477631+0000","last_unstale":"2024-09-21T02:33:30.536385+0000","last_undegraded":"2024-09-21T02:33:30.536385+0000","last_fullsized":"2024-09-21T02:33:30.536385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:19.548261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531963+0000","last_change":"2024-09-21T02:32:38.425388+0000","last_active":"2024-09-21T02:33:30.531963+0000","last_peered":"2024-09-21T02:33:30.531963+0000","last_clean":"2024-09-21T02:33:30.531963+0000","last_became_active":"2024-09-21T02:32:38.424975+0000","last_became_peered":"2024-09-21T02:32:38.424975+0000","last_unstale":"2024-09-21T02:33:30.531963+0000","last_undegraded":"2024-09-21T02:33:30.531963+0000","last_fullsized":"2024-09-21T02:33:30.531963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:43.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535082+0000","last_change":"2024-09-21T02:32:50.695406+0000","last_active":"2024-09-21T02:33:30.535082+0000","last_peered":"2024-09-21T02:33:30.535082+0000","last_clean":"2024-09-21T02:33:30.535082+0000","last_became_active":"2024-09-21T02:32:50.694958+0000","last_became_peered":"2024-09-21T02:32:50.694958+0000","last_unstale":"2024-09-21T02:33:30.535082+0000","last_undegraded":"2024-09-21T02:33:30.535082+0000","last_fullsized":"2024-09-21T02:33:30.535082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:49.038587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536208+0000","last_change":"2024-09-21T02:32:41.463475+0000","last_active":"2024-09-21T02:33:30.536208+0000","last_peered":"2024-09-21T02:33:30.536208+0000","last_clean":"2024-09-21T02:33:30.536208+0000","last_became_active":"2024-09-21T02:32:41.462950+0000","last_became_peered":"2024-09-21T02:32:41.462950+0000","last_unstale":"2024-09-21T02:33:30.536208+0000","last_undegraded":"2024-09-21T02:33:30.536208+0000","last_fullsized":"2024-09-21T02:33:30.536208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:40.871522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039879+0000","last_change":"2024-09-21T02:32:38.512534+0000","last_active":"2024-09-21T02:33:31.039879+0000","last_peered":"2024-09-21T02:33:31.039879+0000","last_clean":"2024-09-21T02:33:31.039879+0000","last_became_active":"2024-09-21T02:32:38.512162+0000","last_became_peered":"2024-09-21T02:32:38.512162+0000","last_unstale":"2024-09-21T02:33:31.039879+0000","last_undegraded":"2024-09-21T02:33:31.039879+0000","last_fullsized":"2024-09-21T02:33:31.039879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:35.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530084+0000","last_change":"2024-09-21T02:32:50.716000+0000","last_active":"2024-09-21T02:33:30.530084+0000","last_peered":"2024-09-21T02:33:30.530084+0000","last_clean":"2024-09-21T02:33:30.530084+0000","last_became_active":"2024-09-21T02:32:50.715371+0000","last_became_peered":"2024-09-21T02:32:50.715371+0000","last_unstale":"2024-09-21T02:33:30.530084+0000","last_undegraded":"2024-09-21T02:33:30.530084+0000","last_fullsized":"2024-09-21T02:33:30.530084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:54.490957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612525+0000","last_change":"2024-09-21T02:32:41.479797+0000","last_active":"2024-09-21T02:33:30.612525+0000","last_peered":"2024-09-21T02:33:30.612525+0000","last_clean":"2024-09-21T02:33:30.612525+0000","last_became_active":"2024-09-21T02:32:41.479400+0000","last_became_peered":"2024-09-21T02:32:41.479400+0000","last_unstale":"2024-09-21T02:33:30.612525+0000","last_undegraded":"2024-09-21T02:33:30.612525+0000","last_fullsized":"2024-09-21T02:33:30.612525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:34.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530750+0000","last_change":"2024-09-21T02:32:38.748844+0000","last_active":"2024-09-21T02:33:30.530750+0000","last_peered":"2024-09-21T02:33:30.530750+0000","last_clean":"2024-09-21T02:33:30.530750+0000","last_became_active":"2024-09-21T02:32:38.748428+0000","last_became_peered":"2024-09-21T02:32:38.748428+0000","last_unstale":"2024-09-21T02:33:30.530750+0000","last_undegraded":"2024-09-21T02:33:30.530750+0000","last_fullsized":"2024-09-21T02:33:30.530750+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:01.300290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.817778+0000","last_change":"2024-09-21T02:32:50.681667+0000","last_active":"2024-09-21T02:33:30.817778+0000","last_peered":"2024-09-21T02:33:30.817778+0000","last_clean":"2024-09-21T02:33:30.817778+0000","last_became_active":"2024-09-21T02:32:50.681113+0000","last_became_peered":"2024-09-21T02:32:50.681113+0000","last_unstale":"2024-09-21T02:33:30.817778+0000","last_undegraded":"2024-09-21T02:33:30.817778+0000","last_fullsized":"2024-09-21T02:33:30.817778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:20.881199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531891+0000","last_change":"2024-09-21T02:32:41.466320+0000","last_active":"2024-09-21T02:33:30.531891+0000","last_peered":"2024-09-21T02:33:30.531891+0000","last_clean":"2024-09-21T02:33:30.531891+0000","last_became_active":"2024-09-21T02:32:41.462700+0000","last_became_peered":"2024-09-21T02:32:41.462700+0000","last_unstale":"2024-09-21T02:33:30.531891+0000","last_undegraded":"2024-09-21T02:33:30.531891+0000","last_fullsized":"2024-09-21T02:33:30.531891+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:05.324192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:49.484414+0000","last_change":"2024-09-21T02:32:38.432478+0000","last_active":"2024-09-21T02:33:49.484414+0000","last_peered":"2024-09-21T02:33:49.484414+0000","last_clean":"2024-09-21T02:33:49.484414+0000","last_became_active":"2024-09-21T02:32:38.431107+0000","last_became_peered":"2024-09-21T02:32:38.431107+0000","last_unstale":"2024-09-21T02:33:49.484414+0000","last_undegraded":"2024-09-21T02:33:49.484414+0000","last_fullsized":"2024-09-21T02:33:49.484414+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:04.629078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531359+0000","last_change":"2024-09-21T02:32:50.715335+0000","last_active":"2024-09-21T02:33:30.531359+0000","last_peered":"2024-09-21T02:33:30.531359+0000","last_clean":"2024-09-21T02:33:30.531359+0000","last_became_active":"2024-09-21T02:32:50.714117+0000","last_became_peered":"2024-09-21T02:32:50.714117+0000","last_unstale":"2024-09-21T02:33:30.531359+0000","last_undegraded":"2024-09-21T02:33:30.531359+0000","last_fullsized":"2024-09-21T02:33:30.531359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:53.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649521+0000","last_change":"2024-09-21T02:32:41.467613+0000","last_active":"2024-09-21T02:33:30.649521+0000","last_peered":"2024-09-21T02:33:30.649521+0000","last_clean":"2024-09-21T02:33:30.649521+0000","last_became_active":"2024-09-21T02:32:41.467136+0000","last_became_peered":"2024-09-21T02:32:41.467136+0000","last_unstale":"2024-09-21T02:33:30.649521+0000","last_undegraded":"2024-09-21T02:33:30.649521+0000","last_fullsized":"2024-09-21T02:33:30.649521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:16.929257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537449+0000","last_change":"2024-09-21T02:32:38.513591+0000","last_active":"2024-09-21T02:33:30.537449+0000","last_peered":"2024-09-21T02:33:30.537449+0000","last_clean":"2024-09-21T02:33:30.537449+0000","last_became_active":"2024-09-21T02:32:38.513169+0000","last_became_peered":"2024-09-21T02:32:38.513169+0000","last_unstale":"2024-09-21T02:33:30.537449+0000","last_undegraded":"2024-09-21T02:33:30.537449+0000","last_fullsized":"2024-09-21T02:33:30.537449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:24.038894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536091+0000","last_change":"2024-09-21T02:32:50.680165+0000","last_active":"2024-09-21T02:33:30.536091+0000","last_peered":"2024-09-21T02:33:30.536091+0000","last_clean":"2024-09-21T02:33:30.536091+0000","last_became_active":"2024-09-21T02:32:50.679730+0000","last_became_peered":"2024-09-21T02:32:50.679730+0000","last_unstale":"2024-09-21T02:33:30.536091+0000","last_undegraded":"2024-09-21T02:33:30.536091+0000","last_fullsized":"2024-09-21T02:33:30.536091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:25.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533091+0000","last_change":"2024-09-21T02:32:41.483355+0000","last_active":"2024-09-21T02:33:30.533091+0000","last_peered":"2024-09-21T02:33:30.533091+0000","last_clean":"2024-09-21T02:33:30.533091+0000","last_became_active":"2024-09-21T02:32:41.482786+0000","last_became_peered":"2024-09-21T02:32:41.482786+0000","last_unstale":"2024-09-21T02:33:30.533091+0000","last_undegraded":"2024-09-21T02:33:30.533091+0000","last_fullsized":"2024-09-21T02:33:30.533091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:46.277233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534935+0000","last_change":"2024-09-21T02:32:38.515173+0000","last_active":"2024-09-21T02:33:30.534935+0000","last_peered":"2024-09-21T02:33:30.534935+0000","last_clean":"2024-09-21T02:33:30.534935+0000","last_became_active":"2024-09-21T02:32:38.513341+0000","last_became_peered":"2024-09-21T02:32:38.513341+0000","last_unstale":"2024-09-21T02:33:30.534935+0000","last_undegraded":"2024-09-21T02:33:30.534935+0000","last_fullsized":"2024-09-21T02:33:30.534935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.988203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536222+0000","last_change":"2024-09-21T02:32:50.714389+0000","last_active":"2024-09-21T02:33:30.536222+0000","last_peered":"2024-09-21T02:33:30.536222+0000","last_clean":"2024-09-21T02:33:30.536222+0000","last_became_active":"2024-09-21T02:32:50.713859+0000","last_became_peered":"2024-09-21T02:32:50.713859+0000","last_unstale":"2024-09-21T02:33:30.536222+0000","last_undegraded":"2024-09-21T02:33:30.536222+0000","last_fullsized":"2024-09-21T02:33:30.536222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:41.315205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.613637+0000","last_change":"2024-09-21T02:33:30.613550+0000","last_active":"2024-09-21T02:33:30.613637+0000","last_peered":"2024-09-21T02:33:30.613637+0000","last_clean":"2024-09-21T02:33:30.613637+0000","last_became_active":"2024-09-21T02:33:30.613216+0000","last_became_peered":"2024-09-21T02:33:30.613216+0000","last_unstale":"2024-09-21T02:33:30.613637+0000","last_undegraded":"2024-09-21T02:33:30.613637+0000","last_fullsized":"2024-09-21T02:33:30.613637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:11.076824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536393+0000","last_change":"2024-09-21T02:32:38.428428+0000","last_active":"2024-09-21T02:33:30.536393+0000","last_peered":"2024-09-21T02:33:30.536393+0000","last_clean":"2024-09-21T02:33:30.536393+0000","last_became_active":"2024-09-21T02:32:38.428066+0000","last_became_peered":"2024-09-21T02:32:38.428066+0000","last_unstale":"2024-09-21T02:33:30.536393+0000","last_undegraded":"2024-09-21T02:33:30.536393+0000","last_fullsized":"2024-09-21T02:33:30.536393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:45.601916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649329+0000","last_change":"2024-09-21T02:32:50.691139+0000","last_active":"2024-09-21T02:33:30.649329+0000","last_peered":"2024-09-21T02:33:30.649329+0000","last_clean":"2024-09-21T02:33:30.649329+0000","last_became_active":"2024-09-21T02:32:50.690653+0000","last_became_peered":"2024-09-21T02:32:50.690653+0000","last_unstale":"2024-09-21T02:33:30.649329+0000","last_undegraded":"2024-09-21T02:33:30.649329+0000","last_fullsized":"2024-09-21T02:33:30.649329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:43.852916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532961+0000","last_change":"2024-09-21T02:32:41.466857+0000","last_active":"2024-09-21T02:33:30.532961+0000","last_peered":"2024-09-21T02:33:30.532961+0000","last_clean":"2024-09-21T02:33:30.532961+0000","last_became_active":"2024-09-21T02:32:41.466467+0000","last_became_peered":"2024-09-21T02:32:41.466467+0000","last_unstale":"2024-09-21T02:33:30.532961+0000","last_undegraded":"2024-09-21T02:33:30.532961+0000","last_fullsized":"2024-09-21T02:33:30.532961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:29.369150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649089+0000","last_change":"2024-09-21T02:32:38.513999+0000","last_active":"2024-09-21T02:33:30.649089+0000","last_peered":"2024-09-21T02:33:30.649089+0000","last_clean":"2024-09-21T02:33:30.649089+0000","last_became_active":"2024-09-21T02:32:38.513605+0000","last_became_peered":"2024-09-21T02:32:38.513605+0000","last_unstale":"2024-09-21T02:33:30.649089+0000","last_undegraded":"2024-09-21T02:33:30.649089+0000","last_fullsized":"2024-09-21T02:33:30.649089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:45.616961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649395+0000","last_change":"2024-09-21T02:32:50.714830+0000","last_active":"2024-09-21T02:33:30.649395+0000","last_peered":"2024-09-21T02:33:30.649395+0000","last_clean":"2024-09-21T02:33:30.649395+0000","last_became_active":"2024-09-21T02:32:50.714166+0000","last_became_peered":"2024-09-21T02:32:50.714166+0000","last_unstale":"2024-09-21T02:33:30.649395+0000","last_undegraded":"2024-09-21T02:33:30.649395+0000","last_fullsized":"2024-09-21T02:33:30.649395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:35.418689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.648937+0000","last_change":"2024-09-21T02:32:41.468695+0000","last_active":"2024-09-21T02:33:30.648937+0000","last_peered":"2024-09-21T02:33:30.648937+0000","last_clean":"2024-09-21T02:33:30.648937+0000","last_became_active":"2024-09-21T02:32:41.468349+0000","last_became_peered":"2024-09-21T02:32:41.468349+0000","last_unstale":"2024-09-21T02:33:30.648937+0000","last_undegraded":"2024-09-21T02:33:30.648937+0000","last_fullsized":"2024-09-21T02:33:30.648937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:51.935336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535932+0000","last_change":"2024-09-21T02:32:38.431187+0000","last_active":"2024-09-21T02:33:30.535932+0000","last_peered":"2024-09-21T02:33:30.535932+0000","last_clean":"2024-09-21T02:33:30.535932+0000","last_became_active":"2024-09-21T02:32:38.430790+0000","last_became_peered":"2024-09-21T02:32:38.430790+0000","last_unstale":"2024-09-21T02:33:30.535932+0000","last_undegraded":"2024-09-21T02:33:30.535932+0000","last_fullsized":"2024-09-21T02:33:30.535932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:05.004479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533332+0000","last_change":"2024-09-21T02:32:50.715728+0000","last_active":"2024-09-21T02:33:30.533332+0000","last_peered":"2024-09-21T02:33:30.533332+0000","last_clean":"2024-09-21T02:33:30.533332+0000","last_became_active":"2024-09-21T02:32:50.715329+0000","last_became_peered":"2024-09-21T02:32:50.715329+0000","last_unstale":"2024-09-21T02:33:30.533332+0000","last_undegraded":"2024-09-21T02:33:30.533332+0000","last_fullsized":"2024-09-21T02:33:30.533332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.790489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532196+0000","last_change":"2024-09-21T02:32:41.474885+0000","last_active":"2024-09-21T02:33:30.532196+0000","last_peered":"2024-09-21T02:33:30.532196+0000","last_clean":"2024-09-21T02:33:30.532196+0000","last_became_active":"2024-09-21T02:32:41.474599+0000","last_became_peered":"2024-09-21T02:32:41.474599+0000","last_unstale":"2024-09-21T02:33:30.532196+0000","last_undegraded":"2024-09-21T02:33:30.532196+0000","last_fullsized":"2024-09-21T02:33:30.532196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:43.006829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531206+0000","last_change":"2024-09-21T02:32:38.431168+0000","last_active":"2024-09-21T02:33:30.531206+0000","last_peered":"2024-09-21T02:33:30.531206+0000","last_clean":"2024-09-21T02:33:30.531206+0000","last_became_active":"2024-09-21T02:32:38.430743+0000","last_became_peered":"2024-09-21T02:32:38.430743+0000","last_unstale":"2024-09-21T02:33:30.531206+0000","last_undegraded":"2024-09-21T02:33:30.531206+0000","last_fullsized":"2024-09-21T02:33:30.531206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:54.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536632+0000","last_change":"2024-09-21T02:31:20.822638+0000","last_active":"2024-09-21T02:33:30.536632+0000","last_peered":"2024-09-21T02:33:30.536632+0000","last_clean":"2024-09-21T02:33:30.536632+0000","last_became_active":"2024-09-21T02:31:20.816679+0000","last_became_peered":"2024-09-21T02:31:20.816679+0000","last_unstale":"2024-09-21T02:33:30.536632+0000","last_undegraded":"2024-09-21T02:33:30.536632+0000","last_fullsized":"2024-09-21T02:33:30.536632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_clean_scrub_stamp":"2024-09-21T02:27:32.360535+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:51.568101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536788+0000","last_change":"2024-09-21T02:32:50.698437+0000","last_active":"2024-09-21T02:33:30.536788+0000","last_peered":"2024-09-21T02:33:30.536788+0000","last_clean":"2024-09-21T02:33:30.536788+0000","last_became_active":"2024-09-21T02:32:50.697814+0000","last_became_peered":"2024-09-21T02:32:50.697814+0000","last_unstale":"2024-09-21T02:33:30.536788+0000","last_undegraded":"2024-09-21T02:33:30.536788+0000","last_fullsized":"2024-09-21T02:33:30.536788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:51.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536897+0000","last_change":"2024-09-21T02:32:41.469539+0000","last_active":"2024-09-21T02:33:30.536897+0000","last_peered":"2024-09-21T02:33:30.536897+0000","last_clean":"2024-09-21T02:33:30.536897+0000","last_became_active":"2024-09-21T02:32:41.469060+0000","last_became_peered":"2024-09-21T02:32:41.469060+0000","last_unstale":"2024-09-21T02:33:30.536897+0000","last_undegraded":"2024-09-21T02:33:30.536897+0000","last_fullsized":"2024-09-21T02:33:30.536897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:36.699360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818540+0000","last_change":"2024-09-21T02:32:38.748487+0000","last_active":"2024-09-21T02:33:30.818540+0000","last_peered":"2024-09-21T02:33:30.818540+0000","last_clean":"2024-09-21T02:33:30.818540+0000","last_became_active":"2024-09-21T02:32:38.747956+0000","last_became_peered":"2024-09-21T02:32:38.747956+0000","last_unstale":"2024-09-21T02:33:30.818540+0000","last_undegraded":"2024-09-21T02:33:30.818540+0000","last_fullsized":"2024-09-21T02:33:30.818540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:15.745119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039152+0000","last_change":"2024-09-21T02:32:50.687412+0000","last_active":"2024-09-21T02:33:31.039152+0000","last_peered":"2024-09-21T02:33:31.039152+0000","last_clean":"2024-09-21T02:33:31.039152+0000","last_became_active":"2024-09-21T02:32:50.686819+0000","last_became_peered":"2024-09-21T02:32:50.686819+0000","last_unstale":"2024-09-21T02:33:31.039152+0000","last_undegraded":"2024-09-21T02:33:31.039152+0000","last_fullsized":"2024-09-21T02:33:31.039152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:28.830619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536352+0000","last_change":"2024-09-21T02:32:41.467719+0000","last_active":"2024-09-21T02:33:30.536352+0000","last_peered":"2024-09-21T02:33:30.536352+0000","last_clean":"2024-09-21T02:33:30.536352+0000","last_became_active":"2024-09-21T02:32:41.467332+0000","last_became_peered":"2024-09-21T02:32:41.467332+0000","last_unstale":"2024-09-21T02:33:30.536352+0000","last_undegraded":"2024-09-21T02:33:30.536352+0000","last_fullsized":"2024-09-21T02:33:30.536352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:06.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534037+0000","last_change":"2024-09-21T02:32:38.428553+0000","last_active":"2024-09-21T02:33:30.534037+0000","last_peered":"2024-09-21T02:33:30.534037+0000","last_clean":"2024-09-21T02:33:30.534037+0000","last_became_active":"2024-09-21T02:32:38.428159+0000","last_became_peered":"2024-09-21T02:32:38.428159+0000","last_unstale":"2024-09-21T02:33:30.534037+0000","last_undegraded":"2024-09-21T02:33:30.534037+0000","last_fullsized":"2024-09-21T02:33:30.534037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:17.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612641+0000","last_change":"2024-09-21T02:32:50.694290+0000","last_active":"2024-09-21T02:33:30.612641+0000","last_peered":"2024-09-21T02:33:30.612641+0000","last_clean":"2024-09-21T02:33:30.612641+0000","last_became_active":"2024-09-21T02:32:50.693794+0000","last_became_peered":"2024-09-21T02:32:50.693794+0000","last_unstale":"2024-09-21T02:33:30.612641+0000","last_undegraded":"2024-09-21T02:33:30.612641+0000","last_fullsized":"2024-09-21T02:33:30.612641+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:07.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536587+0000","last_change":"2024-09-21T02:32:41.466802+0000","last_active":"2024-09-21T02:33:30.536587+0000","last_peered":"2024-09-21T02:33:30.536587+0000","last_clean":"2024-09-21T02:33:30.536587+0000","last_became_active":"2024-09-21T02:32:41.465348+0000","last_became_peered":"2024-09-21T02:32:41.465348+0000","last_unstale":"2024-09-21T02:33:30.536587+0000","last_undegraded":"2024-09-21T02:33:30.536587+0000","last_fullsized":"2024-09-21T02:33:30.536587+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:23.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649459+0000","last_change":"2024-09-21T02:32:38.435725+0000","last_active":"2024-09-21T02:33:30.649459+0000","last_peered":"2024-09-21T02:33:30.649459+0000","last_clean":"2024-09-21T02:33:30.649459+0000","last_became_active":"2024-09-21T02:32:38.434688+0000","last_became_peered":"2024-09-21T02:32:38.434688+0000","last_unstale":"2024-09-21T02:33:30.649459+0000","last_undegraded":"2024-09-21T02:33:30.649459+0000","last_fullsized":"2024-09-21T02:33:30.649459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:27.829955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.042096+0000","last_change":"2024-09-21T02:33:31.041957+0000","last_active":"2024-09-21T02:33:31.042096+0000","last_peered":"2024-09-21T02:33:31.042096+0000","last_clean":"2024-09-21T02:33:31.042096+0000","last_became_active":"2024-09-21T02:33:31.041160+0000","last_became_peered":"2024-09-21T02:33:31.041160+0000","last_unstale":"2024-09-21T02:33:31.042096+0000","last_undegraded":"2024-09-21T02:33:31.042096+0000","last_fullsized":"2024-09-21T02:33:31.042096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.226199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7,1],"acting":[8,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536819+0000","last_change":"2024-09-21T02:32:41.474796+0000","last_active":"2024-09-21T02:33:30.536819+0000","last_peered":"2024-09-21T02:33:30.536819+0000","last_clean":"2024-09-21T02:33:30.536819+0000","last_became_active":"2024-09-21T02:32:41.474377+0000","last_became_peered":"2024-09-21T02:32:41.474377+0000","last_unstale":"2024-09-21T02:33:30.536819+0000","last_undegraded":"2024-09-21T02:33:30.536819+0000","last_fullsized":"2024-09-21T02:33:30.536819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.538884+0000","last_change":"2024-09-21T02:32:38.431090+0000","last_active":"2024-09-21T02:33:30.538884+0000","last_peered":"2024-09-21T02:33:30.538884+0000","last_clean":"2024-09-21T02:33:30.538884+0000","last_became_active":"2024-09-21T02:32:38.430629+0000","last_became_peered":"2024-09-21T02:32:38.430629+0000","last_unstale":"2024-09-21T02:33:30.538884+0000","last_undegraded":"2024-09-21T02:33:30.538884+0000","last_fullsized":"2024-09-21T02:33:30.538884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:49.977384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532404+0000","last_change":"2024-09-21T02:32:50.685932+0000","last_active":"2024-09-21T02:33:30.532404+0000","last_peered":"2024-09-21T02:33:30.532404+0000","last_clean":"2024-09-21T02:33:30.532404+0000","last_became_active":"2024-09-21T02:32:50.685584+0000","last_became_peered":"2024-09-21T02:32:50.685584+0000","last_unstale":"2024-09-21T02:33:30.532404+0000","last_undegraded":"2024-09-21T02:33:30.532404+0000","last_fullsized":"2024-09-21T02:33:30.532404+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:42.118046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.041646+0000","last_change":"2024-09-21T02:33:31.041507+0000","last_active":"2024-09-21T02:33:31.041646+0000","last_peered":"2024-09-21T02:33:31.041646+0000","last_clean":"2024-09-21T02:33:31.041646+0000","last_became_active":"2024-09-21T02:33:31.040982+0000","last_became_peered":"2024-09-21T02:33:31.040982+0000","last_unstale":"2024-09-21T02:33:31.041646+0000","last_undegraded":"2024-09-21T02:33:31.041646+0000","last_fullsized":"2024-09-21T02:33:31.041646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:17.608426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535426+0000","last_change":"2024-09-21T02:32:38.512557+0000","last_active":"2024-09-21T02:33:30.535426+0000","last_peered":"2024-09-21T02:33:30.535426+0000","last_clean":"2024-09-21T02:33:30.535426+0000","last_became_active":"2024-09-21T02:32:38.512069+0000","last_became_peered":"2024-09-21T02:32:38.512069+0000","last_unstale":"2024-09-21T02:33:30.535426+0000","last_undegraded":"2024-09-21T02:33:30.535426+0000","last_fullsized":"2024-09-21T02:33:30.535426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:55.038548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649448+0000","last_change":"2024-09-21T02:32:50.698539+0000","last_active":"2024-09-21T02:33:30.649448+0000","last_peered":"2024-09-21T02:33:30.649448+0000","last_clean":"2024-09-21T02:33:30.649448+0000","last_became_active":"2024-09-21T02:32:50.698107+0000","last_became_peered":"2024-09-21T02:32:50.698107+0000","last_unstale":"2024-09-21T02:33:30.649448+0000","last_undegraded":"2024-09-21T02:33:30.649448+0000","last_fullsized":"2024-09-21T02:33:30.649448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:43.141885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535693+0000","last_change":"2024-09-21T02:32:41.468472+0000","last_active":"2024-09-21T02:33:30.535693+0000","last_peered":"2024-09-21T02:33:30.535693+0000","last_clean":"2024-09-21T02:33:30.535693+0000","last_became_active":"2024-09-21T02:32:41.468039+0000","last_became_peered":"2024-09-21T02:32:41.468039+0000","last_unstale":"2024-09-21T02:33:30.535693+0000","last_undegraded":"2024-09-21T02:33:30.535693+0000","last_fullsized":"2024-09-21T02:33:30.535693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:00.501173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530705+0000","last_change":"2024-09-21T02:32:38.431613+0000","last_active":"2024-09-21T02:33:30.530705+0000","last_peered":"2024-09-21T02:33:30.530705+0000","last_clean":"2024-09-21T02:33:30.530705+0000","last_became_active":"2024-09-21T02:32:38.431128+0000","last_became_peered":"2024-09-21T02:32:38.431128+0000","last_unstale":"2024-09-21T02:33:30.530705+0000","last_undegraded":"2024-09-21T02:33:30.530705+0000","last_fullsized":"2024-09-21T02:33:30.530705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:09.400651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535120+0000","last_change":"2024-09-21T02:32:50.691401+0000","last_active":"2024-09-21T02:33:30.535120+0000","last_peered":"2024-09-21T02:33:30.535120+0000","last_clean":"2024-09-21T02:33:30.535120+0000","last_became_active":"2024-09-21T02:32:50.688202+0000","last_became_peered":"2024-09-21T02:32:50.688202+0000","last_unstale":"2024-09-21T02:33:30.535120+0000","last_undegraded":"2024-09-21T02:33:30.535120+0000","last_fullsized":"2024-09-21T02:33:30.535120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:42.516887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536499+0000","last_change":"2024-09-21T02:32:41.475760+0000","last_active":"2024-09-21T02:33:30.536499+0000","last_peered":"2024-09-21T02:33:30.536499+0000","last_clean":"2024-09-21T02:33:30.536499+0000","last_became_active":"2024-09-21T02:32:41.475381+0000","last_became_peered":"2024-09-21T02:32:41.475381+0000","last_unstale":"2024-09-21T02:33:30.536499+0000","last_undegraded":"2024-09-21T02:33:30.536499+0000","last_fullsized":"2024-09-21T02:33:30.536499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.070064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532763+0000","last_change":"2024-09-21T02:32:38.424789+0000","last_active":"2024-09-21T02:33:30.532763+0000","last_peered":"2024-09-21T02:33:30.532763+0000","last_clean":"2024-09-21T02:33:30.532763+0000","last_became_active":"2024-09-21T02:32:38.424275+0000","last_became_peered":"2024-09-21T02:32:38.424275+0000","last_unstale":"2024-09-21T02:33:30.532763+0000","last_undegraded":"2024-09-21T02:33:30.532763+0000","last_fullsized":"2024-09-21T02:33:30.532763+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:50.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536245+0000","last_change":"2024-09-21T02:32:50.692496+0000","last_active":"2024-09-21T02:33:30.536245+0000","last_peered":"2024-09-21T02:33:30.536245+0000","last_clean":"2024-09-21T02:33:30.536245+0000","last_became_active":"2024-09-21T02:32:50.692055+0000","last_became_peered":"2024-09-21T02:32:50.692055+0000","last_unstale":"2024-09-21T02:33:30.536245+0000","last_undegraded":"2024-09-21T02:33:30.536245+0000","last_fullsized":"2024-09-21T02:33:30.536245+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:25.433298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649109+0000","last_change":"2024-09-21T02:32:41.475732+0000","last_active":"2024-09-21T02:33:30.649109+0000","last_peered":"2024-09-21T02:33:30.649109+0000","last_clean":"2024-09-21T02:33:30.649109+0000","last_became_active":"2024-09-21T02:32:41.475395+0000","last_became_peered":"2024-09-21T02:32:41.475395+0000","last_unstale":"2024-09-21T02:33:30.649109+0000","last_undegraded":"2024-09-21T02:33:30.649109+0000","last_fullsized":"2024-09-21T02:33:30.649109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:26.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818494+0000","last_change":"2024-09-21T02:32:38.434080+0000","last_active":"2024-09-21T02:33:30.818494+0000","last_peered":"2024-09-21T02:33:30.818494+0000","last_clean":"2024-09-21T02:33:30.818494+0000","last_became_active":"2024-09-21T02:32:38.433625+0000","last_became_peered":"2024-09-21T02:32:38.433625+0000","last_unstale":"2024-09-21T02:33:30.818494+0000","last_undegraded":"2024-09-21T02:33:30.818494+0000","last_fullsized":"2024-09-21T02:33:30.818494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:11.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533377+0000","last_change":"2024-09-21T02:32:50.687555+0000","last_active":"2024-09-21T02:33:30.533377+0000","last_peered":"2024-09-21T02:33:30.533377+0000","last_clean":"2024-09-21T02:33:30.533377+0000","last_became_active":"2024-09-21T02:32:50.686979+0000","last_became_peered":"2024-09-21T02:32:50.686979+0000","last_unstale":"2024-09-21T02:33:30.533377+0000","last_undegraded":"2024-09-21T02:33:30.533377+0000","last_fullsized":"2024-09-21T02:33:30.533377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:01.136515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537096+0000","last_change":"2024-09-21T02:32:41.463688+0000","last_active":"2024-09-21T02:33:30.537096+0000","last_peered":"2024-09-21T02:33:30.537096+0000","last_clean":"2024-09-21T02:33:30.537096+0000","last_became_active":"2024-09-21T02:32:41.463306+0000","last_became_peered":"2024-09-21T02:32:41.463306+0000","last_unstale":"2024-09-21T02:33:30.537096+0000","last_undegraded":"2024-09-21T02:33:30.537096+0000","last_fullsized":"2024-09-21T02:33:30.537096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:46.217029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:47.675550+0000","last_change":"2024-09-21T02:32:38.435897+0000","last_active":"2024-09-21T02:33:47.675550+0000","last_peered":"2024-09-21T02:33:47.675550+0000","last_clean":"2024-09-21T02:33:47.675550+0000","last_became_active":"2024-09-21T02:32:38.435397+0000","last_became_peered":"2024-09-21T02:32:38.435397+0000","last_unstale":"2024-09-21T02:33:47.675550+0000","last_undegraded":"2024-09-21T02:33:47.675550+0000","last_fullsized":"2024-09-21T02:33:47.675550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:17.841689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59599,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":77,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.539312+0000","last_change":"2024-09-21T02:33:30.538615+0000","last_active":"2024-09-21T02:33:30.539312+0000","last_peered":"2024-09-21T02:33:30.539312+0000","last_clean":"2024-09-21T02:33:30.539312+0000","last_became_active":"2024-09-21T02:33:30.538046+0000","last_became_peered":"2024-09-21T02:33:30.538046+0000","last_unstale":"2024-09-21T02:33:30.539312+0000","last_undegraded":"2024-09-21T02:33:30.539312+0000","last_fullsized":"2024-09-21T02:33:30.539312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:04.235706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.039662+0000","last_change":"2024-09-21T02:32:41.470318+0000","last_active":"2024-09-21T02:33:31.039662+0000","last_peered":"2024-09-21T02:33:31.039662+0000","last_clean":"2024-09-21T02:33:31.039662+0000","last_became_active":"2024-09-21T02:32:41.466804+0000","last_became_peered":"2024-09-21T02:32:41.466804+0000","last_unstale":"2024-09-21T02:33:31.039662+0000","last_undegraded":"2024-09-21T02:33:31.039662+0000","last_fullsized":"2024-09-21T02:33:31.039662+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533609+0000","last_change":"2024-09-21T02:32:38.514901+0000","last_active":"2024-09-21T02:33:30.533609+0000","last_peered":"2024-09-21T02:33:30.533609+0000","last_clean":"2024-09-21T02:33:30.533609+0000","last_became_active":"2024-09-21T02:32:38.514497+0000","last_became_peered":"2024-09-21T02:32:38.514497+0000","last_unstale":"2024-09-21T02:33:30.533609+0000","last_undegraded":"2024-09-21T02:33:30.533609+0000","last_fullsized":"2024-09-21T02:33:30.533609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:02.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.041691+0000","last_change":"2024-09-21T02:33:31.041566+0000","last_active":"2024-09-21T02:33:31.041691+0000","last_peered":"2024-09-21T02:33:31.041691+0000","last_clean":"2024-09-21T02:33:31.041691+0000","last_became_active":"2024-09-21T02:33:31.041041+0000","last_became_peered":"2024-09-21T02:33:31.041041+0000","last_unstale":"2024-09-21T02:33:31.041691+0000","last_undegraded":"2024-09-21T02:33:31.041691+0000","last_fullsized":"2024-09-21T02:33:31.041691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:00.236406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612696+0000","last_change":"2024-09-21T02:32:41.483502+0000","last_active":"2024-09-21T02:33:30.612696+0000","last_peered":"2024-09-21T02:33:30.612696+0000","last_clean":"2024-09-21T02:33:30.612696+0000","last_became_active":"2024-09-21T02:32:41.483116+0000","last_became_peered":"2024-09-21T02:32:41.483116+0000","last_unstale":"2024-09-21T02:33:30.612696+0000","last_undegraded":"2024-09-21T02:33:30.612696+0000","last_fullsized":"2024-09-21T02:33:30.612696+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:39.146202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.041996+0000","last_change":"2024-09-21T02:33:31.041819+0000","last_active":"2024-09-21T02:33:31.041996+0000","last_peered":"2024-09-21T02:33:31.041996+0000","last_clean":"2024-09-21T02:33:31.041996+0000","last_became_active":"2024-09-21T02:33:31.041241+0000","last_became_peered":"2024-09-21T02:33:31.041241+0000","last_unstale":"2024-09-21T02:33:31.041996+0000","last_undegraded":"2024-09-21T02:33:31.041996+0000","last_fullsized":"2024-09-21T02:33:31.041996+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:00.241618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534284+0000","last_change":"2024-09-21T02:32:50.692227+0000","last_active":"2024-09-21T02:33:30.534284+0000","last_peered":"2024-09-21T02:33:30.534284+0000","last_clean":"2024-09-21T02:33:30.534284+0000","last_became_active":"2024-09-21T02:32:50.691787+0000","last_became_peered":"2024-09-21T02:32:50.691787+0000","last_unstale":"2024-09-21T02:33:30.534284+0000","last_undegraded":"2024-09-21T02:33:30.534284+0000","last_fullsized":"2024-09-21T02:33:30.534284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:40.086313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040307+0000","last_change":"2024-09-21T02:32:41.476056+0000","last_active":"2024-09-21T02:33:31.040307+0000","last_peered":"2024-09-21T02:33:31.040307+0000","last_clean":"2024-09-21T02:33:31.040307+0000","last_became_active":"2024-09-21T02:32:41.475525+0000","last_became_peered":"2024-09-21T02:32:41.475525+0000","last_unstale":"2024-09-21T02:33:31.040307+0000","last_undegraded":"2024-09-21T02:33:31.040307+0000","last_fullsized":"2024-09-21T02:33:31.040307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:42.074296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533628+0000","last_change":"2024-09-21T02:32:38.430845+0000","last_active":"2024-09-21T02:33:30.533628+0000","last_peered":"2024-09-21T02:33:30.533628+0000","last_clean":"2024-09-21T02:33:30.533628+0000","last_became_active":"2024-09-21T02:32:38.430372+0000","last_became_peered":"2024-09-21T02:32:38.430372+0000","last_unstale":"2024-09-21T02:33:30.533628+0000","last_undegraded":"2024-09-21T02:33:30.533628+0000","last_fullsized":"2024-09-21T02:33:30.533628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:40.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531494+0000","last_change":"2024-09-21T02:32:50.685481+0000","last_active":"2024-09-21T02:33:30.531494+0000","last_peered":"2024-09-21T02:33:30.531494+0000","last_clean":"2024-09-21T02:33:30.531494+0000","last_became_active":"2024-09-21T02:32:50.685044+0000","last_became_peered":"2024-09-21T02:32:50.685044+0000","last_unstale":"2024-09-21T02:33:30.531494+0000","last_undegraded":"2024-09-21T02:33:30.531494+0000","last_fullsized":"2024-09-21T02:33:30.531494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:33.132966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612402+0000","last_change":"2024-09-21T02:32:50.690447+0000","last_active":"2024-09-21T02:33:30.612402+0000","last_peered":"2024-09-21T02:33:30.612402+0000","last_clean":"2024-09-21T02:33:30.612402+0000","last_became_active":"2024-09-21T02:32:50.690021+0000","last_became_peered":"2024-09-21T02:32:50.690021+0000","last_unstale":"2024-09-21T02:33:30.612402+0000","last_undegraded":"2024-09-21T02:33:30.612402+0000","last_fullsized":"2024-09-21T02:33:30.612402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:44.436690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.534458+0000","last_change":"2024-09-21T02:32:41.469186+0000","last_active":"2024-09-21T02:33:30.534458+0000","last_peered":"2024-09-21T02:33:30.534458+0000","last_clean":"2024-09-21T02:33:30.534458+0000","last_became_active":"2024-09-21T02:32:41.468837+0000","last_became_peered":"2024-09-21T02:32:41.468837+0000","last_unstale":"2024-09-21T02:33:30.534458+0000","last_undegraded":"2024-09-21T02:33:30.534458+0000","last_fullsized":"2024-09-21T02:33:30.534458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:02.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533125+0000","last_change":"2024-09-21T02:32:38.426631+0000","last_active":"2024-09-21T02:33:30.533125+0000","last_peered":"2024-09-21T02:33:30.533125+0000","last_clean":"2024-09-21T02:33:30.533125+0000","last_became_active":"2024-09-21T02:32:38.425600+0000","last_became_peered":"2024-09-21T02:32:38.425600+0000","last_unstale":"2024-09-21T02:33:30.533125+0000","last_undegraded":"2024-09-21T02:33:30.533125+0000","last_fullsized":"2024-09-21T02:33:30.533125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.669245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536789+0000","last_change":"2024-09-21T02:32:50.697935+0000","last_active":"2024-09-21T02:33:30.536789+0000","last_peered":"2024-09-21T02:33:30.536789+0000","last_clean":"2024-09-21T02:33:30.536789+0000","last_became_active":"2024-09-21T02:32:50.697537+0000","last_became_peered":"2024-09-21T02:32:50.697537+0000","last_unstale":"2024-09-21T02:33:30.536789+0000","last_undegraded":"2024-09-21T02:33:30.536789+0000","last_fullsized":"2024-09-21T02:33:30.536789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:32.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531545+0000","last_change":"2024-09-21T02:32:41.458640+0000","last_active":"2024-09-21T02:33:30.531545+0000","last_peered":"2024-09-21T02:33:30.531545+0000","last_clean":"2024-09-21T02:33:30.531545+0000","last_became_active":"2024-09-21T02:32:41.458231+0000","last_became_peered":"2024-09-21T02:32:41.458231+0000","last_unstale":"2024-09-21T02:33:30.531545+0000","last_undegraded":"2024-09-21T02:33:30.531545+0000","last_fullsized":"2024-09-21T02:33:30.531545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:26.132979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.648941+0000","last_change":"2024-09-21T02:32:38.430888+0000","last_active":"2024-09-21T02:33:30.648941+0000","last_peered":"2024-09-21T02:33:30.648941+0000","last_clean":"2024-09-21T02:33:30.648941+0000","last_became_active":"2024-09-21T02:32:38.430516+0000","last_became_peered":"2024-09-21T02:32:38.430516+0000","last_unstale":"2024-09-21T02:33:30.648941+0000","last_undegraded":"2024-09-21T02:33:30.648941+0000","last_fullsized":"2024-09-21T02:33:30.648941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:54.671763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533814+0000","last_change":"2024-09-21T02:32:38.434012+0000","last_active":"2024-09-21T02:33:30.533814+0000","last_peered":"2024-09-21T02:33:30.533814+0000","last_clean":"2024-09-21T02:33:30.533814+0000","last_became_active":"2024-09-21T02:32:38.433571+0000","last_became_peered":"2024-09-21T02:32:38.433571+0000","last_unstale":"2024-09-21T02:33:30.533814+0000","last_undegraded":"2024-09-21T02:33:30.533814+0000","last_fullsized":"2024-09-21T02:33:30.533814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:59.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.650975+0000","last_change":"2024-09-21T02:33:30.650855+0000","last_active":"2024-09-21T02:33:30.650975+0000","last_peered":"2024-09-21T02:33:30.650975+0000","last_clean":"2024-09-21T02:33:30.650975+0000","last_became_active":"2024-09-21T02:33:30.650428+0000","last_became_peered":"2024-09-21T02:33:30.650428+0000","last_unstale":"2024-09-21T02:33:30.650975+0000","last_undegraded":"2024-09-21T02:33:30.650975+0000","last_fullsized":"2024-09-21T02:33:30.650975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:55.757861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.817842+0000","last_change":"2024-09-21T02:32:50.698249+0000","last_active":"2024-09-21T02:33:30.817842+0000","last_peered":"2024-09-21T02:33:30.817842+0000","last_clean":"2024-09-21T02:33:30.817842+0000","last_became_active":"2024-09-21T02:32:50.697768+0000","last_became_peered":"2024-09-21T02:32:50.697768+0000","last_unstale":"2024-09-21T02:33:30.817842+0000","last_undegraded":"2024-09-21T02:33:30.817842+0000","last_fullsized":"2024-09-21T02:33:30.817842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.723420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533525+0000","last_change":"2024-09-21T02:32:38.435733+0000","last_active":"2024-09-21T02:33:30.533525+0000","last_peered":"2024-09-21T02:33:30.533525+0000","last_clean":"2024-09-21T02:33:30.533525+0000","last_became_active":"2024-09-21T02:32:38.435288+0000","last_became_peered":"2024-09-21T02:32:38.435288+0000","last_unstale":"2024-09-21T02:33:30.533525+0000","last_undegraded":"2024-09-21T02:33:30.533525+0000","last_fullsized":"2024-09-21T02:33:30.533525+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.430652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536434+0000","last_change":"2024-09-21T02:32:41.468127+0000","last_active":"2024-09-21T02:33:30.536434+0000","last_peered":"2024-09-21T02:33:30.536434+0000","last_clean":"2024-09-21T02:33:30.536434+0000","last_became_active":"2024-09-21T02:32:41.467730+0000","last_became_peered":"2024-09-21T02:32:41.467730+0000","last_unstale":"2024-09-21T02:33:30.536434+0000","last_undegraded":"2024-09-21T02:33:30.536434+0000","last_fullsized":"2024-09-21T02:33:30.536434+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:39.684035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.817856+0000","last_change":"2024-09-21T02:32:50.684115+0000","last_active":"2024-09-21T02:33:30.817856+0000","last_peered":"2024-09-21T02:33:30.817856+0000","last_clean":"2024-09-21T02:33:30.817856+0000","last_became_active":"2024-09-21T02:32:50.683627+0000","last_became_peered":"2024-09-21T02:32:50.683627+0000","last_unstale":"2024-09-21T02:33:30.817856+0000","last_undegraded":"2024-09-21T02:33:30.817856+0000","last_fullsized":"2024-09-21T02:33:30.817856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:10.953943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536548+0000","last_change":"2024-09-21T02:32:41.465744+0000","last_active":"2024-09-21T02:33:30.536548+0000","last_peered":"2024-09-21T02:33:30.536548+0000","last_clean":"2024-09-21T02:33:30.536548+0000","last_became_active":"2024-09-21T02:32:41.465392+0000","last_became_peered":"2024-09-21T02:32:41.465392+0000","last_unstale":"2024-09-21T02:33:30.536548+0000","last_undegraded":"2024-09-21T02:33:30.536548+0000","last_fullsized":"2024-09-21T02:33:30.536548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:54.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818542+0000","last_change":"2024-09-21T02:32:41.470967+0000","last_active":"2024-09-21T02:33:30.818542+0000","last_peered":"2024-09-21T02:33:30.818542+0000","last_clean":"2024-09-21T02:33:30.818542+0000","last_became_active":"2024-09-21T02:32:41.470547+0000","last_became_peered":"2024-09-21T02:32:41.470547+0000","last_unstale":"2024-09-21T02:33:30.818542+0000","last_undegraded":"2024-09-21T02:33:30.818542+0000","last_fullsized":"2024-09-21T02:33:30.818542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:57.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818146+0000","last_change":"2024-09-21T02:32:41.474500+0000","last_active":"2024-09-21T02:33:30.818146+0000","last_peered":"2024-09-21T02:33:30.818146+0000","last_clean":"2024-09-21T02:33:30.818146+0000","last_became_active":"2024-09-21T02:32:41.474117+0000","last_became_peered":"2024-09-21T02:32:41.474117+0000","last_unstale":"2024-09-21T02:33:30.818146+0000","last_undegraded":"2024-09-21T02:33:30.818146+0000","last_fullsized":"2024-09-21T02:33:30.818146+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:43.152503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612731+0000","last_change":"2024-09-21T02:32:41.479123+0000","last_active":"2024-09-21T02:33:30.612731+0000","last_peered":"2024-09-21T02:33:30.612731+0000","last_clean":"2024-09-21T02:33:30.612731+0000","last_became_active":"2024-09-21T02:32:41.478543+0000","last_became_peered":"2024-09-21T02:32:41.478543+0000","last_unstale":"2024-09-21T02:33:30.612731+0000","last_undegraded":"2024-09-21T02:33:30.612731+0000","last_fullsized":"2024-09-21T02:33:30.612731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:39.802425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649480+0000","last_change":"2024-09-21T02:32:41.483334+0000","last_active":"2024-09-21T02:33:30.649480+0000","last_peered":"2024-09-21T02:33:30.649480+0000","last_clean":"2024-09-21T02:33:30.649480+0000","last_became_active":"2024-09-21T02:32:41.482999+0000","last_became_peered":"2024-09-21T02:32:41.482999+0000","last_unstale":"2024-09-21T02:33:30.649480+0000","last_undegraded":"2024-09-21T02:33:30.649480+0000","last_fullsized":"2024-09-21T02:33:30.649480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:16.259647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.539524+0000","last_change":"2024-09-21T02:33:30.539417+0000","last_active":"2024-09-21T02:33:30.539524+0000","last_peered":"2024-09-21T02:33:30.539524+0000","last_clean":"2024-09-21T02:33:30.539524+0000","last_became_active":"2024-09-21T02:33:30.538970+0000","last_became_peered":"2024-09-21T02:33:30.538970+0000","last_unstale":"2024-09-21T02:33:30.539524+0000","last_undegraded":"2024-09-21T02:33:30.539524+0000","last_fullsized":"2024-09-21T02:33:30.539524+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:09.772513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818890+0000","last_change":"2024-09-21T02:32:41.469386+0000","last_active":"2024-09-21T02:33:30.818890+0000","last_peered":"2024-09-21T02:33:30.818890+0000","last_clean":"2024-09-21T02:33:30.818890+0000","last_became_active":"2024-09-21T02:32:41.468982+0000","last_became_peered":"2024-09-21T02:32:41.468982+0000","last_unstale":"2024-09-21T02:33:30.818890+0000","last_undegraded":"2024-09-21T02:33:30.818890+0000","last_fullsized":"2024-09-21T02:33:30.818890+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.644854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531854+0000","last_change":"2024-09-21T02:32:41.467365+0000","last_active":"2024-09-21T02:33:30.531854+0000","last_peered":"2024-09-21T02:33:30.531854+0000","last_clean":"2024-09-21T02:33:30.531854+0000","last_became_active":"2024-09-21T02:32:41.466893+0000","last_became_peered":"2024-09-21T02:32:41.466893+0000","last_unstale":"2024-09-21T02:33:30.531854+0000","last_undegraded":"2024-09-21T02:33:30.531854+0000","last_fullsized":"2024-09-21T02:33:30.531854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.532854+0000","last_change":"2024-09-21T02:32:41.473695+0000","last_active":"2024-09-21T02:33:30.532854+0000","last_peered":"2024-09-21T02:33:30.532854+0000","last_clean":"2024-09-21T02:33:30.532854+0000","last_became_active":"2024-09-21T02:32:41.473035+0000","last_became_peered":"2024-09-21T02:32:41.473035+0000","last_unstale":"2024-09-21T02:33:30.532854+0000","last_undegraded":"2024-09-21T02:33:30.532854+0000","last_fullsized":"2024-09-21T02:33:30.532854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:54.343984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.531697+0000","last_change":"2024-09-21T02:32:41.473578+0000","last_active":"2024-09-21T02:33:30.531697+0000","last_peered":"2024-09-21T02:33:30.531697+0000","last_clean":"2024-09-21T02:33:30.531697+0000","last_became_active":"2024-09-21T02:32:41.472983+0000","last_became_peered":"2024-09-21T02:32:41.472983+0000","last_unstale":"2024-09-21T02:33:30.531697+0000","last_undegraded":"2024-09-21T02:33:30.531697+0000","last_fullsized":"2024-09-21T02:33:30.531697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.895809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040096+0000","last_change":"2024-09-21T02:32:41.473751+0000","last_active":"2024-09-21T02:33:31.040096+0000","last_peered":"2024-09-21T02:33:31.040096+0000","last_clean":"2024-09-21T02:33:31.040096+0000","last_became_active":"2024-09-21T02:32:41.473367+0000","last_became_peered":"2024-09-21T02:32:41.473367+0000","last_unstale":"2024-09-21T02:33:31.040096+0000","last_undegraded":"2024-09-21T02:33:31.040096+0000","last_fullsized":"2024-09-21T02:33:31.040096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:04.707745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649412+0000","last_change":"2024-09-21T02:32:41.485375+0000","last_active":"2024-09-21T02:33:30.649412+0000","last_peered":"2024-09-21T02:33:30.649412+0000","last_clean":"2024-09-21T02:33:30.649412+0000","last_became_active":"2024-09-21T02:32:41.484845+0000","last_became_peered":"2024-09-21T02:32:41.484845+0000","last_unstale":"2024-09-21T02:33:30.649412+0000","last_undegraded":"2024-09-21T02:33:30.649412+0000","last_fullsized":"2024-09-21T02:33:30.649412+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:58.529747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536661+0000","last_change":"2024-09-21T02:32:41.462925+0000","last_active":"2024-09-21T02:33:30.536661+0000","last_peered":"2024-09-21T02:33:30.536661+0000","last_clean":"2024-09-21T02:33:30.536661+0000","last_became_active":"2024-09-21T02:32:41.462056+0000","last_became_peered":"2024-09-21T02:32:41.462056+0000","last_unstale":"2024-09-21T02:33:30.536661+0000","last_undegraded":"2024-09-21T02:33:30.536661+0000","last_fullsized":"2024-09-21T02:33:30.536661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:05.447554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.818777+0000","last_change":"2024-09-21T02:32:41.475111+0000","last_active":"2024-09-21T02:33:30.818777+0000","last_peered":"2024-09-21T02:33:30.818777+0000","last_clean":"2024-09-21T02:33:30.818777+0000","last_became_active":"2024-09-21T02:32:41.474634+0000","last_became_peered":"2024-09-21T02:32:41.474634+0000","last_unstale":"2024-09-21T02:33:30.818777+0000","last_undegraded":"2024-09-21T02:33:30.818777+0000","last_fullsized":"2024-09-21T02:33:30.818777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:07.750970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535309+0000","last_change":"2024-09-21T02:32:41.479702+0000","last_active":"2024-09-21T02:33:30.535309+0000","last_peered":"2024-09-21T02:33:30.535309+0000","last_clean":"2024-09-21T02:33:30.535309+0000","last_became_active":"2024-09-21T02:32:41.479378+0000","last_became_peered":"2024-09-21T02:32:41.479378+0000","last_unstale":"2024-09-21T02:33:30.535309+0000","last_undegraded":"2024-09-21T02:33:30.535309+0000","last_fullsized":"2024-09-21T02:33:30.535309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:56.687641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537214+0000","last_change":"2024-09-21T02:32:41.475567+0000","last_active":"2024-09-21T02:33:30.537214+0000","last_peered":"2024-09-21T02:33:30.537214+0000","last_clean":"2024-09-21T02:33:30.537214+0000","last_became_active":"2024-09-21T02:32:41.475207+0000","last_became_peered":"2024-09-21T02:32:41.475207+0000","last_unstale":"2024-09-21T02:33:30.537214+0000","last_undegraded":"2024-09-21T02:33:30.537214+0000","last_fullsized":"2024-09-21T02:33:30.537214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:33.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040363+0000","last_change":"2024-09-21T02:32:41.483518+0000","last_active":"2024-09-21T02:33:31.040363+0000","last_peered":"2024-09-21T02:33:31.040363+0000","last_clean":"2024-09-21T02:33:31.040363+0000","last_became_active":"2024-09-21T02:32:41.483088+0000","last_became_peered":"2024-09-21T02:32:41.483088+0000","last_unstale":"2024-09-21T02:33:31.040363+0000","last_undegraded":"2024-09-21T02:33:31.040363+0000","last_fullsized":"2024-09-21T02:33:31.040363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:23.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612221+0000","last_change":"2024-09-21T02:32:41.482113+0000","last_active":"2024-09-21T02:33:30.612221+0000","last_peered":"2024-09-21T02:33:30.612221+0000","last_clean":"2024-09-21T02:33:30.612221+0000","last_became_active":"2024-09-21T02:32:41.479123+0000","last_became_peered":"2024-09-21T02:32:41.479123+0000","last_unstale":"2024-09-21T02:33:30.612221+0000","last_undegraded":"2024-09-21T02:33:30.612221+0000","last_fullsized":"2024-09-21T02:33:30.612221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:48.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612164+0000","last_change":"2024-09-21T02:32:41.470429+0000","last_active":"2024-09-21T02:33:30.612164+0000","last_peered":"2024-09-21T02:33:30.612164+0000","last_clean":"2024-09-21T02:33:30.612164+0000","last_became_active":"2024-09-21T02:32:41.469421+0000","last_became_peered":"2024-09-21T02:32:41.469421+0000","last_unstale":"2024-09-21T02:33:30.612164+0000","last_undegraded":"2024-09-21T02:33:30.612164+0000","last_fullsized":"2024-09-21T02:33:30.612164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:00.952030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.649290+0000","last_change":"2024-09-21T02:32:41.470361+0000","last_active":"2024-09-21T02:33:30.649290+0000","last_peered":"2024-09-21T02:33:30.649290+0000","last_clean":"2024-09-21T02:33:30.649290+0000","last_became_active":"2024-09-21T02:32:41.469983+0000","last_became_peered":"2024-09-21T02:32:41.469983+0000","last_unstale":"2024-09-21T02:33:30.649290+0000","last_undegraded":"2024-09-21T02:33:30.649290+0000","last_fullsized":"2024-09-21T02:33:30.649290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:02.703688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530484+0000","last_change":"2024-09-21T02:32:41.468975+0000","last_active":"2024-09-21T02:33:30.530484+0000","last_peered":"2024-09-21T02:33:30.530484+0000","last_clean":"2024-09-21T02:33:30.530484+0000","last_became_active":"2024-09-21T02:32:41.468612+0000","last_became_peered":"2024-09-21T02:32:41.468612+0000","last_unstale":"2024-09-21T02:33:30.530484+0000","last_undegraded":"2024-09-21T02:33:30.530484+0000","last_fullsized":"2024-09-21T02:33:30.530484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:04.442257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536851+0000","last_change":"2024-09-21T02:32:41.471444+0000","last_active":"2024-09-21T02:33:30.536851+0000","last_peered":"2024-09-21T02:33:30.536851+0000","last_clean":"2024-09-21T02:33:30.536851+0000","last_became_active":"2024-09-21T02:32:41.470437+0000","last_became_peered":"2024-09-21T02:32:41.470437+0000","last_unstale":"2024-09-21T02:33:30.536851+0000","last_undegraded":"2024-09-21T02:33:30.536851+0000","last_fullsized":"2024-09-21T02:33:30.536851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:13.933069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533687+0000","last_change":"2024-09-21T02:32:41.475397+0000","last_active":"2024-09-21T02:33:30.533687+0000","last_peered":"2024-09-21T02:33:30.533687+0000","last_clean":"2024-09-21T02:33:30.533687+0000","last_became_active":"2024-09-21T02:32:41.475034+0000","last_became_peered":"2024-09-21T02:32:41.475034+0000","last_unstale":"2024-09-21T02:33:30.533687+0000","last_undegraded":"2024-09-21T02:33:30.533687+0000","last_fullsized":"2024-09-21T02:33:30.533687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:24.944289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:31.040408+0000","last_change":"2024-09-21T02:32:41.470297+0000","last_active":"2024-09-21T02:33:31.040408+0000","last_peered":"2024-09-21T02:33:31.040408+0000","last_clean":"2024-09-21T02:33:31.040408+0000","last_became_active":"2024-09-21T02:32:41.469843+0000","last_became_peered":"2024-09-21T02:32:41.469843+0000","last_unstale":"2024-09-21T02:33:31.040408+0000","last_undegraded":"2024-09-21T02:33:31.040408+0000","last_fullsized":"2024-09-21T02:33:31.040408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536267+0000","last_change":"2024-09-21T02:33:30.535828+0000","last_active":"2024-09-21T02:33:30.536267+0000","last_peered":"2024-09-21T02:33:30.536267+0000","last_clean":"2024-09-21T02:33:30.536267+0000","last_became_active":"2024-09-21T02:33:30.535576+0000","last_became_peered":"2024-09-21T02:33:30.535576+0000","last_unstale":"2024-09-21T02:33:30.536267+0000","last_undegraded":"2024-09-21T02:33:30.536267+0000","last_fullsized":"2024-09-21T02:33:30.536267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:05.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.535903+0000","last_change":"2024-09-21T02:32:41.466073+0000","last_active":"2024-09-21T02:33:30.535903+0000","last_peered":"2024-09-21T02:33:30.535903+0000","last_clean":"2024-09-21T02:33:30.535903+0000","last_became_active":"2024-09-21T02:32:41.465664+0000","last_became_peered":"2024-09-21T02:32:41.465664+0000","last_unstale":"2024-09-21T02:33:30.535903+0000","last_undegraded":"2024-09-21T02:33:30.535903+0000","last_fullsized":"2024-09-21T02:33:30.535903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:25.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.533333+0000","last_change":"2024-09-21T02:32:41.471006+0000","last_active":"2024-09-21T02:33:30.533333+0000","last_peered":"2024-09-21T02:33:30.533333+0000","last_clean":"2024-09-21T02:33:30.533333+0000","last_became_active":"2024-09-21T02:32:41.469780+0000","last_became_peered":"2024-09-21T02:32:41.469780+0000","last_unstale":"2024-09-21T02:33:30.533333+0000","last_undegraded":"2024-09-21T02:33:30.533333+0000","last_fullsized":"2024-09-21T02:33:30.533333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:18.604729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.536436+0000","last_change":"2024-09-21T02:32:41.476169+0000","last_active":"2024-09-21T02:33:30.536436+0000","last_peered":"2024-09-21T02:33:30.536436+0000","last_clean":"2024-09-21T02:33:30.536436+0000","last_became_active":"2024-09-21T02:32:41.475754+0000","last_became_peered":"2024-09-21T02:32:41.475754+0000","last_unstale":"2024-09-21T02:33:30.536436+0000","last_undegraded":"2024-09-21T02:33:30.536436+0000","last_fullsized":"2024-09-21T02:33:30.536436+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:18.532122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.530343+0000","last_change":"2024-09-21T02:32:41.467078+0000","last_active":"2024-09-21T02:33:30.530343+0000","last_peered":"2024-09-21T02:33:30.530343+0000","last_clean":"2024-09-21T02:33:30.530343+0000","last_became_active":"2024-09-21T02:32:41.466702+0000","last_became_peered":"2024-09-21T02:32:41.466702+0000","last_unstale":"2024-09-21T02:33:30.530343+0000","last_undegraded":"2024-09-21T02:33:30.530343+0000","last_fullsized":"2024-09-21T02:33:30.530343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:43.409390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612400+0000","last_change":"2024-09-21T02:32:41.467476+0000","last_active":"2024-09-21T02:33:30.612400+0000","last_peered":"2024-09-21T02:33:30.612400+0000","last_clean":"2024-09-21T02:33:30.612400+0000","last_became_active":"2024-09-21T02:32:41.466901+0000","last_became_peered":"2024-09-21T02:32:41.466901+0000","last_unstale":"2024-09-21T02:33:30.612400+0000","last_undegraded":"2024-09-21T02:33:30.612400+0000","last_fullsized":"2024-09-21T02:33:30.612400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:46.207507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.612499+0000","last_change":"2024-09-21T02:32:41.486528+0000","last_active":"2024-09-21T02:33:30.612499+0000","last_peered":"2024-09-21T02:33:30.612499+0000","last_clean":"2024-09-21T02:33:30.612499+0000","last_became_active":"2024-09-21T02:32:41.484370+0000","last_became_peered":"2024-09-21T02:32:41.484370+0000","last_unstale":"2024-09-21T02:33:30.612499+0000","last_undegraded":"2024-09-21T02:33:30.612499+0000","last_fullsized":"2024-09-21T02:33:30.612499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:28.978540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:33:30.537134+0000","last_change":"2024-09-21T02:32:41.474525+0000","last_active":"2024-09-21T02:33:30.537134+0000","last_peered":"2024-09-21T02:33:30.537134+0000","last_clean":"2024-09-21T02:33:30.537134+0000","last_became_active":"2024-09-21T02:32:41.474147+0000","last_became_peered":"2024-09-21T02:32:41.474147+0000","last_unstale":"2024-09-21T02:33:30.537134+0000","last_undegraded":"2024-09-21T02:33:30.537134+0000","last_fullsized":"2024-09-21T02:33:30.537134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:26.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60397,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":44,"num_read_kb":83,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":185456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":486430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1132495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":491108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266731,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":487034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462961,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1081476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626487,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":482334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822717,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36884,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708268,"statfs":{"total":95995035648,"available":95957266432,"internally_reserved":0,"allocated":1576960,"data_stored":1076980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986241,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":486452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":482438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":546232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":541933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":970752,"data_stored":482424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:33:54.572 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:33:54.573 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T02:33:54.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T02:33:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:54 smithi148 ceph-mon[34626]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:33:54.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:54 smithi098 ceph-mon[34832]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:33:54.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:54 smithi079 ceph-mon[30788]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:33:54.979 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:55.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 -- 172.21.15.79:0/2453558202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70075c90 msgr2=0x7fad700760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:55.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 --2- 172.21.15.79:0/2453558202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70075c90 0x7fad700760a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad58009900 tx=0x7fad5802a410 comp rx=0 tx=0).stop 2024-09-21T02:33:55.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 -- 172.21.15.79:0/2453558202 shutdown_connections 2024-09-21T02:33:55.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 --2- 172.21.15.79:0/2453558202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 0x7fad7010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 --2- 172.21.15.79:0/2453558202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70075c90 0x7fad700760a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 --2- 172.21.15.79:0/2453558202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad70077080 0x7fad70075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 -- 172.21.15.79:0/2453558202 >> 172.21.15.79:0/2453558202 conn(0x7fad700ff0c0 msgr2=0x7fad70101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:55.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 -- 172.21.15.79:0/2453558202 shutdown_connections 2024-09-21T02:33:55.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.626+0000 7fad76200640 1 -- 172.21.15.79:0/2453558202 wait complete. 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.627+0000 7fad76200640 1 Processor -- start 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.627+0000 7fad76200640 1 -- start start 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.627+0000 7fad76200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad70075c90 0x7fad7019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.627+0000 7fad76200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70077080 0x7fad7019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.627+0000 7fad76200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 0x7fad7019d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.627+0000 7fad76200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad70111570 con 0x7fad70077080 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.627+0000 7fad76200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fad701113f0 con 0x7fad70075c90 2024-09-21T02:33:55.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad76200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fad701116f0 con 0x7fad7010b750 2024-09-21T02:33:55.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad66a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70077080 0x7fad7019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:55.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 0x7fad7019d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:55.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 0x7fad7019d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50870/0 (socket says 172.21.15.79:50870) 2024-09-21T02:33:55.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 -- 172.21.15.79:0/885614929 learned_addr learned my addr 172.21.15.79:0/885614929 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:55.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6f400640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad70075c90 0x7fad7019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:55.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 -- 172.21.15.79:0/885614929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad70075c90 msgr2=0x7fad7019c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad70075c90 0x7fad7019c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 -- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70077080 msgr2=0x7fad7019c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70077080 0x7fad7019c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.628+0000 7fad6fe00640 1 -- 172.21.15.79:0/885614929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7019dbb0 con 0x7fad7010b750 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.629+0000 7fad6fe00640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 0x7fad7019d390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fad6800eaa0 tx=0x7fad6800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.629+0000 7fad6cc00640 1 -- 172.21.15.79:0/885614929 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6800cdb0 con 0x7fad7010b750 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.629+0000 7fad6cc00640 1 -- 172.21.15.79:0/885614929 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad68005020 con 0x7fad7010b750 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.629+0000 7fad6cc00640 1 -- 172.21.15.79:0/885614929 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad680116d0 con 0x7fad7010b750 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.629+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7019dea0 con 0x7fad7010b750 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.629+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad701a45a0 con 0x7fad7010b750 2024-09-21T02:33:55.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.630+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7010a560 con 0x7fad7010b750 2024-09-21T02:33:55.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.632+0000 7fad6cc00640 1 -- 172.21.15.79:0/885614929 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fad680051d0 con 0x7fad7010b750 2024-09-21T02:33:55.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.634+0000 7fad6cc00640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad540b6620 0x7fad540b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:55.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.634+0000 7fad6cc00640 1 -- 172.21.15.79:0/885614929 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fad680e7940 con 0x7fad7010b750 2024-09-21T02:33:55.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.634+0000 7fad6f400640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad540b6620 0x7fad540b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:55.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.635+0000 7fad6f400640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad540b6620 0x7fad540b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad60009bd0 tx=0x7fad60005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:55.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.638+0000 7fad6cc00640 1 -- 172.21.15.79:0/885614929 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad68016030 con 0x7fad7010b750 2024-09-21T02:33:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:55 smithi079 ceph-mon[30788]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-21T02:33:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:55 smithi148 ceph-mon[34626]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-21T02:33:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.896+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fad7002e640 con 0x7fad7010b750 2024-09-21T02:33:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:55 smithi098 ceph-mon[34832]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-21T02:33:55.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.904+0000 7fad6cc00640 1 -- 172.21.15.79:0/885614929 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fad680b2090 con 0x7fad7010b750 2024-09-21T02:33:55.905 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-09-21T02:33:55.905 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCTMO5mjvqPNRAAhCRXOFNj+Kn25/YLA64tRA== 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad540b6620 msgr2=0x7fad540b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad540b6620 0x7fad540b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad60009bd0 tx=0x7fad60005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 msgr2=0x7fad7019d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 0x7fad7019d390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fad6800eaa0 tx=0x7fad6800ef60 comp rx=0 tx=0).stop 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 shutdown_connections 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad540b6620 0x7fad540b8b30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad7010b750 0x7fad7019d390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad70077080 0x7fad7019c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 --2- 172.21.15.79:0/885614929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad70075c90 0x7fad7019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:55.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 >> 172.21.15.79:0/885614929 conn(0x7fad700ff0c0 msgr2=0x7fad70107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:55.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 shutdown_connections 2024-09-21T02:33:55.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:55.907+0000 7fad76200640 1 -- 172.21.15.79:0/885614929 wait complete. 2024-09-21T02:33:56.637 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:56 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/885614929' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:33:56.637 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:56 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:33:56.637 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:56 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:33:56.677 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:33:56.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T02:33:56.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T02:33:56.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T02:33:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:56 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/885614929' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:33:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:56 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:33:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:56 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:33:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:56 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/885614929' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:33:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:56 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:33:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:56 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:33:57.165 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:57.591 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:57 smithi079 ceph-mon[30788]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T02:33:57.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 -- 172.21.15.79:0/668480410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4103b60 msgr2=0x7fdcf4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/668480410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4103b60 0x7fdcf4103f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009860 tx=0x7fdce402a340 comp rx=0 tx=0).stop 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 -- 172.21.15.79:0/668480410 shutdown_connections 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/668480410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf4109df0 0x7fdcf4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/668480410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf41094a0 0x7fdcf41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/668480410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4103b60 0x7fdcf4103f70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 -- 172.21.15.79:0/668480410 >> 172.21.15.79:0/668480410 conn(0x7fdcf407b850 msgr2=0x7fdcf407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 -- 172.21.15.79:0/668480410 shutdown_connections 2024-09-21T02:33:57.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.762+0000 7fdcf8c00640 1 -- 172.21.15.79:0/668480410 wait complete. 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.763+0000 7fdcf8c00640 1 Processor -- start 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.763+0000 7fdcf8c00640 1 -- start start 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf8c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf4103b60 0x7fdcf4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf8c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf41094a0 0x7fdcf4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf8c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4109df0 0x7fdcf4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf8c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4113ab0 con 0x7fdcf41094a0 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf8c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4113930 con 0x7fdcf4109df0 2024-09-21T02:33:57.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf8c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4113c30 con 0x7fdcf4103b60 2024-09-21T02:33:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcebe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf41094a0 0x7fdcf4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4109df0 0x7fdcf4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf4103b60 0x7fdcf4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4109df0 0x7fdcf4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:44516/0 (socket says 172.21.15.79:44516) 2024-09-21T02:33:57.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcebe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf41094a0 0x7fdcf4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60550/0 (socket says 172.21.15.79:60550) 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.764+0000 7fdcf2800640 1 -- 172.21.15.79:0/2769997623 learned_addr learned my addr 172.21.15.79:0/2769997623 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf2800640 1 -- 172.21.15.79:0/2769997623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf4103b60 msgr2=0x7fdcf4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf2800640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf4103b60 0x7fdcf4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf2800640 1 -- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf41094a0 msgr2=0x7fdcf4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf2800640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf41094a0 0x7fdcf4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf2800640 1 -- 172.21.15.79:0/2769997623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf41a8720 con 0x7fdcf4109df0 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf2800640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4109df0 0x7fdcf4076190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00efd0 tx=0x7fdcec00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdceaa00640 1 -- 172.21.15.79:0/2769997623 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec003b70 con 0x7fdcf4109df0 2024-09-21T02:33:57.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdceaa00640 1 -- 172.21.15.79:0/2769997623 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcec003d10 con 0x7fdcf4109df0 2024-09-21T02:33:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf41a8a10 con 0x7fdcf4109df0 2024-09-21T02:33:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdceaa00640 1 -- 172.21.15.79:0/2769997623 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0108a0 con 0x7fdcf4109df0 2024-09-21T02:33:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.765+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf41a8f00 con 0x7fdcf4109df0 2024-09-21T02:33:57.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.767+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf4103f70 con 0x7fdcf4109df0 2024-09-21T02:33:57.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.769+0000 7fdceaa00640 1 -- 172.21.15.79:0/2769997623 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fdcec004020 con 0x7fdcf4109df0 2024-09-21T02:33:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.770+0000 7fdceaa00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcd80b65a0 0x7fdcd80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:57.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.770+0000 7fdceaa00640 1 -- 172.21.15.79:0/2769997623 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fdcec0e7c80 con 0x7fdcf4109df0 2024-09-21T02:33:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.771+0000 7fdcf1e00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcd80b65a0 0x7fdcd80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:57.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.771+0000 7fdcf1e00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcd80b65a0 0x7fdcd80b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009830 tx=0x7fdce40058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:57.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.775+0000 7fdceaa00640 1 -- 172.21.15.79:0/2769997623 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcec0adff0 con 0x7fdcf4109df0 2024-09-21T02:33:57.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:57 smithi148 ceph-mon[34626]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T02:33:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:57 smithi098 ceph-mon[34832]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T02:33:57.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.964+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fdcf410b630 con 0x7fdcf4109df0 2024-09-21T02:33:57.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.964+0000 7fdceaa00640 1 -- 172.21.15.79:0/2769997623 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7fdcec0b23d0 con 0x7fdcf4109df0 2024-09-21T02:33:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:33:57.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcd80b65a0 msgr2=0x7fdcd80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:57.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcd80b65a0 0x7fdcd80b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009830 tx=0x7fdce40058d0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4109df0 msgr2=0x7fdcf4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4109df0 0x7fdcf4076190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00efd0 tx=0x7fdcec00c6a0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 shutdown_connections 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcd80b65a0 0x7fdcd80b8ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf4109df0 0x7fdcf4076190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf41094a0 0x7fdcf4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 --2- 172.21.15.79:0/2769997623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf4103b60 0x7fdcf4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 >> 172.21.15.79:0/2769997623 conn(0x7fdcf407b850 msgr2=0x7fdcf4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 shutdown_connections 2024-09-21T02:33:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:57.967+0000 7fdcf8c00640 1 -- 172.21.15.79:0/2769997623 wait complete. 2024-09-21T02:33:58.677 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:58 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2769997623' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:33:58.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:58 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2769997623' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:33:58.885 INFO:teuthology.orchestra.run.smithi079.stdout:[{"version":53,"timestamp":"2024-09-21T02:32:29.620970+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T02:33:58.885 INFO:tasks.ceph_manager:config epoch is 53 2024-09-21T02:33:58.885 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T02:33:58.886 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T02:33:58.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T02:33:58.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:58 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2769997623' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:33:59.254 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:59.668 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:33:59 smithi079 ceph-mon[30788]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-21T02:33:59.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:33:59 smithi148 ceph-mon[34626]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-21T02:33:59.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 -- 172.21.15.79:0/538763398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc114740 msgr2=0x7f7edc116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 --2- 172.21.15.79:0/538763398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc114740 0x7f7edc116b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009ca0 tx=0x7f7ed402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 -- 172.21.15.79:0/538763398 shutdown_connections 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 --2- 172.21.15.79:0/538763398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc114740 0x7f7edc116b60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 --2- 172.21.15.79:0/538763398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc078290 0x7f7edc114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 --2- 172.21.15.79:0/538763398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7edc077940 0x7f7edc077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 -- 172.21.15.79:0/538763398 >> 172.21.15.79:0/538763398 conn(0x7f7edc101810 msgr2=0x7f7edc103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 -- 172.21.15.79:0/538763398 shutdown_connections 2024-09-21T02:33:59.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.840+0000 7f7ee2600640 1 -- 172.21.15.79:0/538763398 wait complete. 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.841+0000 7f7ee2600640 1 Processor -- start 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.841+0000 7f7ee2600640 1 -- start start 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7ee2600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc077940 0x7f7edc1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7ee2600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc078290 0x7f7edc1a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7ee2600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7edc114740 0x7f7edc1a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7ee2600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc11a0c0 con 0x7f7edc077940 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7ee2600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc119f40 con 0x7f7edc078290 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7ee2600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc11a240 con 0x7f7edc114740 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc077940 0x7f7edc1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc077940 0x7f7edc1a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60580/0 (socket says 172.21.15.79:60580) 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 -- 172.21.15.79:0/3004434828 learned_addr learned my addr 172.21.15.79:0/3004434828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:33:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7ed2a00640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc078290 0x7f7edc1a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edbe00640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7edc114740 0x7f7edc1a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 -- 172.21.15.79:0/3004434828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7edc114740 msgr2=0x7f7edc1a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7edc114740 0x7f7edc1a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 -- 172.21.15.79:0/3004434828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc078290 msgr2=0x7f7edc1a1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc078290 0x7f7edc1a1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.842+0000 7f7edb400640 1 -- 172.21.15.79:0/3004434828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc1a69e0 con 0x7f7edc077940 2024-09-21T02:33:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.843+0000 7f7edb400640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc077940 0x7f7edc1a0a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00e9f0 tx=0x7f7ecc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.843+0000 7f7ed8c00640 1 -- 172.21.15.79:0/3004434828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc00cd80 con 0x7f7edc077940 2024-09-21T02:33:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.843+0000 7f7ed8c00640 1 -- 172.21.15.79:0/3004434828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ecc0054d0 con 0x7f7edc077940 2024-09-21T02:33:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.843+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7edc1a6cd0 con 0x7f7edc077940 2024-09-21T02:33:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.843+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7edc1ad430 con 0x7f7edc077940 2024-09-21T02:33:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.843+0000 7f7ed8c00640 1 -- 172.21.15.79:0/3004434828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc010690 con 0x7f7edc077940 2024-09-21T02:33:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.845+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb80052c0 con 0x7f7edc077940 2024-09-21T02:33:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.847+0000 7f7ed8c00640 1 -- 172.21.15.79:0/3004434828 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7ecc0046c0 con 0x7f7edc077940 2024-09-21T02:33:59.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.849+0000 7f7ed8c00640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7ec00b6620 0x7f7ec00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:59.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.849+0000 7f7ed8c00640 1 -- 172.21.15.79:0/3004434828 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f7ecc0e7b30 con 0x7f7edc077940 2024-09-21T02:33:59.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.849+0000 7f7ed2a00640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7ec00b6620 0x7f7ec00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:59.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.850+0000 7f7ed2a00640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7ec00b6620 0x7f7ec00b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7edc07b210 tx=0x7f7ec4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:59.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:33:59.853+0000 7f7ed8c00640 1 -- 172.21.15.79:0/3004434828 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ecc0adea0 con 0x7f7edc077940 2024-09-21T02:33:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:33:59 smithi098 ceph-mon[34832]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-21T02:34:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.088+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7eb8005880 con 0x7f7edc077940 2024-09-21T02:34:00.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.094+0000 7f7ed8c00640 1 -- 172.21.15.79:0/3004434828 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) ==== 74+0+296435 (secure 0 0 0) 0x7f7ecc0b2280 con 0x7f7edc077940 2024-09-21T02:34:00.099 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.099+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7ec00b6620 msgr2=0x7f7ec00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.099+0000 7f7ee2600640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7ec00b6620 0x7f7ec00b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7edc07b210 tx=0x7f7ec4005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.099+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc077940 msgr2=0x7f7edc1a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.099+0000 7f7ee2600640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc077940 0x7f7edc1a0a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00e9f0 tx=0x7f7ecc00edf0 comp rx=0 tx=0).stop 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 shutdown_connections 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7ec00b6620 0x7f7ec00b8b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7edc114740 0x7f7edc1a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7edc078290 0x7f7edc1a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 --2- 172.21.15.79:0/3004434828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7edc077940 0x7f7edc1a0a70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 >> 172.21.15.79:0/3004434828 conn(0x7f7edc101810 msgr2=0x7f7edc116760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 shutdown_connections 2024-09-21T02:34:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:00.100+0000 7f7ee2600640 1 -- 172.21.15.79:0/3004434828 wait complete. 2024-09-21T02:34:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:00 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3004434828' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:34:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:00 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3004434828' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:34:00.858 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":863078239},{"type":"v1","addr":"172.21.15.79:6801","nonce":863078239}]},"active_addr":"172.21.15.79:6801/863078239","active_change":"2024-09-21T02:24:29.283683+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24121,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.79:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3138137294}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1178365537}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3534476640}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3355512948}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":4095419217}]}]} 2024-09-21T02:34:00.865 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T02:34:00.865 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T02:34:00.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:34:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:00 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3004434828' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:34:01.266 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:01.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:01 smithi148 ceph-mon[34626]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:01.827 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:01 smithi079 ceph-mon[30788]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:01.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 -- 172.21.15.79:0/998686039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 msgr2=0x7f30dc112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 --2- 172.21.15.79:0/998686039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 0x7f30dc112350 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009900 tx=0x7f30d402a410 comp rx=0 tx=0).stop 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 -- 172.21.15.79:0/998686039 shutdown_connections 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 --2- 172.21.15.79:0/998686039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 0x7f30dc112350 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 --2- 172.21.15.79:0/998686039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30dc076100 0x7f30dc10f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 --2- 172.21.15.79:0/998686039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc0757b0 0x7f30dc075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 -- 172.21.15.79:0/998686039 >> 172.21.15.79:0/998686039 conn(0x7f30dc0ff440 msgr2=0x7f30dc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 -- 172.21.15.79:0/998686039 shutdown_connections 2024-09-21T02:34:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.891+0000 7f30db200640 1 -- 172.21.15.79:0/998686039 wait complete. 2024-09-21T02:34:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.892+0000 7f30db200640 1 Processor -- start 2024-09-21T02:34:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30db200640 1 -- start start 2024-09-21T02:34:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30db200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc0757b0 0x7f30dc19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30db200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30dc076100 0x7f30dc19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30db200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 0x7f30dc1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30db200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc115ac0 con 0x7f30dc10ff10 2024-09-21T02:34:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30db200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc115940 con 0x7f30dc076100 2024-09-21T02:34:01.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30db200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc115c40 con 0x7f30dc0757b0 2024-09-21T02:34:01.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30da800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 0x7f30dc1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30da800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 0x7f30dc1a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60602/0 (socket says 172.21.15.79:60602) 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30da800640 1 -- 172.21.15.79:0/3681266509 learned_addr learned my addr 172.21.15.79:0/3681266509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30d9400640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30dc076100 0x7f30dc19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.893+0000 7f30d9e00640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc0757b0 0x7f30dc19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.894+0000 7f30d9e00640 1 -- 172.21.15.79:0/3681266509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30dc076100 msgr2=0x7f30dc19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.894+0000 7f30d9e00640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30dc076100 0x7f30dc19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.894+0000 7f30d9e00640 1 -- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 msgr2=0x7f30dc1a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.894+0000 7f30d9e00640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 0x7f30dc1a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.894+0000 7f30d9e00640 1 -- 172.21.15.79:0/3681266509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc1a2420 con 0x7f30dc0757b0 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.894+0000 7f30d9400640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30dc076100 0x7f30dc19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.894+0000 7f30d9e00640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc0757b0 0x7f30dc19c4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00dab0 tx=0x7f30cc00df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.895+0000 7f30d2a00640 1 -- 172.21.15.79:0/3681266509 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00be30 con 0x7f30dc0757b0 2024-09-21T02:34:01.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.895+0000 7f30d2a00640 1 -- 172.21.15.79:0/3681266509 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30cc003e20 con 0x7f30dc0757b0 2024-09-21T02:34:01.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.895+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc1a2710 con 0x7f30dc0757b0 2024-09-21T02:34:01.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.895+0000 7f30d2a00640 1 -- 172.21.15.79:0/3681266509 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0106a0 con 0x7f30dc0757b0 2024-09-21T02:34:01.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.895+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc1a8e70 con 0x7f30dc0757b0 2024-09-21T02:34:01.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.896+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc075bc0 con 0x7f30dc0757b0 2024-09-21T02:34:01.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.898+0000 7f30d2a00640 1 -- 172.21.15.79:0/3681266509 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f30cc004000 con 0x7f30dc0757b0 2024-09-21T02:34:01.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.900+0000 7f30d2a00640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30c00b65a0 0x7f30c00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.900+0000 7f30d2a00640 1 -- 172.21.15.79:0/3681266509 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f30cc0e7f50 con 0x7f30dc0757b0 2024-09-21T02:34:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.900+0000 7f30d9400640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30c00b65a0 0x7f30c00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.901+0000 7f30d9400640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30c00b65a0 0x7f30c00b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f30dc112230 tx=0x7f30c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:01.901+0000 7f30d2a00640 1 -- 172.21.15.79:0/3681266509 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30cc0ae2c0 con 0x7f30dc0757b0 2024-09-21T02:34:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:01 smithi098 ceph-mon[34832]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:02.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.089+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30dc19d5e0 con 0x7f30dc0757b0 2024-09-21T02:34:02.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.091+0000 7f30d2a00640 1 -- 172.21.15.79:0/3681266509 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24636 (secure 0 0 0) 0x7f30cc0b26a0 con 0x7f30dc0757b0 2024-09-21T02:34:02.093 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:02.093 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:33:30.524684+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:34:02.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30c00b65a0 msgr2=0x7f30c00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:02.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30c00b65a0 0x7f30c00b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f30dc112230 tx=0x7f30c8005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:02.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc0757b0 msgr2=0x7f30dc19c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:02.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc0757b0 0x7f30dc19c4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00dab0 tx=0x7f30cc00df70 comp rx=0 tx=0).stop 2024-09-21T02:34:02.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 shutdown_connections 2024-09-21T02:34:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30c00b65a0 0x7f30c00b8ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30dc10ff10 0x7f30dc1a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30dc076100 0x7f30dc19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 --2- 172.21.15.79:0/3681266509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc0757b0 0x7f30dc19c4b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 >> 172.21.15.79:0/3681266509 conn(0x7f30dc0ff440 msgr2=0x7f30dc109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 shutdown_connections 2024-09-21T02:34:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:02.096+0000 7f30db200640 1 -- 172.21.15.79:0/3681266509 wait complete. 2024-09-21T02:34:02.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:02 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3681266509' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:02.880 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T02:34:02.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:34:02.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:02 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3681266509' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:03.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:02 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3681266509' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:03.273 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:03.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:03 smithi079 ceph-mon[30788]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:03 smithi098 ceph-mon[34832]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 -- 172.21.15.79:0/846186320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7810de30 msgr2=0x7fde78110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 --2- 172.21.15.79:0/846186320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7810de30 0x7fde78110320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fde70009ca0 tx=0x7fde7002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 -- 172.21.15.79:0/846186320 shutdown_connections 2024-09-21T02:34:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 --2- 172.21.15.79:0/846186320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7810de30 0x7fde78110320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 --2- 172.21.15.79:0/846186320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78105320 0x7fde7810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 --2- 172.21.15.79:0/846186320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde781049d0 0x7fde78104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:03.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 -- 172.21.15.79:0/846186320 >> 172.21.15.79:0/846186320 conn(0x7fde78079740 msgr2=0x7fde78079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:03.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 -- 172.21.15.79:0/846186320 shutdown_connections 2024-09-21T02:34:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.916+0000 7fde7e400640 1 -- 172.21.15.79:0/846186320 wait complete. 2024-09-21T02:34:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.917+0000 7fde7e400640 1 Processor -- start 2024-09-21T02:34:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde7e400640 1 -- start start 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde7e400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde781049d0 0x7fde7819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde7e400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78105320 0x7fde7819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde7e400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde7810de30 0x7fde781a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde7e400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde78113ab0 con 0x7fde781049d0 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde7e400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde78113930 con 0x7fde78105320 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde7e400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fde78113c30 con 0x7fde7810de30 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde77400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde781049d0 0x7fde7819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde77400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde781049d0 0x7fde7819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34040/0 (socket says 172.21.15.79:34040) 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde77400640 1 -- 172.21.15.79:0/2819644171 learned_addr learned my addr 172.21.15.79:0/2819644171 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde6ea00640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78105320 0x7fde7819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.918+0000 7fde77e00640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde7810de30 0x7fde781a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde77400640 1 -- 172.21.15.79:0/2819644171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde7810de30 msgr2=0x7fde781a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde77400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde7810de30 0x7fde781a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde77400640 1 -- 172.21.15.79:0/2819644171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78105320 msgr2=0x7fde7819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde77400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78105320 0x7fde7819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde77400640 1 -- 172.21.15.79:0/2819644171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde781a2610 con 0x7fde781049d0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde77e00640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde7810de30 0x7fde781a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde77400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde781049d0 0x7fde7819c6a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fde6800e9c0 tx=0x7fde6800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde74c00640 1 -- 172.21.15.79:0/2819644171 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6800cd80 con 0x7fde781049d0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde74c00640 1 -- 172.21.15.79:0/2819644171 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde680035f0 con 0x7fde781049d0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde74c00640 1 -- 172.21.15.79:0/2819644171 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68010690 con 0x7fde781049d0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.919+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde781a2900 con 0x7fde781049d0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.920+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde781a9060 con 0x7fde781049d0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.921+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7806c240 con 0x7fde781049d0 2024-09-21T02:34:03.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.923+0000 7fde74c00640 1 -- 172.21.15.79:0/2819644171 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fde68004000 con 0x7fde781049d0 2024-09-21T02:34:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.925+0000 7fde74c00640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde5c0b6620 0x7fde5c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.926+0000 7fde74c00640 1 -- 172.21.15.79:0/2819644171 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fde680e7eb0 con 0x7fde781049d0 2024-09-21T02:34:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.926+0000 7fde6ea00640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde5c0b6620 0x7fde5c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.927+0000 7fde6ea00640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde5c0b6620 0x7fde5c0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde7810fa80 tx=0x7fde60005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:03.928+0000 7fde74c00640 1 -- 172.21.15.79:0/2819644171 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde680ae220 con 0x7fde781049d0 2024-09-21T02:34:04.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:03 smithi148 ceph-mon[34626]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:04.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.115+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde78104de0 con 0x7fde781049d0 2024-09-21T02:34:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.117+0000 7fde74c00640 1 -- 172.21.15.79:0/2819644171 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24636 (secure 0 0 0) 0x7fde680b2600 con 0x7fde781049d0 2024-09-21T02:34:04.119 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:04.119 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":86,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:33:30.524684+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde5c0b6620 msgr2=0x7fde5c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde5c0b6620 0x7fde5c0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde7810fa80 tx=0x7fde60005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde781049d0 msgr2=0x7fde7819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde781049d0 0x7fde7819c6a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fde6800e9c0 tx=0x7fde6800ee80 comp rx=0 tx=0).stop 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 shutdown_connections 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde5c0b6620 0x7fde5c0b8b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde7810de30 0x7fde781a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78105320 0x7fde7819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 --2- 172.21.15.79:0/2819644171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde781049d0 0x7fde7819c6a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 >> 172.21.15.79:0/2819644171 conn(0x7fde78079740 msgr2=0x7fde7810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.119+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 shutdown_connections 2024-09-21T02:34:04.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:04.120+0000 7fde7e400640 1 -- 172.21.15.79:0/2819644171 wait complete. 2024-09-21T02:34:04.866 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:04 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2819644171' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:04.906 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T02:34:04.906 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T02:34:04.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T02:34:04.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T02:34:04.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T02:34:04.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T02:34:04.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T02:34:04.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T02:34:04.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T02:34:04.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T02:34:04.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T02:34:04.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T02:34:04.912 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:04 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2819644171' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:05.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:04 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2819644171' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:05.875 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:05 smithi098 ceph-mon[34832]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:05.922 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:05.924 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:05.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:05 smithi079 ceph-mon[30788]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:06.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:05 smithi148 ceph-mon[34626]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T02:34:06.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 -- 172.21.15.79:0/3518156559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac0109c40 msgr2=0x7f5ac0110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:06.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 --2- 172.21.15.79:0/3518156559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac0109c40 0x7f5ac0110470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009ca0 tx=0x7f5ab802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 -- 172.21.15.79:0/3518156559 shutdown_connections 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 --2- 172.21.15.79:0/3518156559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac0109c40 0x7f5ac0110470 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 --2- 172.21.15.79:0/3518156559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01092f0 0x7f5ac0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 --2- 172.21.15.79:0/3518156559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac01039b0 0x7f5ac0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 -- 172.21.15.79:0/3518156559 >> 172.21.15.79:0/3518156559 conn(0x7f5ac00ff440 msgr2=0x7f5ac0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 -- 172.21.15.79:0/3518156559 shutdown_connections 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.825+0000 7f5abfe00640 1 -- 172.21.15.79:0/3518156559 wait complete. 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.826+0000 7f5abfe00640 1 Processor -- start 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.826+0000 7f5abfe00640 1 -- start start 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac01039b0 0x7f5ac019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01092f0 0x7f5ac019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:06.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac0109c40 0x7f5ac01a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abfe00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113900 con 0x7f5ac0109c40 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abfe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113780 con 0x7f5ac01092f0 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abfe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113a80 con 0x7f5ac01039b0 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01092f0 0x7f5ac019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac01039b0 0x7f5ac019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01092f0 0x7f5ac019ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58572/0 (socket says 172.21.15.79:58572) 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 -- 172.21.15.79:0/2065201938 learned_addr learned my addr 172.21.15.79:0/2065201938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac01039b0 0x7f5ac019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:36140/0 (socket says 172.21.15.79:36140) 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abf400640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac0109c40 0x7f5ac01a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 -- 172.21.15.79:0/2065201938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac01039b0 msgr2=0x7f5ac019c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac01039b0 0x7f5ac019c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 -- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac0109c40 msgr2=0x7f5ac01a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac0109c40 0x7f5ac01a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.827+0000 7f5abe000640 1 -- 172.21.15.79:0/2065201938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01a2460 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.828+0000 7f5abe000640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01092f0 0x7f5ac019ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00e9f0 tx=0x7f5aac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.828+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00ccc0 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.828+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01a2750 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.828+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aac0108e0 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.828+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac018860 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.828+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01a8eb0 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.829+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ac010fa90 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.833+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5aac010430 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.834+0000 7f5ac4a00640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5aa40b65a0 0x7f5aa40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.834+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f5aac0e8660 con 0x7f5ac01092f0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.834+0000 7f5abea00640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5aa40b65a0 0x7f5aa40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:06.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.834+0000 7f5ac4a00640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] conn(0x7f5aa40c16b0 0x7f5aa40c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.834+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 --> [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5aa40c4270 con 0x7f5aa40c16b0 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.834+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5aac0e8a10 con 0x7f5ac01092f0 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.835+0000 7f5abf400640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] conn(0x7f5aa40c16b0 0x7f5aa40c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.835+0000 7f5abea00640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5aa40b65a0 0x7f5aa40b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009bd0 tx=0x7f5ab0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.835+0000 7f5abf400640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] conn(0x7f5aa40c16b0 0x7f5aa40c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.836+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== osd.0 v2:172.21.15.79:6802/3943221665 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5aa40c4270 con 0x7f5aa40c16b0 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.851+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 --> [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ac0104c30 con 0x7f5aa40c16b0 2024-09-21T02:34:06.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.852+0000 7f5ac4a00640 1 -- 172.21.15.79:0/2065201938 <== osd.0 v2:172.21.15.79:6802/3943221665 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ac0104c30 con 0x7f5aa40c16b0 2024-09-21T02:34:06.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.852+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] conn(0x7f5aa40c16b0 msgr2=0x7f5aa40c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:06.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.852+0000 7f5abfe00640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] conn(0x7f5aa40c16b0 0x7f5aa40c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5aa40b65a0 msgr2=0x7f5aa40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5aa40b65a0 0x7f5aa40b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009bd0 tx=0x7f5ab0005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01092f0 msgr2=0x7f5ac019ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 --2- 172.21.15.79:0/2065201938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01092f0 0x7f5ac019ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00e9f0 tx=0x7f5aac00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abf400640 1 -- 172.21.15.79:0/2065201938 reap_dead start 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 shutdown_connections 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 >> 172.21.15.79:0/2065201938 conn(0x7f5ac00ff440 msgr2=0x7f5ac01068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 shutdown_connections 2024-09-21T02:34:06.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.853+0000 7f5abfe00640 1 -- 172.21.15.79:0/2065201938 wait complete. 2024-09-21T02:34:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 -- 172.21.15.79:0/950935391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce80103b60 msgr2=0x7fce80103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 --2- 172.21.15.79:0/950935391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce80103b60 0x7fce80103f70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce74009900 tx=0x7fce7402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:34:07.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 -- 172.21.15.79:0/950935391 shutdown_connections 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 --2- 172.21.15.79:0/950935391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce80109df0 0x7fce80110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 --2- 172.21.15.79:0/950935391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce801094a0 0x7fce801098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 --2- 172.21.15.79:0/950935391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce80103b60 0x7fce80103f70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 -- 172.21.15.79:0/950935391 >> 172.21.15.79:0/950935391 conn(0x7fce8007b850 msgr2=0x7fce8007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 -- 172.21.15.79:0/950935391 shutdown_connections 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.940+0000 7fce87400640 1 -- 172.21.15.79:0/950935391 wait complete. 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.941+0000 7fce87400640 1 Processor -- start 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.941+0000 7fce87400640 1 -- start start 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce87400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80103b60 0x7fce8019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce87400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce801094a0 0x7fce8019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce87400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce80109df0 0x7fce8019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:07.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce87400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce80113b00 con 0x7fce801094a0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce87400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce80113980 con 0x7fce80109df0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce87400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce80113c80 con 0x7fce80103b60 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce801094a0 0x7fce8019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce801094a0 0x7fce8019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34080/0 (socket says 172.21.15.79:34080) 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 -- 172.21.15.79:0/507662857 learned_addr learned my addr 172.21.15.79:0/507662857 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce84a00640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80103b60 0x7fce8019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce85400640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce80109df0 0x7fce8019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 -- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80103b60 msgr2=0x7fce8019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80103b60 0x7fce8019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 -- 172.21.15.79:0/507662857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce80109df0 msgr2=0x7fce8019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce80109df0 0x7fce8019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.942+0000 7fce7fe00640 1 -- 172.21.15.79:0/507662857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce801a0400 con 0x7fce801094a0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.943+0000 7fce7fe00640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce801094a0 0x7fce8019aa30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00e9c0 tx=0x7fce6c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.943+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00ccc0 con 0x7fce801094a0 2024-09-21T02:34:07.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.943+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce6c0054d0 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.943+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce801a06f0 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.943+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c010430 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.943+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801a6e50 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.944+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce80063b50 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.946+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fce6c005000 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.948+0000 7fce7d600640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce680b65a0 0x7fce680b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.948+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fce6c0e7fd0 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.948+0000 7fce84a00640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce680b65a0 0x7fce680b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.948+0000 7fce7d600640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] conn(0x7fce680c16b0 0x7fce680c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.948+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 --> [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce6c016ec0 con 0x7fce680c16b0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.948+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fce6c0e8380 con 0x7fce801094a0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.949+0000 7fce85400640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] conn(0x7fce680c16b0 0x7fce680c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:07.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.949+0000 7fce84a00640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce680b65a0 0x7fce680b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce74005ab0 tx=0x7fce74005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.949+0000 7fce85400640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] conn(0x7fce680c16b0 0x7fce680c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.950+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== osd.5 v2:172.21.15.148:6808/517086756 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce6c016ec0 con 0x7fce680c16b0 2024-09-21T02:34:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.965+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 --> [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce80063fd0 con 0x7fce680c16b0 2024-09-21T02:34:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.965+0000 7fce7d600640 1 -- 172.21.15.79:0/507662857 <== osd.5 v2:172.21.15.148:6808/517086756 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fce80063fd0 con 0x7fce680c16b0 2024-09-21T02:34:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] conn(0x7fce680c16b0 msgr2=0x7fce680c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:07.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] conn(0x7fce680c16b0 0x7fce680c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce680b65a0 msgr2=0x7fce680b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce680b65a0 0x7fce680b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce74005ab0 tx=0x7fce74005a20 comp rx=0 tx=0).stop 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce801094a0 msgr2=0x7fce8019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 --2- 172.21.15.79:0/507662857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce801094a0 0x7fce8019aa30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00e9c0 tx=0x7fce6c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce85400640 1 -- 172.21.15.79:0/507662857 reap_dead start 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 shutdown_connections 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 >> 172.21.15.79:0/507662857 conn(0x7fce8007b850 msgr2=0x7fce801074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 shutdown_connections 2024-09-21T02:34:07.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:06.966+0000 7fce87400640 1 -- 172.21.15.79:0/507662857 wait complete. 2024-09-21T02:34:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:07 smithi079 ceph-mon[30788]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 1 op/s 2024-09-21T02:34:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:07 smithi148 ceph-mon[34626]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 1 op/s 2024-09-21T02:34:07.834 INFO:teuthology.orchestra.run.smithi079.stdout:154618822721 2024-09-21T02:34:07.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T02:34:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:07 smithi098 ceph-mon[34832]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 1 op/s 2024-09-21T02:34:08.156 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:08.156 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:08.157 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:08.157 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:08.665 INFO:teuthology.orchestra.run.smithi079.stdout:34359738459 2024-09-21T02:34:08.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T02:34:09.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 -- 172.21.15.79:0/4271737920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938109c40 msgr2=0x7f3938110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 --2- 172.21.15.79:0/4271737920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938109c40 0x7f3938110470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3930009ca0 tx=0x7f393002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 -- 172.21.15.79:0/4271737920 shutdown_connections 2024-09-21T02:34:09.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 --2- 172.21.15.79:0/4271737920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938109c40 0x7f3938110470 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 --2- 172.21.15.79:0/4271737920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39381092f0 0x7f3938109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 --2- 172.21.15.79:0/4271737920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39381039b0 0x7f3938103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 -- 172.21.15.79:0/4271737920 >> 172.21.15.79:0/4271737920 conn(0x7f39380ff440 msgr2=0x7f3938101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 -- 172.21.15.79:0/4271737920 shutdown_connections 2024-09-21T02:34:09.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.581+0000 7f393e800640 1 -- 172.21.15.79:0/4271737920 wait complete. 2024-09-21T02:34:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.582+0000 7f393e800640 1 Processor -- start 2024-09-21T02:34:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.582+0000 7f393e800640 1 -- start start 2024-09-21T02:34:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39381039b0 0x7f393819c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39381092f0 0x7f393819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3938109c40 0x7f39381a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393e800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3938113950 con 0x7f39381092f0 2024-09-21T02:34:09.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393e800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f39381137d0 con 0x7f39381039b0 2024-09-21T02:34:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393e800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3938113ad0 con 0x7f3938109c40 2024-09-21T02:34:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393ca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39381092f0 0x7f393819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39381039b0 0x7f393819c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39381039b0 0x7f393819c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58618/0 (socket says 172.21.15.79:58618) 2024-09-21T02:34:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393d400640 1 -- 172.21.15.79:0/2806926927 learned_addr learned my addr 172.21.15.79:0/2806926927 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:09.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393de00640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3938109c40 0x7f39381a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393d400640 1 -- 172.21.15.79:0/2806926927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3938109c40 msgr2=0x7f39381a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393d400640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3938109c40 0x7f39381a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.583+0000 7f393d400640 1 -- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39381092f0 msgr2=0x7f393819ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f393d400640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39381092f0 0x7f393819ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f393d400640 1 -- 172.21.15.79:0/2806926927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39381a2450 con 0x7f39381039b0 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f393d400640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39381039b0 0x7f393819c4e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f392c00e9f0 tx=0x7f392c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c00cd80 con 0x7f39381039b0 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39381a2740 con 0x7f39381039b0 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f392c0108e0 con 0x7f39381039b0 2024-09-21T02:34:09.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c018980 con 0x7f39381039b0 2024-09-21T02:34:09.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.584+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39381a8ea0 con 0x7f39381039b0 2024-09-21T02:34:09.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.585+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f393810fa50 con 0x7f39381039b0 2024-09-21T02:34:09.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.588+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f392c010430 con 0x7f39381039b0 2024-09-21T02:34:09.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.589+0000 7f3936000640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f39200b65a0 0x7f39200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.589+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f392c0e8290 con 0x7f39381039b0 2024-09-21T02:34:09.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.589+0000 7f393ca00640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f39200b65a0 0x7f39200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.589+0000 7f3936000640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] conn(0x7f39200c16b0 0x7f39200c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.589+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 --> [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f392c01ce70 con 0x7f39200c16b0 2024-09-21T02:34:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.589+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f392c0e8640 con 0x7f39381039b0 2024-09-21T02:34:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.590+0000 7f393de00640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] conn(0x7f39200c16b0 0x7f39200c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.590+0000 7f393ca00640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f39200b65a0 0x7f39200b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3938105a10 tx=0x7f3924005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.590+0000 7f393de00640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] conn(0x7f39200c16b0 0x7f39200c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:09.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.591+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== osd.3 v2:172.21.15.79:6810/748592463 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f392c01ce70 con 0x7f39200c16b0 2024-09-21T02:34:09.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.605+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 --> [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3938104c30 con 0x7f39200c16b0 2024-09-21T02:34:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f3936000640 1 -- 172.21.15.79:0/2806926927 <== osd.3 v2:172.21.15.79:6810/748592463 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3938104c30 con 0x7f39200c16b0 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] conn(0x7f39200c16b0 msgr2=0x7f39200c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f393e800640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] conn(0x7f39200c16b0 0x7f39200c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f39200b65a0 msgr2=0x7f39200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f393e800640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f39200b65a0 0x7f39200b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3938105a10 tx=0x7f3924005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39381039b0 msgr2=0x7f393819c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f393e800640 1 --2- 172.21.15.79:0/2806926927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39381039b0 0x7f393819c4e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f392c00e9f0 tx=0x7f392c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.606+0000 7f393de00640 1 -- 172.21.15.79:0/2806926927 reap_dead start 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.607+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 shutdown_connections 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.607+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 >> 172.21.15.79:0/2806926927 conn(0x7f39380ff440 msgr2=0x7f3938108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.607+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 shutdown_connections 2024-09-21T02:34:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.607+0000 7f393e800640 1 -- 172.21.15.79:0/2806926927 wait complete. 2024-09-21T02:34:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.445+0000 7f043cc00640 1 -- 172.21.15.79:0/657628241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 msgr2=0x7f0438116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.445+0000 7f043cc00640 1 --2- 172.21.15.79:0/657628241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 0x7f0438116750 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0430009ca0 tx=0x7f043002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.446+0000 7f043cc00640 1 -- 172.21.15.79:0/657628241 shutdown_connections 2024-09-21T02:34:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.446+0000 7f043cc00640 1 --2- 172.21.15.79:0/657628241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 0x7f0438116750 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.446+0000 7f043cc00640 1 --2- 172.21.15.79:0/657628241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0438075dd0 0x7f04380761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.446+0000 7f043cc00640 1 --2- 172.21.15.79:0/657628241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0438077380 0x7f04380757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.446+0000 7f043cc00640 1 -- 172.21.15.79:0/657628241 >> 172.21.15.79:0/657628241 conn(0x7f04380ff440 msgr2=0x7f0438101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.446+0000 7f043cc00640 1 -- 172.21.15.79:0/657628241 shutdown_connections 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.446+0000 7f043cc00640 1 -- 172.21.15.79:0/657628241 wait complete. 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.447+0000 7f043cc00640 1 Processor -- start 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.448+0000 7f043cc00640 1 -- start start 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.448+0000 7f043cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0438075dd0 0x7f04381a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.448+0000 7f043cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0438077380 0x7f04381a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.448+0000 7f043cc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 0x7f04381a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.448+0000 7f043cc00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0438119ec0 con 0x7f0438114280 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.448+0000 7f043cc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0438119d40 con 0x7f0438075dd0 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.448+0000 7f043cc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f043811a040 con 0x7f0438077380 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0437e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 0x7f04381a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0437e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 0x7f04381a60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34106/0 (socket says 172.21.15.79:34106) 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0437e00640 1 -- 172.21.15.79:0/3036858238 learned_addr learned my addr 172.21.15.79:0/3036858238 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0437400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0438075dd0 0x7f04381a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0436a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0438077380 0x7f04381a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0436a00640 1 -- 172.21.15.79:0/3036858238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0438075dd0 msgr2=0x7f04381a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0436a00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0438075dd0 0x7f04381a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0436a00640 1 -- 172.21.15.79:0/3036858238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 msgr2=0x7f04381a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0436a00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0438114280 0x7f04381a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.449+0000 7f0436a00640 1 -- 172.21.15.79:0/3036858238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04381a6800 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.450+0000 7f0436a00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0438077380 0x7f04381a0e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f042400e9c0 tx=0x7f042400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.450+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042400ccc0 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.450+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04381a6af0 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.450+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0424005020 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.450+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424004a00 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.450+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04381ad250 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.451+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0438063b50 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.454+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f04240051d0 con 0x7f0438077380 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.456+0000 7f042fe00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f041c0b65a0 0x7f041c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.457+0000 7f0437400640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f041c0b65a0 0x7f041c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.457+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f04240e7a60 con 0x7f0438077380 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.457+0000 7f042fe00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] conn(0x7f041c0c16a0 0x7f041c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.457+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 --> [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0424012ec0 con 0x7f041c0c16a0 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.457+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f04240e7e10 con 0x7f0438077380 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.457+0000 7f0437400640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f041c0b65a0 0x7f041c0b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0428009bd0 tx=0x7f0428005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.457+0000 7f0437e00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] conn(0x7f041c0c16a0 0x7f041c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.458+0000 7f0437e00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] conn(0x7f041c0c16a0 0x7f041c0c3b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.459+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== osd.2 v2:172.21.15.148:6800/1764684633 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0424012ec0 con 0x7f041c0c16a0 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.478+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 --> [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0438063fd0 con 0x7f041c0c16a0 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f042fe00640 1 -- 172.21.15.79:0/3036858238 <== osd.2 v2:172.21.15.148:6800/1764684633 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0438063fd0 con 0x7f041c0c16a0 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] conn(0x7f041c0c16a0 msgr2=0x7f041c0c3b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f043cc00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] conn(0x7f041c0c16a0 0x7f041c0c3b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f041c0b65a0 msgr2=0x7f041c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f043cc00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f041c0b65a0 0x7f041c0b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0428009bd0 tx=0x7f0428005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0438077380 msgr2=0x7f04381a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f043cc00640 1 --2- 172.21.15.79:0/3036858238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0438077380 0x7f04381a0e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f042400e9c0 tx=0x7f042400ee80 comp rx=0 tx=0).stop 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f0437e00640 1 -- 172.21.15.79:0/3036858238 reap_dead start 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.479+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 shutdown_connections 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.480+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 >> 172.21.15.79:0/3036858238 conn(0x7f04380ff440 msgr2=0x7f0438110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.480+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 shutdown_connections 2024-09-21T02:34:09.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:09.480+0000 7f043cc00640 1 -- 172.21.15.79:0/3036858238 wait complete. 2024-09-21T02:34:09.701 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:09 smithi079 ceph-mon[30788]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T02:34:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:09 smithi148 ceph-mon[34626]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T02:34:09.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:09 smithi098 ceph-mon[34832]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T02:34:11.383 INFO:teuthology.orchestra.run.smithi079.stdout:77309411411 2024-09-21T02:34:11.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T02:34:11.603 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:11 smithi079 ceph-mon[30788]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:11 smithi148 ceph-mon[34626]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:11 smithi098 ceph-mon[34832]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:11.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 -- 172.21.15.79:0/1043218722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 msgr2=0x7f1eb4103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 --2- 172.21.15.79:0/1043218722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 0x7f1eb4103dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009900 tx=0x7f1ea802a410 comp rx=0 tx=0).stop 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 -- 172.21.15.79:0/1043218722 shutdown_connections 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 --2- 172.21.15.79:0/1043218722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eb4109c40 0x7f1eb4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 --2- 172.21.15.79:0/1043218722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1eb41092f0 0x7f1eb4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 --2- 172.21.15.79:0/1043218722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 0x7f1eb4103dc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 -- 172.21.15.79:0/1043218722 >> 172.21.15.79:0/1043218722 conn(0x7f1eb40ff440 msgr2=0x7f1eb4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 -- 172.21.15.79:0/1043218722 shutdown_connections 2024-09-21T02:34:11.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.927+0000 7f1eba000640 1 -- 172.21.15.79:0/1043218722 wait complete. 2024-09-21T02:34:11.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.928+0000 7f1eba000640 1 Processor -- start 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.928+0000 7f1eba000640 1 -- start start 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eba000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 0x7f1eb419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eba000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eb41092f0 0x7f1eb419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eba000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1eb4109c40 0x7f1eb419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eba000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4113950 con 0x7f1eb41039b0 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eba000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41137d0 con 0x7f1eb4109c40 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eba000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4113ad0 con 0x7f1eb41092f0 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eb8c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 0x7f1eb419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eb8c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 0x7f1eb419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34164/0 (socket says 172.21.15.79:34164) 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eb8c00640 1 -- 172.21.15.79:0/2877607342 learned_addr learned my addr 172.21.15.79:0/2877607342 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eb3e00640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eb41092f0 0x7f1eb419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:11.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.929+0000 7f1eb9600640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1eb4109c40 0x7f1eb419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:11.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.930+0000 7f1eb8c00640 1 -- 172.21.15.79:0/2877607342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eb41092f0 msgr2=0x7f1eb419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.930+0000 7f1eb8c00640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eb41092f0 0x7f1eb419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.930+0000 7f1eb8c00640 1 -- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1eb4109c40 msgr2=0x7f1eb419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.930+0000 7f1eb8c00640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1eb4109c40 0x7f1eb419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.930+0000 7f1eb8c00640 1 -- 172.21.15.79:0/2877607342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb41a0270 con 0x7f1eb41039b0 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.930+0000 7f1eb8c00640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 0x7f1eb419a300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8005ab0 tx=0x7f1ea8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.930+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea803f070 con 0x7f1eb41039b0 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.931+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ea8031b60 con 0x7f1eb41039b0 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.931+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8035030 con 0x7f1eb41039b0 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.931+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb41a0500 con 0x7f1eb41039b0 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.931+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb41a6cc0 con 0x7f1eb41039b0 2024-09-21T02:34:11.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.932+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1eb4063b50 con 0x7f1eb41039b0 2024-09-21T02:34:11.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.934+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f1ea8042070 con 0x7f1eb41039b0 2024-09-21T02:34:11.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.936+0000 7f1eb1600640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1e9c0b66f0 0x7f1e9c0b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:11.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.936+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f1ea8108620 con 0x7f1eb41039b0 2024-09-21T02:34:11.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.936+0000 7f1eb3e00640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1e9c0b66f0 0x7f1e9c0b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.936+0000 7f1eb1600640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] conn(0x7f1e9c0c1800 0x7f1e9c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.936+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 --> [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e9c0c43c0 con 0x7f1e9c0c1800 2024-09-21T02:34:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.936+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f1ea81089d0 con 0x7f1eb41039b0 2024-09-21T02:34:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.937+0000 7f1eb9600640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] conn(0x7f1e9c0c1800 0x7f1e9c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.937+0000 7f1eb3e00640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1e9c0b66f0 0x7f1e9c0b8c00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00095f0 tx=0x7f1ea0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.937+0000 7f1eb9600640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] conn(0x7f1e9c0c1800 0x7f1e9c0c3cf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:11.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.938+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== osd.4 v2:172.21.15.98:6808/1179399736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e9c0c43c0 con 0x7f1e9c0c1800 2024-09-21T02:34:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.953+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 --> [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1eb4064020 con 0x7f1e9c0c1800 2024-09-21T02:34:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.953+0000 7f1eb1600640 1 -- 172.21.15.79:0/2877607342 <== osd.4 v2:172.21.15.98:6808/1179399736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1eb4064020 con 0x7f1e9c0c1800 2024-09-21T02:34:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] conn(0x7f1e9c0c1800 msgr2=0x7f1e9c0c3cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] conn(0x7f1e9c0c1800 0x7f1e9c0c3cf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1e9c0b66f0 msgr2=0x7f1e9c0b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1e9c0b66f0 0x7f1e9c0b8c00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00095f0 tx=0x7f1ea0005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 msgr2=0x7f1eb419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 --2- 172.21.15.79:0/2877607342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1eb41039b0 0x7f1eb419a300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8005ab0 tx=0x7f1ea8003c10 comp rx=0 tx=0).stop 2024-09-21T02:34:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eb9600640 1 -- 172.21.15.79:0/2877607342 reap_dead start 2024-09-21T02:34:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 shutdown_connections 2024-09-21T02:34:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 >> 172.21.15.79:0/2877607342 conn(0x7f1eb40ff440 msgr2=0x7f1eb4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 shutdown_connections 2024-09-21T02:34:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.954+0000 7f1eba000640 1 -- 172.21.15.79:0/2877607342 wait complete. 2024-09-21T02:34:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.650+0000 7fce3b200640 1 -- 172.21.15.79:0/174486780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341049d0 msgr2=0x7fce34104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.650+0000 7fce3b200640 1 --2- 172.21.15.79:0/174486780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341049d0 0x7fce34104de0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fce24009900 tx=0x7fce2402a410 comp rx=0 tx=0).stop 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.651+0000 7fce3b200640 1 -- 172.21.15.79:0/174486780 shutdown_connections 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.651+0000 7fce3b200640 1 --2- 172.21.15.79:0/174486780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce3410de30 0x7fce34110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.651+0000 7fce3b200640 1 --2- 172.21.15.79:0/174486780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce34105320 0x7fce3410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.651+0000 7fce3b200640 1 --2- 172.21.15.79:0/174486780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce341049d0 0x7fce34104de0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.651+0000 7fce3b200640 1 -- 172.21.15.79:0/174486780 >> 172.21.15.79:0/174486780 conn(0x7fce34079740 msgr2=0x7fce34079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.651+0000 7fce3b200640 1 -- 172.21.15.79:0/174486780 shutdown_connections 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.651+0000 7fce3b200640 1 -- 172.21.15.79:0/174486780 wait complete. 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.652+0000 7fce3b200640 1 Processor -- start 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.652+0000 7fce3b200640 1 -- start start 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce3b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce341049d0 0x7fce3419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce3b200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce34105320 0x7fce3419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce3b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3410de30 0x7fce341a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:12.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce3b200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce34113ae0 con 0x7fce34105320 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce3b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce34113960 con 0x7fce341049d0 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce3b200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce34113c60 con 0x7fce3410de30 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce33400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce34105320 0x7fce3419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce33e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce341049d0 0x7fce3419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce33400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce34105320 0x7fce3419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34146/0 (socket says 172.21.15.79:34146) 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce33400640 1 -- 172.21.15.79:0/2382554169 learned_addr learned my addr 172.21.15.79:0/2382554169 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce33e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce341049d0 0x7fce3419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58632/0 (socket says 172.21.15.79:58632) 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce39200640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3410de30 0x7fce341a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce39200640 1 -- 172.21.15.79:0/2382554169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce341049d0 msgr2=0x7fce3419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce39200640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce341049d0 0x7fce3419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce39200640 1 -- 172.21.15.79:0/2382554169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce34105320 msgr2=0x7fce3419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.653+0000 7fce39200640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce34105320 0x7fce3419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:12.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.654+0000 7fce39200640 1 -- 172.21.15.79:0/2382554169 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce341a2680 con 0x7fce3410de30 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.654+0000 7fce39200640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3410de30 0x7fce341a1f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009fd0 tx=0x7fce2c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.654+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00ce20 con 0x7fce3410de30 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.654+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce2c005020 con 0x7fce3410de30 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.654+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c010690 con 0x7fce3410de30 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.654+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce341a2970 con 0x7fce3410de30 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.654+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce341a90d0 con 0x7fce3410de30 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.655+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce34100fc0 con 0x7fce3410de30 2024-09-21T02:34:12.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.658+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fce2c0054d0 con 0x7fce3410de30 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.659+0000 7fce30c00640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce180b65a0 0x7fce180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.660+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fce2c0e8090 con 0x7fce3410de30 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.660+0000 7fce33e00640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce180b65a0 0x7fce180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.660+0000 7fce30c00640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] conn(0x7fce180c16b0 0x7fce180c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.660+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 --> [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce2c016e50 con 0x7fce180c16b0 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.660+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fce2c0e8440 con 0x7fce3410de30 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.660+0000 7fce33400640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] conn(0x7fce180c16b0 0x7fce180c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.661+0000 7fce33e00640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce180b65a0 0x7fce180b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fce2402aa00 tx=0x7fce24031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.661+0000 7fce33400640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] conn(0x7fce180c16b0 0x7fce180c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.662+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== osd.1 v2:172.21.15.98:6800/1838130596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce2c016e50 con 0x7fce180c16b0 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.676+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 --> [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce3406b390 con 0x7fce180c16b0 2024-09-21T02:34:12.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce30c00640 1 -- 172.21.15.79:0/2382554169 <== osd.1 v2:172.21.15.98:6800/1838130596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce3406b390 con 0x7fce180c16b0 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 >> [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] conn(0x7fce180c16b0 msgr2=0x7fce180c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] conn(0x7fce180c16b0 0x7fce180c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce180b65a0 msgr2=0x7fce180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce180b65a0 0x7fce180b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fce2402aa00 tx=0x7fce24031400 comp rx=0 tx=0).stop 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3410de30 msgr2=0x7fce341a1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 --2- 172.21.15.79:0/2382554169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3410de30 0x7fce341a1f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009fd0 tx=0x7fce2c00ef10 comp rx=0 tx=0).stop 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce39200640 1 -- 172.21.15.79:0/2382554169 reap_dead start 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 shutdown_connections 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 >> 172.21.15.79:0/2382554169 conn(0x7fce34079740 msgr2=0x7fce341005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:12.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 shutdown_connections 2024-09-21T02:34:12.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:11.677+0000 7fce3b200640 1 -- 172.21.15.79:0/2382554169 wait complete. 2024-09-21T02:34:12.870 INFO:teuthology.orchestra.run.smithi079.stdout:107374182476 2024-09-21T02:34:12.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T02:34:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:13.791 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:13 smithi079 ceph-mon[30788]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:13.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:13 smithi148 ceph-mon[34626]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:13 smithi098 ceph-mon[34832]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.196+0000 7f88af200640 1 -- 172.21.15.79:0/2966056836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 msgr2=0x7f88a8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.196+0000 7f88af200640 1 --2- 172.21.15.79:0/2966056836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 0x7f88a8103dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f889c009900 tx=0x7f889c02a410 comp rx=0 tx=0).stop 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.196+0000 7f88af200640 1 -- 172.21.15.79:0/2966056836 shutdown_connections 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.196+0000 7f88af200640 1 --2- 172.21.15.79:0/2966056836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a8109c40 0x7f88a8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.196+0000 7f88af200640 1 --2- 172.21.15.79:0/2966056836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a81092f0 0x7f88a8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.196+0000 7f88af200640 1 --2- 172.21.15.79:0/2966056836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 0x7f88a8103dc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.196+0000 7f88af200640 1 -- 172.21.15.79:0/2966056836 >> 172.21.15.79:0/2966056836 conn(0x7f88a80ff440 msgr2=0x7f88a8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.197+0000 7f88af200640 1 -- 172.21.15.79:0/2966056836 shutdown_connections 2024-09-21T02:34:14.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.197+0000 7f88af200640 1 -- 172.21.15.79:0/2966056836 wait complete. 2024-09-21T02:34:14.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 Processor -- start 2024-09-21T02:34:14.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 -- start start 2024-09-21T02:34:14.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 0x7f88a819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a81092f0 0x7f88a819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a8109c40 0x7f88a819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88a8113950 con 0x7f88a81039b0 2024-09-21T02:34:14.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81137d0 con 0x7f88a8109c40 2024-09-21T02:34:14.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.198+0000 7f88af200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f88a8113ad0 con 0x7f88a81092f0 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 0x7f88a819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 0x7f88a819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51418/0 (socket says 172.21.15.79:51418) 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 -- 172.21.15.79:0/2708109099 learned_addr learned my addr 172.21.15.79:0/2708109099 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ad400640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a81092f0 0x7f88a819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ae800640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a8109c40 0x7f88a819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 -- 172.21.15.79:0/2708109099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a81092f0 msgr2=0x7f88a819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a81092f0 0x7f88a819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 -- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a8109c40 msgr2=0x7f88a819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a8109c40 0x7f88a819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 -- 172.21.15.79:0/2708109099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a81a0290 con 0x7f88a81039b0 2024-09-21T02:34:14.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.199+0000 7f88ade00640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 0x7f88a819a320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f889c005ab0 tx=0x7f889c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:14.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.200+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c03f070 con 0x7f88a81039b0 2024-09-21T02:34:14.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.200+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889c031d60 con 0x7f88a81039b0 2024-09-21T02:34:14.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.200+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a81a0520 con 0x7f88a81039b0 2024-09-21T02:34:14.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.200+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c035030 con 0x7f88a81039b0 2024-09-21T02:34:14.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.200+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a81a6ce0 con 0x7f88a81039b0 2024-09-21T02:34:14.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.201+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88a8063b50 con 0x7f88a81039b0 2024-09-21T02:34:14.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.203+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f889c042070 con 0x7f88a81039b0 2024-09-21T02:34:14.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.205+0000 7f88a2a00640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88900b65a0 0x7f88900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.205+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f889c108650 con 0x7f88a81039b0 2024-09-21T02:34:14.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.205+0000 7f88ad400640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88900b65a0 0x7f88900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.205+0000 7f88a2a00640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] conn(0x7f88900c16b0 0x7f88900c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.205+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 --> [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88900c4270 con 0x7f88900c16b0 2024-09-21T02:34:14.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.205+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f889c108a00 con 0x7f88a81039b0 2024-09-21T02:34:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.206+0000 7f88ae800640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] conn(0x7f88900c16b0 0x7f88900c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.206+0000 7f88ad400640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88900b65a0 0x7f88900b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88a8102b40 tx=0x7f8898005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:14.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.206+0000 7f88ae800640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] conn(0x7f88900c16b0 0x7f88900c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:14.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.207+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== osd.7 v2:172.21.15.98:6816/3242795120 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88900c4270 con 0x7f88900c16b0 2024-09-21T02:34:14.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.222+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 --> [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88a8063fd0 con 0x7f88900c16b0 2024-09-21T02:34:14.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.222+0000 7f88a2a00640 1 -- 172.21.15.79:0/2708109099 <== osd.7 v2:172.21.15.98:6816/3242795120 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f88a8063fd0 con 0x7f88900c16b0 2024-09-21T02:34:14.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] conn(0x7f88900c16b0 msgr2=0x7f88900c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] conn(0x7f88900c16b0 0x7f88900c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88900b65a0 msgr2=0x7f88900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88900b65a0 0x7f88900b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88a8102b40 tx=0x7f8898005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 msgr2=0x7f88a819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 --2- 172.21.15.79:0/2708109099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88a81039b0 0x7f88a819a320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f889c005ab0 tx=0x7f889c003c80 comp rx=0 tx=0).stop 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88ae800640 1 -- 172.21.15.79:0/2708109099 reap_dead start 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 shutdown_connections 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 >> 172.21.15.79:0/2708109099 conn(0x7f88a80ff440 msgr2=0x7f88a81089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 shutdown_connections 2024-09-21T02:34:14.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.223+0000 7f88af200640 1 -- 172.21.15.79:0/2708109099 wait complete. 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.426+0000 7f6589a00640 1 -- 172.21.15.79:0/403594432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6584109c40 msgr2=0x7f6584110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.426+0000 7f6589a00640 1 --2- 172.21.15.79:0/403594432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6584109c40 0x7f6584110470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f657c009be0 tx=0x7f657c02a6c0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.426+0000 7f6589a00640 1 -- 172.21.15.79:0/403594432 shutdown_connections 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.426+0000 7f6589a00640 1 --2- 172.21.15.79:0/403594432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6584109c40 0x7f6584110470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.426+0000 7f6589a00640 1 --2- 172.21.15.79:0/403594432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65841092f0 0x7f6584109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.426+0000 7f6589a00640 1 --2- 172.21.15.79:0/403594432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65841039b0 0x7f6584103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.426+0000 7f6589a00640 1 -- 172.21.15.79:0/403594432 >> 172.21.15.79:0/403594432 conn(0x7f65840ff440 msgr2=0x7f6584101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.427+0000 7f6589a00640 1 -- 172.21.15.79:0/403594432 shutdown_connections 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.427+0000 7f6589a00640 1 -- 172.21.15.79:0/403594432 wait complete. 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.428+0000 7f6589a00640 1 Processor -- start 2024-09-21T02:34:14.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.428+0000 7f6589a00640 1 -- start start 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.428+0000 7f6589a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65841039b0 0x7f65841a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.428+0000 7f6589a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65841092f0 0x7f65841a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.428+0000 7f6589a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6584109c40 0x7f65841a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6589a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6584113900 con 0x7f6584109c40 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6589a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6584113780 con 0x7f65841039b0 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6589a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6584113a80 con 0x7f65841092f0 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65841039b0 0x7f65841a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65841039b0 0x7f65841a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47726/0 (socket says 172.21.15.79:47726) 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 -- 172.21.15.79:0/582887645 learned_addr learned my addr 172.21.15.79:0/582887645 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583400640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65841092f0 0x7f65841a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6589000640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6584109c40 0x7f65841a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 -- 172.21.15.79:0/582887645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65841092f0 msgr2=0x7f65841a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65841092f0 0x7f65841a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 -- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6584109c40 msgr2=0x7f65841a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6584109c40 0x7f65841a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6583e00640 1 -- 172.21.15.79:0/582887645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65841ac940 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.429+0000 7f6589000640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6584109c40 0x7f65841a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.430+0000 7f6583e00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65841039b0 0x7f65841a15e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f657400e9f0 tx=0x7f657400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.430+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657400cd80 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.430+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65740054d0 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.430+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65841acc30 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.430+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574010690 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.430+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65841ad170 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.431+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6564001060 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.435+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f65740046c0 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.436+0000 7f6580c00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f65680b6620 0x7f65680b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.436+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f65740e7e60 con 0x7f65841039b0 2024-09-21T02:34:14.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.437+0000 7f6583400640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f65680b6620 0x7f65680b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.437+0000 7f6580c00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] conn(0x7f65680c1730 0x7f65680c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:14.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.437+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 --> [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65680c42f0 con 0x7f65680c1730 2024-09-21T02:34:14.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.437+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f65740e8210 con 0x7f65841039b0 2024-09-21T02:34:14.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.437+0000 7f6589000640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] conn(0x7f65680c1730 0x7f65680c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:14.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.437+0000 7f6583400640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f65680b6620 0x7f65680b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65841089d0 tx=0x7f6570009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:14.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.438+0000 7f6589000640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] conn(0x7f65680c1730 0x7f65680c3c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:14.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.439+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== osd.9 v2:172.21.15.79:6826/89755781 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65680c42f0 con 0x7f65680c1730 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.453+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 --> [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6564002e00 con 0x7f65680c1730 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.453+0000 7f6580c00640 1 -- 172.21.15.79:0/582887645 <== osd.9 v2:172.21.15.79:6826/89755781 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6564002e00 con 0x7f65680c1730 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] conn(0x7f65680c1730 msgr2=0x7f65680c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] conn(0x7f65680c1730 0x7f65680c3c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f65680b6620 msgr2=0x7f65680b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f65680b6620 0x7f65680b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65841089d0 tx=0x7f6570009260 comp rx=0 tx=0).stop 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65841039b0 msgr2=0x7f65841a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 --2- 172.21.15.79:0/582887645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65841039b0 0x7f65841a15e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f657400e9f0 tx=0x7f657400edf0 comp rx=0 tx=0).stop 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589000640 1 -- 172.21.15.79:0/582887645 reap_dead start 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 shutdown_connections 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 >> 172.21.15.79:0/582887645 conn(0x7f65840ff440 msgr2=0x7f65841068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 shutdown_connections 2024-09-21T02:34:14.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:14.454+0000 7f6589a00640 1 -- 172.21.15.79:0/582887645 wait complete. 2024-09-21T02:34:15.268 INFO:teuthology.orchestra.run.smithi079.stdout:55834574935 2024-09-21T02:34:15.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T02:34:15.623 INFO:teuthology.orchestra.run.smithi079.stdout:133143986246 2024-09-21T02:34:15.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T02:34:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:15 smithi148 ceph-mon[34626]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:15.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:15 smithi098 ceph-mon[34832]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:15.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:15 smithi079 ceph-mon[30788]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:16.120 INFO:teuthology.orchestra.run.smithi079.stdout:253403070506 2024-09-21T02:34:16.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 -- 172.21.15.79:0/604893407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790109e00 msgr2=0x7f7790110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 --2- 172.21.15.79:0/604893407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790109e00 0x7f7790110630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7788009ca0 tx=0x7f778802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 -- 172.21.15.79:0/604893407 shutdown_connections 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 --2- 172.21.15.79:0/604893407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790109e00 0x7f7790110630 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 --2- 172.21.15.79:0/604893407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77901094b0 0x7f77901098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 --2- 172.21.15.79:0/604893407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7790103b70 0x7f7790103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 -- 172.21.15.79:0/604893407 >> 172.21.15.79:0/604893407 conn(0x7f77900ff5e0 msgr2=0x7f7790101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 -- 172.21.15.79:0/604893407 shutdown_connections 2024-09-21T02:34:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.440+0000 7f7796c00640 1 -- 172.21.15.79:0/604893407 wait complete. 2024-09-21T02:34:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 Processor -- start 2024-09-21T02:34:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 -- start start 2024-09-21T02:34:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7790103b70 0x7f779019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:16.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77901094b0 0x7f779019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:16.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790109e00 0x7f77901a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:16.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7790113ac0 con 0x7f7790109e00 2024-09-21T02:34:16.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7790113940 con 0x7f77901094b0 2024-09-21T02:34:16.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.442+0000 7f7796c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7790113c40 con 0x7f7790103b70 2024-09-21T02:34:16.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77901094b0 0x7f779019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:16.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77901094b0 0x7f779019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47742/0 (socket says 172.21.15.79:47742) 2024-09-21T02:34:16.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778f400640 1 -- 172.21.15.79:0/2386738789 learned_addr learned my addr 172.21.15.79:0/2386738789 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:16.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778fe00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7790103b70 0x7f779019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:16.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f7794c00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790109e00 0x7f77901a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:16.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778fe00640 1 -- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77901094b0 msgr2=0x7f779019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778fe00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77901094b0 0x7f779019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778fe00640 1 -- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790109e00 msgr2=0x7f77901a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778fe00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7790109e00 0x7f77901a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778fe00640 1 -- 172.21.15.79:0/2386738789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77901a25a0 con 0x7f7790103b70 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.443+0000 7f778f400640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77901094b0 0x7f779019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.444+0000 7f778fe00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7790103b70 0x7f779019c630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9f0 tx=0x7f778000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.444+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778000cd80 con 0x7f7790103b70 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.444+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77901a2890 con 0x7f7790103b70 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.444+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77800035f0 con 0x7f7790103b70 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.444+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780010670 con 0x7f7790103b70 2024-09-21T02:34:16.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.444+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77901a8ff0 con 0x7f7790103b70 2024-09-21T02:34:16.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.445+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f779010fc50 con 0x7f7790103b70 2024-09-21T02:34:16.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.448+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f77800037a0 con 0x7f7790103b70 2024-09-21T02:34:16.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.449+0000 7f778cc00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f77740b6620 0x7f77740b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.450+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f77800e7fe0 con 0x7f7790103b70 2024-09-21T02:34:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.450+0000 7f778f400640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f77740b6620 0x7f77740b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.450+0000 7f778cc00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] conn(0x7f77740c1730 0x7f77740c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.450+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 --> [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7780020e50 con 0x7f77740c1730 2024-09-21T02:34:16.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.450+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f77800e8410 con 0x7f7790103b70 2024-09-21T02:34:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.450+0000 7f7794c00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] conn(0x7f77740c1730 0x7f77740c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.451+0000 7f778f400640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f77740b6620 0x7f77740b8b30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7790109db0 tx=0x7f777c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:16.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.451+0000 7f7794c00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] conn(0x7f77740c1730 0x7f77740c3c20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:16.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.452+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== osd.10 v2:172.21.15.98:6824/3998530479 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7780020e50 con 0x7f77740c1730 2024-09-21T02:34:16.464 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:16.464 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:16.472 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.478+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 --> [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7790104df0 con 0x7f77740c1730 2024-09-21T02:34:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.480+0000 7f778cc00640 1 -- 172.21.15.79:0/2386738789 <== osd.10 v2:172.21.15.98:6824/3998530479 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7790104df0 con 0x7f77740c1730 2024-09-21T02:34:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.482+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] conn(0x7f77740c1730 msgr2=0x7f77740c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.482+0000 7f7796c00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] conn(0x7f77740c1730 0x7f77740c3c20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.482+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f77740b6620 msgr2=0x7f77740b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.482+0000 7f7796c00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f77740b6620 0x7f77740b8b30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7790109db0 tx=0x7f777c005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.482+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7790103b70 msgr2=0x7f779019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.482+0000 7f7796c00640 1 --2- 172.21.15.79:0/2386738789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7790103b70 0x7f779019c630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9f0 tx=0x7f778000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.483+0000 7f7794c00640 1 -- 172.21.15.79:0/2386738789 reap_dead start 2024-09-21T02:34:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.483+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 shutdown_connections 2024-09-21T02:34:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.483+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 >> 172.21.15.79:0/2386738789 conn(0x7f77900ff5e0 msgr2=0x7f7790108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.483+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 shutdown_connections 2024-09-21T02:34:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:16.484+0000 7f7796c00640 1 -- 172.21.15.79:0/2386738789 wait complete. 2024-09-21T02:34:17.338 INFO:teuthology.orchestra.run.smithi079.stdout:201863462966 2024-09-21T02:34:17.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T02:34:17.643 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:17 smithi079 ceph-mon[30788]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T02:34:17.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:17 smithi148 ceph-mon[34626]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T02:34:17.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:17 smithi098 ceph-mon[34832]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T02:34:17.924 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:18.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 -- 172.21.15.79:0/2231123602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341039b0 msgr2=0x7fc734103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:18.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 --2- 172.21.15.79:0/2231123602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341039b0 0x7fc734103dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc728009900 tx=0x7fc72802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 -- 172.21.15.79:0/2231123602 shutdown_connections 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 --2- 172.21.15.79:0/2231123602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc734109c40 0x7fc734110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 --2- 172.21.15.79:0/2231123602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7341092f0 0x7fc734109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 --2- 172.21.15.79:0/2231123602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341039b0 0x7fc734103dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 -- 172.21.15.79:0/2231123602 >> 172.21.15.79:0/2231123602 conn(0x7fc7340ff400 msgr2=0x7fc734101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 -- 172.21.15.79:0/2231123602 shutdown_connections 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.298+0000 7fc73a600640 1 -- 172.21.15.79:0/2231123602 wait complete. 2024-09-21T02:34:18.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.299+0000 7fc73a600640 1 Processor -- start 2024-09-21T02:34:18.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.299+0000 7fc73a600640 1 -- start start 2024-09-21T02:34:18.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc73a600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7341039b0 0x7fc73419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:18.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc73a600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341092f0 0x7fc73419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:18.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc73a600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc734109c40 0x7fc7341a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc73a600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc734113900 con 0x7fc7341039b0 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc73a600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc734113780 con 0x7fc7341092f0 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc73a600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc734113a80 con 0x7fc734109c40 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc733e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341092f0 0x7fc73419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc739200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7341039b0 0x7fc73419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc733e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341092f0 0x7fc73419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47754/0 (socket says 172.21.15.79:47754) 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc733e00640 1 -- 172.21.15.79:0/3987696380 learned_addr learned my addr 172.21.15.79:0/3987696380 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:18.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.300+0000 7fc739c00640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc734109c40 0x7fc7341a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc733e00640 1 -- 172.21.15.79:0/3987696380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc734109c40 msgr2=0x7fc7341a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc733e00640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc734109c40 0x7fc7341a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc733e00640 1 -- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7341039b0 msgr2=0x7fc73419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc733e00640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7341039b0 0x7fc73419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc733e00640 1 -- 172.21.15.79:0/3987696380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7341a2440 con 0x7fc7341092f0 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc733e00640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341092f0 0x7fc73419ca70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc72000e9f0 tx=0x7fc72000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72000ccc0 con 0x7fc7341092f0 2024-09-21T02:34:18.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7341a2730 con 0x7fc7341092f0 2024-09-21T02:34:18.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7200108e0 con 0x7fc7341092f0 2024-09-21T02:34:18.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720018860 con 0x7fc7341092f0 2024-09-21T02:34:18.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.301+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7341a8e90 con 0x7fc7341092f0 2024-09-21T02:34:18.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.302+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc73410fa70 con 0x7fc7341092f0 2024-09-21T02:34:18.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.305+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc720010430 con 0x7fc7341092f0 2024-09-21T02:34:18.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.306+0000 7fc731600640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc71c0b6620 0x7fc71c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:18.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.306+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fc7200e81c0 con 0x7fc7341092f0 2024-09-21T02:34:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.307+0000 7fc739200640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc71c0b6620 0x7fc71c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.307+0000 7fc731600640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] conn(0x7fc71c0c1730 0x7fc71c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.307+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 --> [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc71c0c42f0 con 0x7fc71c0c1730 2024-09-21T02:34:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.307+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc7200e8570 con 0x7fc7341092f0 2024-09-21T02:34:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.307+0000 7fc739c00640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] conn(0x7fc71c0c1730 0x7fc71c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:18.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.307+0000 7fc739200640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc71c0b6620 0x7fc71c0b8b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc728031440 tx=0x7fc728009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:18.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.308+0000 7fc739c00640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] conn(0x7fc71c0c1730 0x7fc71c0c3c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:18.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.309+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== osd.6 v2:172.21.15.79:6818/1578312751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc71c0c42f0 con 0x7fc71c0c1730 2024-09-21T02:34:18.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.323+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 --> [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc734104c30 con 0x7fc71c0c1730 2024-09-21T02:34:18.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.323+0000 7fc731600640 1 -- 172.21.15.79:0/3987696380 <== osd.6 v2:172.21.15.79:6818/1578312751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc734104c30 con 0x7fc71c0c1730 2024-09-21T02:34:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] conn(0x7fc71c0c1730 msgr2=0x7fc71c0c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] conn(0x7fc71c0c1730 0x7fc71c0c3c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc71c0b6620 msgr2=0x7fc71c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc71c0b6620 0x7fc71c0b8b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc728031440 tx=0x7fc728009560 comp rx=0 tx=0).stop 2024-09-21T02:34:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341092f0 msgr2=0x7fc73419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 --2- 172.21.15.79:0/3987696380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7341092f0 0x7fc73419ca70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc72000e9f0 tx=0x7fc72000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:18.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc739c00640 1 -- 172.21.15.79:0/3987696380 reap_dead start 2024-09-21T02:34:18.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 shutdown_connections 2024-09-21T02:34:18.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 >> 172.21.15.79:0/3987696380 conn(0x7fc7340ff400 msgr2=0x7fc7341089b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:18.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 shutdown_connections 2024-09-21T02:34:18.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:18.324+0000 7fc73a600640 1 -- 172.21.15.79:0/3987696380 wait complete. 2024-09-21T02:34:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 -- 172.21.15.79:0/2265254584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824077380 msgr2=0x7f18240757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 --2- 172.21.15.79:0/2265254584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824077380 0x7f18240757b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1814009900 tx=0x7f181402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 -- 172.21.15.79:0/2265254584 shutdown_connections 2024-09-21T02:34:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 --2- 172.21.15.79:0/2265254584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824114280 0x7f1824116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 --2- 172.21.15.79:0/2265254584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1824075dd0 0x7f18240761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 --2- 172.21.15.79:0/2265254584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824077380 0x7f18240757b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 -- 172.21.15.79:0/2265254584 >> 172.21.15.79:0/2265254584 conn(0x7f18240ff440 msgr2=0x7f1824101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 -- 172.21.15.79:0/2265254584 shutdown_connections 2024-09-21T02:34:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.036+0000 7f1829a00640 1 -- 172.21.15.79:0/2265254584 wait complete. 2024-09-21T02:34:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 Processor -- start 2024-09-21T02:34:19.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 -- start start 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824075dd0 0x7f18241a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1824077380 0x7f18241a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824114280 0x7f18241a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1824119ec0 con 0x7f1824114280 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1824119d40 con 0x7f1824075dd0 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.037+0000 7f1829a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f182411a040 con 0x7f1824077380 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824075dd0 0x7f18241a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:19.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824075dd0 0x7f18241a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47772/0 (socket says 172.21.15.79:47772) 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823e00640 1 -- 172.21.15.79:0/2713268347 learned_addr learned my addr 172.21.15.79:0/2713268347 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1829000640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824114280 0x7f18241a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823400640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1824077380 0x7f18241a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823e00640 1 -- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1824077380 msgr2=0x7f18241a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823e00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1824077380 0x7f18241a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823e00640 1 -- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824114280 msgr2=0x7f18241a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.038+0000 7f1823e00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824114280 0x7f18241a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1823e00640 1 -- 172.21.15.79:0/2713268347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18241a6880 con 0x7f1824075dd0 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1823400640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1824077380 0x7f18241a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1829000640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824114280 0x7f18241a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:19.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1823e00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824075dd0 0x7f18241a0910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1814005940 tx=0x7f18140040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:19.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181403f030 con 0x7f1824075dd0 2024-09-21T02:34:19.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18140044c0 con 0x7f1824075dd0 2024-09-21T02:34:19.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814035070 con 0x7f1824075dd0 2024-09-21T02:34:19.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18241a6b10 con 0x7f1824075dd0 2024-09-21T02:34:19.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.039+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18241ad2d0 con 0x7f1824075dd0 2024-09-21T02:34:19.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.040+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1824063b50 con 0x7f1824075dd0 2024-09-21T02:34:19.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.045+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f1814042030 con 0x7f1824075dd0 2024-09-21T02:34:19.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.047+0000 7f1820c00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f18080b6620 0x7f18080b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:19.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.047+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f1814108280 con 0x7f1824075dd0 2024-09-21T02:34:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.047+0000 7f1820c00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] conn(0x7f18080c1730 0x7f18080c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.047+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 --> [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1814003b20 con 0x7f18080c1730 2024-09-21T02:34:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.047+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f1814108630 con 0x7f1824075dd0 2024-09-21T02:34:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.047+0000 7f1823400640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f18080b6620 0x7f18080b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:19.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.048+0000 7f1829000640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] conn(0x7f18080c1730 0x7f18080c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:19.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.049+0000 7f1823400640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f18080b6620 0x7f18080b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1824116310 tx=0x7f1810005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:19.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.055+0000 7f1829000640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] conn(0x7f18080c1730 0x7f18080c3c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:19.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.056+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== osd.11 v2:172.21.15.148:6824/2210220942 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1814003b20 con 0x7f18080c1730 2024-09-21T02:34:19.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.071+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 --> [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1824063fa0 con 0x7f18080c1730 2024-09-21T02:34:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.072+0000 7f1820c00640 1 -- 172.21.15.79:0/2713268347 <== osd.11 v2:172.21.15.148:6824/2210220942 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1824063fa0 con 0x7f18080c1730 2024-09-21T02:34:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.072+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] conn(0x7f18080c1730 msgr2=0x7f18080c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.072+0000 7f1829a00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] conn(0x7f18080c1730 0x7f18080c3c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f18080b6620 msgr2=0x7f18080b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f18080b6620 0x7f18080b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1824116310 tx=0x7f1810005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824075dd0 msgr2=0x7f18241a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 --2- 172.21.15.79:0/2713268347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1824075dd0 0x7f18241a0910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1814005940 tx=0x7f18140040c0 comp rx=0 tx=0).stop 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829000640 1 -- 172.21.15.79:0/2713268347 reap_dead start 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 shutdown_connections 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 >> 172.21.15.79:0/2713268347 conn(0x7f18240ff440 msgr2=0x7f1824110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 shutdown_connections 2024-09-21T02:34:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:19.073+0000 7f1829a00640 1 -- 172.21.15.79:0/2713268347 wait complete. 2024-09-21T02:34:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:19 smithi079 ceph-mon[30788]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:19.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:19 smithi148 ceph-mon[34626]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:19 smithi098 ceph-mon[34832]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 -- 172.21.15.79:0/3180835975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c10c040 msgr2=0x7f386c112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 --2- 172.21.15.79:0/3180835975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c10c040 0x7f386c112870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3868009ca0 tx=0x7f386802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 -- 172.21.15.79:0/3180835975 shutdown_connections 2024-09-21T02:34:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 --2- 172.21.15.79:0/3180835975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c10c040 0x7f386c112870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 --2- 172.21.15.79:0/3180835975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c10b6f0 0x7f386c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 --2- 172.21.15.79:0/3180835975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f386c105db0 0x7f386c1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 -- 172.21.15.79:0/3180835975 >> 172.21.15.79:0/3180835975 conn(0x7f386c1017e0 msgr2=0x7f386c103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 -- 172.21.15.79:0/3180835975 shutdown_connections 2024-09-21T02:34:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.100+0000 7f3874800640 1 -- 172.21.15.79:0/3180835975 wait complete. 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.101+0000 7f3874800640 1 Processor -- start 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.101+0000 7f3874800640 1 -- start start 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3874800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c105db0 0x7f386c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3874800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f386c10b6f0 0x7f386c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3874800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c10c040 0x7f386c1a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3874800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f386c115d50 con 0x7f386c10c040 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3874800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f386c115bd0 con 0x7f386c10b6f0 2024-09-21T02:34:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3874800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f386c115ed0 con 0x7f386c105db0 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3871400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f386c10b6f0 0x7f386c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3871400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f386c10b6f0 0x7f386c19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47792/0 (socket says 172.21.15.79:47792) 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3871400640 1 -- 172.21.15.79:0/2493127899 learned_addr learned my addr 172.21.15.79:0/2493127899 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3871e00640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c105db0 0x7f386c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.102+0000 7f3872800640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c10c040 0x7f386c1a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3871400640 1 -- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c105db0 msgr2=0x7f386c19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3871400640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c105db0 0x7f386c19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:20.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3871400640 1 -- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c10c040 msgr2=0x7f386c1a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:20.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3871400640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f386c10c040 0x7f386c1a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:20.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3871400640 1 -- 172.21.15.79:0/2493127899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c1a2610 con 0x7f386c10b6f0 2024-09-21T02:34:20.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3871400640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f386c10b6f0 0x7f386c19cc40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e9c0 tx=0x7f385c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:20.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c00ccc0 con 0x7f386c10b6f0 2024-09-21T02:34:20.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f385c0054d0 con 0x7f386c10b6f0 2024-09-21T02:34:20.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c1a2900 con 0x7f386c10b6f0 2024-09-21T02:34:20.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c010430 con 0x7f386c10b6f0 2024-09-21T02:34:20.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.103+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c1a9060 con 0x7f386c10b6f0 2024-09-21T02:34:20.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.104+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f386c063b50 con 0x7f386c10b6f0 2024-09-21T02:34:20.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.107+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f385c005000 con 0x7f386c10b6f0 2024-09-21T02:34:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.108+0000 7f3866a00640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38540b6620 0x7f38540b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.109+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f385c0e7ee0 con 0x7f386c10b6f0 2024-09-21T02:34:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.109+0000 7f3871e00640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38540b6620 0x7f38540b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.109+0000 7f3866a00640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] conn(0x7f38540c1730 0x7f38540c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.109+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 --> [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38540c42f0 con 0x7f38540c1730 2024-09-21T02:34:20.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.109+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f385c0e8290 con 0x7f386c10b6f0 2024-09-21T02:34:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.109+0000 7f3872800640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] conn(0x7f38540c1730 0x7f38540c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.109+0000 7f3871e00640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38540b6620 0x7f38540b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3860009bd0 tx=0x7f3860005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:20.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.110+0000 7f3872800640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] conn(0x7f38540c1730 0x7f38540c3c20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:20.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.111+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== osd.8 v2:172.21.15.148:6816/2813432297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38540c42f0 con 0x7f38540c1730 2024-09-21T02:34:20.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.125+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 --> [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f386c063fd0 con 0x7f38540c1730 2024-09-21T02:34:20.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.126+0000 7f3866a00640 1 -- 172.21.15.79:0/2493127899 <== osd.8 v2:172.21.15.148:6816/2813432297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f386c063fd0 con 0x7f38540c1730 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.126+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] conn(0x7f38540c1730 msgr2=0x7f38540c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.126+0000 7f3874800640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] conn(0x7f38540c1730 0x7f38540c3c20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.126+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38540b6620 msgr2=0x7f38540b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.126+0000 7f3874800640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38540b6620 0x7f38540b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3860009bd0 tx=0x7f3860005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.126+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f386c10b6f0 msgr2=0x7f386c19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.127+0000 7f3874800640 1 --2- 172.21.15.79:0/2493127899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f386c10b6f0 0x7f386c19cc40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e9c0 tx=0x7f385c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.127+0000 7f3872800640 1 -- 172.21.15.79:0/2493127899 reap_dead start 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.127+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 shutdown_connections 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.127+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 >> 172.21.15.79:0/2493127899 conn(0x7f386c1017e0 msgr2=0x7f386c108c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.127+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 shutdown_connections 2024-09-21T02:34:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:20.127+0000 7f3874800640 1 -- 172.21.15.79:0/2493127899 wait complete. 2024-09-21T02:34:20.217 INFO:teuthology.orchestra.run.smithi079.stdout:274877906981 2024-09-21T02:34:20.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T02:34:20.962 INFO:teuthology.orchestra.run.smithi079.stdout:300647710753 2024-09-21T02:34:20.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T02:34:21.345 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:21.346 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:21.347 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:21.715 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:21 smithi079 ceph-mon[30788]: pgmap v372: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:21.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:21 smithi148 ceph-mon[34626]: pgmap v372: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.639+0000 7f9906400640 1 -- 172.21.15.79:0/2424764513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9900105db0 msgr2=0x7f99001061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.639+0000 7f9906400640 1 --2- 172.21.15.79:0/2424764513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9900105db0 0x7f99001061c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009900 tx=0x7f98f002a410 comp rx=0 tx=0).stop 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.639+0000 7f9906400640 1 -- 172.21.15.79:0/2424764513 shutdown_connections 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.639+0000 7f9906400640 1 --2- 172.21.15.79:0/2424764513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990010c040 0x7f9900112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.639+0000 7f9906400640 1 --2- 172.21.15.79:0/2424764513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f990010b6f0 0x7f990010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.639+0000 7f9906400640 1 --2- 172.21.15.79:0/2424764513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9900105db0 0x7f99001061c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.639+0000 7f9906400640 1 -- 172.21.15.79:0/2424764513 >> 172.21.15.79:0/2424764513 conn(0x7f99001017c0 msgr2=0x7f9900103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.640+0000 7f9906400640 1 -- 172.21.15.79:0/2424764513 shutdown_connections 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.640+0000 7f9906400640 1 -- 172.21.15.79:0/2424764513 wait complete. 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 Processor -- start 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 -- start start 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9900105db0 0x7f990019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990010b6f0 0x7f990019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990010c040 0x7f99001a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9900115d00 con 0x7f990010c040 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9900115b80 con 0x7f9900105db0 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f9906400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9900115e80 con 0x7f990010b6f0 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f98ffe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990010c040 0x7f99001a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f98ffe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990010c040 0x7f99001a1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51506/0 (socket says 172.21.15.79:51506) 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.641+0000 7f98ffe00640 1 -- 172.21.15.79:0/1200048020 learned_addr learned my addr 172.21.15.79:0/1200048020 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98ff400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9900105db0 0x7f990019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98fea00640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990010b6f0 0x7f990019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98ffe00640 1 -- 172.21.15.79:0/1200048020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990010b6f0 msgr2=0x7f990019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98ffe00640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990010b6f0 0x7f990019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98ffe00640 1 -- 172.21.15.79:0/1200048020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9900105db0 msgr2=0x7f990019c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98ffe00640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9900105db0 0x7f990019c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98ffe00640 1 -- 172.21.15.79:0/1200048020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99001a2680 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.642+0000 7f98ffe00640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990010c040 0x7f99001a1f50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009fd0 tx=0x7f98f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.643+0000 7f98f7e00640 1 -- 172.21.15.79:0/1200048020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8017070 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.643+0000 7f98f7e00640 1 -- 172.21.15.79:0/1200048020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98f8003e20 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.643+0000 7f98f7e00640 1 -- 172.21.15.79:0/1200048020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8010460 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.643+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99001a2970 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.643+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99001a90d0 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.644+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99001061c0 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.646+0000 7f98f7e00640 1 -- 172.21.15.79:0/1200048020 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f98f8003970 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.648+0000 7f98f7e00640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e40b65a0 0x7f98e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.648+0000 7f98f7e00640 1 -- 172.21.15.79:0/1200048020 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f98f80e7550 con 0x7f990010c040 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.648+0000 7f98ff400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e40b65a0 0x7f98e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.649+0000 7f98ff400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e40b65a0 0x7f98e40b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98f0031440 tx=0x7f98f0009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.650+0000 7f98f7e00640 1 -- 172.21.15.79:0/1200048020 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98f80b1ca0 con 0x7f990010c040 2024-09-21T02:34:21.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.865+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f990019d840 con 0x7f990010c040 2024-09-21T02:34:21.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.866+0000 7f98f7e00640 1 -- 172.21.15.79:0/1200048020 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f990019d840 con 0x7f990010c040 2024-09-21T02:34:21.867 INFO:teuthology.orchestra.run.smithi079.stdout:154618822724 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e40b65a0 msgr2=0x7f98e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e40b65a0 0x7f98e40b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98f0031440 tx=0x7f98f0009560 comp rx=0 tx=0).stop 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990010c040 msgr2=0x7f99001a1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990010c040 0x7f99001a1f50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009fd0 tx=0x7f98f800b260 comp rx=0 tx=0).stop 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 shutdown_connections 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e40b65a0 0x7f98e40b8ab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f990010c040 0x7f99001a1f50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990010b6f0 0x7f990019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.868+0000 7f9906400640 1 --2- 172.21.15.79:0/1200048020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9900105db0 0x7f990019c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.869+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 >> 172.21.15.79:0/1200048020 conn(0x7f99001017c0 msgr2=0x7f9900109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:21.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.869+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 shutdown_connections 2024-09-21T02:34:21.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:21.869+0000 7f9906400640 1 -- 172.21.15.79:0/1200048020 wait complete. 2024-09-21T02:34:21.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:21 smithi098 ceph-mon[34832]: pgmap v372: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:22.219 INFO:teuthology.orchestra.run.smithi079.stdout:227633266738 2024-09-21T02:34:22.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T02:34:22.772 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:22 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1200048020' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:34:22.774 INFO:teuthology.orchestra.run.smithi079.stdout:180388626493 2024-09-21T02:34:22.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T02:34:22.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:22 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1200048020' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:34:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:22 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1200048020' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:34:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.685+0000 7f2ecb200640 1 -- 172.21.15.79:0/757482724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1039b0 msgr2=0x7f2ecc103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.685+0000 7f2ecb200640 1 --2- 172.21.15.79:0/757482724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc103dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009860 tx=0x7f2ebc02a340 comp rx=0 tx=0).stop 2024-09-21T02:34:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.686+0000 7f2ecb200640 1 -- 172.21.15.79:0/757482724 shutdown_connections 2024-09-21T02:34:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.686+0000 7f2ecb200640 1 --2- 172.21.15.79:0/757482724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ecc109c40 0x7f2ecc110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.686+0000 7f2ecb200640 1 --2- 172.21.15.79:0/757482724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1092f0 0x7f2ecc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.686+0000 7f2ecb200640 1 --2- 172.21.15.79:0/757482724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc103dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.686+0000 7f2ecb200640 1 -- 172.21.15.79:0/757482724 >> 172.21.15.79:0/757482724 conn(0x7f2ecc0ff440 msgr2=0x7f2ecc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.686+0000 7f2ecb200640 1 -- 172.21.15.79:0/757482724 shutdown_connections 2024-09-21T02:34:23.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:23 smithi079 ceph-mon[30788]: pgmap v373: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.686+0000 7f2ecb200640 1 -- 172.21.15.79:0/757482724 wait complete. 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.687+0000 7f2ecb200640 1 Processor -- start 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.687+0000 7f2ecb200640 1 -- start start 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ecb200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc074e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ecb200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1092f0 0x7f2ecc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ecb200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ecc109c40 0x7f2ecc06e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ecb200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc113900 con 0x7f2ecc1039b0 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ecb200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc113780 con 0x7f2ecc109c40 2024-09-21T02:34:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ecb200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc113a80 con 0x7f2ecc1092f0 2024-09-21T02:34:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ec9e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc074e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ec9e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc074e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51532/0 (socket says 172.21.15.79:51532) 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ec9e00640 1 -- 172.21.15.79:0/459520237 learned_addr learned my addr 172.21.15.79:0/459520237 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2ec9400640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1092f0 0x7f2ecc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.688+0000 7f2eca800640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ecc109c40 0x7f2ecc06e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec9400640 1 -- 172.21.15.79:0/459520237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ecc109c40 msgr2=0x7f2ecc06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec9400640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ecc109c40 0x7f2ecc06e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec9400640 1 -- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1039b0 msgr2=0x7f2ecc074e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec9400640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc074e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec9400640 1 -- 172.21.15.79:0/459520237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc06eed0 con 0x7f2ecc1092f0 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec9e00640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc074e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec9400640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1092f0 0x7f2ecc06e130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06b700 tx=0x7f2eb800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec2a00640 1 -- 172.21.15.79:0/459520237 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb800ccd0 con 0x7f2ecc1092f0 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec2a00640 1 -- 172.21.15.79:0/459520237 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eb80035f0 con 0x7f2ecc1092f0 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc073b90 con 0x7f2ecc1092f0 2024-09-21T02:34:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ec2a00640 1 -- 172.21.15.79:0/459520237 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8010690 con 0x7f2ecc1092f0 2024-09-21T02:34:23.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.689+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc0740d0 con 0x7f2ecc1092f0 2024-09-21T02:34:23.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.691+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc103dc0 con 0x7f2ecc1092f0 2024-09-21T02:34:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.693+0000 7f2ec2a00640 1 -- 172.21.15.79:0/459520237 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2eb80037a0 con 0x7f2ecc1092f0 2024-09-21T02:34:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.694+0000 7f2ec2a00640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2eb00b65a0 0x7f2eb00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.695+0000 7f2ec2a00640 1 -- 172.21.15.79:0/459520237 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f2eb80e79b0 con 0x7f2ecc1092f0 2024-09-21T02:34:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.695+0000 7f2ec9e00640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2eb00b65a0 0x7f2eb00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.695+0000 7f2ec9e00640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2eb00b65a0 0x7f2eb00b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005eb0 tx=0x7f2ebc030340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.698+0000 7f2ec2a00640 1 -- 172.21.15.79:0/459520237 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2eb80add20 con 0x7f2ecc1092f0 2024-09-21T02:34:23.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:23 smithi148 ceph-mon[34626]: pgmap v373: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.608+0000 7ffa72c00640 1 -- 172.21.15.79:0/952089084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c1092f0 msgr2=0x7ffa6c109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.608+0000 7ffa72c00640 1 --2- 172.21.15.79:0/952089084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c1092f0 0x7ffa6c109700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009900 tx=0x7ffa5802a410 comp rx=0 tx=0).stop 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.609+0000 7ffa72c00640 1 -- 172.21.15.79:0/952089084 shutdown_connections 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.609+0000 7ffa72c00640 1 --2- 172.21.15.79:0/952089084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa6c109c40 0x7ffa6c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.609+0000 7ffa72c00640 1 --2- 172.21.15.79:0/952089084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c1092f0 0x7ffa6c109700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.609+0000 7ffa72c00640 1 --2- 172.21.15.79:0/952089084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 0x7ffa6c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.609+0000 7ffa72c00640 1 -- 172.21.15.79:0/952089084 >> 172.21.15.79:0/952089084 conn(0x7ffa6c0ff440 msgr2=0x7ffa6c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.609+0000 7ffa72c00640 1 -- 172.21.15.79:0/952089084 shutdown_connections 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.609+0000 7ffa72c00640 1 -- 172.21.15.79:0/952089084 wait complete. 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.610+0000 7ffa72c00640 1 Processor -- start 2024-09-21T02:34:23.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.610+0000 7ffa72c00640 1 -- start start 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa72c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 0x7ffa6c19c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa72c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa6c1092f0 0x7ffa6c19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa72c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c109c40 0x7ffa6c1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa72c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c113900 con 0x7ffa6c109c40 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa72c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c113780 con 0x7ffa6c1092f0 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa72c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c113a80 con 0x7ffa6c1039b0 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa71800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 0x7ffa6c19c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa71800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 0x7ffa6c19c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51848/0 (socket says 172.21.15.79:51848) 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa71800640 1 -- 172.21.15.79:0/1685681905 learned_addr learned my addr 172.21.15.79:0/1685681905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa70e00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa6c1092f0 0x7ffa6c19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.611+0000 7ffa72200640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c109c40 0x7ffa6c1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa71800640 1 -- 172.21.15.79:0/1685681905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa6c1092f0 msgr2=0x7ffa6c19cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa71800640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa6c1092f0 0x7ffa6c19cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa71800640 1 -- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c109c40 msgr2=0x7ffa6c1a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa71800640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c109c40 0x7ffa6c1a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa71800640 1 -- 172.21.15.79:0/1685681905 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c1a2480 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa71800640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 0x7ffa6c19c510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000e9f0 tx=0x7ffa6000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa6a000640 1 -- 172.21.15.79:0/1685681905 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000cd80 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa6a000640 1 -- 172.21.15.79:0/1685681905 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa600054d0 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c1a2770 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c1a8ed0 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.612+0000 7ffa6a000640 1 -- 172.21.15.79:0/1685681905 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60010690 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.614+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa4c0052c0 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.616+0000 7ffa6a000640 1 -- 172.21.15.79:0/1685681905 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7ffa60004e90 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.617+0000 7ffa6a000640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffa540b6620 0x7ffa540b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.618+0000 7ffa6a000640 1 -- 172.21.15.79:0/1685681905 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7ffa600e7950 con 0x7ffa6c1039b0 2024-09-21T02:34:23.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.618+0000 7ffa70e00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffa540b6620 0x7ffa540b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:23.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.618+0000 7ffa70e00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffa540b6620 0x7ffa540b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009230 tx=0x7ffa58031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:23.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.621+0000 7ffa6a000640 1 -- 172.21.15.79:0/1685681905 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa600adcc0 con 0x7ffa6c1039b0 2024-09-21T02:34:23.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.824+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ffa4c005880 con 0x7ffa6c1039b0 2024-09-21T02:34:23.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.824+0000 7ffa6a000640 1 -- 172.21.15.79:0/1685681905 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa600b20a0 con 0x7ffa6c1039b0 2024-09-21T02:34:23.826 INFO:teuthology.orchestra.run.smithi079.stdout:55834574937 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.826+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffa540b6620 msgr2=0x7ffa540b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.826+0000 7ffa72c00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffa540b6620 0x7ffa540b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009230 tx=0x7ffa58031400 comp rx=0 tx=0).stop 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 msgr2=0x7ffa6c19c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 0x7ffa6c19c510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000e9f0 tx=0x7ffa6000edf0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 shutdown_connections 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffa540b6620 0x7ffa540b8b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa6c109c40 0x7ffa6c1a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa6c1092f0 0x7ffa6c19cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 --2- 172.21.15.79:0/1685681905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa6c1039b0 0x7ffa6c19c510 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 >> 172.21.15.79:0/1685681905 conn(0x7ffa6c0ff440 msgr2=0x7ffa6c1089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 shutdown_connections 2024-09-21T02:34:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.827+0000 7ffa72c00640 1 -- 172.21.15.79:0/1685681905 wait complete. 2024-09-21T02:34:23.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:23 smithi098 ceph-mon[34832]: pgmap v373: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:23.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.905+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2ecc10b480 con 0x7f2ecc1092f0 2024-09-21T02:34:23.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.906+0000 7f2ec2a00640 1 -- 172.21.15.79:0/459520237 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2eb8009510 con 0x7f2ecc1092f0 2024-09-21T02:34:23.908 INFO:teuthology.orchestra.run.smithi079.stdout:34359738462 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2eb00b65a0 msgr2=0x7f2eb00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2eb00b65a0 0x7f2eb00b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005eb0 tx=0x7f2ebc030340 comp rx=0 tx=0).stop 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1092f0 msgr2=0x7f2ecc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1092f0 0x7f2ecc06e130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06b700 tx=0x7f2eb800ee50 comp rx=0 tx=0).stop 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 shutdown_connections 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2eb00b65a0 0x7f2eb00b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ecc109c40 0x7f2ecc06e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc1092f0 0x7f2ecc06e130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 --2- 172.21.15.79:0/459520237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ecc1039b0 0x7f2ecc074e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:23.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 >> 172.21.15.79:0/459520237 conn(0x7f2ecc0ff440 msgr2=0x7f2ecc101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:23.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 shutdown_connections 2024-09-21T02:34:23.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:23.909+0000 7f2ecb200640 1 -- 172.21.15.79:0/459520237 wait complete. 2024-09-21T02:34:24.219 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:24.219 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:24.220 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:24 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1685681905' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:34:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:24 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/459520237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:34:24.819 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:24 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1685681905' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:34:24.819 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:24 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/459520237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:34:24.865 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822721 got 154618822724 for osd.5 2024-09-21T02:34:24.865 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:24 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1685681905' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:34:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:24 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/459520237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:34:25.280 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:25.284 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:25.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:25 smithi079 ceph-mon[30788]: pgmap v374: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:25.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:25 smithi148 ceph-mon[34626]: pgmap v374: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:25 smithi098 ceph-mon[34832]: pgmap v374: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:26.190 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738459 got 34359738462 for osd.0 2024-09-21T02:34:26.190 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 -- 172.21.15.79:0/83492222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c109c40 msgr2=0x7fb58c110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 --2- 172.21.15.79:0/83492222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c109c40 0x7fb58c110470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb584009be0 tx=0x7fb58402a6c0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 -- 172.21.15.79:0/83492222 shutdown_connections 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 --2- 172.21.15.79:0/83492222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c109c40 0x7fb58c110470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 --2- 172.21.15.79:0/83492222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb58c1092f0 0x7fb58c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 --2- 172.21.15.79:0/83492222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb58c1039b0 0x7fb58c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 -- 172.21.15.79:0/83492222 >> 172.21.15.79:0/83492222 conn(0x7fb58c0ff440 msgr2=0x7fb58c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 -- 172.21.15.79:0/83492222 shutdown_connections 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.358+0000 7fb58b200640 1 -- 172.21.15.79:0/83492222 wait complete. 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.359+0000 7fb58b200640 1 Processor -- start 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb58b200640 1 -- start start 2024-09-21T02:34:27.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb58b200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c1039b0 0x7fb58c19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb58b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb58c1092f0 0x7fb58c19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb58b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb58c109c40 0x7fb58c1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb58b200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c113900 con 0x7fb58c1039b0 2024-09-21T02:34:27.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb58b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c113780 con 0x7fb58c1092f0 2024-09-21T02:34:27.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb58b200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c113a80 con 0x7fb58c109c40 2024-09-21T02:34:27.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb589e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c1039b0 0x7fb58c19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb589e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c1039b0 0x7fb58c19c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36746/0 (socket says 172.21.15.79:36746) 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb589e00640 1 -- 172.21.15.79:0/3440738 learned_addr learned my addr 172.21.15.79:0/3440738 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.360+0000 7fb589400640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb58c1092f0 0x7fb58c19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb58a800640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb58c109c40 0x7fb58c1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb589e00640 1 -- 172.21.15.79:0/3440738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb58c109c40 msgr2=0x7fb58c1a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb589e00640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb58c109c40 0x7fb58c1a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb589e00640 1 -- 172.21.15.79:0/3440738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb58c1092f0 msgr2=0x7fb58c19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb589e00640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb58c1092f0 0x7fb58c19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb589e00640 1 -- 172.21.15.79:0/3440738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58c1a2440 con 0x7fb58c1039b0 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb589400640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb58c1092f0 0x7fb58c19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.361+0000 7fb589e00640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c1039b0 0x7fb58c19c4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00e9c0 tx=0x7fb57c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.362+0000 7fb582a00640 1 -- 172.21.15.79:0/3440738 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00cde0 con 0x7fb58c1039b0 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.362+0000 7fb582a00640 1 -- 172.21.15.79:0/3440738 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb57c0035f0 con 0x7fb58c1039b0 2024-09-21T02:34:27.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.362+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58c1a2730 con 0x7fb58c1039b0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.362+0000 7fb582a00640 1 -- 172.21.15.79:0/3440738 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c010690 con 0x7fb58c1039b0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.362+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58c1a8e90 con 0x7fb58c1039b0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.363+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb58c103dc0 con 0x7fb58c1039b0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.366+0000 7fb582a00640 1 -- 172.21.15.79:0/3440738 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fb57c004000 con 0x7fb58c1039b0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.367+0000 7fb582a00640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b65a0 0x7fb5700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.368+0000 7fb582a00640 1 -- 172.21.15.79:0/3440738 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fb57c0e7bd0 con 0x7fb58c1039b0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.368+0000 7fb589400640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b65a0 0x7fb5700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.368+0000 7fb582a00640 1 -- 172.21.15.79:0/3440738 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb57c0ae030 con 0x7fb58c1039b0 2024-09-21T02:34:27.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.369+0000 7fb589400640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b65a0 0x7fb5700b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5780095f0 tx=0x7fb578005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:27.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 -- 172.21.15.79:0/1043467701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41039b0 msgr2=0x7f06d4103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1043467701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41039b0 0x7f06d4103dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009900 tx=0x7f06c802a410 comp rx=0 tx=0).stop 2024-09-21T02:34:27.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 -- 172.21.15.79:0/1043467701 shutdown_connections 2024-09-21T02:34:27.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1043467701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06d4109c40 0x7f06d4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1043467701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06d41092f0 0x7f06d4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1043467701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41039b0 0x7f06d4103dc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 -- 172.21.15.79:0/1043467701 >> 172.21.15.79:0/1043467701 conn(0x7f06d40ff440 msgr2=0x7f06d4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 -- 172.21.15.79:0/1043467701 shutdown_connections 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.986+0000 7f06d9e00640 1 -- 172.21.15.79:0/1043467701 wait complete. 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 Processor -- start 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 -- start start 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06d41039b0 0x7f06d419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41092f0 0x7f06d419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06d4109c40 0x7f06d419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4113900 con 0x7f06d41092f0 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4113780 con 0x7f06d41039b0 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.988+0000 7f06d9e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4113a80 con 0x7f06d4109c40 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41092f0 0x7f06d419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41092f0 0x7f06d419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36722/0 (socket says 172.21.15.79:36722) 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 -- 172.21.15.79:0/1318056091 learned_addr learned my addr 172.21.15.79:0/1318056091 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d8a00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06d41039b0 0x7f06d419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d9400640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06d4109c40 0x7f06d419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 -- 172.21.15.79:0/1318056091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06d4109c40 msgr2=0x7f06d419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06d4109c40 0x7f06d419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 -- 172.21.15.79:0/1318056091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06d41039b0 msgr2=0x7f06d419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06d41039b0 0x7f06d419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 -- 172.21.15.79:0/1318056091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d41a0280 con 0x7f06d41092f0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.989+0000 7f06d3e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41092f0 0x7f06d419a8b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e9c0 tx=0x7f06c000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.990+0000 7f06d1600640 1 -- 172.21.15.79:0/1318056091 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c000ccc0 con 0x7f06d41092f0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.990+0000 7f06d1600640 1 -- 172.21.15.79:0/1318056091 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c00054d0 con 0x7f06d41092f0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.990+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d41a0570 con 0x7f06d41092f0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.990+0000 7f06d1600640 1 -- 172.21.15.79:0/1318056091 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0010430 con 0x7f06d41092f0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.990+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d41a6cd0 con 0x7f06d41092f0 2024-09-21T02:34:27.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.991+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d4103dc0 con 0x7f06d41092f0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.993+0000 7f06d1600640 1 -- 172.21.15.79:0/1318056091 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f06c0005000 con 0x7f06d41092f0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.995+0000 7f06d1600640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06bc0b65a0 0x7f06bc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.995+0000 7f06d1600640 1 -- 172.21.15.79:0/1318056091 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f06c00e7d90 con 0x7f06d41092f0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.995+0000 7f06d8a00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06bc0b65a0 0x7f06bc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.996+0000 7f06d8a00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06bc0b65a0 0x7f06bc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f06c8031440 tx=0x7f06c8009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:26.997+0000 7f06d1600640 1 -- 172.21.15.79:0/1318056091 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06c0056710 con 0x7f06d41092f0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.199+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f06d419b440 con 0x7f06d41092f0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.199+0000 7f06d1600640 1 -- 172.21.15.79:0/1318056091 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06d419b440 con 0x7f06d41092f0 2024-09-21T02:34:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:77309411414 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06bc0b65a0 msgr2=0x7f06bc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06bc0b65a0 0x7f06bc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f06c8031440 tx=0x7f06c8009560 comp rx=0 tx=0).stop 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41092f0 msgr2=0x7f06d419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41092f0 0x7f06d419a8b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e9c0 tx=0x7f06c000ee80 comp rx=0 tx=0).stop 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 shutdown_connections 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06bc0b65a0 0x7f06bc0b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06d4109c40 0x7f06d419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06d41092f0 0x7f06d419a8b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 --2- 172.21.15.79:0/1318056091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06d41039b0 0x7f06d419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 >> 172.21.15.79:0/1318056091 conn(0x7f06d40ff440 msgr2=0x7f06d4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 shutdown_connections 2024-09-21T02:34:27.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.202+0000 7f06d9e00640 1 -- 172.21.15.79:0/1318056091 wait complete. 2024-09-21T02:34:27.531 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:27 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1318056091' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:34:27.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:27 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1318056091' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:34:27.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.618+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb58c19d600 con 0x7fb58c1039b0 2024-09-21T02:34:27.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.618+0000 7fb582a00640 1 -- 172.21.15.79:0/3440738 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb57c0b2410 con 0x7fb58c1039b0 2024-09-21T02:34:27.619 INFO:teuthology.orchestra.run.smithi079.stdout:133143986248 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.620+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b65a0 msgr2=0x7fb5700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.620+0000 7fb58b200640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b65a0 0x7fb5700b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5780095f0 tx=0x7fb578005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.620+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c1039b0 msgr2=0x7fb58c19c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.620+0000 7fb58b200640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c1039b0 0x7fb58c19c4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00e9c0 tx=0x7fb57c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 shutdown_connections 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b65a0 0x7fb5700b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb58c109c40 0x7fb58c1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb58c1092f0 0x7fb58c19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 --2- 172.21.15.79:0/3440738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb58c1039b0 0x7fb58c19c4d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:27.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 >> 172.21.15.79:0/3440738 conn(0x7fb58c0ff440 msgr2=0x7fb58c108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:27.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 shutdown_connections 2024-09-21T02:34:27.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.621+0000 7fb58b200640 1 -- 172.21.15.79:0/3440738 wait complete. 2024-09-21T02:34:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:27 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1318056091' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.456+0000 7fb375000640 1 -- 172.21.15.79:0/3249629523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb370109c40 msgr2=0x7fb370110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.456+0000 7fb375000640 1 --2- 172.21.15.79:0/3249629523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb370109c40 0x7fb370110470 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb368009be0 tx=0x7fb36802a6d0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.456+0000 7fb375000640 1 -- 172.21.15.79:0/3249629523 shutdown_connections 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.456+0000 7fb375000640 1 --2- 172.21.15.79:0/3249629523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb370109c40 0x7fb370110470 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.456+0000 7fb375000640 1 --2- 172.21.15.79:0/3249629523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3701092f0 0x7fb370109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.456+0000 7fb375000640 1 --2- 172.21.15.79:0/3249629523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3701039b0 0x7fb370103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.456+0000 7fb375000640 1 -- 172.21.15.79:0/3249629523 >> 172.21.15.79:0/3249629523 conn(0x7fb3700ff440 msgr2=0x7fb370101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.457+0000 7fb375000640 1 -- 172.21.15.79:0/3249629523 shutdown_connections 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.457+0000 7fb375000640 1 -- 172.21.15.79:0/3249629523 wait complete. 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 Processor -- start 2024-09-21T02:34:28.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 -- start start 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3701039b0 0x7fb37019c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3701092f0 0x7fb37019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb370109c40 0x7fb3701a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb370113900 con 0x7fb3701092f0 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb370113780 con 0x7fb3701039b0 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.458+0000 7fb375000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb370113a80 con 0x7fb370109c40 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3701092f0 0x7fb37019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3701039b0 0x7fb37019c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3701039b0 0x7fb37019c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52824/0 (socket says 172.21.15.79:52824) 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 -- 172.21.15.79:0/873655000 learned_addr learned my addr 172.21.15.79:0/873655000 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36fe00640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb370109c40 0x7fb3701a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 -- 172.21.15.79:0/873655000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb370109c40 msgr2=0x7fb3701a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb370109c40 0x7fb3701a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 -- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3701092f0 msgr2=0x7fb37019ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3701092f0 0x7fb37019ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 -- 172.21.15.79:0/873655000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3701a2440 con 0x7fb3701039b0 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36fe00640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb370109c40 0x7fb3701a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.459+0000 7fb36f400640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3701039b0 0x7fb37019c4d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb36000e9c0 tx=0x7fb36000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.460+0000 7fb367e00640 1 -- 172.21.15.79:0/873655000 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36000cde0 con 0x7fb3701039b0 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.460+0000 7fb367e00640 1 -- 172.21.15.79:0/873655000 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3600035f0 con 0x7fb3701039b0 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.460+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3701a2730 con 0x7fb3701039b0 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.460+0000 7fb367e00640 1 -- 172.21.15.79:0/873655000 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360010690 con 0x7fb3701039b0 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.460+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3701a8e90 con 0x7fb3701039b0 2024-09-21T02:34:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.461+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb370103dc0 con 0x7fb3701039b0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stdout:253403070508 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.463+0000 7fb367e00640 1 -- 172.21.15.79:0/873655000 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fb360004000 con 0x7fb3701039b0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.465+0000 7fb367e00640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3540b65a0 0x7fb3540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.465+0000 7fb367e00640 1 -- 172.21.15.79:0/873655000 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fb3600e7c30 con 0x7fb3701039b0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.465+0000 7fb36ea00640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3540b65a0 0x7fb3540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.466+0000 7fb36ea00640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3540b65a0 0x7fb3540b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb370105900 tx=0x7fb35c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.469+0000 7fb367e00640 1 -- 172.21.15.79:0/873655000 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb360009510 con 0x7fb3701039b0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.717+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb3701a91e0 con 0x7fb3701039b0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.717+0000 7fb367e00640 1 -- 172.21.15.79:0/873655000 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb3600adfa0 con 0x7fb3701039b0 2024-09-21T02:34:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3540b65a0 msgr2=0x7fb3540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3540b65a0 0x7fb3540b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb370105900 tx=0x7fb35c005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3701039b0 msgr2=0x7fb37019c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3701039b0 0x7fb37019c4d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb36000e9c0 tx=0x7fb36000ee80 comp rx=0 tx=0).stop 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 shutdown_connections 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb3540b65a0 0x7fb3540b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb370109c40 0x7fb3701a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3701092f0 0x7fb37019ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 --2- 172.21.15.79:0/873655000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3701039b0 0x7fb37019c4d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 >> 172.21.15.79:0/873655000 conn(0x7fb3700ff440 msgr2=0x7fb370108920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 shutdown_connections 2024-09-21T02:34:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:27.720+0000 7fb375000640 1 -- 172.21.15.79:0/873655000 wait complete. 2024-09-21T02:34:28.518 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:28 smithi079 ceph-mon[30788]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:28.518 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:28 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3440738' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:34:28.518 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:28 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/873655000' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:34:28.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:28 smithi148 ceph-mon[34626]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:28.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:28 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3440738' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:34:28.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:28 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/873655000' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:34:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:28 smithi098 ceph-mon[34832]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:28 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3440738' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:34:28.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:28 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/873655000' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:34:29.550 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:29 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3765350186' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:34:29.588 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411411 got 77309411414 for osd.2 2024-09-21T02:34:29.588 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:29 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3765350186' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:34:29.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:29 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3765350186' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:34:29.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 -- 172.21.15.79:0/2044731178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 msgr2=0x7f4f48112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:29.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2044731178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 0x7f4f48112680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009ca0 tx=0x7f4f4002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 -- 172.21.15.79:0/2044731178 shutdown_connections 2024-09-21T02:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2044731178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 0x7f4f48112680 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2044731178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f4810b500 0x7f4f4810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2044731178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 0x7f4f48105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 -- 172.21.15.79:0/2044731178 >> 172.21.15.79:0/2044731178 conn(0x7f4f48101670 msgr2=0x7f4f48103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:29.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 -- 172.21.15.79:0/2044731178 shutdown_connections 2024-09-21T02:34:29.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.831+0000 7f4f47e00640 1 -- 172.21.15.79:0/2044731178 wait complete. 2024-09-21T02:34:29.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.832+0000 7f4f47e00640 1 Processor -- start 2024-09-21T02:34:29.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47e00640 1 -- start start 2024-09-21T02:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 0x7f4f4819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f4810b500 0x7f4f4819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 0x7f4f481a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48115b10 con 0x7f4f4810be50 2024-09-21T02:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48115990 con 0x7f4f48105bc0 2024-09-21T02:34:29.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48115c90 con 0x7f4f4810b500 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f47400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 0x7f4f481a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 0x7f4f4819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f46a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 0x7f4f4819c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52872/0 (socket says 172.21.15.79:52872) 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f46a00640 1 -- 172.21.15.79:0/2669883306 learned_addr learned my addr 172.21.15.79:0/2669883306 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.833+0000 7f4f46000640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f4810b500 0x7f4f4819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f46a00640 1 -- 172.21.15.79:0/2669883306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f4810b500 msgr2=0x7f4f4819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f46a00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f4810b500 0x7f4f4819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f46a00640 1 -- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 msgr2=0x7f4f481a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f46a00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 0x7f4f481a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f46a00640 1 -- 172.21.15.79:0/2669883306 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f481a2410 con 0x7f4f48105bc0 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f47400640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 0x7f4f481a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f46a00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 0x7f4f4819c4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800e9f0 tx=0x7f4f3800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f3f400640 1 -- 172.21.15.79:0/2669883306 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800cd80 con 0x7f4f48105bc0 2024-09-21T02:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f3f400640 1 -- 172.21.15.79:0/2669883306 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f380108e0 con 0x7f4f48105bc0 2024-09-21T02:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f481a2700 con 0x7f4f48105bc0 2024-09-21T02:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.834+0000 7f4f3f400640 1 -- 172.21.15.79:0/2669883306 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38018980 con 0x7f4f48105bc0 2024-09-21T02:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.835+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f481a8e60 con 0x7f4f48105bc0 2024-09-21T02:34:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.836+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f48105fd0 con 0x7f4f48105bc0 2024-09-21T02:34:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.838+0000 7f4f3f400640 1 -- 172.21.15.79:0/2669883306 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4f38010430 con 0x7f4f48105bc0 2024-09-21T02:34:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.839+0000 7f4f3f400640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4f2c0b6620 0x7f4f2c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.840+0000 7f4f3f400640 1 -- 172.21.15.79:0/2669883306 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f4f380e7f90 con 0x7f4f48105bc0 2024-09-21T02:34:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.840+0000 7f4f46000640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4f2c0b6620 0x7f4f2c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.840+0000 7f4f46000640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4f2c0b6620 0x7f4f2c0b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f48107f00 tx=0x7f4f34005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:29.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.841+0000 7f4f3f400640 1 -- 172.21.15.79:0/2669883306 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f380b26e0 con 0x7f4f48105bc0 2024-09-21T02:34:30.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.044+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f4f4802e640 con 0x7f4f48105bc0 2024-09-21T02:34:30.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.045+0000 7f4f3f400640 1 -- 172.21.15.79:0/2669883306 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4f380b7620 con 0x7f4f48105bc0 2024-09-21T02:34:30.046 INFO:teuthology.orchestra.run.smithi079.stdout:300647710755 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4f2c0b6620 msgr2=0x7f4f2c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4f2c0b6620 0x7f4f2c0b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f48107f00 tx=0x7f4f34005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 msgr2=0x7f4f4819c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 0x7f4f4819c4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800e9f0 tx=0x7f4f3800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 shutdown_connections 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4f2c0b6620 0x7f4f2c0b8b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4810be50 0x7f4f481a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f4810b500 0x7f4f4819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:30.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 --2- 172.21.15.79:0/2669883306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f48105bc0 0x7f4f4819c4a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:30.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 >> 172.21.15.79:0/2669883306 conn(0x7f4f48101670 msgr2=0x7f4f4810abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:30.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 shutdown_connections 2024-09-21T02:34:30.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:30.047+0000 7f4f47e00640 1 -- 172.21.15.79:0/2669883306 wait complete. 2024-09-21T02:34:30.133 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070506 got 253403070508 for osd.9 2024-09-21T02:34:30.133 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:30.406 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:30 smithi079 ceph-mon[30788]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T02:34:30.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T02:34:30.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T02:34:30.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:30 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-21T02:34:30.407 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:30 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2669883306' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:34:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:30 smithi098 ceph-mon[34832]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T02:34:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T02:34:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T02:34:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:30 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-21T02:34:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:30 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2669883306' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:34:30.743 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574935 got 55834574937 for osd.1 2024-09-21T02:34:30.744 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:30 smithi148 ceph-mon[34626]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T02:34:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T02:34:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T02:34:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:30 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-21T02:34:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:30 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2669883306' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:34:31.310 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986246 got 133143986248 for osd.4 2024-09-21T02:34:31.310 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:31.548 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T02:34:31.548 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T02:34:31.548 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:31 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-21T02:34:31.548 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:31 smithi079 ceph-mon[30788]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T02:34:31.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 -- 172.21.15.79:0/3773736155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0694105d80 msgr2=0x7f0694106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 --2- 172.21.15.79:0/3773736155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0694105d80 0x7f0694106190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0684009900 tx=0x7f068402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 -- 172.21.15.79:0/3773736155 shutdown_connections 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 --2- 172.21.15.79:0/3773736155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f069410c010 0x7f0694112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 --2- 172.21.15.79:0/3773736155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069410b6c0 0x7f069410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 --2- 172.21.15.79:0/3773736155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0694105d80 0x7f0694106190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 -- 172.21.15.79:0/3773736155 >> 172.21.15.79:0/3773736155 conn(0x7f0694101810 msgr2=0x7f0694103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 -- 172.21.15.79:0/3773736155 shutdown_connections 2024-09-21T02:34:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.723+0000 7f0699600640 1 -- 172.21.15.79:0/3773736155 wait complete. 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.724+0000 7f0699600640 1 Processor -- start 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.724+0000 7f0699600640 1 -- start start 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0699600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0694105d80 0x7f069419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0699600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f069410b6c0 0x7f069419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0699600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069410c010 0x7f06941a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0699600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0694115cd0 con 0x7f069410b6c0 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0699600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0694115b50 con 0x7f0694105d80 2024-09-21T02:34:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0699600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0694115e50 con 0x7f069410c010 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0692000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f069410b6c0 0x7f069419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0692000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f069410b6c0 0x7f069419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36822/0 (socket says 172.21.15.79:36822) 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0692000640 1 -- 172.21.15.79:0/3649318491 learned_addr learned my addr 172.21.15.79:0/3649318491 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0692a00640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0694105d80 0x7f069419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.725+0000 7f0693400640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069410c010 0x7f06941a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f0692000640 1 -- 172.21.15.79:0/3649318491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069410c010 msgr2=0x7f06941a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f0692000640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069410c010 0x7f06941a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f0692000640 1 -- 172.21.15.79:0/3649318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0694105d80 msgr2=0x7f069419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f0692000640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0694105d80 0x7f069419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f0692000640 1 -- 172.21.15.79:0/3649318491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06941a2610 con 0x7f069410b6c0 2024-09-21T02:34:31.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f0692000640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f069410b6c0 0x7f069419cc40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f068000d950 tx=0x7f068000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f068b400640 1 -- 172.21.15.79:0/3649318491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680017070 con 0x7f069410b6c0 2024-09-21T02:34:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f068b400640 1 -- 172.21.15.79:0/3649318491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0680009c30 con 0x7f069410b6c0 2024-09-21T02:34:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06941a2900 con 0x7f069410b6c0 2024-09-21T02:34:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.726+0000 7f068b400640 1 -- 172.21.15.79:0/3649318491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800047a0 con 0x7f069410b6c0 2024-09-21T02:34:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.727+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06941a9060 con 0x7f069410b6c0 2024-09-21T02:34:31.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.728+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0694106190 con 0x7f069410b6c0 2024-09-21T02:34:31.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.730+0000 7f068b400640 1 -- 172.21.15.79:0/3649318491 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f0680004020 con 0x7f069410b6c0 2024-09-21T02:34:31.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.731+0000 7f068b400640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06780b65a0 0x7f06780b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:31.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.732+0000 7f068b400640 1 -- 172.21.15.79:0/3649318491 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f06800e78f0 con 0x7f069410b6c0 2024-09-21T02:34:31.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.732+0000 7f0692a00640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06780b65a0 0x7f06780b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:31.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.733+0000 7f0692a00640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06780b65a0 0x7f06780b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0684031440 tx=0x7f0684009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.734+0000 7f068b400640 1 -- 172.21.15.79:0/3649318491 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0680020020 con 0x7f069410b6c0 2024-09-21T02:34:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T02:34:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T02:34:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:31 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-21T02:34:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:31 smithi148 ceph-mon[34626]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T02:34:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T02:34:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T02:34:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:31 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-21T02:34:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:31 smithi098 ceph-mon[34832]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T02:34:31.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.929+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f069402e640 con 0x7f069410b6c0 2024-09-21T02:34:31.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.930+0000 7f068b400640 1 -- 172.21.15.79:0/3649318491 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f06800adc10 con 0x7f069410b6c0 2024-09-21T02:34:31.931 INFO:teuthology.orchestra.run.smithi079.stdout:274877906984 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06780b65a0 msgr2=0x7f06780b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06780b65a0 0x7f06780b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0684031440 tx=0x7f0684009560 comp rx=0 tx=0).stop 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f069410b6c0 msgr2=0x7f069419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f069410b6c0 0x7f069419cc40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f068000d950 tx=0x7f068000de10 comp rx=0 tx=0).stop 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 shutdown_connections 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f06780b65a0 0x7f06780b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069410c010 0x7f06941a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f069410b6c0 0x7f069419cc40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 --2- 172.21.15.79:0/3649318491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0694105d80 0x7f069419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:31.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.932+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 >> 172.21.15.79:0/3649318491 conn(0x7f0694101810 msgr2=0x7f0694103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:31.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.933+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 shutdown_connections 2024-09-21T02:34:31.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:31.933+0000 7f0699600640 1 -- 172.21.15.79:0/3649318491 wait complete. 2024-09-21T02:34:32.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710753 got 300647710755 for osd.11 2024-09-21T02:34:32.031 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:32.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 -- 172.21.15.79:0/3602940534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c1049d0 msgr2=0x7f4a7c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:32.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3602940534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c1049d0 0x7f4a7c104de0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009900 tx=0x7f4a6c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 -- 172.21.15.79:0/3602940534 shutdown_connections 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3602940534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a7c10de30 0x7f4a7c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3602940534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a7c105320 0x7f4a7c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3602940534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c1049d0 0x7f4a7c104de0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 -- 172.21.15.79:0/3602940534 >> 172.21.15.79:0/3602940534 conn(0x7f4a7c079740 msgr2=0x7f4a7c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.128+0000 7f4a81e00640 1 -- 172.21.15.79:0/3602940534 shutdown_connections 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.129+0000 7f4a81e00640 1 -- 172.21.15.79:0/3602940534 wait complete. 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.129+0000 7f4a81e00640 1 Processor -- start 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a81e00640 1 -- start start 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a81e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a7c1049d0 0x7f4a7c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a81e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c105320 0x7f4a7c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a81e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a7c10de30 0x7f4a7c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a81e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c113ab0 con 0x7f4a7c105320 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a81e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c113930 con 0x7f4a7c1049d0 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a81e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c113c30 con 0x7f4a7c10de30 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a7a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c105320 0x7f4a7c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a7a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c105320 0x7f4a7c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36786/0 (socket says 172.21.15.79:36786) 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a7a000640 1 -- 172.21.15.79:0/3765350186 learned_addr learned my addr 172.21.15.79:0/3765350186 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.130+0000 7f4a7aa00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a7c1049d0 0x7f4a7c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7b400640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a7c10de30 0x7f4a7c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7a000640 1 -- 172.21.15.79:0/3765350186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a7c10de30 msgr2=0x7f4a7c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7a000640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a7c10de30 0x7f4a7c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7a000640 1 -- 172.21.15.79:0/3765350186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a7c1049d0 msgr2=0x7f4a7c19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7a000640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a7c1049d0 0x7f4a7c19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7a000640 1 -- 172.21.15.79:0/3765350186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c1a04b0 con 0x7f4a7c105320 2024-09-21T02:34:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7aa00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a7c1049d0 0x7f4a7c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7b400640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a7c10de30 0x7f4a7c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a7a000640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c105320 0x7f4a7c19aae0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800d750 tx=0x7f4a6800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.131+0000 7f4a80a00640 1 -- 172.21.15.79:0/3765350186 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68017070 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.132+0000 7f4a80a00640 1 -- 172.21.15.79:0/3765350186 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a680054d0 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.132+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c1a07a0 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.132+0000 7f4a80a00640 1 -- 172.21.15.79:0/3765350186 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68004c30 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.132+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c1a6f00 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.133+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c06c240 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.136+0000 7f4a80a00640 1 -- 172.21.15.79:0/3765350186 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4a68004dd0 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.138+0000 7f4a80a00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4a600b65a0 0x7f4a600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.139+0000 7f4a80a00640 1 -- 172.21.15.79:0/3765350186 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f4a680e7280 con 0x7f4a7c105320 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.139+0000 7f4a7aa00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4a600b65a0 0x7f4a600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:32.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.139+0000 7f4a7aa00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4a600b65a0 0x7f4a600b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000c00 tx=0x7f4a6c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.143+0000 7f4a80a00640 1 -- 172.21.15.79:0/3765350186 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a680ad5f0 con 0x7f4a7c105320 2024-09-21T02:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.341+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4a7c108f30 con 0x7f4a7c105320 2024-09-21T02:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.342+0000 7f4a80a00640 1 -- 172.21.15.79:0/3765350186 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4a680b19d0 con 0x7f4a7c105320 2024-09-21T02:34:32.257 INFO:teuthology.orchestra.run.smithi079.stdout:107374182479 2024-09-21T02:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.344+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4a600b65a0 msgr2=0x7f4a600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.344+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4a600b65a0 0x7f4a600b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000c00 tx=0x7f4a6c031400 comp rx=0 tx=0).stop 2024-09-21T02:34:32.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c105320 msgr2=0x7f4a7c19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c105320 0x7f4a7c19aae0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800d750 tx=0x7f4a6800dc10 comp rx=0 tx=0).stop 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 shutdown_connections 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4a600b65a0 0x7f4a600b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a7c10de30 0x7f4a7c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a7c105320 0x7f4a7c19aae0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 --2- 172.21.15.79:0/3765350186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a7c1049d0 0x7f4a7c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 >> 172.21.15.79:0/3765350186 conn(0x7f4a7c079740 msgr2=0x7f4a7c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 shutdown_connections 2024-09-21T02:34:32.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:29.345+0000 7f4a81e00640 1 -- 172.21.15.79:0/3765350186 wait complete. 2024-09-21T02:34:32.498 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:32.500 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:32.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:32 smithi079 ceph-mon[30788]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T02:34:32.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:32 smithi079 ceph-mon[30788]: pgmap v379: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T02:34:32.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:32 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3649318491' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:34:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:32 smithi148 ceph-mon[34626]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T02:34:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:32 smithi148 ceph-mon[34626]: pgmap v379: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T02:34:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:32 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3649318491' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:34:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:32 smithi098 ceph-mon[34832]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T02:34:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:32 smithi098 ceph-mon[34832]: pgmap v379: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T02:34:32.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:32 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3649318491' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:34:33.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182476 got 107374182479 for osd.3 2024-09-21T02:34:33.004 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:33.477 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:33 smithi079 ceph-mon[30788]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T02:34:33.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:33 smithi148 ceph-mon[34626]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T02:34:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.815+0000 7f4caca00640 1 -- 172.21.15.79:0/33745417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca8110040 msgr2=0x7f4ca8112550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.815+0000 7f4caca00640 1 --2- 172.21.15.79:0/33745417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca8110040 0x7f4ca8112550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009ca0 tx=0x7f4ca002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.815+0000 7f4caca00640 1 -- 172.21.15.79:0/33745417 shutdown_connections 2024-09-21T02:34:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.815+0000 7f4caca00640 1 --2- 172.21.15.79:0/33745417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca8110040 0x7f4ca8112550 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.815+0000 7f4caca00640 1 --2- 172.21.15.79:0/33745417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ca806c0e0 0x7f4ca806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.815+0000 7f4caca00640 1 --2- 172.21.15.79:0/33745417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca81046a0 0x7f4ca806bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.815+0000 7f4caca00640 1 -- 172.21.15.79:0/33745417 >> 172.21.15.79:0/33745417 conn(0x7f4ca80799a0 msgr2=0x7f4ca8079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.816+0000 7f4caca00640 1 -- 172.21.15.79:0/33745417 shutdown_connections 2024-09-21T02:34:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.816+0000 7f4caca00640 1 -- 172.21.15.79:0/33745417 wait complete. 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 Processor -- start 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 -- start start 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca806c0e0 0x7f4ca819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca81046a0 0x7f4ca819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ca8110040 0x7f4ca81a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8115ce0 con 0x7f4ca806c0e0 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8115b60 con 0x7f4ca81046a0 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.817+0000 7f4caca00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8115e60 con 0x7f4ca8110040 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca806c0e0 0x7f4ca819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4c9d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca81046a0 0x7f4ca819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca806c0e0 0x7f4ca819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49828/0 (socket says 172.21.15.79:49828) 2024-09-21T02:34:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 -- 172.21.15.79:0/4094959562 learned_addr learned my addr 172.21.15.79:0/4094959562 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca6800640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ca8110040 0x7f4ca81a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 -- 172.21.15.79:0/4094959562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ca8110040 msgr2=0x7f4ca81a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ca8110040 0x7f4ca81a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 -- 172.21.15.79:0/4094959562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca81046a0 msgr2=0x7f4ca819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca81046a0 0x7f4ca819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 -- 172.21.15.79:0/4094959562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca81a25e0 con 0x7f4ca806c0e0 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4c9d400640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca81046a0 0x7f4ca819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.818+0000 7f4ca5e00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca806c0e0 0x7f4ca819c670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800e9f0 tx=0x7f4c9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.819+0000 7f4c9f400640 1 -- 172.21.15.79:0/4094959562 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800cd80 con 0x7f4ca806c0e0 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.819+0000 7f4c9f400640 1 -- 172.21.15.79:0/4094959562 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c980108e0 con 0x7f4ca806c0e0 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.819+0000 7f4c9f400640 1 -- 172.21.15.79:0/4094959562 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98018980 con 0x7f4ca806c0e0 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.819+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca81a28d0 con 0x7f4ca806c0e0 2024-09-21T02:34:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.819+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca81a9030 con 0x7f4ca806c0e0 2024-09-21T02:34:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.820+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca806c4f0 con 0x7f4ca806c0e0 2024-09-21T02:34:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.822+0000 7f4c9f400640 1 -- 172.21.15.79:0/4094959562 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4c98010430 con 0x7f4ca806c0e0 2024-09-21T02:34:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.824+0000 7f4c9f400640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c8c0b65a0 0x7f4c8c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.824+0000 7f4c9f400640 1 -- 172.21.15.79:0/4094959562 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4c980e8090 con 0x7f4ca806c0e0 2024-09-21T02:34:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.824+0000 7f4c9d400640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c8c0b65a0 0x7f4c8c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.825+0000 7f4c9d400640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c8c0b65a0 0x7f4c8c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ca806af70 tx=0x7f4c90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:33.826+0000 7f4c9f400640 1 -- 172.21.15.79:0/4094959562 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c980b2790 con 0x7f4ca806c0e0 2024-09-21T02:34:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:33 smithi098 ceph-mon[34832]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T02:34:34.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.023+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f4ca81a9320 con 0x7f4ca806c0e0 2024-09-21T02:34:34.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.024+0000 7f4c9f400640 1 -- 172.21.15.79:0/4094959562 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4c980b76d0 con 0x7f4ca806c0e0 2024-09-21T02:34:34.025 INFO:teuthology.orchestra.run.smithi079.stdout:201863462970 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.026+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c8c0b65a0 msgr2=0x7f4c8c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.026+0000 7f4caca00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c8c0b65a0 0x7f4c8c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ca806af70 tx=0x7f4c90005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.026+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca806c0e0 msgr2=0x7f4ca819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.026+0000 7f4caca00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca806c0e0 0x7f4ca819c670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800e9f0 tx=0x7f4c9800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 shutdown_connections 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c8c0b65a0 0x7f4c8c0b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ca8110040 0x7f4ca81a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca81046a0 0x7f4ca819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 --2- 172.21.15.79:0/4094959562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca806c0e0 0x7f4ca819c670 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 >> 172.21.15.79:0/4094959562 conn(0x7f4ca80799a0 msgr2=0x7f4ca81014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 shutdown_connections 2024-09-21T02:34:34.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.027+0000 7f4caca00640 1 -- 172.21.15.79:0/4094959562 wait complete. 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2650562825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 msgr2=0x7fa6d0110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2650562825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 0x7fa6d0110630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009ca0 tx=0x7fa6c802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2650562825 shutdown_connections 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2650562825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 0x7fa6d0110630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2650562825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d01094b0 0x7fa6d01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2650562825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0103b70 0x7fa6d0103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2650562825 >> 172.21.15.79:0/2650562825 conn(0x7fa6d00ff5e0 msgr2=0x7fa6d0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2650562825 shutdown_connections 2024-09-21T02:34:34.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.066+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2650562825 wait complete. 2024-09-21T02:34:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.067+0000 7fa6d4e00640 1 Processor -- start 2024-09-21T02:34:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6d4e00640 1 -- start start 2024-09-21T02:34:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6d4e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d0103b70 0x7fa6d019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6d4e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d01094b0 0x7fa6d019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6d4e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 0x7fa6d01a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:34.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6d4e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0113ac0 con 0x7fa6d01094b0 2024-09-21T02:34:34.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6d4e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0113940 con 0x7fa6d0109e00 2024-09-21T02:34:34.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6d4e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0113c40 con 0x7fa6d0103b70 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6cd400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d01094b0 0x7fa6d019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 0x7fa6d01a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.068+0000 7fa6cde00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d0103b70 0x7fa6d019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 0x7fa6d01a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:45134/0 (socket says 172.21.15.79:45134) 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6cde00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d0103b70 0x7fa6d019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54416/0 (socket says 172.21.15.79:54416) 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6ce800640 1 -- 172.21.15.79:0/2347339692 learned_addr learned my addr 172.21.15.79:0/2347339692 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6cde00640 1 -- 172.21.15.79:0/2347339692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 msgr2=0x7fa6d01a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:34.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6cde00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 0x7fa6d01a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6cde00640 1 -- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d01094b0 msgr2=0x7fa6d019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6cde00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d01094b0 0x7fa6d019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6cde00640 1 -- 172.21.15.79:0/2347339692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d01a25a0 con 0x7fa6d0103b70 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.069+0000 7fa6cde00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d0103b70 0x7fa6d019c630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000e9f0 tx=0x7fa6c000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.070+0000 7fa6c6a00640 1 -- 172.21.15.79:0/2347339692 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000cd80 con 0x7fa6d0103b70 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.070+0000 7fa6c6a00640 1 -- 172.21.15.79:0/2347339692 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6c00035f0 con 0x7fa6d0103b70 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.070+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d01a2890 con 0x7fa6d0103b70 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.070+0000 7fa6c6a00640 1 -- 172.21.15.79:0/2347339692 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0010670 con 0x7fa6d0103b70 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.070+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01a8ff0 con 0x7fa6d0103b70 2024-09-21T02:34:34.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.071+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d0103f80 con 0x7fa6d0103b70 2024-09-21T02:34:34.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.074+0000 7fa6c6a00640 1 -- 172.21.15.79:0/2347339692 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa6c00037a0 con 0x7fa6d0103b70 2024-09-21T02:34:34.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.076+0000 7fa6c6a00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6b40b65a0 0x7fa6b40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:34.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.076+0000 7fa6c6a00640 1 -- 172.21.15.79:0/2347339692 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa6c00e7e50 con 0x7fa6d0103b70 2024-09-21T02:34:34.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.076+0000 7fa6cd400640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6b40b65a0 0x7fa6b40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:34.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.077+0000 7fa6cd400640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6b40b65a0 0x7fa6b40b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0105ae0 tx=0x7fa6bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:34.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.077+0000 7fa6c6a00640 1 -- 172.21.15.79:0/2347339692 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6c00ae170 con 0x7fa6d0103b70 2024-09-21T02:34:34.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.268+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa6d019d760 con 0x7fa6d0103b70 2024-09-21T02:34:34.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.269+0000 7fa6c6a00640 1 -- 172.21.15.79:0/2347339692 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa6d019d760 con 0x7fa6d0103b70 2024-09-21T02:34:34.270 INFO:teuthology.orchestra.run.smithi079.stdout:227633266740 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6b40b65a0 msgr2=0x7fa6b40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6b40b65a0 0x7fa6b40b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0105ae0 tx=0x7fa6bc005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d0103b70 msgr2=0x7fa6d019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d0103b70 0x7fa6d019c630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000e9f0 tx=0x7fa6c000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 shutdown_connections 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa6b40b65a0 0x7fa6b40b8ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0109e00 0x7fa6d01a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d01094b0 0x7fa6d019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 --2- 172.21.15.79:0/2347339692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d0103b70 0x7fa6d019c630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.271+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 >> 172.21.15.79:0/2347339692 conn(0x7fa6d00ff5e0 msgr2=0x7fa6d0108ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.272+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 shutdown_connections 2024-09-21T02:34:34.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:34.272+0000 7fa6d4e00640 1 -- 172.21.15.79:0/2347339692 wait complete. 2024-09-21T02:34:34.643 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:34 smithi079 ceph-mon[30788]: pgmap v380: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-21T02:34:34.643 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:34 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4094959562' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:34:34.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:34 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2347339692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:34:34.657 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:34.686 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906981 got 274877906984 for osd.10 2024-09-21T02:34:34.687 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:34 smithi148 ceph-mon[34626]: pgmap v380: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-21T02:34:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:34 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4094959562' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:34:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:34 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2347339692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:34:34.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:34 smithi098 ceph-mon[34832]: pgmap v380: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-21T02:34:34.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:34 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4094959562' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:34:34.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:34 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2347339692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 -- 172.21.15.79:0/3003468156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80102670 msgr2=0x7f8b80102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 --2- 172.21.15.79:0/3003468156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80102670 0x7f8b80102a80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009900 tx=0x7f8b7402a480 comp rx=0 tx=0).stop 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 -- 172.21.15.79:0/3003468156 shutdown_connections 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 --2- 172.21.15.79:0/3003468156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80110220 0x7f8b80112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 --2- 172.21.15.79:0/3003468156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102fc0 0x7f8b8010fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 --2- 172.21.15.79:0/3003468156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80102670 0x7f8b80102a80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 -- 172.21.15.79:0/3003468156 >> 172.21.15.79:0/3003468156 conn(0x7f8b80079740 msgr2=0x7f8b80079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 -- 172.21.15.79:0/3003468156 shutdown_connections 2024-09-21T02:34:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.511+0000 7f8b88200640 1 -- 172.21.15.79:0/3003468156 wait complete. 2024-09-21T02:34:35.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.512+0000 7f8b88200640 1 Processor -- start 2024-09-21T02:34:35.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.512+0000 7f8b88200640 1 -- start start 2024-09-21T02:34:35.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b88200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102670 0x7f8b8019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b88200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102fc0 0x7f8b8019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b88200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80110220 0x7f8b801a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b88200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80115ce0 con 0x7f8b80110220 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b88200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80115b60 con 0x7f8b80102fc0 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b88200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80115e60 con 0x7f8b80102670 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b85800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102670 0x7f8b8019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b84e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102fc0 0x7f8b8019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b85800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102670 0x7f8b8019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54430/0 (socket says 172.21.15.79:54430) 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b85800640 1 -- 172.21.15.79:0/1491386666 learned_addr learned my addr 172.21.15.79:0/1491386666 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:35.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.513+0000 7f8b86200640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80110220 0x7f8b801a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.514+0000 7f8b85800640 1 -- 172.21.15.79:0/1491386666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102fc0 msgr2=0x7f8b8019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.514+0000 7f8b85800640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102fc0 0x7f8b8019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.514+0000 7f8b85800640 1 -- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80110220 msgr2=0x7f8b801a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.514+0000 7f8b85800640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80110220 0x7f8b801a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.514+0000 7f8b85800640 1 -- 172.21.15.79:0/1491386666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b801a25c0 con 0x7f8b80102670 2024-09-21T02:34:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.514+0000 7f8b85800640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102670 0x7f8b8019c650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005ab0 tx=0x7f8b74003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:35.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.515+0000 7f8b7e000640 1 -- 172.21.15.79:0/1491386666 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7403f070 con 0x7f8b80102670 2024-09-21T02:34:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.515+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b801a2850 con 0x7f8b80102670 2024-09-21T02:34:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.515+0000 7f8b7e000640 1 -- 172.21.15.79:0/1491386666 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b74031b60 con 0x7f8b80102670 2024-09-21T02:34:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.515+0000 7f8b7e000640 1 -- 172.21.15.79:0/1491386666 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74035030 con 0x7f8b80102670 2024-09-21T02:34:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.515+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b801a9010 con 0x7f8b80102670 2024-09-21T02:34:35.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.516+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8006c1c0 con 0x7f8b80102670 2024-09-21T02:34:35.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.518+0000 7f8b7e000640 1 -- 172.21.15.79:0/1491386666 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8b74042070 con 0x7f8b80102670 2024-09-21T02:34:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.520+0000 7f8b7e000640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b680b65a0 0x7f8b680b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.520+0000 7f8b7e000640 1 -- 172.21.15.79:0/1491386666 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8b74108700 con 0x7f8b80102670 2024-09-21T02:34:35.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.520+0000 7f8b84e00640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b680b65a0 0x7f8b680b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:35.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.521+0000 7f8b84e00640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b680b65a0 0x7f8b680b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b80103ee0 tx=0x7f8b6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:35.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.524+0000 7f8b7e000640 1 -- 172.21.15.79:0/1491386666 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b740d2e60 con 0x7f8b80102670 2024-09-21T02:34:35.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:35 smithi079 ceph-mon[30788]: pgmap v381: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 8.5 KiB/s, 0 objects/s recovering 2024-09-21T02:34:35.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.720+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8b80102a80 con 0x7f8b80102670 2024-09-21T02:34:35.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.721+0000 7f8b7e000640 1 -- 172.21.15.79:0/1491386666 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8b740d7da0 con 0x7f8b80102670 2024-09-21T02:34:35.722 INFO:teuthology.orchestra.run.smithi079.stdout:180388626496 2024-09-21T02:34:35.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b680b65a0 msgr2=0x7f8b680b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:35.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b680b65a0 0x7f8b680b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b80103ee0 tx=0x7f8b6c005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102670 msgr2=0x7f8b8019c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102670 0x7f8b8019c650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005ab0 tx=0x7f8b74003c10 comp rx=0 tx=0).stop 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 shutdown_connections 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8b680b65a0 0x7f8b680b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b80110220 0x7f8b801a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102fc0 0x7f8b8019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 --2- 172.21.15.79:0/1491386666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b80102670 0x7f8b8019c650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 >> 172.21.15.79:0/1491386666 conn(0x7f8b80079740 msgr2=0x7f8b80109da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 shutdown_connections 2024-09-21T02:34:35.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:35.723+0000 7f8b88200640 1 -- 172.21.15.79:0/1491386666 wait complete. 2024-09-21T02:34:35.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:35 smithi148 ceph-mon[34626]: pgmap v381: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 8.5 KiB/s, 0 objects/s recovering 2024-09-21T02:34:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:35 smithi098 ceph-mon[34832]: pgmap v381: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 8.5 KiB/s, 0 objects/s recovering 2024-09-21T02:34:36.050 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266738 got 227633266740 for osd.8 2024-09-21T02:34:36.050 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:36.373 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462966 got 201863462970 for osd.7 2024-09-21T02:34:36.374 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:36.722 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:36 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1491386666' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:34:36.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:36 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1491386666' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:34:36.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:36 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1491386666' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:34:37.319 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626493 got 180388626496 for osd.6 2024-09-21T02:34:37.319 DEBUG:teuthology.parallel:result is None 2024-09-21T02:34:37.319 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:34:37.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:34:37.695 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:37 smithi079 ceph-mon[30788]: pgmap v382: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1 op/s; 8.5 KiB/s, 0 objects/s recovering 2024-09-21T02:34:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:37 smithi148 ceph-mon[34626]: pgmap v382: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1 op/s; 8.5 KiB/s, 0 objects/s recovering 2024-09-21T02:34:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:37 smithi098 ceph-mon[34832]: pgmap v382: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1 op/s; 8.5 KiB/s, 0 objects/s recovering 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 -- 172.21.15.79:0/3179977980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0109df0 msgr2=0x7f8cb0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/3179977980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0109df0 0x7f8cb0110620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009ca0 tx=0x7f8ca802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 -- 172.21.15.79:0/3179977980 shutdown_connections 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/3179977980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0109df0 0x7f8cb0110620 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/3179977980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cb01094a0 0x7f8cb01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/3179977980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cb0103b60 0x7f8cb0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 -- 172.21.15.79:0/3179977980 >> 172.21.15.79:0/3179977980 conn(0x7f8cb007b850 msgr2=0x7f8cb007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 -- 172.21.15.79:0/3179977980 shutdown_connections 2024-09-21T02:34:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.339+0000 7f8cb7c00640 1 -- 172.21.15.79:0/3179977980 wait complete. 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.340+0000 7f8cb7c00640 1 Processor -- start 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.340+0000 7f8cb7c00640 1 -- start start 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb7c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0103b60 0x7f8cb0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb7c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cb01094a0 0x7f8cb0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb7c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cb0109df0 0x7f8cb0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb7c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0113b00 con 0x7f8cb0103b60 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb7c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0113980 con 0x7f8cb01094a0 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb7c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0113c80 con 0x7f8cb0109df0 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0103b60 0x7f8cb0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0103b60 0x7f8cb0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49878/0 (socket says 172.21.15.79:49878) 2024-09-21T02:34:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cb5200640 1 -- 172.21.15.79:0/4105676293 learned_addr learned my addr 172.21.15.79:0/4105676293 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.341+0000 7f8cafe00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cb01094a0 0x7f8cb0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cb5c00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cb0109df0 0x7f8cb0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cb5200640 1 -- 172.21.15.79:0/4105676293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cb0109df0 msgr2=0x7f8cb0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cb5200640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cb0109df0 0x7f8cb0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cb5200640 1 -- 172.21.15.79:0/4105676293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cb01094a0 msgr2=0x7f8cb0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cb5200640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cb01094a0 0x7f8cb0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cb5200640 1 -- 172.21.15.79:0/4105676293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb01a8710 con 0x7f8cb0103b60 2024-09-21T02:34:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cafe00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cb01094a0 0x7f8cb0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cb5200640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0103b60 0x7f8cb0075710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400e9f0 tx=0x7f8ca400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.342+0000 7f8cad600640 1 -- 172.21.15.79:0/4105676293 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400cd80 con 0x7f8cb0103b60 2024-09-21T02:34:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.343+0000 7f8cad600640 1 -- 172.21.15.79:0/4105676293 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca40108e0 con 0x7f8cb0103b60 2024-09-21T02:34:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.343+0000 7f8cad600640 1 -- 172.21.15.79:0/4105676293 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4018980 con 0x7f8cb0103b60 2024-09-21T02:34:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.343+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb01a8a00 con 0x7f8cb0103b60 2024-09-21T02:34:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.343+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb01a8ef0 con 0x7f8cb0103b60 2024-09-21T02:34:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.344+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb0103f70 con 0x7f8cb0103b60 2024-09-21T02:34:38.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.346+0000 7f8cad600640 1 -- 172.21.15.79:0/4105676293 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8ca4010430 con 0x7f8cb0103b60 2024-09-21T02:34:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.348+0000 7f8cad600640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8c980b6620 0x7f8c980b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.348+0000 7f8cad600640 1 -- 172.21.15.79:0/4105676293 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8ca40e7b60 con 0x7f8cb0103b60 2024-09-21T02:34:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.348+0000 7f8cafe00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8c980b6620 0x7f8c980b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.349+0000 7f8cafe00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8c980b6620 0x7f8c980b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0107140 tx=0x7f8c9c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:38.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.352+0000 7f8cad600640 1 -- 172.21.15.79:0/4105676293 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ca40b2260 con 0x7f8cb0103b60 2024-09-21T02:34:38.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.544+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cb0063800 con 0x7f8c980b6620 2024-09-21T02:34:38.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.550+0000 7f8cad600640 1 -- 172.21.15.79:0/4105676293 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340315 (secure 0 0 0) 0x7f8cb0063800 con 0x7f8c980b6620 2024-09-21T02:34:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8c980b6620 msgr2=0x7f8c980b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8c980b6620 0x7f8c980b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0107140 tx=0x7f8c9c00b390 comp rx=0 tx=0).stop 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0103b60 msgr2=0x7f8cb0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0103b60 0x7f8cb0075710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400e9f0 tx=0x7f8ca400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 shutdown_connections 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8c980b6620 0x7f8c980b8b30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cb0109df0 0x7f8cb0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cb01094a0 0x7f8cb0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 --2- 172.21.15.79:0/4105676293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0103b60 0x7f8cb0075710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.555+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 >> 172.21.15.79:0/4105676293 conn(0x7f8cb007b850 msgr2=0x7f8cb0107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.556+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 shutdown_connections 2024-09-21T02:34:38.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:38.556+0000 7f8cb7c00640 1 -- 172.21.15.79:0/4105676293 wait complete. 2024-09-21T02:34:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:38 smithi148 ceph-mon[34626]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T02:34:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:38 smithi148 ceph-mon[34626]: Cluster is now healthy 2024-09-21T02:34:38.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:38 smithi098 ceph-mon[34832]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T02:34:38.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:38 smithi098 ceph-mon[34832]: Cluster is now healthy 2024-09-21T02:34:38.958 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:38 smithi079 ceph-mon[30788]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T02:34:38.958 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:38 smithi079 ceph-mon[30788]: Cluster is now healthy 2024-09-21T02:34:39.379 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-09-21T02:34:37.427674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":219,"num_write_kb":2253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3021711,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388064,"kb_used_data":13772,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553760,"statfs":{"total":1151940427776,"available":1151543050240,"internally_reserved":0,"allocated":14102528,"data_stored":8028503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":69871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002151"},"pg_stats":[{"pgid":"2.1f","version":"78'4","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.422142+0000","last_change":"2024-09-21T02:34:31.422073+0000","last_active":"2024-09-21T02:34:31.422142+0000","last_peered":"2024-09-21T02:34:31.422142+0000","last_clean":"2024-09-21T02:34:31.422142+0000","last_became_active":"2024-09-21T02:34:31.412208+0000","last_became_peered":"2024-09-21T02:34:31.412208+0000","last_unstale":"2024-09-21T02:34:31.422142+0000","last_undegraded":"2024-09-21T02:34:31.422142+0000","last_fullsized":"2024-09-21T02:34:31.422142+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.165710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409633+0000","last_change":"2024-09-21T02:32:41.473485+0000","last_active":"2024-09-21T02:34:31.409633+0000","last_peered":"2024-09-21T02:34:31.409633+0000","last_clean":"2024-09-21T02:34:31.409633+0000","last_became_active":"2024-09-21T02:32:41.473134+0000","last_became_peered":"2024-09-21T02:32:41.473134+0000","last_unstale":"2024-09-21T02:34:31.409633+0000","last_undegraded":"2024-09-21T02:34:31.409633+0000","last_fullsized":"2024-09-21T02:34:31.409633+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415762+0000","last_change":"2024-09-21T02:32:50.687618+0000","last_active":"2024-09-21T02:34:31.415762+0000","last_peered":"2024-09-21T02:34:31.415762+0000","last_clean":"2024-09-21T02:34:31.415762+0000","last_became_active":"2024-09-21T02:32:50.687157+0000","last_became_peered":"2024-09-21T02:32:50.687157+0000","last_unstale":"2024-09-21T02:34:31.415762+0000","last_undegraded":"2024-09-21T02:34:31.415762+0000","last_fullsized":"2024-09-21T02:34:31.415762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:29.247287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409867+0000","last_change":"2024-09-21T02:32:38.512667+0000","last_active":"2024-09-21T02:34:31.409867+0000","last_peered":"2024-09-21T02:34:31.409867+0000","last_clean":"2024-09-21T02:34:31.409867+0000","last_became_active":"2024-09-21T02:32:38.512261+0000","last_became_peered":"2024-09-21T02:32:38.512261+0000","last_unstale":"2024-09-21T02:34:31.409867+0000","last_undegraded":"2024-09-21T02:34:31.409867+0000","last_fullsized":"2024-09-21T02:34:31.409867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:05.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602401+0000","last_change":"2024-09-21T02:32:41.481816+0000","last_active":"2024-09-21T02:34:31.602401+0000","last_peered":"2024-09-21T02:34:31.602401+0000","last_clean":"2024-09-21T02:34:31.602401+0000","last_became_active":"2024-09-21T02:32:41.478295+0000","last_became_peered":"2024-09-21T02:32:41.478295+0000","last_unstale":"2024-09-21T02:34:31.602401+0000","last_undegraded":"2024-09-21T02:34:31.602401+0000","last_fullsized":"2024-09-21T02:34:31.602401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:58.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409468+0000","last_change":"2024-09-21T02:32:50.692598+0000","last_active":"2024-09-21T02:34:31.409468+0000","last_peered":"2024-09-21T02:34:31.409468+0000","last_clean":"2024-09-21T02:34:31.409468+0000","last_became_active":"2024-09-21T02:32:50.692120+0000","last_became_peered":"2024-09-21T02:32:50.692120+0000","last_unstale":"2024-09-21T02:34:31.409468+0000","last_undegraded":"2024-09-21T02:34:31.409468+0000","last_fullsized":"2024-09-21T02:34:31.409468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:57.642195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411058+0000","last_change":"2024-09-21T02:32:38.435292+0000","last_active":"2024-09-21T02:34:31.411058+0000","last_peered":"2024-09-21T02:34:31.411058+0000","last_clean":"2024-09-21T02:34:31.411058+0000","last_became_active":"2024-09-21T02:32:38.434878+0000","last_became_peered":"2024-09-21T02:32:38.434878+0000","last_unstale":"2024-09-21T02:34:31.411058+0000","last_undegraded":"2024-09-21T02:34:31.411058+0000","last_fullsized":"2024-09-21T02:34:31.411058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:56.827844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415945+0000","last_change":"2024-09-21T02:32:41.467834+0000","last_active":"2024-09-21T02:34:31.415945+0000","last_peered":"2024-09-21T02:34:31.415945+0000","last_clean":"2024-09-21T02:34:31.415945+0000","last_became_active":"2024-09-21T02:32:41.467440+0000","last_became_peered":"2024-09-21T02:32:41.467440+0000","last_unstale":"2024-09-21T02:34:31.415945+0000","last_undegraded":"2024-09-21T02:34:31.415945+0000","last_fullsized":"2024-09-21T02:34:31.415945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:16.857988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409793+0000","last_change":"2024-09-21T02:33:30.539580+0000","last_active":"2024-09-21T02:34:31.409793+0000","last_peered":"2024-09-21T02:34:31.409793+0000","last_clean":"2024-09-21T02:34:31.409793+0000","last_became_active":"2024-09-21T02:33:30.539088+0000","last_became_peered":"2024-09-21T02:33:30.539088+0000","last_unstale":"2024-09-21T02:34:31.409793+0000","last_undegraded":"2024-09-21T02:34:31.409793+0000","last_fullsized":"2024-09-21T02:34:31.409793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:42.437535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410548+0000","last_change":"2024-09-21T02:32:38.431645+0000","last_active":"2024-09-21T02:34:31.410548+0000","last_peered":"2024-09-21T02:34:31.410548+0000","last_clean":"2024-09-21T02:34:31.410548+0000","last_became_active":"2024-09-21T02:32:38.431069+0000","last_became_peered":"2024-09-21T02:32:38.431069+0000","last_unstale":"2024-09-21T02:34:31.410548+0000","last_undegraded":"2024-09-21T02:34:31.410548+0000","last_fullsized":"2024-09-21T02:34:31.410548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:34.893292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411775+0000","last_change":"2024-09-21T02:32:41.470506+0000","last_active":"2024-09-21T02:34:31.411775+0000","last_peered":"2024-09-21T02:34:31.411775+0000","last_clean":"2024-09-21T02:34:31.411775+0000","last_became_active":"2024-09-21T02:32:41.470165+0000","last_became_peered":"2024-09-21T02:32:41.470165+0000","last_unstale":"2024-09-21T02:34:31.411775+0000","last_undegraded":"2024-09-21T02:34:31.411775+0000","last_fullsized":"2024-09-21T02:34:31.411775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409551+0000","last_change":"2024-09-21T02:32:50.681923+0000","last_active":"2024-09-21T02:34:31.409551+0000","last_peered":"2024-09-21T02:34:31.409551+0000","last_clean":"2024-09-21T02:34:31.409551+0000","last_became_active":"2024-09-21T02:32:50.681374+0000","last_became_peered":"2024-09-21T02:32:50.681374+0000","last_unstale":"2024-09-21T02:34:31.409551+0000","last_undegraded":"2024-09-21T02:34:31.409551+0000","last_fullsized":"2024-09-21T02:34:31.409551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:46.060715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411685+0000","last_change":"2024-09-21T02:32:41.470550+0000","last_active":"2024-09-21T02:34:31.411685+0000","last_peered":"2024-09-21T02:34:31.411685+0000","last_clean":"2024-09-21T02:34:31.411685+0000","last_became_active":"2024-09-21T02:32:41.469282+0000","last_became_peered":"2024-09-21T02:32:41.469282+0000","last_unstale":"2024-09-21T02:34:31.411685+0000","last_undegraded":"2024-09-21T02:34:31.411685+0000","last_fullsized":"2024-09-21T02:34:31.411685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:34.619382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410262+0000","last_change":"2024-09-21T02:32:38.435261+0000","last_active":"2024-09-21T02:34:31.410262+0000","last_peered":"2024-09-21T02:34:31.410262+0000","last_clean":"2024-09-21T02:34:31.410262+0000","last_became_active":"2024-09-21T02:32:38.434795+0000","last_became_peered":"2024-09-21T02:32:38.434795+0000","last_unstale":"2024-09-21T02:34:31.410262+0000","last_undegraded":"2024-09-21T02:34:31.410262+0000","last_fullsized":"2024-09-21T02:34:31.410262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:05.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409842+0000","last_change":"2024-09-21T02:32:50.714657+0000","last_active":"2024-09-21T02:34:31.409842+0000","last_peered":"2024-09-21T02:34:31.409842+0000","last_clean":"2024-09-21T02:34:31.409842+0000","last_became_active":"2024-09-21T02:32:50.714077+0000","last_became_peered":"2024-09-21T02:32:50.714077+0000","last_unstale":"2024-09-21T02:34:31.409842+0000","last_undegraded":"2024-09-21T02:34:31.409842+0000","last_fullsized":"2024-09-21T02:34:31.409842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.812785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409777+0000","last_change":"2024-09-21T02:32:41.473964+0000","last_active":"2024-09-21T02:34:31.409777+0000","last_peered":"2024-09-21T02:34:31.409777+0000","last_clean":"2024-09-21T02:34:31.409777+0000","last_became_active":"2024-09-21T02:32:41.473598+0000","last_became_peered":"2024-09-21T02:32:41.473598+0000","last_unstale":"2024-09-21T02:34:31.409777+0000","last_undegraded":"2024-09-21T02:34:31.409777+0000","last_fullsized":"2024-09-21T02:34:31.409777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415867+0000","last_change":"2024-09-21T02:32:38.435800+0000","last_active":"2024-09-21T02:34:31.415867+0000","last_peered":"2024-09-21T02:34:31.415867+0000","last_clean":"2024-09-21T02:34:31.415867+0000","last_became_active":"2024-09-21T02:32:38.434797+0000","last_became_peered":"2024-09-21T02:32:38.434797+0000","last_unstale":"2024-09-21T02:34:31.415867+0000","last_undegraded":"2024-09-21T02:34:31.415867+0000","last_fullsized":"2024-09-21T02:34:31.415867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:46.540597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410017+0000","last_change":"2024-09-21T02:32:50.693447+0000","last_active":"2024-09-21T02:34:31.410017+0000","last_peered":"2024-09-21T02:34:31.410017+0000","last_clean":"2024-09-21T02:34:31.410017+0000","last_became_active":"2024-09-21T02:32:50.692829+0000","last_became_peered":"2024-09-21T02:32:50.692829+0000","last_unstale":"2024-09-21T02:34:31.410017+0000","last_undegraded":"2024-09-21T02:34:31.410017+0000","last_fullsized":"2024-09-21T02:34:31.410017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:10.958279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407255+0000","last_change":"2024-09-21T02:32:41.478053+0000","last_active":"2024-09-21T02:34:31.407255+0000","last_peered":"2024-09-21T02:34:31.407255+0000","last_clean":"2024-09-21T02:34:31.407255+0000","last_became_active":"2024-09-21T02:32:41.477631+0000","last_became_peered":"2024-09-21T02:32:41.477631+0000","last_unstale":"2024-09-21T02:34:31.407255+0000","last_undegraded":"2024-09-21T02:34:31.407255+0000","last_fullsized":"2024-09-21T02:34:31.407255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:19.548261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409566+0000","last_change":"2024-09-21T02:32:38.425388+0000","last_active":"2024-09-21T02:34:31.409566+0000","last_peered":"2024-09-21T02:34:31.409566+0000","last_clean":"2024-09-21T02:34:31.409566+0000","last_became_active":"2024-09-21T02:32:38.424975+0000","last_became_peered":"2024-09-21T02:32:38.424975+0000","last_unstale":"2024-09-21T02:34:31.409566+0000","last_undegraded":"2024-09-21T02:34:31.409566+0000","last_fullsized":"2024-09-21T02:34:31.409566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:43.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408129+0000","last_change":"2024-09-21T02:32:50.695406+0000","last_active":"2024-09-21T02:34:31.408129+0000","last_peered":"2024-09-21T02:34:31.408129+0000","last_clean":"2024-09-21T02:34:31.408129+0000","last_became_active":"2024-09-21T02:32:50.694958+0000","last_became_peered":"2024-09-21T02:32:50.694958+0000","last_unstale":"2024-09-21T02:34:31.408129+0000","last_undegraded":"2024-09-21T02:34:31.408129+0000","last_fullsized":"2024-09-21T02:34:31.408129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:49.038587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409869+0000","last_change":"2024-09-21T02:32:41.463475+0000","last_active":"2024-09-21T02:34:31.409869+0000","last_peered":"2024-09-21T02:34:31.409869+0000","last_clean":"2024-09-21T02:34:31.409869+0000","last_became_active":"2024-09-21T02:32:41.462950+0000","last_became_peered":"2024-09-21T02:32:41.462950+0000","last_unstale":"2024-09-21T02:34:31.409869+0000","last_undegraded":"2024-09-21T02:34:31.409869+0000","last_fullsized":"2024-09-21T02:34:31.409869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:40.871522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415807+0000","last_change":"2024-09-21T02:32:38.512534+0000","last_active":"2024-09-21T02:34:31.415807+0000","last_peered":"2024-09-21T02:34:31.415807+0000","last_clean":"2024-09-21T02:34:31.415807+0000","last_became_active":"2024-09-21T02:32:38.512162+0000","last_became_peered":"2024-09-21T02:32:38.512162+0000","last_unstale":"2024-09-21T02:34:31.415807+0000","last_undegraded":"2024-09-21T02:34:31.415807+0000","last_fullsized":"2024-09-21T02:34:31.415807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:35.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410045+0000","last_change":"2024-09-21T02:32:50.716000+0000","last_active":"2024-09-21T02:34:31.410045+0000","last_peered":"2024-09-21T02:34:31.410045+0000","last_clean":"2024-09-21T02:34:31.410045+0000","last_became_active":"2024-09-21T02:32:50.715371+0000","last_became_peered":"2024-09-21T02:32:50.715371+0000","last_unstale":"2024-09-21T02:34:31.410045+0000","last_undegraded":"2024-09-21T02:34:31.410045+0000","last_fullsized":"2024-09-21T02:34:31.410045+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:54.490957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602421+0000","last_change":"2024-09-21T02:32:41.479797+0000","last_active":"2024-09-21T02:34:31.602421+0000","last_peered":"2024-09-21T02:34:31.602421+0000","last_clean":"2024-09-21T02:34:31.602421+0000","last_became_active":"2024-09-21T02:32:41.479400+0000","last_became_peered":"2024-09-21T02:32:41.479400+0000","last_unstale":"2024-09-21T02:34:31.602421+0000","last_undegraded":"2024-09-21T02:34:31.602421+0000","last_fullsized":"2024-09-21T02:34:31.602421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:34.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410452+0000","last_change":"2024-09-21T02:32:38.748844+0000","last_active":"2024-09-21T02:34:31.410452+0000","last_peered":"2024-09-21T02:34:31.410452+0000","last_clean":"2024-09-21T02:34:31.410452+0000","last_became_active":"2024-09-21T02:32:38.748428+0000","last_became_peered":"2024-09-21T02:32:38.748428+0000","last_unstale":"2024-09-21T02:34:31.410452+0000","last_undegraded":"2024-09-21T02:34:31.410452+0000","last_fullsized":"2024-09-21T02:34:31.410452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:01.300290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415919+0000","last_change":"2024-09-21T02:32:50.681667+0000","last_active":"2024-09-21T02:34:31.415919+0000","last_peered":"2024-09-21T02:34:31.415919+0000","last_clean":"2024-09-21T02:34:31.415919+0000","last_became_active":"2024-09-21T02:32:50.681113+0000","last_became_peered":"2024-09-21T02:32:50.681113+0000","last_unstale":"2024-09-21T02:34:31.415919+0000","last_undegraded":"2024-09-21T02:34:31.415919+0000","last_fullsized":"2024-09-21T02:34:31.415919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:20.881199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409259+0000","last_change":"2024-09-21T02:32:41.466320+0000","last_active":"2024-09-21T02:34:31.409259+0000","last_peered":"2024-09-21T02:34:31.409259+0000","last_clean":"2024-09-21T02:34:31.409259+0000","last_became_active":"2024-09-21T02:32:41.462700+0000","last_became_peered":"2024-09-21T02:32:41.462700+0000","last_unstale":"2024-09-21T02:34:31.409259+0000","last_undegraded":"2024-09-21T02:34:31.409259+0000","last_fullsized":"2024-09-21T02:34:31.409259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:05.324192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408142+0000","last_change":"2024-09-21T02:32:38.432478+0000","last_active":"2024-09-21T02:34:31.408142+0000","last_peered":"2024-09-21T02:34:31.408142+0000","last_clean":"2024-09-21T02:34:31.408142+0000","last_became_active":"2024-09-21T02:32:38.431107+0000","last_became_peered":"2024-09-21T02:32:38.431107+0000","last_unstale":"2024-09-21T02:34:31.408142+0000","last_undegraded":"2024-09-21T02:34:31.408142+0000","last_fullsized":"2024-09-21T02:34:31.408142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:04.629078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408572+0000","last_change":"2024-09-21T02:32:50.715335+0000","last_active":"2024-09-21T02:34:31.408572+0000","last_peered":"2024-09-21T02:34:31.408572+0000","last_clean":"2024-09-21T02:34:31.408572+0000","last_became_active":"2024-09-21T02:32:50.714117+0000","last_became_peered":"2024-09-21T02:32:50.714117+0000","last_unstale":"2024-09-21T02:34:31.408572+0000","last_undegraded":"2024-09-21T02:34:31.408572+0000","last_fullsized":"2024-09-21T02:34:31.408572+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:53.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601350+0000","last_change":"2024-09-21T02:32:41.467613+0000","last_active":"2024-09-21T02:34:31.601350+0000","last_peered":"2024-09-21T02:34:31.601350+0000","last_clean":"2024-09-21T02:34:31.601350+0000","last_became_active":"2024-09-21T02:32:41.467136+0000","last_became_peered":"2024-09-21T02:32:41.467136+0000","last_unstale":"2024-09-21T02:34:31.601350+0000","last_undegraded":"2024-09-21T02:34:31.601350+0000","last_fullsized":"2024-09-21T02:34:31.601350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:16.929257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411185+0000","last_change":"2024-09-21T02:32:38.513591+0000","last_active":"2024-09-21T02:34:31.411185+0000","last_peered":"2024-09-21T02:34:31.411185+0000","last_clean":"2024-09-21T02:34:31.411185+0000","last_became_active":"2024-09-21T02:32:38.513169+0000","last_became_peered":"2024-09-21T02:32:38.513169+0000","last_unstale":"2024-09-21T02:34:31.411185+0000","last_undegraded":"2024-09-21T02:34:31.411185+0000","last_fullsized":"2024-09-21T02:34:31.411185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:24.038894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407236+0000","last_change":"2024-09-21T02:32:50.680165+0000","last_active":"2024-09-21T02:34:31.407236+0000","last_peered":"2024-09-21T02:34:31.407236+0000","last_clean":"2024-09-21T02:34:31.407236+0000","last_became_active":"2024-09-21T02:32:50.679730+0000","last_became_peered":"2024-09-21T02:32:50.679730+0000","last_unstale":"2024-09-21T02:34:31.407236+0000","last_undegraded":"2024-09-21T02:34:31.407236+0000","last_fullsized":"2024-09-21T02:34:31.407236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:25.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413286+0000","last_change":"2024-09-21T02:32:41.483355+0000","last_active":"2024-09-21T02:34:31.413286+0000","last_peered":"2024-09-21T02:34:31.413286+0000","last_clean":"2024-09-21T02:34:31.413286+0000","last_became_active":"2024-09-21T02:32:41.482786+0000","last_became_peered":"2024-09-21T02:32:41.482786+0000","last_unstale":"2024-09-21T02:34:31.413286+0000","last_undegraded":"2024-09-21T02:34:31.413286+0000","last_fullsized":"2024-09-21T02:34:31.413286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:46.277233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407818+0000","last_change":"2024-09-21T02:32:38.515173+0000","last_active":"2024-09-21T02:34:31.407818+0000","last_peered":"2024-09-21T02:34:31.407818+0000","last_clean":"2024-09-21T02:34:31.407818+0000","last_became_active":"2024-09-21T02:32:38.513341+0000","last_became_peered":"2024-09-21T02:32:38.513341+0000","last_unstale":"2024-09-21T02:34:31.407818+0000","last_undegraded":"2024-09-21T02:34:31.407818+0000","last_fullsized":"2024-09-21T02:34:31.407818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.988203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410760+0000","last_change":"2024-09-21T02:32:50.714389+0000","last_active":"2024-09-21T02:34:31.410760+0000","last_peered":"2024-09-21T02:34:31.410760+0000","last_clean":"2024-09-21T02:34:31.410760+0000","last_became_active":"2024-09-21T02:32:50.713859+0000","last_became_peered":"2024-09-21T02:32:50.713859+0000","last_unstale":"2024-09-21T02:34:31.410760+0000","last_undegraded":"2024-09-21T02:34:31.410760+0000","last_fullsized":"2024-09-21T02:34:31.410760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:41.315205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413006+0000","last_change":"2024-09-21T02:33:30.613550+0000","last_active":"2024-09-21T02:34:31.413006+0000","last_peered":"2024-09-21T02:34:31.413006+0000","last_clean":"2024-09-21T02:34:31.413006+0000","last_became_active":"2024-09-21T02:33:30.613216+0000","last_became_peered":"2024-09-21T02:33:30.613216+0000","last_unstale":"2024-09-21T02:34:31.413006+0000","last_undegraded":"2024-09-21T02:34:31.413006+0000","last_fullsized":"2024-09-21T02:34:31.413006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:11.076824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411910+0000","last_change":"2024-09-21T02:32:38.428428+0000","last_active":"2024-09-21T02:34:31.411910+0000","last_peered":"2024-09-21T02:34:31.411910+0000","last_clean":"2024-09-21T02:34:31.411910+0000","last_became_active":"2024-09-21T02:32:38.428066+0000","last_became_peered":"2024-09-21T02:32:38.428066+0000","last_unstale":"2024-09-21T02:34:31.411910+0000","last_undegraded":"2024-09-21T02:34:31.411910+0000","last_fullsized":"2024-09-21T02:34:31.411910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:45.601916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601210+0000","last_change":"2024-09-21T02:32:50.691139+0000","last_active":"2024-09-21T02:34:31.601210+0000","last_peered":"2024-09-21T02:34:31.601210+0000","last_clean":"2024-09-21T02:34:31.601210+0000","last_became_active":"2024-09-21T02:32:50.690653+0000","last_became_peered":"2024-09-21T02:32:50.690653+0000","last_unstale":"2024-09-21T02:34:31.601210+0000","last_undegraded":"2024-09-21T02:34:31.601210+0000","last_fullsized":"2024-09-21T02:34:31.601210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:43.852916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410437+0000","last_change":"2024-09-21T02:32:41.466857+0000","last_active":"2024-09-21T02:34:31.410437+0000","last_peered":"2024-09-21T02:34:31.410437+0000","last_clean":"2024-09-21T02:34:31.410437+0000","last_became_active":"2024-09-21T02:32:41.466467+0000","last_became_peered":"2024-09-21T02:32:41.466467+0000","last_unstale":"2024-09-21T02:34:31.410437+0000","last_undegraded":"2024-09-21T02:34:31.410437+0000","last_fullsized":"2024-09-21T02:34:31.410437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:29.369150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600787+0000","last_change":"2024-09-21T02:32:38.513999+0000","last_active":"2024-09-21T02:34:31.600787+0000","last_peered":"2024-09-21T02:34:31.600787+0000","last_clean":"2024-09-21T02:34:31.600787+0000","last_became_active":"2024-09-21T02:32:38.513605+0000","last_became_peered":"2024-09-21T02:32:38.513605+0000","last_unstale":"2024-09-21T02:34:31.600787+0000","last_undegraded":"2024-09-21T02:34:31.600787+0000","last_fullsized":"2024-09-21T02:34:31.600787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:45.616961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601179+0000","last_change":"2024-09-21T02:32:50.714830+0000","last_active":"2024-09-21T02:34:31.601179+0000","last_peered":"2024-09-21T02:34:31.601179+0000","last_clean":"2024-09-21T02:34:31.601179+0000","last_became_active":"2024-09-21T02:32:50.714166+0000","last_became_peered":"2024-09-21T02:32:50.714166+0000","last_unstale":"2024-09-21T02:34:31.601179+0000","last_undegraded":"2024-09-21T02:34:31.601179+0000","last_fullsized":"2024-09-21T02:34:31.601179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:35.418689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600657+0000","last_change":"2024-09-21T02:32:41.468695+0000","last_active":"2024-09-21T02:34:31.600657+0000","last_peered":"2024-09-21T02:34:31.600657+0000","last_clean":"2024-09-21T02:34:31.600657+0000","last_became_active":"2024-09-21T02:32:41.468349+0000","last_became_peered":"2024-09-21T02:32:41.468349+0000","last_unstale":"2024-09-21T02:34:31.600657+0000","last_undegraded":"2024-09-21T02:34:31.600657+0000","last_fullsized":"2024-09-21T02:34:31.600657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:51.935336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411076+0000","last_change":"2024-09-21T02:32:38.431187+0000","last_active":"2024-09-21T02:34:31.411076+0000","last_peered":"2024-09-21T02:34:31.411076+0000","last_clean":"2024-09-21T02:34:31.411076+0000","last_became_active":"2024-09-21T02:32:38.430790+0000","last_became_peered":"2024-09-21T02:32:38.430790+0000","last_unstale":"2024-09-21T02:34:31.411076+0000","last_undegraded":"2024-09-21T02:34:31.411076+0000","last_fullsized":"2024-09-21T02:34:31.411076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:05.004479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411303+0000","last_change":"2024-09-21T02:32:50.715728+0000","last_active":"2024-09-21T02:34:31.411303+0000","last_peered":"2024-09-21T02:34:31.411303+0000","last_clean":"2024-09-21T02:34:31.411303+0000","last_became_active":"2024-09-21T02:32:50.715329+0000","last_became_peered":"2024-09-21T02:32:50.715329+0000","last_unstale":"2024-09-21T02:34:31.411303+0000","last_undegraded":"2024-09-21T02:34:31.411303+0000","last_fullsized":"2024-09-21T02:34:31.411303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.790489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409307+0000","last_change":"2024-09-21T02:32:41.474885+0000","last_active":"2024-09-21T02:34:31.409307+0000","last_peered":"2024-09-21T02:34:31.409307+0000","last_clean":"2024-09-21T02:34:31.409307+0000","last_became_active":"2024-09-21T02:32:41.474599+0000","last_became_peered":"2024-09-21T02:32:41.474599+0000","last_unstale":"2024-09-21T02:34:31.409307+0000","last_undegraded":"2024-09-21T02:34:31.409307+0000","last_fullsized":"2024-09-21T02:34:31.409307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:43.006829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410372+0000","last_change":"2024-09-21T02:32:38.431168+0000","last_active":"2024-09-21T02:34:31.410372+0000","last_peered":"2024-09-21T02:34:31.410372+0000","last_clean":"2024-09-21T02:34:31.410372+0000","last_became_active":"2024-09-21T02:32:38.430743+0000","last_became_peered":"2024-09-21T02:32:38.430743+0000","last_unstale":"2024-09-21T02:34:31.410372+0000","last_undegraded":"2024-09-21T02:34:31.410372+0000","last_fullsized":"2024-09-21T02:34:31.410372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:54.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411399+0000","last_change":"2024-09-21T02:31:20.822638+0000","last_active":"2024-09-21T02:34:31.411399+0000","last_peered":"2024-09-21T02:34:31.411399+0000","last_clean":"2024-09-21T02:34:31.411399+0000","last_became_active":"2024-09-21T02:31:20.816679+0000","last_became_peered":"2024-09-21T02:31:20.816679+0000","last_unstale":"2024-09-21T02:34:31.411399+0000","last_undegraded":"2024-09-21T02:34:31.411399+0000","last_fullsized":"2024-09-21T02:34:31.411399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_clean_scrub_stamp":"2024-09-21T02:27:32.360535+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:51.568101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411653+0000","last_change":"2024-09-21T02:32:50.698437+0000","last_active":"2024-09-21T02:34:31.411653+0000","last_peered":"2024-09-21T02:34:31.411653+0000","last_clean":"2024-09-21T02:34:31.411653+0000","last_became_active":"2024-09-21T02:32:50.697814+0000","last_became_peered":"2024-09-21T02:32:50.697814+0000","last_unstale":"2024-09-21T02:34:31.411653+0000","last_undegraded":"2024-09-21T02:34:31.411653+0000","last_fullsized":"2024-09-21T02:34:31.411653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:51.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412115+0000","last_change":"2024-09-21T02:32:41.469539+0000","last_active":"2024-09-21T02:34:31.412115+0000","last_peered":"2024-09-21T02:34:31.412115+0000","last_clean":"2024-09-21T02:34:31.412115+0000","last_became_active":"2024-09-21T02:32:41.469060+0000","last_became_peered":"2024-09-21T02:32:41.469060+0000","last_unstale":"2024-09-21T02:34:31.412115+0000","last_undegraded":"2024-09-21T02:34:31.412115+0000","last_fullsized":"2024-09-21T02:34:31.412115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:36.699360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416482+0000","last_change":"2024-09-21T02:32:38.748487+0000","last_active":"2024-09-21T02:34:31.416482+0000","last_peered":"2024-09-21T02:34:31.416482+0000","last_clean":"2024-09-21T02:34:31.416482+0000","last_became_active":"2024-09-21T02:32:38.747956+0000","last_became_peered":"2024-09-21T02:32:38.747956+0000","last_unstale":"2024-09-21T02:34:31.416482+0000","last_undegraded":"2024-09-21T02:34:31.416482+0000","last_fullsized":"2024-09-21T02:34:31.416482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:15.745119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415850+0000","last_change":"2024-09-21T02:32:50.687412+0000","last_active":"2024-09-21T02:34:31.415850+0000","last_peered":"2024-09-21T02:34:31.415850+0000","last_clean":"2024-09-21T02:34:31.415850+0000","last_became_active":"2024-09-21T02:32:50.686819+0000","last_became_peered":"2024-09-21T02:32:50.686819+0000","last_unstale":"2024-09-21T02:34:31.415850+0000","last_undegraded":"2024-09-21T02:34:31.415850+0000","last_fullsized":"2024-09-21T02:34:31.415850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:28.830619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411500+0000","last_change":"2024-09-21T02:32:41.467719+0000","last_active":"2024-09-21T02:34:31.411500+0000","last_peered":"2024-09-21T02:34:31.411500+0000","last_clean":"2024-09-21T02:34:31.411500+0000","last_became_active":"2024-09-21T02:32:41.467332+0000","last_became_peered":"2024-09-21T02:32:41.467332+0000","last_unstale":"2024-09-21T02:34:31.411500+0000","last_undegraded":"2024-09-21T02:34:31.411500+0000","last_fullsized":"2024-09-21T02:34:31.411500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:06.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411939+0000","last_change":"2024-09-21T02:32:38.428553+0000","last_active":"2024-09-21T02:34:31.411939+0000","last_peered":"2024-09-21T02:34:31.411939+0000","last_clean":"2024-09-21T02:34:31.411939+0000","last_became_active":"2024-09-21T02:32:38.428159+0000","last_became_peered":"2024-09-21T02:32:38.428159+0000","last_unstale":"2024-09-21T02:34:31.411939+0000","last_undegraded":"2024-09-21T02:34:31.411939+0000","last_fullsized":"2024-09-21T02:34:31.411939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:17.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602104+0000","last_change":"2024-09-21T02:32:50.694290+0000","last_active":"2024-09-21T02:34:31.602104+0000","last_peered":"2024-09-21T02:34:31.602104+0000","last_clean":"2024-09-21T02:34:31.602104+0000","last_became_active":"2024-09-21T02:32:50.693794+0000","last_became_peered":"2024-09-21T02:32:50.693794+0000","last_unstale":"2024-09-21T02:34:31.602104+0000","last_undegraded":"2024-09-21T02:34:31.602104+0000","last_fullsized":"2024-09-21T02:34:31.602104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:07.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411790+0000","last_change":"2024-09-21T02:32:41.466802+0000","last_active":"2024-09-21T02:34:31.411790+0000","last_peered":"2024-09-21T02:34:31.411790+0000","last_clean":"2024-09-21T02:34:31.411790+0000","last_became_active":"2024-09-21T02:32:41.465348+0000","last_became_peered":"2024-09-21T02:32:41.465348+0000","last_unstale":"2024-09-21T02:34:31.411790+0000","last_undegraded":"2024-09-21T02:34:31.411790+0000","last_fullsized":"2024-09-21T02:34:31.411790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:23.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601363+0000","last_change":"2024-09-21T02:32:38.435725+0000","last_active":"2024-09-21T02:34:31.601363+0000","last_peered":"2024-09-21T02:34:31.601363+0000","last_clean":"2024-09-21T02:34:31.601363+0000","last_became_active":"2024-09-21T02:32:38.434688+0000","last_became_peered":"2024-09-21T02:32:38.434688+0000","last_unstale":"2024-09-21T02:34:31.601363+0000","last_undegraded":"2024-09-21T02:34:31.601363+0000","last_fullsized":"2024-09-21T02:34:31.601363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:27.829955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410365+0000","last_change":"2024-09-21T02:33:31.041957+0000","last_active":"2024-09-21T02:34:31.410365+0000","last_peered":"2024-09-21T02:34:31.410365+0000","last_clean":"2024-09-21T02:34:31.410365+0000","last_became_active":"2024-09-21T02:33:31.041160+0000","last_became_peered":"2024-09-21T02:33:31.041160+0000","last_unstale":"2024-09-21T02:34:31.410365+0000","last_undegraded":"2024-09-21T02:34:31.410365+0000","last_fullsized":"2024-09-21T02:34:31.410365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.226199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7,1],"acting":[8,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407566+0000","last_change":"2024-09-21T02:32:41.474796+0000","last_active":"2024-09-21T02:34:31.407566+0000","last_peered":"2024-09-21T02:34:31.407566+0000","last_clean":"2024-09-21T02:34:31.407566+0000","last_became_active":"2024-09-21T02:32:41.474377+0000","last_became_peered":"2024-09-21T02:32:41.474377+0000","last_unstale":"2024-09-21T02:34:31.407566+0000","last_undegraded":"2024-09-21T02:34:31.407566+0000","last_fullsized":"2024-09-21T02:34:31.407566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.418508+0000","last_change":"2024-09-21T02:34:31.418421+0000","last_active":"2024-09-21T02:34:31.418508+0000","last_peered":"2024-09-21T02:34:31.418508+0000","last_clean":"2024-09-21T02:34:31.418508+0000","last_became_active":"2024-09-21T02:34:31.413206+0000","last_became_peered":"2024-09-21T02:34:31.413206+0000","last_unstale":"2024-09-21T02:34:31.418508+0000","last_undegraded":"2024-09-21T02:34:31.418508+0000","last_fullsized":"2024-09-21T02:34:31.418508+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:33.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410471+0000","last_change":"2024-09-21T02:32:50.685932+0000","last_active":"2024-09-21T02:34:31.410471+0000","last_peered":"2024-09-21T02:34:31.410471+0000","last_clean":"2024-09-21T02:34:31.410471+0000","last_became_active":"2024-09-21T02:32:50.685584+0000","last_became_peered":"2024-09-21T02:32:50.685584+0000","last_unstale":"2024-09-21T02:34:31.410471+0000","last_undegraded":"2024-09-21T02:34:31.410471+0000","last_fullsized":"2024-09-21T02:34:31.410471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:42.118046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410610+0000","last_change":"2024-09-21T02:33:31.041507+0000","last_active":"2024-09-21T02:34:31.410610+0000","last_peered":"2024-09-21T02:34:31.410610+0000","last_clean":"2024-09-21T02:34:31.410610+0000","last_became_active":"2024-09-21T02:33:31.040982+0000","last_became_peered":"2024-09-21T02:33:31.040982+0000","last_unstale":"2024-09-21T02:34:31.410610+0000","last_undegraded":"2024-09-21T02:34:31.410610+0000","last_fullsized":"2024-09-21T02:34:31.410610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:17.608426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410120+0000","last_change":"2024-09-21T02:32:38.512557+0000","last_active":"2024-09-21T02:34:31.410120+0000","last_peered":"2024-09-21T02:34:31.410120+0000","last_clean":"2024-09-21T02:34:31.410120+0000","last_became_active":"2024-09-21T02:32:38.512069+0000","last_became_peered":"2024-09-21T02:32:38.512069+0000","last_unstale":"2024-09-21T02:34:31.410120+0000","last_undegraded":"2024-09-21T02:34:31.410120+0000","last_fullsized":"2024-09-21T02:34:31.410120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:55.038548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601248+0000","last_change":"2024-09-21T02:32:50.698539+0000","last_active":"2024-09-21T02:34:31.601248+0000","last_peered":"2024-09-21T02:34:31.601248+0000","last_clean":"2024-09-21T02:34:31.601248+0000","last_became_active":"2024-09-21T02:32:50.698107+0000","last_became_peered":"2024-09-21T02:32:50.698107+0000","last_unstale":"2024-09-21T02:34:31.601248+0000","last_undegraded":"2024-09-21T02:34:31.601248+0000","last_fullsized":"2024-09-21T02:34:31.601248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:43.141885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411068+0000","last_change":"2024-09-21T02:32:41.468472+0000","last_active":"2024-09-21T02:34:31.411068+0000","last_peered":"2024-09-21T02:34:31.411068+0000","last_clean":"2024-09-21T02:34:31.411068+0000","last_became_active":"2024-09-21T02:32:41.468039+0000","last_became_peered":"2024-09-21T02:32:41.468039+0000","last_unstale":"2024-09-21T02:34:31.411068+0000","last_undegraded":"2024-09-21T02:34:31.411068+0000","last_fullsized":"2024-09-21T02:34:31.411068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:00.501173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409973+0000","last_change":"2024-09-21T02:32:38.431613+0000","last_active":"2024-09-21T02:34:31.409973+0000","last_peered":"2024-09-21T02:34:31.409973+0000","last_clean":"2024-09-21T02:34:31.409973+0000","last_became_active":"2024-09-21T02:32:38.431128+0000","last_became_peered":"2024-09-21T02:32:38.431128+0000","last_unstale":"2024-09-21T02:34:31.409973+0000","last_undegraded":"2024-09-21T02:34:31.409973+0000","last_fullsized":"2024-09-21T02:34:31.409973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:09.400651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408160+0000","last_change":"2024-09-21T02:32:50.691401+0000","last_active":"2024-09-21T02:34:31.408160+0000","last_peered":"2024-09-21T02:34:31.408160+0000","last_clean":"2024-09-21T02:34:31.408160+0000","last_became_active":"2024-09-21T02:32:50.688202+0000","last_became_peered":"2024-09-21T02:32:50.688202+0000","last_unstale":"2024-09-21T02:34:31.408160+0000","last_undegraded":"2024-09-21T02:34:31.408160+0000","last_fullsized":"2024-09-21T02:34:31.408160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:42.516887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411431+0000","last_change":"2024-09-21T02:32:41.475760+0000","last_active":"2024-09-21T02:34:31.411431+0000","last_peered":"2024-09-21T02:34:31.411431+0000","last_clean":"2024-09-21T02:34:31.411431+0000","last_became_active":"2024-09-21T02:32:41.475381+0000","last_became_peered":"2024-09-21T02:32:41.475381+0000","last_unstale":"2024-09-21T02:34:31.411431+0000","last_undegraded":"2024-09-21T02:34:31.411431+0000","last_fullsized":"2024-09-21T02:34:31.411431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.070064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410941+0000","last_change":"2024-09-21T02:32:38.424789+0000","last_active":"2024-09-21T02:34:31.410941+0000","last_peered":"2024-09-21T02:34:31.410941+0000","last_clean":"2024-09-21T02:34:31.410941+0000","last_became_active":"2024-09-21T02:32:38.424275+0000","last_became_peered":"2024-09-21T02:32:38.424275+0000","last_unstale":"2024-09-21T02:34:31.410941+0000","last_undegraded":"2024-09-21T02:34:31.410941+0000","last_fullsized":"2024-09-21T02:34:31.410941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:50.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407286+0000","last_change":"2024-09-21T02:32:50.692496+0000","last_active":"2024-09-21T02:34:31.407286+0000","last_peered":"2024-09-21T02:34:31.407286+0000","last_clean":"2024-09-21T02:34:31.407286+0000","last_became_active":"2024-09-21T02:32:50.692055+0000","last_became_peered":"2024-09-21T02:32:50.692055+0000","last_unstale":"2024-09-21T02:34:31.407286+0000","last_undegraded":"2024-09-21T02:34:31.407286+0000","last_fullsized":"2024-09-21T02:34:31.407286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:25.433298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600960+0000","last_change":"2024-09-21T02:32:41.475732+0000","last_active":"2024-09-21T02:34:31.600960+0000","last_peered":"2024-09-21T02:34:31.600960+0000","last_clean":"2024-09-21T02:34:31.600960+0000","last_became_active":"2024-09-21T02:32:41.475395+0000","last_became_peered":"2024-09-21T02:32:41.475395+0000","last_unstale":"2024-09-21T02:34:31.600960+0000","last_undegraded":"2024-09-21T02:34:31.600960+0000","last_fullsized":"2024-09-21T02:34:31.600960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:26.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416147+0000","last_change":"2024-09-21T02:32:38.434080+0000","last_active":"2024-09-21T02:34:31.416147+0000","last_peered":"2024-09-21T02:34:31.416147+0000","last_clean":"2024-09-21T02:34:31.416147+0000","last_became_active":"2024-09-21T02:32:38.433625+0000","last_became_peered":"2024-09-21T02:32:38.433625+0000","last_unstale":"2024-09-21T02:34:31.416147+0000","last_undegraded":"2024-09-21T02:34:31.416147+0000","last_fullsized":"2024-09-21T02:34:31.416147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:11.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411522+0000","last_change":"2024-09-21T02:32:50.687555+0000","last_active":"2024-09-21T02:34:31.411522+0000","last_peered":"2024-09-21T02:34:31.411522+0000","last_clean":"2024-09-21T02:34:31.411522+0000","last_became_active":"2024-09-21T02:32:50.686979+0000","last_became_peered":"2024-09-21T02:32:50.686979+0000","last_unstale":"2024-09-21T02:34:31.411522+0000","last_undegraded":"2024-09-21T02:34:31.411522+0000","last_fullsized":"2024-09-21T02:34:31.411522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:01.136515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410876+0000","last_change":"2024-09-21T02:32:41.463688+0000","last_active":"2024-09-21T02:34:31.410876+0000","last_peered":"2024-09-21T02:34:31.410876+0000","last_clean":"2024-09-21T02:34:31.410876+0000","last_became_active":"2024-09-21T02:32:41.463306+0000","last_became_peered":"2024-09-21T02:32:41.463306+0000","last_unstale":"2024-09-21T02:34:31.410876+0000","last_undegraded":"2024-09-21T02:34:31.410876+0000","last_fullsized":"2024-09-21T02:34:31.410876+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:46.217029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'34","reported_seq":223,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:33.423886+0000","last_change":"2024-09-21T02:34:31.423753+0000","last_active":"2024-09-21T02:34:33.423886+0000","last_peered":"2024-09-21T02:34:33.423886+0000","last_clean":"2024-09-21T02:34:33.423886+0000","last_became_active":"2024-09-21T02:34:31.417307+0000","last_became_peered":"2024-09-21T02:34:31.417307+0000","last_unstale":"2024-09-21T02:34:33.423886+0000","last_undegraded":"2024-09-21T02:34:33.423886+0000","last_fullsized":"2024-09-21T02:34:33.423886+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:29.538505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":130,"num_read_kb":133,"num_write":34,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":69267,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412671+0000","last_change":"2024-09-21T02:33:30.538615+0000","last_active":"2024-09-21T02:34:31.412671+0000","last_peered":"2024-09-21T02:34:31.412671+0000","last_clean":"2024-09-21T02:34:31.412671+0000","last_became_active":"2024-09-21T02:33:30.538046+0000","last_became_peered":"2024-09-21T02:33:30.538046+0000","last_unstale":"2024-09-21T02:34:31.412671+0000","last_undegraded":"2024-09-21T02:34:31.412671+0000","last_fullsized":"2024-09-21T02:34:31.412671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:04.235706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416192+0000","last_change":"2024-09-21T02:32:41.470318+0000","last_active":"2024-09-21T02:34:31.416192+0000","last_peered":"2024-09-21T02:34:31.416192+0000","last_clean":"2024-09-21T02:34:31.416192+0000","last_became_active":"2024-09-21T02:32:41.466804+0000","last_became_peered":"2024-09-21T02:32:41.466804+0000","last_unstale":"2024-09-21T02:34:31.416192+0000","last_undegraded":"2024-09-21T02:34:31.416192+0000","last_fullsized":"2024-09-21T02:34:31.416192+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411783+0000","last_change":"2024-09-21T02:32:38.514901+0000","last_active":"2024-09-21T02:34:31.411783+0000","last_peered":"2024-09-21T02:34:31.411783+0000","last_clean":"2024-09-21T02:34:31.411783+0000","last_became_active":"2024-09-21T02:32:38.514497+0000","last_became_peered":"2024-09-21T02:32:38.514497+0000","last_unstale":"2024-09-21T02:34:31.411783+0000","last_undegraded":"2024-09-21T02:34:31.411783+0000","last_fullsized":"2024-09-21T02:34:31.411783+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:02.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410176+0000","last_change":"2024-09-21T02:33:31.041566+0000","last_active":"2024-09-21T02:34:31.410176+0000","last_peered":"2024-09-21T02:34:31.410176+0000","last_clean":"2024-09-21T02:34:31.410176+0000","last_became_active":"2024-09-21T02:33:31.041041+0000","last_became_peered":"2024-09-21T02:33:31.041041+0000","last_unstale":"2024-09-21T02:34:31.410176+0000","last_undegraded":"2024-09-21T02:34:31.410176+0000","last_fullsized":"2024-09-21T02:34:31.410176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:00.236406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602510+0000","last_change":"2024-09-21T02:32:41.483502+0000","last_active":"2024-09-21T02:34:31.602510+0000","last_peered":"2024-09-21T02:34:31.602510+0000","last_clean":"2024-09-21T02:34:31.602510+0000","last_became_active":"2024-09-21T02:32:41.483116+0000","last_became_peered":"2024-09-21T02:32:41.483116+0000","last_unstale":"2024-09-21T02:34:31.602510+0000","last_undegraded":"2024-09-21T02:34:31.602510+0000","last_fullsized":"2024-09-21T02:34:31.602510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:39.146202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411971+0000","last_change":"2024-09-21T02:33:31.041819+0000","last_active":"2024-09-21T02:34:31.411971+0000","last_peered":"2024-09-21T02:34:31.411971+0000","last_clean":"2024-09-21T02:34:31.411971+0000","last_became_active":"2024-09-21T02:33:31.041241+0000","last_became_peered":"2024-09-21T02:33:31.041241+0000","last_unstale":"2024-09-21T02:34:31.411971+0000","last_undegraded":"2024-09-21T02:34:31.411971+0000","last_fullsized":"2024-09-21T02:34:31.411971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:00.241618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407242+0000","last_change":"2024-09-21T02:32:50.692227+0000","last_active":"2024-09-21T02:34:31.407242+0000","last_peered":"2024-09-21T02:34:31.407242+0000","last_clean":"2024-09-21T02:34:31.407242+0000","last_became_active":"2024-09-21T02:32:50.691787+0000","last_became_peered":"2024-09-21T02:32:50.691787+0000","last_unstale":"2024-09-21T02:34:31.407242+0000","last_undegraded":"2024-09-21T02:34:31.407242+0000","last_fullsized":"2024-09-21T02:34:31.407242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:40.086313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416685+0000","last_change":"2024-09-21T02:32:41.476056+0000","last_active":"2024-09-21T02:34:31.416685+0000","last_peered":"2024-09-21T02:34:31.416685+0000","last_clean":"2024-09-21T02:34:31.416685+0000","last_became_active":"2024-09-21T02:32:41.475525+0000","last_became_peered":"2024-09-21T02:32:41.475525+0000","last_unstale":"2024-09-21T02:34:31.416685+0000","last_undegraded":"2024-09-21T02:34:31.416685+0000","last_fullsized":"2024-09-21T02:34:31.416685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:42.074296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413561+0000","last_change":"2024-09-21T02:32:38.430845+0000","last_active":"2024-09-21T02:34:31.413561+0000","last_peered":"2024-09-21T02:34:31.413561+0000","last_clean":"2024-09-21T02:34:31.413561+0000","last_became_active":"2024-09-21T02:32:38.430372+0000","last_became_peered":"2024-09-21T02:32:38.430372+0000","last_unstale":"2024-09-21T02:34:31.413561+0000","last_undegraded":"2024-09-21T02:34:31.413561+0000","last_fullsized":"2024-09-21T02:34:31.413561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:40.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409209+0000","last_change":"2024-09-21T02:32:50.685481+0000","last_active":"2024-09-21T02:34:31.409209+0000","last_peered":"2024-09-21T02:34:31.409209+0000","last_clean":"2024-09-21T02:34:31.409209+0000","last_became_active":"2024-09-21T02:32:50.685044+0000","last_became_peered":"2024-09-21T02:32:50.685044+0000","last_unstale":"2024-09-21T02:34:31.409209+0000","last_undegraded":"2024-09-21T02:34:31.409209+0000","last_fullsized":"2024-09-21T02:34:31.409209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:33.132966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602251+0000","last_change":"2024-09-21T02:32:50.690447+0000","last_active":"2024-09-21T02:34:31.602251+0000","last_peered":"2024-09-21T02:34:31.602251+0000","last_clean":"2024-09-21T02:34:31.602251+0000","last_became_active":"2024-09-21T02:32:50.690021+0000","last_became_peered":"2024-09-21T02:32:50.690021+0000","last_unstale":"2024-09-21T02:34:31.602251+0000","last_undegraded":"2024-09-21T02:34:31.602251+0000","last_fullsized":"2024-09-21T02:34:31.602251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:44.436690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407416+0000","last_change":"2024-09-21T02:32:41.469186+0000","last_active":"2024-09-21T02:34:31.407416+0000","last_peered":"2024-09-21T02:34:31.407416+0000","last_clean":"2024-09-21T02:34:31.407416+0000","last_became_active":"2024-09-21T02:32:41.468837+0000","last_became_peered":"2024-09-21T02:32:41.468837+0000","last_unstale":"2024-09-21T02:34:31.407416+0000","last_undegraded":"2024-09-21T02:34:31.407416+0000","last_fullsized":"2024-09-21T02:34:31.407416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:02.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411539+0000","last_change":"2024-09-21T02:32:38.426631+0000","last_active":"2024-09-21T02:34:31.411539+0000","last_peered":"2024-09-21T02:34:31.411539+0000","last_clean":"2024-09-21T02:34:31.411539+0000","last_became_active":"2024-09-21T02:32:38.425600+0000","last_became_peered":"2024-09-21T02:32:38.425600+0000","last_unstale":"2024-09-21T02:34:31.411539+0000","last_undegraded":"2024-09-21T02:34:31.411539+0000","last_fullsized":"2024-09-21T02:34:31.411539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.669245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407581+0000","last_change":"2024-09-21T02:32:50.697935+0000","last_active":"2024-09-21T02:34:31.407581+0000","last_peered":"2024-09-21T02:34:31.407581+0000","last_clean":"2024-09-21T02:34:31.407581+0000","last_became_active":"2024-09-21T02:32:50.697537+0000","last_became_peered":"2024-09-21T02:32:50.697537+0000","last_unstale":"2024-09-21T02:34:31.407581+0000","last_undegraded":"2024-09-21T02:34:31.407581+0000","last_fullsized":"2024-09-21T02:34:31.407581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:32.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408783+0000","last_change":"2024-09-21T02:32:41.458640+0000","last_active":"2024-09-21T02:34:31.408783+0000","last_peered":"2024-09-21T02:34:31.408783+0000","last_clean":"2024-09-21T02:34:31.408783+0000","last_became_active":"2024-09-21T02:32:41.458231+0000","last_became_peered":"2024-09-21T02:32:41.458231+0000","last_unstale":"2024-09-21T02:34:31.408783+0000","last_undegraded":"2024-09-21T02:34:31.408783+0000","last_fullsized":"2024-09-21T02:34:31.408783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:26.132979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600785+0000","last_change":"2024-09-21T02:32:38.430888+0000","last_active":"2024-09-21T02:34:31.600785+0000","last_peered":"2024-09-21T02:34:31.600785+0000","last_clean":"2024-09-21T02:34:31.600785+0000","last_became_active":"2024-09-21T02:32:38.430516+0000","last_became_peered":"2024-09-21T02:32:38.430516+0000","last_unstale":"2024-09-21T02:34:31.600785+0000","last_undegraded":"2024-09-21T02:34:31.600785+0000","last_fullsized":"2024-09-21T02:34:31.600785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:54.671763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412860+0000","last_change":"2024-09-21T02:32:38.434012+0000","last_active":"2024-09-21T02:34:31.412860+0000","last_peered":"2024-09-21T02:34:31.412860+0000","last_clean":"2024-09-21T02:34:31.412860+0000","last_became_active":"2024-09-21T02:32:38.433571+0000","last_became_peered":"2024-09-21T02:32:38.433571+0000","last_unstale":"2024-09-21T02:34:31.412860+0000","last_undegraded":"2024-09-21T02:34:31.412860+0000","last_fullsized":"2024-09-21T02:34:31.412860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:59.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411182+0000","last_change":"2024-09-21T02:33:30.650855+0000","last_active":"2024-09-21T02:34:31.411182+0000","last_peered":"2024-09-21T02:34:31.411182+0000","last_clean":"2024-09-21T02:34:31.411182+0000","last_became_active":"2024-09-21T02:33:30.650428+0000","last_became_peered":"2024-09-21T02:33:30.650428+0000","last_unstale":"2024-09-21T02:34:31.411182+0000","last_undegraded":"2024-09-21T02:34:31.411182+0000","last_fullsized":"2024-09-21T02:34:31.411182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:55.757861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416100+0000","last_change":"2024-09-21T02:32:50.698249+0000","last_active":"2024-09-21T02:34:31.416100+0000","last_peered":"2024-09-21T02:34:31.416100+0000","last_clean":"2024-09-21T02:34:31.416100+0000","last_became_active":"2024-09-21T02:32:50.697768+0000","last_became_peered":"2024-09-21T02:32:50.697768+0000","last_unstale":"2024-09-21T02:34:31.416100+0000","last_undegraded":"2024-09-21T02:34:31.416100+0000","last_fullsized":"2024-09-21T02:34:31.416100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.723420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411300+0000","last_change":"2024-09-21T02:32:38.435733+0000","last_active":"2024-09-21T02:34:31.411300+0000","last_peered":"2024-09-21T02:34:31.411300+0000","last_clean":"2024-09-21T02:34:31.411300+0000","last_became_active":"2024-09-21T02:32:38.435288+0000","last_became_peered":"2024-09-21T02:32:38.435288+0000","last_unstale":"2024-09-21T02:34:31.411300+0000","last_undegraded":"2024-09-21T02:34:31.411300+0000","last_fullsized":"2024-09-21T02:34:31.411300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.430652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409999+0000","last_change":"2024-09-21T02:32:41.468127+0000","last_active":"2024-09-21T02:34:31.409999+0000","last_peered":"2024-09-21T02:34:31.409999+0000","last_clean":"2024-09-21T02:34:31.409999+0000","last_became_active":"2024-09-21T02:32:41.467730+0000","last_became_peered":"2024-09-21T02:32:41.467730+0000","last_unstale":"2024-09-21T02:34:31.409999+0000","last_undegraded":"2024-09-21T02:34:31.409999+0000","last_fullsized":"2024-09-21T02:34:31.409999+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:39.684035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416383+0000","last_change":"2024-09-21T02:32:50.684115+0000","last_active":"2024-09-21T02:34:31.416383+0000","last_peered":"2024-09-21T02:34:31.416383+0000","last_clean":"2024-09-21T02:34:31.416383+0000","last_became_active":"2024-09-21T02:32:50.683627+0000","last_became_peered":"2024-09-21T02:32:50.683627+0000","last_unstale":"2024-09-21T02:34:31.416383+0000","last_undegraded":"2024-09-21T02:34:31.416383+0000","last_fullsized":"2024-09-21T02:34:31.416383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:10.953943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407103+0000","last_change":"2024-09-21T02:32:41.465744+0000","last_active":"2024-09-21T02:34:31.407103+0000","last_peered":"2024-09-21T02:34:31.407103+0000","last_clean":"2024-09-21T02:34:31.407103+0000","last_became_active":"2024-09-21T02:32:41.465392+0000","last_became_peered":"2024-09-21T02:32:41.465392+0000","last_unstale":"2024-09-21T02:34:31.407103+0000","last_undegraded":"2024-09-21T02:34:31.407103+0000","last_fullsized":"2024-09-21T02:34:31.407103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:54.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416061+0000","last_change":"2024-09-21T02:32:41.470967+0000","last_active":"2024-09-21T02:34:31.416061+0000","last_peered":"2024-09-21T02:34:31.416061+0000","last_clean":"2024-09-21T02:34:31.416061+0000","last_became_active":"2024-09-21T02:32:41.470547+0000","last_became_peered":"2024-09-21T02:32:41.470547+0000","last_unstale":"2024-09-21T02:34:31.416061+0000","last_undegraded":"2024-09-21T02:34:31.416061+0000","last_fullsized":"2024-09-21T02:34:31.416061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:57.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416216+0000","last_change":"2024-09-21T02:32:41.474500+0000","last_active":"2024-09-21T02:34:31.416216+0000","last_peered":"2024-09-21T02:34:31.416216+0000","last_clean":"2024-09-21T02:34:31.416216+0000","last_became_active":"2024-09-21T02:32:41.474117+0000","last_became_peered":"2024-09-21T02:32:41.474117+0000","last_unstale":"2024-09-21T02:34:31.416216+0000","last_undegraded":"2024-09-21T02:34:31.416216+0000","last_fullsized":"2024-09-21T02:34:31.416216+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:43.152503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602107+0000","last_change":"2024-09-21T02:32:41.479123+0000","last_active":"2024-09-21T02:34:31.602107+0000","last_peered":"2024-09-21T02:34:31.602107+0000","last_clean":"2024-09-21T02:34:31.602107+0000","last_became_active":"2024-09-21T02:32:41.478543+0000","last_became_peered":"2024-09-21T02:32:41.478543+0000","last_unstale":"2024-09-21T02:34:31.602107+0000","last_undegraded":"2024-09-21T02:34:31.602107+0000","last_fullsized":"2024-09-21T02:34:31.602107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:39.802425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601358+0000","last_change":"2024-09-21T02:32:41.483334+0000","last_active":"2024-09-21T02:34:31.601358+0000","last_peered":"2024-09-21T02:34:31.601358+0000","last_clean":"2024-09-21T02:34:31.601358+0000","last_became_active":"2024-09-21T02:32:41.482999+0000","last_became_peered":"2024-09-21T02:32:41.482999+0000","last_unstale":"2024-09-21T02:34:31.601358+0000","last_undegraded":"2024-09-21T02:34:31.601358+0000","last_fullsized":"2024-09-21T02:34:31.601358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:16.259647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407511+0000","last_change":"2024-09-21T02:33:30.539417+0000","last_active":"2024-09-21T02:34:31.407511+0000","last_peered":"2024-09-21T02:34:31.407511+0000","last_clean":"2024-09-21T02:34:31.407511+0000","last_became_active":"2024-09-21T02:33:30.538970+0000","last_became_peered":"2024-09-21T02:33:30.538970+0000","last_unstale":"2024-09-21T02:34:31.407511+0000","last_undegraded":"2024-09-21T02:34:31.407511+0000","last_fullsized":"2024-09-21T02:34:31.407511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:09.772513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416699+0000","last_change":"2024-09-21T02:32:41.469386+0000","last_active":"2024-09-21T02:34:31.416699+0000","last_peered":"2024-09-21T02:34:31.416699+0000","last_clean":"2024-09-21T02:34:31.416699+0000","last_became_active":"2024-09-21T02:32:41.468982+0000","last_became_peered":"2024-09-21T02:32:41.468982+0000","last_unstale":"2024-09-21T02:34:31.416699+0000","last_undegraded":"2024-09-21T02:34:31.416699+0000","last_fullsized":"2024-09-21T02:34:31.416699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.644854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409193+0000","last_change":"2024-09-21T02:32:41.467365+0000","last_active":"2024-09-21T02:34:31.409193+0000","last_peered":"2024-09-21T02:34:31.409193+0000","last_clean":"2024-09-21T02:34:31.409193+0000","last_became_active":"2024-09-21T02:32:41.466893+0000","last_became_peered":"2024-09-21T02:32:41.466893+0000","last_unstale":"2024-09-21T02:34:31.409193+0000","last_undegraded":"2024-09-21T02:34:31.409193+0000","last_fullsized":"2024-09-21T02:34:31.409193+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410286+0000","last_change":"2024-09-21T02:32:41.473695+0000","last_active":"2024-09-21T02:34:31.410286+0000","last_peered":"2024-09-21T02:34:31.410286+0000","last_clean":"2024-09-21T02:34:31.410286+0000","last_became_active":"2024-09-21T02:32:41.473035+0000","last_became_peered":"2024-09-21T02:32:41.473035+0000","last_unstale":"2024-09-21T02:34:31.410286+0000","last_undegraded":"2024-09-21T02:34:31.410286+0000","last_fullsized":"2024-09-21T02:34:31.410286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:54.343984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409402+0000","last_change":"2024-09-21T02:32:41.473578+0000","last_active":"2024-09-21T02:34:31.409402+0000","last_peered":"2024-09-21T02:34:31.409402+0000","last_clean":"2024-09-21T02:34:31.409402+0000","last_became_active":"2024-09-21T02:32:41.472983+0000","last_became_peered":"2024-09-21T02:32:41.472983+0000","last_unstale":"2024-09-21T02:34:31.409402+0000","last_undegraded":"2024-09-21T02:34:31.409402+0000","last_fullsized":"2024-09-21T02:34:31.409402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.895809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416461+0000","last_change":"2024-09-21T02:32:41.473751+0000","last_active":"2024-09-21T02:34:31.416461+0000","last_peered":"2024-09-21T02:34:31.416461+0000","last_clean":"2024-09-21T02:34:31.416461+0000","last_became_active":"2024-09-21T02:32:41.473367+0000","last_became_peered":"2024-09-21T02:32:41.473367+0000","last_unstale":"2024-09-21T02:34:31.416461+0000","last_undegraded":"2024-09-21T02:34:31.416461+0000","last_fullsized":"2024-09-21T02:34:31.416461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:04.707745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601370+0000","last_change":"2024-09-21T02:32:41.485375+0000","last_active":"2024-09-21T02:34:31.601370+0000","last_peered":"2024-09-21T02:34:31.601370+0000","last_clean":"2024-09-21T02:34:31.601370+0000","last_became_active":"2024-09-21T02:32:41.484845+0000","last_became_peered":"2024-09-21T02:32:41.484845+0000","last_unstale":"2024-09-21T02:34:31.601370+0000","last_undegraded":"2024-09-21T02:34:31.601370+0000","last_fullsized":"2024-09-21T02:34:31.601370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:58.529747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407318+0000","last_change":"2024-09-21T02:32:41.462925+0000","last_active":"2024-09-21T02:34:31.407318+0000","last_peered":"2024-09-21T02:34:31.407318+0000","last_clean":"2024-09-21T02:34:31.407318+0000","last_became_active":"2024-09-21T02:32:41.462056+0000","last_became_peered":"2024-09-21T02:32:41.462056+0000","last_unstale":"2024-09-21T02:34:31.407318+0000","last_undegraded":"2024-09-21T02:34:31.407318+0000","last_fullsized":"2024-09-21T02:34:31.407318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:05.447554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416578+0000","last_change":"2024-09-21T02:32:41.475111+0000","last_active":"2024-09-21T02:34:31.416578+0000","last_peered":"2024-09-21T02:34:31.416578+0000","last_clean":"2024-09-21T02:34:31.416578+0000","last_became_active":"2024-09-21T02:32:41.474634+0000","last_became_peered":"2024-09-21T02:32:41.474634+0000","last_unstale":"2024-09-21T02:34:31.416578+0000","last_undegraded":"2024-09-21T02:34:31.416578+0000","last_fullsized":"2024-09-21T02:34:31.416578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:07.750970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408080+0000","last_change":"2024-09-21T02:32:41.479702+0000","last_active":"2024-09-21T02:34:31.408080+0000","last_peered":"2024-09-21T02:34:31.408080+0000","last_clean":"2024-09-21T02:34:31.408080+0000","last_became_active":"2024-09-21T02:32:41.479378+0000","last_became_peered":"2024-09-21T02:32:41.479378+0000","last_unstale":"2024-09-21T02:34:31.408080+0000","last_undegraded":"2024-09-21T02:34:31.408080+0000","last_fullsized":"2024-09-21T02:34:31.408080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:56.687641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407944+0000","last_change":"2024-09-21T02:32:41.475567+0000","last_active":"2024-09-21T02:34:31.407944+0000","last_peered":"2024-09-21T02:34:31.407944+0000","last_clean":"2024-09-21T02:34:31.407944+0000","last_became_active":"2024-09-21T02:32:41.475207+0000","last_became_peered":"2024-09-21T02:32:41.475207+0000","last_unstale":"2024-09-21T02:34:31.407944+0000","last_undegraded":"2024-09-21T02:34:31.407944+0000","last_fullsized":"2024-09-21T02:34:31.407944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:33.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415571+0000","last_change":"2024-09-21T02:32:41.483518+0000","last_active":"2024-09-21T02:34:31.415571+0000","last_peered":"2024-09-21T02:34:31.415571+0000","last_clean":"2024-09-21T02:34:31.415571+0000","last_became_active":"2024-09-21T02:32:41.483088+0000","last_became_peered":"2024-09-21T02:32:41.483088+0000","last_unstale":"2024-09-21T02:34:31.415571+0000","last_undegraded":"2024-09-21T02:34:31.415571+0000","last_fullsized":"2024-09-21T02:34:31.415571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:23.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601610+0000","last_change":"2024-09-21T02:32:41.482113+0000","last_active":"2024-09-21T02:34:31.601610+0000","last_peered":"2024-09-21T02:34:31.601610+0000","last_clean":"2024-09-21T02:34:31.601610+0000","last_became_active":"2024-09-21T02:32:41.479123+0000","last_became_peered":"2024-09-21T02:32:41.479123+0000","last_unstale":"2024-09-21T02:34:31.601610+0000","last_undegraded":"2024-09-21T02:34:31.601610+0000","last_fullsized":"2024-09-21T02:34:31.601610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:48.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601584+0000","last_change":"2024-09-21T02:32:41.470429+0000","last_active":"2024-09-21T02:34:31.601584+0000","last_peered":"2024-09-21T02:34:31.601584+0000","last_clean":"2024-09-21T02:34:31.601584+0000","last_became_active":"2024-09-21T02:32:41.469421+0000","last_became_peered":"2024-09-21T02:32:41.469421+0000","last_unstale":"2024-09-21T02:34:31.601584+0000","last_undegraded":"2024-09-21T02:34:31.601584+0000","last_fullsized":"2024-09-21T02:34:31.601584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:00.952030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601265+0000","last_change":"2024-09-21T02:32:41.470361+0000","last_active":"2024-09-21T02:34:31.601265+0000","last_peered":"2024-09-21T02:34:31.601265+0000","last_clean":"2024-09-21T02:34:31.601265+0000","last_became_active":"2024-09-21T02:32:41.469983+0000","last_became_peered":"2024-09-21T02:32:41.469983+0000","last_unstale":"2024-09-21T02:34:31.601265+0000","last_undegraded":"2024-09-21T02:34:31.601265+0000","last_fullsized":"2024-09-21T02:34:31.601265+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:02.703688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410341+0000","last_change":"2024-09-21T02:32:41.468975+0000","last_active":"2024-09-21T02:34:31.410341+0000","last_peered":"2024-09-21T02:34:31.410341+0000","last_clean":"2024-09-21T02:34:31.410341+0000","last_became_active":"2024-09-21T02:32:41.468612+0000","last_became_peered":"2024-09-21T02:32:41.468612+0000","last_unstale":"2024-09-21T02:34:31.410341+0000","last_undegraded":"2024-09-21T02:34:31.410341+0000","last_fullsized":"2024-09-21T02:34:31.410341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:04.442257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411965+0000","last_change":"2024-09-21T02:32:41.471444+0000","last_active":"2024-09-21T02:34:31.411965+0000","last_peered":"2024-09-21T02:34:31.411965+0000","last_clean":"2024-09-21T02:34:31.411965+0000","last_became_active":"2024-09-21T02:32:41.470437+0000","last_became_peered":"2024-09-21T02:32:41.470437+0000","last_unstale":"2024-09-21T02:34:31.411965+0000","last_undegraded":"2024-09-21T02:34:31.411965+0000","last_fullsized":"2024-09-21T02:34:31.411965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:13.933069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413672+0000","last_change":"2024-09-21T02:32:41.475397+0000","last_active":"2024-09-21T02:34:31.413672+0000","last_peered":"2024-09-21T02:34:31.413672+0000","last_clean":"2024-09-21T02:34:31.413672+0000","last_became_active":"2024-09-21T02:32:41.475034+0000","last_became_peered":"2024-09-21T02:32:41.475034+0000","last_unstale":"2024-09-21T02:34:31.413672+0000","last_undegraded":"2024-09-21T02:34:31.413672+0000","last_fullsized":"2024-09-21T02:34:31.413672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:24.944289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416907+0000","last_change":"2024-09-21T02:32:41.470297+0000","last_active":"2024-09-21T02:34:31.416907+0000","last_peered":"2024-09-21T02:34:31.416907+0000","last_clean":"2024-09-21T02:34:31.416907+0000","last_became_active":"2024-09-21T02:32:41.469843+0000","last_became_peered":"2024-09-21T02:32:41.469843+0000","last_unstale":"2024-09-21T02:34:31.416907+0000","last_undegraded":"2024-09-21T02:34:31.416907+0000","last_fullsized":"2024-09-21T02:34:31.416907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407203+0000","last_change":"2024-09-21T02:33:30.535828+0000","last_active":"2024-09-21T02:34:31.407203+0000","last_peered":"2024-09-21T02:34:31.407203+0000","last_clean":"2024-09-21T02:34:31.407203+0000","last_became_active":"2024-09-21T02:33:30.535576+0000","last_became_peered":"2024-09-21T02:33:30.535576+0000","last_unstale":"2024-09-21T02:34:31.407203+0000","last_undegraded":"2024-09-21T02:34:31.407203+0000","last_fullsized":"2024-09-21T02:34:31.407203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:05.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411109+0000","last_change":"2024-09-21T02:32:41.466073+0000","last_active":"2024-09-21T02:34:31.411109+0000","last_peered":"2024-09-21T02:34:31.411109+0000","last_clean":"2024-09-21T02:34:31.411109+0000","last_became_active":"2024-09-21T02:32:41.465664+0000","last_became_peered":"2024-09-21T02:32:41.465664+0000","last_unstale":"2024-09-21T02:34:31.411109+0000","last_undegraded":"2024-09-21T02:34:31.411109+0000","last_fullsized":"2024-09-21T02:34:31.411109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:25.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412809+0000","last_change":"2024-09-21T02:32:41.471006+0000","last_active":"2024-09-21T02:34:31.412809+0000","last_peered":"2024-09-21T02:34:31.412809+0000","last_clean":"2024-09-21T02:34:31.412809+0000","last_became_active":"2024-09-21T02:32:41.469780+0000","last_became_peered":"2024-09-21T02:32:41.469780+0000","last_unstale":"2024-09-21T02:34:31.412809+0000","last_undegraded":"2024-09-21T02:34:31.412809+0000","last_fullsized":"2024-09-21T02:34:31.412809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:18.604729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410176+0000","last_change":"2024-09-21T02:32:41.476169+0000","last_active":"2024-09-21T02:34:31.410176+0000","last_peered":"2024-09-21T02:34:31.410176+0000","last_clean":"2024-09-21T02:34:31.410176+0000","last_became_active":"2024-09-21T02:32:41.475754+0000","last_became_peered":"2024-09-21T02:32:41.475754+0000","last_unstale":"2024-09-21T02:34:31.410176+0000","last_undegraded":"2024-09-21T02:34:31.410176+0000","last_fullsized":"2024-09-21T02:34:31.410176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:18.532122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410190+0000","last_change":"2024-09-21T02:32:41.467078+0000","last_active":"2024-09-21T02:34:31.410190+0000","last_peered":"2024-09-21T02:34:31.410190+0000","last_clean":"2024-09-21T02:34:31.410190+0000","last_became_active":"2024-09-21T02:32:41.466702+0000","last_became_peered":"2024-09-21T02:32:41.466702+0000","last_unstale":"2024-09-21T02:34:31.410190+0000","last_undegraded":"2024-09-21T02:34:31.410190+0000","last_fullsized":"2024-09-21T02:34:31.410190+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:43.409390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602252+0000","last_change":"2024-09-21T02:32:41.467476+0000","last_active":"2024-09-21T02:34:31.602252+0000","last_peered":"2024-09-21T02:34:31.602252+0000","last_clean":"2024-09-21T02:34:31.602252+0000","last_became_active":"2024-09-21T02:32:41.466901+0000","last_became_peered":"2024-09-21T02:32:41.466901+0000","last_unstale":"2024-09-21T02:34:31.602252+0000","last_undegraded":"2024-09-21T02:34:31.602252+0000","last_fullsized":"2024-09-21T02:34:31.602252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:46.207507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602380+0000","last_change":"2024-09-21T02:32:41.486528+0000","last_active":"2024-09-21T02:34:31.602380+0000","last_peered":"2024-09-21T02:34:31.602380+0000","last_clean":"2024-09-21T02:34:31.602380+0000","last_became_active":"2024-09-21T02:32:41.484370+0000","last_became_peered":"2024-09-21T02:32:41.484370+0000","last_unstale":"2024-09-21T02:34:31.602380+0000","last_undegraded":"2024-09-21T02:34:31.602380+0000","last_fullsized":"2024-09-21T02:34:31.602380+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:28.978540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407849+0000","last_change":"2024-09-21T02:32:41.474525+0000","last_active":"2024-09-21T02:34:31.407849+0000","last_peered":"2024-09-21T02:34:31.407849+0000","last_clean":"2024-09-21T02:34:31.407849+0000","last_became_active":"2024-09-21T02:32:41.474147+0000","last_became_peered":"2024-09-21T02:32:41.474147+0000","last_unstale":"2024-09-21T02:34:31.407849+0000","last_undegraded":"2024-09-21T02:34:31.407849+0000","last_fullsized":"2024-09-21T02:34:31.407849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:26.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":135,"num_read_kb":138,"num_write":94,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":69871,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":210195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710757,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1011712,"data_stored":505903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906985,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1683456,"data_stored":1161032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070510,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1011712,"data_stored":509977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":505881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1601536,"data_stored":1099763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626497,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":501203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822727,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36924,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708228,"statfs":{"total":95995035648,"available":95957225472,"internally_reserved":0,"allocated":1609728,"data_stored":1095849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1085440,"data_stored":574588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1007616,"data_stored":501307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":501237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1077248,"data_stored":570470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":501293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:34:39.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:34:39.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:39 smithi079 ceph-mon[30788]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:34:39.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:39 smithi079 ceph-mon[30788]: pgmap v383: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 2 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-09-21T02:34:39.792 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:39.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:39 smithi148 ceph-mon[34626]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:34:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:39 smithi148 ceph-mon[34626]: pgmap v383: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 2 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-09-21T02:34:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:39 smithi098 ceph-mon[34832]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:34:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:39 smithi098 ceph-mon[34832]: pgmap v383: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 2 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-09-21T02:34:40.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 -- 172.21.15.79:0/399420541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c077940 msgr2=0x7f3b7c077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 --2- 172.21.15.79:0/399420541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c077940 0x7f3b7c077d50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009900 tx=0x7f3b7002a410 comp rx=0 tx=0).stop 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 -- 172.21.15.79:0/399420541 shutdown_connections 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 --2- 172.21.15.79:0/399420541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c114750 0x7f3b7c116b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 --2- 172.21.15.79:0/399420541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b7c078290 0x7f3b7c114210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 --2- 172.21.15.79:0/399420541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c077940 0x7f3b7c077d50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 -- 172.21.15.79:0/399420541 >> 172.21.15.79:0/399420541 conn(0x7f3b7c1017c0 msgr2=0x7f3b7c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 -- 172.21.15.79:0/399420541 shutdown_connections 2024-09-21T02:34:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.412+0000 7f3b84400640 1 -- 172.21.15.79:0/399420541 wait complete. 2024-09-21T02:34:40.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.413+0000 7f3b84400640 1 Processor -- start 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.413+0000 7f3b84400640 1 -- start start 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b84400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c077940 0x7f3b7c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b84400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c078290 0x7f3b7c1a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b84400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b7c114750 0x7f3b7c1a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b84400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c11a130 con 0x7f3b7c078290 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b84400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c119fb0 con 0x7f3b7c077940 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b84400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c11a2b0 con 0x7f3b7c114750 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b81a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c077940 0x7f3b7c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b81000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c078290 0x7f3b7c1a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b82400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b7c114750 0x7f3b7c1a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b81a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c077940 0x7f3b7c1a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:45190/0 (socket says 172.21.15.79:45190) 2024-09-21T02:34:40.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.414+0000 7f3b81a00640 1 -- 172.21.15.79:0/2281505609 learned_addr learned my addr 172.21.15.79:0/2281505609 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:40.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b81a00640 1 -- 172.21.15.79:0/2281505609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b7c114750 msgr2=0x7f3b7c1a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:40.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b81a00640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b7c114750 0x7f3b7c1a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b81a00640 1 -- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c078290 msgr2=0x7f3b7c1a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:40.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b81a00640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c078290 0x7f3b7c1a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b81a00640 1 -- 172.21.15.79:0/2281505609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1a6a70 con 0x7f3b7c077940 2024-09-21T02:34:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b81a00640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c077940 0x7f3b7c1a0b00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005ab0 tx=0x7f3b70003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b7a000640 1 -- 172.21.15.79:0/2281505609 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7003f070 con 0x7f3b7c077940 2024-09-21T02:34:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c1a6d00 con 0x7f3b7c077940 2024-09-21T02:34:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.415+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c1ad4c0 con 0x7f3b7c077940 2024-09-21T02:34:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.416+0000 7f3b7a000640 1 -- 172.21.15.79:0/2281505609 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b7003b910 con 0x7f3b7c077940 2024-09-21T02:34:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.416+0000 7f3b7a000640 1 -- 172.21.15.79:0/2281505609 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70049060 con 0x7f3b7c077940 2024-09-21T02:34:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.416+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c0052c0 con 0x7f3b7c077940 2024-09-21T02:34:40.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.419+0000 7f3b7a000640 1 -- 172.21.15.79:0/2281505609 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f3b70042070 con 0x7f3b7c077940 2024-09-21T02:34:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.421+0000 7f3b7a000640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b640b65a0 0x7f3b640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.421+0000 7f3b7a000640 1 -- 172.21.15.79:0/2281505609 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3b70107de0 con 0x7f3b7c077940 2024-09-21T02:34:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.421+0000 7f3b81000640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b640b65a0 0x7f3b640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.422+0000 7f3b81000640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b640b65a0 0x7f3b640b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c079e90 tx=0x7f3b6800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.422+0000 7f3b7a000640 1 -- 172.21.15.79:0/2281505609 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b700d24e0 con 0x7f3b7c077940 2024-09-21T02:34:40.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.605+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b5c000bf0 con 0x7f3b640b65a0 2024-09-21T02:34:40.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.613+0000 7f3b7a000640 1 -- 172.21.15.79:0/2281505609 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340292 (secure 0 0 0) 0x7f3b5c000bf0 con 0x7f3b640b65a0 2024-09-21T02:34:40.618 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T02:34:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.617+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b640b65a0 msgr2=0x7f3b640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.617+0000 7f3b84400640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b640b65a0 0x7f3b640b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c079e90 tx=0x7f3b6800b390 comp rx=0 tx=0).stop 2024-09-21T02:34:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.617+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c077940 msgr2=0x7f3b7c1a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.617+0000 7f3b84400640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c077940 0x7f3b7c1a0b00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005ab0 tx=0x7f3b70003c80 comp rx=0 tx=0).stop 2024-09-21T02:34:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 shutdown_connections 2024-09-21T02:34:40.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3b640b65a0 0x7f3b640b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b7c114750 0x7f3b7c1a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b7c078290 0x7f3b7c1a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 --2- 172.21.15.79:0/2281505609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b7c077940 0x7f3b7c1a0b00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 >> 172.21.15.79:0/2281505609 conn(0x7f3b7c1017c0 msgr2=0x7f3b7c116750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 shutdown_connections 2024-09-21T02:34:40.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:40.618+0000 7f3b84400640 1 -- 172.21.15.79:0/2281505609 wait complete. 2024-09-21T02:34:41.475 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-09-21T02:34:39.428377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":221,"num_read_kb":207,"num_write":219,"num_write_kb":2253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3021711,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171,"ondisk_log_size":171,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388064,"kb_used_data":13772,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553760,"statfs":{"total":1151940427776,"available":1151543050240,"internally_reserved":0,"allocated":14102528,"data_stored":8028503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":69871,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.022970"},"pg_stats":[{"pgid":"2.1f","version":"78'4","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.422142+0000","last_change":"2024-09-21T02:34:31.422073+0000","last_active":"2024-09-21T02:34:31.422142+0000","last_peered":"2024-09-21T02:34:31.422142+0000","last_clean":"2024-09-21T02:34:31.422142+0000","last_became_active":"2024-09-21T02:34:31.412208+0000","last_became_peered":"2024-09-21T02:34:31.412208+0000","last_unstale":"2024-09-21T02:34:31.422142+0000","last_undegraded":"2024-09-21T02:34:31.422142+0000","last_fullsized":"2024-09-21T02:34:31.422142+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.165710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409633+0000","last_change":"2024-09-21T02:32:41.473485+0000","last_active":"2024-09-21T02:34:31.409633+0000","last_peered":"2024-09-21T02:34:31.409633+0000","last_clean":"2024-09-21T02:34:31.409633+0000","last_became_active":"2024-09-21T02:32:41.473134+0000","last_became_peered":"2024-09-21T02:32:41.473134+0000","last_unstale":"2024-09-21T02:34:31.409633+0000","last_undegraded":"2024-09-21T02:34:31.409633+0000","last_fullsized":"2024-09-21T02:34:31.409633+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415762+0000","last_change":"2024-09-21T02:32:50.687618+0000","last_active":"2024-09-21T02:34:31.415762+0000","last_peered":"2024-09-21T02:34:31.415762+0000","last_clean":"2024-09-21T02:34:31.415762+0000","last_became_active":"2024-09-21T02:32:50.687157+0000","last_became_peered":"2024-09-21T02:32:50.687157+0000","last_unstale":"2024-09-21T02:34:31.415762+0000","last_undegraded":"2024-09-21T02:34:31.415762+0000","last_fullsized":"2024-09-21T02:34:31.415762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:29.247287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409896+0000","last_change":"2024-09-21T02:32:38.512667+0000","last_active":"2024-09-21T02:34:31.409896+0000","last_peered":"2024-09-21T02:34:31.409896+0000","last_clean":"2024-09-21T02:34:31.409896+0000","last_became_active":"2024-09-21T02:32:38.512261+0000","last_became_peered":"2024-09-21T02:32:38.512261+0000","last_unstale":"2024-09-21T02:34:31.409896+0000","last_undegraded":"2024-09-21T02:34:31.409896+0000","last_fullsized":"2024-09-21T02:34:31.409896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:05.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602401+0000","last_change":"2024-09-21T02:32:41.481816+0000","last_active":"2024-09-21T02:34:31.602401+0000","last_peered":"2024-09-21T02:34:31.602401+0000","last_clean":"2024-09-21T02:34:31.602401+0000","last_became_active":"2024-09-21T02:32:41.478295+0000","last_became_peered":"2024-09-21T02:32:41.478295+0000","last_unstale":"2024-09-21T02:34:31.602401+0000","last_undegraded":"2024-09-21T02:34:31.602401+0000","last_fullsized":"2024-09-21T02:34:31.602401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:58.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409468+0000","last_change":"2024-09-21T02:32:50.692598+0000","last_active":"2024-09-21T02:34:31.409468+0000","last_peered":"2024-09-21T02:34:31.409468+0000","last_clean":"2024-09-21T02:34:31.409468+0000","last_became_active":"2024-09-21T02:32:50.692120+0000","last_became_peered":"2024-09-21T02:32:50.692120+0000","last_unstale":"2024-09-21T02:34:31.409468+0000","last_undegraded":"2024-09-21T02:34:31.409468+0000","last_fullsized":"2024-09-21T02:34:31.409468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:57.642195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411058+0000","last_change":"2024-09-21T02:32:38.435292+0000","last_active":"2024-09-21T02:34:31.411058+0000","last_peered":"2024-09-21T02:34:31.411058+0000","last_clean":"2024-09-21T02:34:31.411058+0000","last_became_active":"2024-09-21T02:32:38.434878+0000","last_became_peered":"2024-09-21T02:32:38.434878+0000","last_unstale":"2024-09-21T02:34:31.411058+0000","last_undegraded":"2024-09-21T02:34:31.411058+0000","last_fullsized":"2024-09-21T02:34:31.411058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:56.827844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415945+0000","last_change":"2024-09-21T02:32:41.467834+0000","last_active":"2024-09-21T02:34:31.415945+0000","last_peered":"2024-09-21T02:34:31.415945+0000","last_clean":"2024-09-21T02:34:31.415945+0000","last_became_active":"2024-09-21T02:32:41.467440+0000","last_became_peered":"2024-09-21T02:32:41.467440+0000","last_unstale":"2024-09-21T02:34:31.415945+0000","last_undegraded":"2024-09-21T02:34:31.415945+0000","last_fullsized":"2024-09-21T02:34:31.415945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:16.857988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409793+0000","last_change":"2024-09-21T02:33:30.539580+0000","last_active":"2024-09-21T02:34:31.409793+0000","last_peered":"2024-09-21T02:34:31.409793+0000","last_clean":"2024-09-21T02:34:31.409793+0000","last_became_active":"2024-09-21T02:33:30.539088+0000","last_became_peered":"2024-09-21T02:33:30.539088+0000","last_unstale":"2024-09-21T02:34:31.409793+0000","last_undegraded":"2024-09-21T02:34:31.409793+0000","last_fullsized":"2024-09-21T02:34:31.409793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:42.437535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410548+0000","last_change":"2024-09-21T02:32:38.431645+0000","last_active":"2024-09-21T02:34:31.410548+0000","last_peered":"2024-09-21T02:34:31.410548+0000","last_clean":"2024-09-21T02:34:31.410548+0000","last_became_active":"2024-09-21T02:32:38.431069+0000","last_became_peered":"2024-09-21T02:32:38.431069+0000","last_unstale":"2024-09-21T02:34:31.410548+0000","last_undegraded":"2024-09-21T02:34:31.410548+0000","last_fullsized":"2024-09-21T02:34:31.410548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:34.893292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411775+0000","last_change":"2024-09-21T02:32:41.470506+0000","last_active":"2024-09-21T02:34:31.411775+0000","last_peered":"2024-09-21T02:34:31.411775+0000","last_clean":"2024-09-21T02:34:31.411775+0000","last_became_active":"2024-09-21T02:32:41.470165+0000","last_became_peered":"2024-09-21T02:32:41.470165+0000","last_unstale":"2024-09-21T02:34:31.411775+0000","last_undegraded":"2024-09-21T02:34:31.411775+0000","last_fullsized":"2024-09-21T02:34:31.411775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409551+0000","last_change":"2024-09-21T02:32:50.681923+0000","last_active":"2024-09-21T02:34:31.409551+0000","last_peered":"2024-09-21T02:34:31.409551+0000","last_clean":"2024-09-21T02:34:31.409551+0000","last_became_active":"2024-09-21T02:32:50.681374+0000","last_became_peered":"2024-09-21T02:32:50.681374+0000","last_unstale":"2024-09-21T02:34:31.409551+0000","last_undegraded":"2024-09-21T02:34:31.409551+0000","last_fullsized":"2024-09-21T02:34:31.409551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:46.060715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411685+0000","last_change":"2024-09-21T02:32:41.470550+0000","last_active":"2024-09-21T02:34:31.411685+0000","last_peered":"2024-09-21T02:34:31.411685+0000","last_clean":"2024-09-21T02:34:31.411685+0000","last_became_active":"2024-09-21T02:32:41.469282+0000","last_became_peered":"2024-09-21T02:32:41.469282+0000","last_unstale":"2024-09-21T02:34:31.411685+0000","last_undegraded":"2024-09-21T02:34:31.411685+0000","last_fullsized":"2024-09-21T02:34:31.411685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:34.619382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410262+0000","last_change":"2024-09-21T02:32:38.435261+0000","last_active":"2024-09-21T02:34:31.410262+0000","last_peered":"2024-09-21T02:34:31.410262+0000","last_clean":"2024-09-21T02:34:31.410262+0000","last_became_active":"2024-09-21T02:32:38.434795+0000","last_became_peered":"2024-09-21T02:32:38.434795+0000","last_unstale":"2024-09-21T02:34:31.410262+0000","last_undegraded":"2024-09-21T02:34:31.410262+0000","last_fullsized":"2024-09-21T02:34:31.410262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:05.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409842+0000","last_change":"2024-09-21T02:32:50.714657+0000","last_active":"2024-09-21T02:34:31.409842+0000","last_peered":"2024-09-21T02:34:31.409842+0000","last_clean":"2024-09-21T02:34:31.409842+0000","last_became_active":"2024-09-21T02:32:50.714077+0000","last_became_peered":"2024-09-21T02:32:50.714077+0000","last_unstale":"2024-09-21T02:34:31.409842+0000","last_undegraded":"2024-09-21T02:34:31.409842+0000","last_fullsized":"2024-09-21T02:34:31.409842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.812785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409777+0000","last_change":"2024-09-21T02:32:41.473964+0000","last_active":"2024-09-21T02:34:31.409777+0000","last_peered":"2024-09-21T02:34:31.409777+0000","last_clean":"2024-09-21T02:34:31.409777+0000","last_became_active":"2024-09-21T02:32:41.473598+0000","last_became_peered":"2024-09-21T02:32:41.473598+0000","last_unstale":"2024-09-21T02:34:31.409777+0000","last_undegraded":"2024-09-21T02:34:31.409777+0000","last_fullsized":"2024-09-21T02:34:31.409777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415867+0000","last_change":"2024-09-21T02:32:38.435800+0000","last_active":"2024-09-21T02:34:31.415867+0000","last_peered":"2024-09-21T02:34:31.415867+0000","last_clean":"2024-09-21T02:34:31.415867+0000","last_became_active":"2024-09-21T02:32:38.434797+0000","last_became_peered":"2024-09-21T02:32:38.434797+0000","last_unstale":"2024-09-21T02:34:31.415867+0000","last_undegraded":"2024-09-21T02:34:31.415867+0000","last_fullsized":"2024-09-21T02:34:31.415867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:46.540597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410017+0000","last_change":"2024-09-21T02:32:50.693447+0000","last_active":"2024-09-21T02:34:31.410017+0000","last_peered":"2024-09-21T02:34:31.410017+0000","last_clean":"2024-09-21T02:34:31.410017+0000","last_became_active":"2024-09-21T02:32:50.692829+0000","last_became_peered":"2024-09-21T02:32:50.692829+0000","last_unstale":"2024-09-21T02:34:31.410017+0000","last_undegraded":"2024-09-21T02:34:31.410017+0000","last_fullsized":"2024-09-21T02:34:31.410017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:10.958279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407255+0000","last_change":"2024-09-21T02:32:41.478053+0000","last_active":"2024-09-21T02:34:31.407255+0000","last_peered":"2024-09-21T02:34:31.407255+0000","last_clean":"2024-09-21T02:34:31.407255+0000","last_became_active":"2024-09-21T02:32:41.477631+0000","last_became_peered":"2024-09-21T02:32:41.477631+0000","last_unstale":"2024-09-21T02:34:31.407255+0000","last_undegraded":"2024-09-21T02:34:31.407255+0000","last_fullsized":"2024-09-21T02:34:31.407255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:19.548261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409566+0000","last_change":"2024-09-21T02:32:38.425388+0000","last_active":"2024-09-21T02:34:31.409566+0000","last_peered":"2024-09-21T02:34:31.409566+0000","last_clean":"2024-09-21T02:34:31.409566+0000","last_became_active":"2024-09-21T02:32:38.424975+0000","last_became_peered":"2024-09-21T02:32:38.424975+0000","last_unstale":"2024-09-21T02:34:31.409566+0000","last_undegraded":"2024-09-21T02:34:31.409566+0000","last_fullsized":"2024-09-21T02:34:31.409566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:43.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408129+0000","last_change":"2024-09-21T02:32:50.695406+0000","last_active":"2024-09-21T02:34:31.408129+0000","last_peered":"2024-09-21T02:34:31.408129+0000","last_clean":"2024-09-21T02:34:31.408129+0000","last_became_active":"2024-09-21T02:32:50.694958+0000","last_became_peered":"2024-09-21T02:32:50.694958+0000","last_unstale":"2024-09-21T02:34:31.408129+0000","last_undegraded":"2024-09-21T02:34:31.408129+0000","last_fullsized":"2024-09-21T02:34:31.408129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:49.038587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409869+0000","last_change":"2024-09-21T02:32:41.463475+0000","last_active":"2024-09-21T02:34:31.409869+0000","last_peered":"2024-09-21T02:34:31.409869+0000","last_clean":"2024-09-21T02:34:31.409869+0000","last_became_active":"2024-09-21T02:32:41.462950+0000","last_became_peered":"2024-09-21T02:32:41.462950+0000","last_unstale":"2024-09-21T02:34:31.409869+0000","last_undegraded":"2024-09-21T02:34:31.409869+0000","last_fullsized":"2024-09-21T02:34:31.409869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:40.871522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415807+0000","last_change":"2024-09-21T02:32:38.512534+0000","last_active":"2024-09-21T02:34:31.415807+0000","last_peered":"2024-09-21T02:34:31.415807+0000","last_clean":"2024-09-21T02:34:31.415807+0000","last_became_active":"2024-09-21T02:32:38.512162+0000","last_became_peered":"2024-09-21T02:32:38.512162+0000","last_unstale":"2024-09-21T02:34:31.415807+0000","last_undegraded":"2024-09-21T02:34:31.415807+0000","last_fullsized":"2024-09-21T02:34:31.415807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:35.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410045+0000","last_change":"2024-09-21T02:32:50.716000+0000","last_active":"2024-09-21T02:34:31.410045+0000","last_peered":"2024-09-21T02:34:31.410045+0000","last_clean":"2024-09-21T02:34:31.410045+0000","last_became_active":"2024-09-21T02:32:50.715371+0000","last_became_peered":"2024-09-21T02:32:50.715371+0000","last_unstale":"2024-09-21T02:34:31.410045+0000","last_undegraded":"2024-09-21T02:34:31.410045+0000","last_fullsized":"2024-09-21T02:34:31.410045+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:54.490957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602421+0000","last_change":"2024-09-21T02:32:41.479797+0000","last_active":"2024-09-21T02:34:31.602421+0000","last_peered":"2024-09-21T02:34:31.602421+0000","last_clean":"2024-09-21T02:34:31.602421+0000","last_became_active":"2024-09-21T02:32:41.479400+0000","last_became_peered":"2024-09-21T02:32:41.479400+0000","last_unstale":"2024-09-21T02:34:31.602421+0000","last_undegraded":"2024-09-21T02:34:31.602421+0000","last_fullsized":"2024-09-21T02:34:31.602421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:34.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410452+0000","last_change":"2024-09-21T02:32:38.748844+0000","last_active":"2024-09-21T02:34:31.410452+0000","last_peered":"2024-09-21T02:34:31.410452+0000","last_clean":"2024-09-21T02:34:31.410452+0000","last_became_active":"2024-09-21T02:32:38.748428+0000","last_became_peered":"2024-09-21T02:32:38.748428+0000","last_unstale":"2024-09-21T02:34:31.410452+0000","last_undegraded":"2024-09-21T02:34:31.410452+0000","last_fullsized":"2024-09-21T02:34:31.410452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:01.300290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415919+0000","last_change":"2024-09-21T02:32:50.681667+0000","last_active":"2024-09-21T02:34:31.415919+0000","last_peered":"2024-09-21T02:34:31.415919+0000","last_clean":"2024-09-21T02:34:31.415919+0000","last_became_active":"2024-09-21T02:32:50.681113+0000","last_became_peered":"2024-09-21T02:32:50.681113+0000","last_unstale":"2024-09-21T02:34:31.415919+0000","last_undegraded":"2024-09-21T02:34:31.415919+0000","last_fullsized":"2024-09-21T02:34:31.415919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:20.881199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409259+0000","last_change":"2024-09-21T02:32:41.466320+0000","last_active":"2024-09-21T02:34:31.409259+0000","last_peered":"2024-09-21T02:34:31.409259+0000","last_clean":"2024-09-21T02:34:31.409259+0000","last_became_active":"2024-09-21T02:32:41.462700+0000","last_became_peered":"2024-09-21T02:32:41.462700+0000","last_unstale":"2024-09-21T02:34:31.409259+0000","last_undegraded":"2024-09-21T02:34:31.409259+0000","last_fullsized":"2024-09-21T02:34:31.409259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:05.324192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408142+0000","last_change":"2024-09-21T02:32:38.432478+0000","last_active":"2024-09-21T02:34:31.408142+0000","last_peered":"2024-09-21T02:34:31.408142+0000","last_clean":"2024-09-21T02:34:31.408142+0000","last_became_active":"2024-09-21T02:32:38.431107+0000","last_became_peered":"2024-09-21T02:32:38.431107+0000","last_unstale":"2024-09-21T02:34:31.408142+0000","last_undegraded":"2024-09-21T02:34:31.408142+0000","last_fullsized":"2024-09-21T02:34:31.408142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:04.629078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408572+0000","last_change":"2024-09-21T02:32:50.715335+0000","last_active":"2024-09-21T02:34:31.408572+0000","last_peered":"2024-09-21T02:34:31.408572+0000","last_clean":"2024-09-21T02:34:31.408572+0000","last_became_active":"2024-09-21T02:32:50.714117+0000","last_became_peered":"2024-09-21T02:32:50.714117+0000","last_unstale":"2024-09-21T02:34:31.408572+0000","last_undegraded":"2024-09-21T02:34:31.408572+0000","last_fullsized":"2024-09-21T02:34:31.408572+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:53.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601350+0000","last_change":"2024-09-21T02:32:41.467613+0000","last_active":"2024-09-21T02:34:31.601350+0000","last_peered":"2024-09-21T02:34:31.601350+0000","last_clean":"2024-09-21T02:34:31.601350+0000","last_became_active":"2024-09-21T02:32:41.467136+0000","last_became_peered":"2024-09-21T02:32:41.467136+0000","last_unstale":"2024-09-21T02:34:31.601350+0000","last_undegraded":"2024-09-21T02:34:31.601350+0000","last_fullsized":"2024-09-21T02:34:31.601350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:16.929257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411185+0000","last_change":"2024-09-21T02:32:38.513591+0000","last_active":"2024-09-21T02:34:31.411185+0000","last_peered":"2024-09-21T02:34:31.411185+0000","last_clean":"2024-09-21T02:34:31.411185+0000","last_became_active":"2024-09-21T02:32:38.513169+0000","last_became_peered":"2024-09-21T02:32:38.513169+0000","last_unstale":"2024-09-21T02:34:31.411185+0000","last_undegraded":"2024-09-21T02:34:31.411185+0000","last_fullsized":"2024-09-21T02:34:31.411185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:24.038894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407236+0000","last_change":"2024-09-21T02:32:50.680165+0000","last_active":"2024-09-21T02:34:31.407236+0000","last_peered":"2024-09-21T02:34:31.407236+0000","last_clean":"2024-09-21T02:34:31.407236+0000","last_became_active":"2024-09-21T02:32:50.679730+0000","last_became_peered":"2024-09-21T02:32:50.679730+0000","last_unstale":"2024-09-21T02:34:31.407236+0000","last_undegraded":"2024-09-21T02:34:31.407236+0000","last_fullsized":"2024-09-21T02:34:31.407236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:25.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413286+0000","last_change":"2024-09-21T02:32:41.483355+0000","last_active":"2024-09-21T02:34:31.413286+0000","last_peered":"2024-09-21T02:34:31.413286+0000","last_clean":"2024-09-21T02:34:31.413286+0000","last_became_active":"2024-09-21T02:32:41.482786+0000","last_became_peered":"2024-09-21T02:32:41.482786+0000","last_unstale":"2024-09-21T02:34:31.413286+0000","last_undegraded":"2024-09-21T02:34:31.413286+0000","last_fullsized":"2024-09-21T02:34:31.413286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:46.277233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407818+0000","last_change":"2024-09-21T02:32:38.515173+0000","last_active":"2024-09-21T02:34:31.407818+0000","last_peered":"2024-09-21T02:34:31.407818+0000","last_clean":"2024-09-21T02:34:31.407818+0000","last_became_active":"2024-09-21T02:32:38.513341+0000","last_became_peered":"2024-09-21T02:32:38.513341+0000","last_unstale":"2024-09-21T02:34:31.407818+0000","last_undegraded":"2024-09-21T02:34:31.407818+0000","last_fullsized":"2024-09-21T02:34:31.407818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.988203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410760+0000","last_change":"2024-09-21T02:32:50.714389+0000","last_active":"2024-09-21T02:34:31.410760+0000","last_peered":"2024-09-21T02:34:31.410760+0000","last_clean":"2024-09-21T02:34:31.410760+0000","last_became_active":"2024-09-21T02:32:50.713859+0000","last_became_peered":"2024-09-21T02:32:50.713859+0000","last_unstale":"2024-09-21T02:34:31.410760+0000","last_undegraded":"2024-09-21T02:34:31.410760+0000","last_fullsized":"2024-09-21T02:34:31.410760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:41.315205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413006+0000","last_change":"2024-09-21T02:33:30.613550+0000","last_active":"2024-09-21T02:34:31.413006+0000","last_peered":"2024-09-21T02:34:31.413006+0000","last_clean":"2024-09-21T02:34:31.413006+0000","last_became_active":"2024-09-21T02:33:30.613216+0000","last_became_peered":"2024-09-21T02:33:30.613216+0000","last_unstale":"2024-09-21T02:34:31.413006+0000","last_undegraded":"2024-09-21T02:34:31.413006+0000","last_fullsized":"2024-09-21T02:34:31.413006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:11.076824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411910+0000","last_change":"2024-09-21T02:32:38.428428+0000","last_active":"2024-09-21T02:34:31.411910+0000","last_peered":"2024-09-21T02:34:31.411910+0000","last_clean":"2024-09-21T02:34:31.411910+0000","last_became_active":"2024-09-21T02:32:38.428066+0000","last_became_peered":"2024-09-21T02:32:38.428066+0000","last_unstale":"2024-09-21T02:34:31.411910+0000","last_undegraded":"2024-09-21T02:34:31.411910+0000","last_fullsized":"2024-09-21T02:34:31.411910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:45.601916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601210+0000","last_change":"2024-09-21T02:32:50.691139+0000","last_active":"2024-09-21T02:34:31.601210+0000","last_peered":"2024-09-21T02:34:31.601210+0000","last_clean":"2024-09-21T02:34:31.601210+0000","last_became_active":"2024-09-21T02:32:50.690653+0000","last_became_peered":"2024-09-21T02:32:50.690653+0000","last_unstale":"2024-09-21T02:34:31.601210+0000","last_undegraded":"2024-09-21T02:34:31.601210+0000","last_fullsized":"2024-09-21T02:34:31.601210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:43.852916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410437+0000","last_change":"2024-09-21T02:32:41.466857+0000","last_active":"2024-09-21T02:34:31.410437+0000","last_peered":"2024-09-21T02:34:31.410437+0000","last_clean":"2024-09-21T02:34:31.410437+0000","last_became_active":"2024-09-21T02:32:41.466467+0000","last_became_peered":"2024-09-21T02:32:41.466467+0000","last_unstale":"2024-09-21T02:34:31.410437+0000","last_undegraded":"2024-09-21T02:34:31.410437+0000","last_fullsized":"2024-09-21T02:34:31.410437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:29.369150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600787+0000","last_change":"2024-09-21T02:32:38.513999+0000","last_active":"2024-09-21T02:34:31.600787+0000","last_peered":"2024-09-21T02:34:31.600787+0000","last_clean":"2024-09-21T02:34:31.600787+0000","last_became_active":"2024-09-21T02:32:38.513605+0000","last_became_peered":"2024-09-21T02:32:38.513605+0000","last_unstale":"2024-09-21T02:34:31.600787+0000","last_undegraded":"2024-09-21T02:34:31.600787+0000","last_fullsized":"2024-09-21T02:34:31.600787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:45.616961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601179+0000","last_change":"2024-09-21T02:32:50.714830+0000","last_active":"2024-09-21T02:34:31.601179+0000","last_peered":"2024-09-21T02:34:31.601179+0000","last_clean":"2024-09-21T02:34:31.601179+0000","last_became_active":"2024-09-21T02:32:50.714166+0000","last_became_peered":"2024-09-21T02:32:50.714166+0000","last_unstale":"2024-09-21T02:34:31.601179+0000","last_undegraded":"2024-09-21T02:34:31.601179+0000","last_fullsized":"2024-09-21T02:34:31.601179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:35.418689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600657+0000","last_change":"2024-09-21T02:32:41.468695+0000","last_active":"2024-09-21T02:34:31.600657+0000","last_peered":"2024-09-21T02:34:31.600657+0000","last_clean":"2024-09-21T02:34:31.600657+0000","last_became_active":"2024-09-21T02:32:41.468349+0000","last_became_peered":"2024-09-21T02:32:41.468349+0000","last_unstale":"2024-09-21T02:34:31.600657+0000","last_undegraded":"2024-09-21T02:34:31.600657+0000","last_fullsized":"2024-09-21T02:34:31.600657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:51.935336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411076+0000","last_change":"2024-09-21T02:32:38.431187+0000","last_active":"2024-09-21T02:34:31.411076+0000","last_peered":"2024-09-21T02:34:31.411076+0000","last_clean":"2024-09-21T02:34:31.411076+0000","last_became_active":"2024-09-21T02:32:38.430790+0000","last_became_peered":"2024-09-21T02:32:38.430790+0000","last_unstale":"2024-09-21T02:34:31.411076+0000","last_undegraded":"2024-09-21T02:34:31.411076+0000","last_fullsized":"2024-09-21T02:34:31.411076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:05.004479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411303+0000","last_change":"2024-09-21T02:32:50.715728+0000","last_active":"2024-09-21T02:34:31.411303+0000","last_peered":"2024-09-21T02:34:31.411303+0000","last_clean":"2024-09-21T02:34:31.411303+0000","last_became_active":"2024-09-21T02:32:50.715329+0000","last_became_peered":"2024-09-21T02:32:50.715329+0000","last_unstale":"2024-09-21T02:34:31.411303+0000","last_undegraded":"2024-09-21T02:34:31.411303+0000","last_fullsized":"2024-09-21T02:34:31.411303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.790489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409307+0000","last_change":"2024-09-21T02:32:41.474885+0000","last_active":"2024-09-21T02:34:31.409307+0000","last_peered":"2024-09-21T02:34:31.409307+0000","last_clean":"2024-09-21T02:34:31.409307+0000","last_became_active":"2024-09-21T02:32:41.474599+0000","last_became_peered":"2024-09-21T02:32:41.474599+0000","last_unstale":"2024-09-21T02:34:31.409307+0000","last_undegraded":"2024-09-21T02:34:31.409307+0000","last_fullsized":"2024-09-21T02:34:31.409307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:43.006829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410372+0000","last_change":"2024-09-21T02:32:38.431168+0000","last_active":"2024-09-21T02:34:31.410372+0000","last_peered":"2024-09-21T02:34:31.410372+0000","last_clean":"2024-09-21T02:34:31.410372+0000","last_became_active":"2024-09-21T02:32:38.430743+0000","last_became_peered":"2024-09-21T02:32:38.430743+0000","last_unstale":"2024-09-21T02:34:31.410372+0000","last_undegraded":"2024-09-21T02:34:31.410372+0000","last_fullsized":"2024-09-21T02:34:31.410372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:54.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411399+0000","last_change":"2024-09-21T02:31:20.822638+0000","last_active":"2024-09-21T02:34:31.411399+0000","last_peered":"2024-09-21T02:34:31.411399+0000","last_clean":"2024-09-21T02:34:31.411399+0000","last_became_active":"2024-09-21T02:31:20.816679+0000","last_became_peered":"2024-09-21T02:31:20.816679+0000","last_unstale":"2024-09-21T02:34:31.411399+0000","last_undegraded":"2024-09-21T02:34:31.411399+0000","last_fullsized":"2024-09-21T02:34:31.411399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_clean_scrub_stamp":"2024-09-21T02:27:32.360535+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:51.568101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411653+0000","last_change":"2024-09-21T02:32:50.698437+0000","last_active":"2024-09-21T02:34:31.411653+0000","last_peered":"2024-09-21T02:34:31.411653+0000","last_clean":"2024-09-21T02:34:31.411653+0000","last_became_active":"2024-09-21T02:32:50.697814+0000","last_became_peered":"2024-09-21T02:32:50.697814+0000","last_unstale":"2024-09-21T02:34:31.411653+0000","last_undegraded":"2024-09-21T02:34:31.411653+0000","last_fullsized":"2024-09-21T02:34:31.411653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:51.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412115+0000","last_change":"2024-09-21T02:32:41.469539+0000","last_active":"2024-09-21T02:34:31.412115+0000","last_peered":"2024-09-21T02:34:31.412115+0000","last_clean":"2024-09-21T02:34:31.412115+0000","last_became_active":"2024-09-21T02:32:41.469060+0000","last_became_peered":"2024-09-21T02:32:41.469060+0000","last_unstale":"2024-09-21T02:34:31.412115+0000","last_undegraded":"2024-09-21T02:34:31.412115+0000","last_fullsized":"2024-09-21T02:34:31.412115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:36.699360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416482+0000","last_change":"2024-09-21T02:32:38.748487+0000","last_active":"2024-09-21T02:34:31.416482+0000","last_peered":"2024-09-21T02:34:31.416482+0000","last_clean":"2024-09-21T02:34:31.416482+0000","last_became_active":"2024-09-21T02:32:38.747956+0000","last_became_peered":"2024-09-21T02:32:38.747956+0000","last_unstale":"2024-09-21T02:34:31.416482+0000","last_undegraded":"2024-09-21T02:34:31.416482+0000","last_fullsized":"2024-09-21T02:34:31.416482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:15.745119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415850+0000","last_change":"2024-09-21T02:32:50.687412+0000","last_active":"2024-09-21T02:34:31.415850+0000","last_peered":"2024-09-21T02:34:31.415850+0000","last_clean":"2024-09-21T02:34:31.415850+0000","last_became_active":"2024-09-21T02:32:50.686819+0000","last_became_peered":"2024-09-21T02:32:50.686819+0000","last_unstale":"2024-09-21T02:34:31.415850+0000","last_undegraded":"2024-09-21T02:34:31.415850+0000","last_fullsized":"2024-09-21T02:34:31.415850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:28.830619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411500+0000","last_change":"2024-09-21T02:32:41.467719+0000","last_active":"2024-09-21T02:34:31.411500+0000","last_peered":"2024-09-21T02:34:31.411500+0000","last_clean":"2024-09-21T02:34:31.411500+0000","last_became_active":"2024-09-21T02:32:41.467332+0000","last_became_peered":"2024-09-21T02:32:41.467332+0000","last_unstale":"2024-09-21T02:34:31.411500+0000","last_undegraded":"2024-09-21T02:34:31.411500+0000","last_fullsized":"2024-09-21T02:34:31.411500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:06.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411939+0000","last_change":"2024-09-21T02:32:38.428553+0000","last_active":"2024-09-21T02:34:31.411939+0000","last_peered":"2024-09-21T02:34:31.411939+0000","last_clean":"2024-09-21T02:34:31.411939+0000","last_became_active":"2024-09-21T02:32:38.428159+0000","last_became_peered":"2024-09-21T02:32:38.428159+0000","last_unstale":"2024-09-21T02:34:31.411939+0000","last_undegraded":"2024-09-21T02:34:31.411939+0000","last_fullsized":"2024-09-21T02:34:31.411939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:17.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602104+0000","last_change":"2024-09-21T02:32:50.694290+0000","last_active":"2024-09-21T02:34:31.602104+0000","last_peered":"2024-09-21T02:34:31.602104+0000","last_clean":"2024-09-21T02:34:31.602104+0000","last_became_active":"2024-09-21T02:32:50.693794+0000","last_became_peered":"2024-09-21T02:32:50.693794+0000","last_unstale":"2024-09-21T02:34:31.602104+0000","last_undegraded":"2024-09-21T02:34:31.602104+0000","last_fullsized":"2024-09-21T02:34:31.602104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:07.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411790+0000","last_change":"2024-09-21T02:32:41.466802+0000","last_active":"2024-09-21T02:34:31.411790+0000","last_peered":"2024-09-21T02:34:31.411790+0000","last_clean":"2024-09-21T02:34:31.411790+0000","last_became_active":"2024-09-21T02:32:41.465348+0000","last_became_peered":"2024-09-21T02:32:41.465348+0000","last_unstale":"2024-09-21T02:34:31.411790+0000","last_undegraded":"2024-09-21T02:34:31.411790+0000","last_fullsized":"2024-09-21T02:34:31.411790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:23.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601363+0000","last_change":"2024-09-21T02:32:38.435725+0000","last_active":"2024-09-21T02:34:31.601363+0000","last_peered":"2024-09-21T02:34:31.601363+0000","last_clean":"2024-09-21T02:34:31.601363+0000","last_became_active":"2024-09-21T02:32:38.434688+0000","last_became_peered":"2024-09-21T02:32:38.434688+0000","last_unstale":"2024-09-21T02:34:31.601363+0000","last_undegraded":"2024-09-21T02:34:31.601363+0000","last_fullsized":"2024-09-21T02:34:31.601363+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:27.829955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410365+0000","last_change":"2024-09-21T02:33:31.041957+0000","last_active":"2024-09-21T02:34:31.410365+0000","last_peered":"2024-09-21T02:34:31.410365+0000","last_clean":"2024-09-21T02:34:31.410365+0000","last_became_active":"2024-09-21T02:33:31.041160+0000","last_became_peered":"2024-09-21T02:33:31.041160+0000","last_unstale":"2024-09-21T02:34:31.410365+0000","last_undegraded":"2024-09-21T02:34:31.410365+0000","last_fullsized":"2024-09-21T02:34:31.410365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.226199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7,1],"acting":[8,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407566+0000","last_change":"2024-09-21T02:32:41.474796+0000","last_active":"2024-09-21T02:34:31.407566+0000","last_peered":"2024-09-21T02:34:31.407566+0000","last_clean":"2024-09-21T02:34:31.407566+0000","last_became_active":"2024-09-21T02:32:41.474377+0000","last_became_peered":"2024-09-21T02:32:41.474377+0000","last_unstale":"2024-09-21T02:34:31.407566+0000","last_undegraded":"2024-09-21T02:34:31.407566+0000","last_fullsized":"2024-09-21T02:34:31.407566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.418508+0000","last_change":"2024-09-21T02:34:31.418421+0000","last_active":"2024-09-21T02:34:31.418508+0000","last_peered":"2024-09-21T02:34:31.418508+0000","last_clean":"2024-09-21T02:34:31.418508+0000","last_became_active":"2024-09-21T02:34:31.413206+0000","last_became_peered":"2024-09-21T02:34:31.413206+0000","last_unstale":"2024-09-21T02:34:31.418508+0000","last_undegraded":"2024-09-21T02:34:31.418508+0000","last_fullsized":"2024-09-21T02:34:31.418508+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:33.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410471+0000","last_change":"2024-09-21T02:32:50.685932+0000","last_active":"2024-09-21T02:34:31.410471+0000","last_peered":"2024-09-21T02:34:31.410471+0000","last_clean":"2024-09-21T02:34:31.410471+0000","last_became_active":"2024-09-21T02:32:50.685584+0000","last_became_peered":"2024-09-21T02:32:50.685584+0000","last_unstale":"2024-09-21T02:34:31.410471+0000","last_undegraded":"2024-09-21T02:34:31.410471+0000","last_fullsized":"2024-09-21T02:34:31.410471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:42.118046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410610+0000","last_change":"2024-09-21T02:33:31.041507+0000","last_active":"2024-09-21T02:34:31.410610+0000","last_peered":"2024-09-21T02:34:31.410610+0000","last_clean":"2024-09-21T02:34:31.410610+0000","last_became_active":"2024-09-21T02:33:31.040982+0000","last_became_peered":"2024-09-21T02:33:31.040982+0000","last_unstale":"2024-09-21T02:34:31.410610+0000","last_undegraded":"2024-09-21T02:34:31.410610+0000","last_fullsized":"2024-09-21T02:34:31.410610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:17.608426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410120+0000","last_change":"2024-09-21T02:32:38.512557+0000","last_active":"2024-09-21T02:34:31.410120+0000","last_peered":"2024-09-21T02:34:31.410120+0000","last_clean":"2024-09-21T02:34:31.410120+0000","last_became_active":"2024-09-21T02:32:38.512069+0000","last_became_peered":"2024-09-21T02:32:38.512069+0000","last_unstale":"2024-09-21T02:34:31.410120+0000","last_undegraded":"2024-09-21T02:34:31.410120+0000","last_fullsized":"2024-09-21T02:34:31.410120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:55.038548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601248+0000","last_change":"2024-09-21T02:32:50.698539+0000","last_active":"2024-09-21T02:34:31.601248+0000","last_peered":"2024-09-21T02:34:31.601248+0000","last_clean":"2024-09-21T02:34:31.601248+0000","last_became_active":"2024-09-21T02:32:50.698107+0000","last_became_peered":"2024-09-21T02:32:50.698107+0000","last_unstale":"2024-09-21T02:34:31.601248+0000","last_undegraded":"2024-09-21T02:34:31.601248+0000","last_fullsized":"2024-09-21T02:34:31.601248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:43.141885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411068+0000","last_change":"2024-09-21T02:32:41.468472+0000","last_active":"2024-09-21T02:34:31.411068+0000","last_peered":"2024-09-21T02:34:31.411068+0000","last_clean":"2024-09-21T02:34:31.411068+0000","last_became_active":"2024-09-21T02:32:41.468039+0000","last_became_peered":"2024-09-21T02:32:41.468039+0000","last_unstale":"2024-09-21T02:34:31.411068+0000","last_undegraded":"2024-09-21T02:34:31.411068+0000","last_fullsized":"2024-09-21T02:34:31.411068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:00.501173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409973+0000","last_change":"2024-09-21T02:32:38.431613+0000","last_active":"2024-09-21T02:34:31.409973+0000","last_peered":"2024-09-21T02:34:31.409973+0000","last_clean":"2024-09-21T02:34:31.409973+0000","last_became_active":"2024-09-21T02:32:38.431128+0000","last_became_peered":"2024-09-21T02:32:38.431128+0000","last_unstale":"2024-09-21T02:34:31.409973+0000","last_undegraded":"2024-09-21T02:34:31.409973+0000","last_fullsized":"2024-09-21T02:34:31.409973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:09.400651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408160+0000","last_change":"2024-09-21T02:32:50.691401+0000","last_active":"2024-09-21T02:34:31.408160+0000","last_peered":"2024-09-21T02:34:31.408160+0000","last_clean":"2024-09-21T02:34:31.408160+0000","last_became_active":"2024-09-21T02:32:50.688202+0000","last_became_peered":"2024-09-21T02:32:50.688202+0000","last_unstale":"2024-09-21T02:34:31.408160+0000","last_undegraded":"2024-09-21T02:34:31.408160+0000","last_fullsized":"2024-09-21T02:34:31.408160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:42.516887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411431+0000","last_change":"2024-09-21T02:32:41.475760+0000","last_active":"2024-09-21T02:34:31.411431+0000","last_peered":"2024-09-21T02:34:31.411431+0000","last_clean":"2024-09-21T02:34:31.411431+0000","last_became_active":"2024-09-21T02:32:41.475381+0000","last_became_peered":"2024-09-21T02:32:41.475381+0000","last_unstale":"2024-09-21T02:34:31.411431+0000","last_undegraded":"2024-09-21T02:34:31.411431+0000","last_fullsized":"2024-09-21T02:34:31.411431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.070064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410941+0000","last_change":"2024-09-21T02:32:38.424789+0000","last_active":"2024-09-21T02:34:31.410941+0000","last_peered":"2024-09-21T02:34:31.410941+0000","last_clean":"2024-09-21T02:34:31.410941+0000","last_became_active":"2024-09-21T02:32:38.424275+0000","last_became_peered":"2024-09-21T02:32:38.424275+0000","last_unstale":"2024-09-21T02:34:31.410941+0000","last_undegraded":"2024-09-21T02:34:31.410941+0000","last_fullsized":"2024-09-21T02:34:31.410941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:50.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407286+0000","last_change":"2024-09-21T02:32:50.692496+0000","last_active":"2024-09-21T02:34:31.407286+0000","last_peered":"2024-09-21T02:34:31.407286+0000","last_clean":"2024-09-21T02:34:31.407286+0000","last_became_active":"2024-09-21T02:32:50.692055+0000","last_became_peered":"2024-09-21T02:32:50.692055+0000","last_unstale":"2024-09-21T02:34:31.407286+0000","last_undegraded":"2024-09-21T02:34:31.407286+0000","last_fullsized":"2024-09-21T02:34:31.407286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:25.433298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600960+0000","last_change":"2024-09-21T02:32:41.475732+0000","last_active":"2024-09-21T02:34:31.600960+0000","last_peered":"2024-09-21T02:34:31.600960+0000","last_clean":"2024-09-21T02:34:31.600960+0000","last_became_active":"2024-09-21T02:32:41.475395+0000","last_became_peered":"2024-09-21T02:32:41.475395+0000","last_unstale":"2024-09-21T02:34:31.600960+0000","last_undegraded":"2024-09-21T02:34:31.600960+0000","last_fullsized":"2024-09-21T02:34:31.600960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:26.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416147+0000","last_change":"2024-09-21T02:32:38.434080+0000","last_active":"2024-09-21T02:34:31.416147+0000","last_peered":"2024-09-21T02:34:31.416147+0000","last_clean":"2024-09-21T02:34:31.416147+0000","last_became_active":"2024-09-21T02:32:38.433625+0000","last_became_peered":"2024-09-21T02:32:38.433625+0000","last_unstale":"2024-09-21T02:34:31.416147+0000","last_undegraded":"2024-09-21T02:34:31.416147+0000","last_fullsized":"2024-09-21T02:34:31.416147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:11.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411522+0000","last_change":"2024-09-21T02:32:50.687555+0000","last_active":"2024-09-21T02:34:31.411522+0000","last_peered":"2024-09-21T02:34:31.411522+0000","last_clean":"2024-09-21T02:34:31.411522+0000","last_became_active":"2024-09-21T02:32:50.686979+0000","last_became_peered":"2024-09-21T02:32:50.686979+0000","last_unstale":"2024-09-21T02:34:31.411522+0000","last_undegraded":"2024-09-21T02:34:31.411522+0000","last_fullsized":"2024-09-21T02:34:31.411522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:01.136515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410876+0000","last_change":"2024-09-21T02:32:41.463688+0000","last_active":"2024-09-21T02:34:31.410876+0000","last_peered":"2024-09-21T02:34:31.410876+0000","last_clean":"2024-09-21T02:34:31.410876+0000","last_became_active":"2024-09-21T02:32:41.463306+0000","last_became_peered":"2024-09-21T02:32:41.463306+0000","last_unstale":"2024-09-21T02:34:31.410876+0000","last_undegraded":"2024-09-21T02:34:31.410876+0000","last_fullsized":"2024-09-21T02:34:31.410876+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:46.217029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'34","reported_seq":233,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:38.431778+0000","last_change":"2024-09-21T02:34:31.423753+0000","last_active":"2024-09-21T02:34:38.431778+0000","last_peered":"2024-09-21T02:34:38.431778+0000","last_clean":"2024-09-21T02:34:38.431778+0000","last_became_active":"2024-09-21T02:34:31.417307+0000","last_became_peered":"2024-09-21T02:34:31.417307+0000","last_unstale":"2024-09-21T02:34:38.431778+0000","last_undegraded":"2024-09-21T02:34:38.431778+0000","last_fullsized":"2024-09-21T02:34:38.431778+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:29.538505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":34,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":69267,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412671+0000","last_change":"2024-09-21T02:33:30.538615+0000","last_active":"2024-09-21T02:34:31.412671+0000","last_peered":"2024-09-21T02:34:31.412671+0000","last_clean":"2024-09-21T02:34:31.412671+0000","last_became_active":"2024-09-21T02:33:30.538046+0000","last_became_peered":"2024-09-21T02:33:30.538046+0000","last_unstale":"2024-09-21T02:34:31.412671+0000","last_undegraded":"2024-09-21T02:34:31.412671+0000","last_fullsized":"2024-09-21T02:34:31.412671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:04.235706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416192+0000","last_change":"2024-09-21T02:32:41.470318+0000","last_active":"2024-09-21T02:34:31.416192+0000","last_peered":"2024-09-21T02:34:31.416192+0000","last_clean":"2024-09-21T02:34:31.416192+0000","last_became_active":"2024-09-21T02:32:41.466804+0000","last_became_peered":"2024-09-21T02:32:41.466804+0000","last_unstale":"2024-09-21T02:34:31.416192+0000","last_undegraded":"2024-09-21T02:34:31.416192+0000","last_fullsized":"2024-09-21T02:34:31.416192+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411783+0000","last_change":"2024-09-21T02:32:38.514901+0000","last_active":"2024-09-21T02:34:31.411783+0000","last_peered":"2024-09-21T02:34:31.411783+0000","last_clean":"2024-09-21T02:34:31.411783+0000","last_became_active":"2024-09-21T02:32:38.514497+0000","last_became_peered":"2024-09-21T02:32:38.514497+0000","last_unstale":"2024-09-21T02:34:31.411783+0000","last_undegraded":"2024-09-21T02:34:31.411783+0000","last_fullsized":"2024-09-21T02:34:31.411783+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:02.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410176+0000","last_change":"2024-09-21T02:33:31.041566+0000","last_active":"2024-09-21T02:34:31.410176+0000","last_peered":"2024-09-21T02:34:31.410176+0000","last_clean":"2024-09-21T02:34:31.410176+0000","last_became_active":"2024-09-21T02:33:31.041041+0000","last_became_peered":"2024-09-21T02:33:31.041041+0000","last_unstale":"2024-09-21T02:34:31.410176+0000","last_undegraded":"2024-09-21T02:34:31.410176+0000","last_fullsized":"2024-09-21T02:34:31.410176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:00.236406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602510+0000","last_change":"2024-09-21T02:32:41.483502+0000","last_active":"2024-09-21T02:34:31.602510+0000","last_peered":"2024-09-21T02:34:31.602510+0000","last_clean":"2024-09-21T02:34:31.602510+0000","last_became_active":"2024-09-21T02:32:41.483116+0000","last_became_peered":"2024-09-21T02:32:41.483116+0000","last_unstale":"2024-09-21T02:34:31.602510+0000","last_undegraded":"2024-09-21T02:34:31.602510+0000","last_fullsized":"2024-09-21T02:34:31.602510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:39.146202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411971+0000","last_change":"2024-09-21T02:33:31.041819+0000","last_active":"2024-09-21T02:34:31.411971+0000","last_peered":"2024-09-21T02:34:31.411971+0000","last_clean":"2024-09-21T02:34:31.411971+0000","last_became_active":"2024-09-21T02:33:31.041241+0000","last_became_peered":"2024-09-21T02:33:31.041241+0000","last_unstale":"2024-09-21T02:34:31.411971+0000","last_undegraded":"2024-09-21T02:34:31.411971+0000","last_fullsized":"2024-09-21T02:34:31.411971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:00.241618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407242+0000","last_change":"2024-09-21T02:32:50.692227+0000","last_active":"2024-09-21T02:34:31.407242+0000","last_peered":"2024-09-21T02:34:31.407242+0000","last_clean":"2024-09-21T02:34:31.407242+0000","last_became_active":"2024-09-21T02:32:50.691787+0000","last_became_peered":"2024-09-21T02:32:50.691787+0000","last_unstale":"2024-09-21T02:34:31.407242+0000","last_undegraded":"2024-09-21T02:34:31.407242+0000","last_fullsized":"2024-09-21T02:34:31.407242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:40.086313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416685+0000","last_change":"2024-09-21T02:32:41.476056+0000","last_active":"2024-09-21T02:34:31.416685+0000","last_peered":"2024-09-21T02:34:31.416685+0000","last_clean":"2024-09-21T02:34:31.416685+0000","last_became_active":"2024-09-21T02:32:41.475525+0000","last_became_peered":"2024-09-21T02:32:41.475525+0000","last_unstale":"2024-09-21T02:34:31.416685+0000","last_undegraded":"2024-09-21T02:34:31.416685+0000","last_fullsized":"2024-09-21T02:34:31.416685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:42.074296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413561+0000","last_change":"2024-09-21T02:32:38.430845+0000","last_active":"2024-09-21T02:34:31.413561+0000","last_peered":"2024-09-21T02:34:31.413561+0000","last_clean":"2024-09-21T02:34:31.413561+0000","last_became_active":"2024-09-21T02:32:38.430372+0000","last_became_peered":"2024-09-21T02:32:38.430372+0000","last_unstale":"2024-09-21T02:34:31.413561+0000","last_undegraded":"2024-09-21T02:34:31.413561+0000","last_fullsized":"2024-09-21T02:34:31.413561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:40.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409209+0000","last_change":"2024-09-21T02:32:50.685481+0000","last_active":"2024-09-21T02:34:31.409209+0000","last_peered":"2024-09-21T02:34:31.409209+0000","last_clean":"2024-09-21T02:34:31.409209+0000","last_became_active":"2024-09-21T02:32:50.685044+0000","last_became_peered":"2024-09-21T02:32:50.685044+0000","last_unstale":"2024-09-21T02:34:31.409209+0000","last_undegraded":"2024-09-21T02:34:31.409209+0000","last_fullsized":"2024-09-21T02:34:31.409209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:33.132966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602251+0000","last_change":"2024-09-21T02:32:50.690447+0000","last_active":"2024-09-21T02:34:31.602251+0000","last_peered":"2024-09-21T02:34:31.602251+0000","last_clean":"2024-09-21T02:34:31.602251+0000","last_became_active":"2024-09-21T02:32:50.690021+0000","last_became_peered":"2024-09-21T02:32:50.690021+0000","last_unstale":"2024-09-21T02:34:31.602251+0000","last_undegraded":"2024-09-21T02:34:31.602251+0000","last_fullsized":"2024-09-21T02:34:31.602251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:44.436690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407416+0000","last_change":"2024-09-21T02:32:41.469186+0000","last_active":"2024-09-21T02:34:31.407416+0000","last_peered":"2024-09-21T02:34:31.407416+0000","last_clean":"2024-09-21T02:34:31.407416+0000","last_became_active":"2024-09-21T02:32:41.468837+0000","last_became_peered":"2024-09-21T02:32:41.468837+0000","last_unstale":"2024-09-21T02:34:31.407416+0000","last_undegraded":"2024-09-21T02:34:31.407416+0000","last_fullsized":"2024-09-21T02:34:31.407416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:02.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411539+0000","last_change":"2024-09-21T02:32:38.426631+0000","last_active":"2024-09-21T02:34:31.411539+0000","last_peered":"2024-09-21T02:34:31.411539+0000","last_clean":"2024-09-21T02:34:31.411539+0000","last_became_active":"2024-09-21T02:32:38.425600+0000","last_became_peered":"2024-09-21T02:32:38.425600+0000","last_unstale":"2024-09-21T02:34:31.411539+0000","last_undegraded":"2024-09-21T02:34:31.411539+0000","last_fullsized":"2024-09-21T02:34:31.411539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.669245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407581+0000","last_change":"2024-09-21T02:32:50.697935+0000","last_active":"2024-09-21T02:34:31.407581+0000","last_peered":"2024-09-21T02:34:31.407581+0000","last_clean":"2024-09-21T02:34:31.407581+0000","last_became_active":"2024-09-21T02:32:50.697537+0000","last_became_peered":"2024-09-21T02:32:50.697537+0000","last_unstale":"2024-09-21T02:34:31.407581+0000","last_undegraded":"2024-09-21T02:34:31.407581+0000","last_fullsized":"2024-09-21T02:34:31.407581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:32.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408783+0000","last_change":"2024-09-21T02:32:41.458640+0000","last_active":"2024-09-21T02:34:31.408783+0000","last_peered":"2024-09-21T02:34:31.408783+0000","last_clean":"2024-09-21T02:34:31.408783+0000","last_became_active":"2024-09-21T02:32:41.458231+0000","last_became_peered":"2024-09-21T02:32:41.458231+0000","last_unstale":"2024-09-21T02:34:31.408783+0000","last_undegraded":"2024-09-21T02:34:31.408783+0000","last_fullsized":"2024-09-21T02:34:31.408783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:26.132979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600785+0000","last_change":"2024-09-21T02:32:38.430888+0000","last_active":"2024-09-21T02:34:31.600785+0000","last_peered":"2024-09-21T02:34:31.600785+0000","last_clean":"2024-09-21T02:34:31.600785+0000","last_became_active":"2024-09-21T02:32:38.430516+0000","last_became_peered":"2024-09-21T02:32:38.430516+0000","last_unstale":"2024-09-21T02:34:31.600785+0000","last_undegraded":"2024-09-21T02:34:31.600785+0000","last_fullsized":"2024-09-21T02:34:31.600785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:54.671763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412860+0000","last_change":"2024-09-21T02:32:38.434012+0000","last_active":"2024-09-21T02:34:31.412860+0000","last_peered":"2024-09-21T02:34:31.412860+0000","last_clean":"2024-09-21T02:34:31.412860+0000","last_became_active":"2024-09-21T02:32:38.433571+0000","last_became_peered":"2024-09-21T02:32:38.433571+0000","last_unstale":"2024-09-21T02:34:31.412860+0000","last_undegraded":"2024-09-21T02:34:31.412860+0000","last_fullsized":"2024-09-21T02:34:31.412860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:59.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411182+0000","last_change":"2024-09-21T02:33:30.650855+0000","last_active":"2024-09-21T02:34:31.411182+0000","last_peered":"2024-09-21T02:34:31.411182+0000","last_clean":"2024-09-21T02:34:31.411182+0000","last_became_active":"2024-09-21T02:33:30.650428+0000","last_became_peered":"2024-09-21T02:33:30.650428+0000","last_unstale":"2024-09-21T02:34:31.411182+0000","last_undegraded":"2024-09-21T02:34:31.411182+0000","last_fullsized":"2024-09-21T02:34:31.411182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:55.757861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416100+0000","last_change":"2024-09-21T02:32:50.698249+0000","last_active":"2024-09-21T02:34:31.416100+0000","last_peered":"2024-09-21T02:34:31.416100+0000","last_clean":"2024-09-21T02:34:31.416100+0000","last_became_active":"2024-09-21T02:32:50.697768+0000","last_became_peered":"2024-09-21T02:32:50.697768+0000","last_unstale":"2024-09-21T02:34:31.416100+0000","last_undegraded":"2024-09-21T02:34:31.416100+0000","last_fullsized":"2024-09-21T02:34:31.416100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.723420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411300+0000","last_change":"2024-09-21T02:32:38.435733+0000","last_active":"2024-09-21T02:34:31.411300+0000","last_peered":"2024-09-21T02:34:31.411300+0000","last_clean":"2024-09-21T02:34:31.411300+0000","last_became_active":"2024-09-21T02:32:38.435288+0000","last_became_peered":"2024-09-21T02:32:38.435288+0000","last_unstale":"2024-09-21T02:34:31.411300+0000","last_undegraded":"2024-09-21T02:34:31.411300+0000","last_fullsized":"2024-09-21T02:34:31.411300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.430652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409999+0000","last_change":"2024-09-21T02:32:41.468127+0000","last_active":"2024-09-21T02:34:31.409999+0000","last_peered":"2024-09-21T02:34:31.409999+0000","last_clean":"2024-09-21T02:34:31.409999+0000","last_became_active":"2024-09-21T02:32:41.467730+0000","last_became_peered":"2024-09-21T02:32:41.467730+0000","last_unstale":"2024-09-21T02:34:31.409999+0000","last_undegraded":"2024-09-21T02:34:31.409999+0000","last_fullsized":"2024-09-21T02:34:31.409999+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:39.684035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416383+0000","last_change":"2024-09-21T02:32:50.684115+0000","last_active":"2024-09-21T02:34:31.416383+0000","last_peered":"2024-09-21T02:34:31.416383+0000","last_clean":"2024-09-21T02:34:31.416383+0000","last_became_active":"2024-09-21T02:32:50.683627+0000","last_became_peered":"2024-09-21T02:32:50.683627+0000","last_unstale":"2024-09-21T02:34:31.416383+0000","last_undegraded":"2024-09-21T02:34:31.416383+0000","last_fullsized":"2024-09-21T02:34:31.416383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:10.953943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407103+0000","last_change":"2024-09-21T02:32:41.465744+0000","last_active":"2024-09-21T02:34:31.407103+0000","last_peered":"2024-09-21T02:34:31.407103+0000","last_clean":"2024-09-21T02:34:31.407103+0000","last_became_active":"2024-09-21T02:32:41.465392+0000","last_became_peered":"2024-09-21T02:32:41.465392+0000","last_unstale":"2024-09-21T02:34:31.407103+0000","last_undegraded":"2024-09-21T02:34:31.407103+0000","last_fullsized":"2024-09-21T02:34:31.407103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:54.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416061+0000","last_change":"2024-09-21T02:32:41.470967+0000","last_active":"2024-09-21T02:34:31.416061+0000","last_peered":"2024-09-21T02:34:31.416061+0000","last_clean":"2024-09-21T02:34:31.416061+0000","last_became_active":"2024-09-21T02:32:41.470547+0000","last_became_peered":"2024-09-21T02:32:41.470547+0000","last_unstale":"2024-09-21T02:34:31.416061+0000","last_undegraded":"2024-09-21T02:34:31.416061+0000","last_fullsized":"2024-09-21T02:34:31.416061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:57.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416216+0000","last_change":"2024-09-21T02:32:41.474500+0000","last_active":"2024-09-21T02:34:31.416216+0000","last_peered":"2024-09-21T02:34:31.416216+0000","last_clean":"2024-09-21T02:34:31.416216+0000","last_became_active":"2024-09-21T02:32:41.474117+0000","last_became_peered":"2024-09-21T02:32:41.474117+0000","last_unstale":"2024-09-21T02:34:31.416216+0000","last_undegraded":"2024-09-21T02:34:31.416216+0000","last_fullsized":"2024-09-21T02:34:31.416216+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:43.152503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602107+0000","last_change":"2024-09-21T02:32:41.479123+0000","last_active":"2024-09-21T02:34:31.602107+0000","last_peered":"2024-09-21T02:34:31.602107+0000","last_clean":"2024-09-21T02:34:31.602107+0000","last_became_active":"2024-09-21T02:32:41.478543+0000","last_became_peered":"2024-09-21T02:32:41.478543+0000","last_unstale":"2024-09-21T02:34:31.602107+0000","last_undegraded":"2024-09-21T02:34:31.602107+0000","last_fullsized":"2024-09-21T02:34:31.602107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:39.802425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601358+0000","last_change":"2024-09-21T02:32:41.483334+0000","last_active":"2024-09-21T02:34:31.601358+0000","last_peered":"2024-09-21T02:34:31.601358+0000","last_clean":"2024-09-21T02:34:31.601358+0000","last_became_active":"2024-09-21T02:32:41.482999+0000","last_became_peered":"2024-09-21T02:32:41.482999+0000","last_unstale":"2024-09-21T02:34:31.601358+0000","last_undegraded":"2024-09-21T02:34:31.601358+0000","last_fullsized":"2024-09-21T02:34:31.601358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:16.259647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407511+0000","last_change":"2024-09-21T02:33:30.539417+0000","last_active":"2024-09-21T02:34:31.407511+0000","last_peered":"2024-09-21T02:34:31.407511+0000","last_clean":"2024-09-21T02:34:31.407511+0000","last_became_active":"2024-09-21T02:33:30.538970+0000","last_became_peered":"2024-09-21T02:33:30.538970+0000","last_unstale":"2024-09-21T02:34:31.407511+0000","last_undegraded":"2024-09-21T02:34:31.407511+0000","last_fullsized":"2024-09-21T02:34:31.407511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:09.772513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416699+0000","last_change":"2024-09-21T02:32:41.469386+0000","last_active":"2024-09-21T02:34:31.416699+0000","last_peered":"2024-09-21T02:34:31.416699+0000","last_clean":"2024-09-21T02:34:31.416699+0000","last_became_active":"2024-09-21T02:32:41.468982+0000","last_became_peered":"2024-09-21T02:32:41.468982+0000","last_unstale":"2024-09-21T02:34:31.416699+0000","last_undegraded":"2024-09-21T02:34:31.416699+0000","last_fullsized":"2024-09-21T02:34:31.416699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.644854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409193+0000","last_change":"2024-09-21T02:32:41.467365+0000","last_active":"2024-09-21T02:34:31.409193+0000","last_peered":"2024-09-21T02:34:31.409193+0000","last_clean":"2024-09-21T02:34:31.409193+0000","last_became_active":"2024-09-21T02:32:41.466893+0000","last_became_peered":"2024-09-21T02:32:41.466893+0000","last_unstale":"2024-09-21T02:34:31.409193+0000","last_undegraded":"2024-09-21T02:34:31.409193+0000","last_fullsized":"2024-09-21T02:34:31.409193+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410286+0000","last_change":"2024-09-21T02:32:41.473695+0000","last_active":"2024-09-21T02:34:31.410286+0000","last_peered":"2024-09-21T02:34:31.410286+0000","last_clean":"2024-09-21T02:34:31.410286+0000","last_became_active":"2024-09-21T02:32:41.473035+0000","last_became_peered":"2024-09-21T02:32:41.473035+0000","last_unstale":"2024-09-21T02:34:31.410286+0000","last_undegraded":"2024-09-21T02:34:31.410286+0000","last_fullsized":"2024-09-21T02:34:31.410286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:54.343984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409402+0000","last_change":"2024-09-21T02:32:41.473578+0000","last_active":"2024-09-21T02:34:31.409402+0000","last_peered":"2024-09-21T02:34:31.409402+0000","last_clean":"2024-09-21T02:34:31.409402+0000","last_became_active":"2024-09-21T02:32:41.472983+0000","last_became_peered":"2024-09-21T02:32:41.472983+0000","last_unstale":"2024-09-21T02:34:31.409402+0000","last_undegraded":"2024-09-21T02:34:31.409402+0000","last_fullsized":"2024-09-21T02:34:31.409402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.895809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416461+0000","last_change":"2024-09-21T02:32:41.473751+0000","last_active":"2024-09-21T02:34:31.416461+0000","last_peered":"2024-09-21T02:34:31.416461+0000","last_clean":"2024-09-21T02:34:31.416461+0000","last_became_active":"2024-09-21T02:32:41.473367+0000","last_became_peered":"2024-09-21T02:32:41.473367+0000","last_unstale":"2024-09-21T02:34:31.416461+0000","last_undegraded":"2024-09-21T02:34:31.416461+0000","last_fullsized":"2024-09-21T02:34:31.416461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:04.707745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601370+0000","last_change":"2024-09-21T02:32:41.485375+0000","last_active":"2024-09-21T02:34:31.601370+0000","last_peered":"2024-09-21T02:34:31.601370+0000","last_clean":"2024-09-21T02:34:31.601370+0000","last_became_active":"2024-09-21T02:32:41.484845+0000","last_became_peered":"2024-09-21T02:32:41.484845+0000","last_unstale":"2024-09-21T02:34:31.601370+0000","last_undegraded":"2024-09-21T02:34:31.601370+0000","last_fullsized":"2024-09-21T02:34:31.601370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:58.529747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407318+0000","last_change":"2024-09-21T02:32:41.462925+0000","last_active":"2024-09-21T02:34:31.407318+0000","last_peered":"2024-09-21T02:34:31.407318+0000","last_clean":"2024-09-21T02:34:31.407318+0000","last_became_active":"2024-09-21T02:32:41.462056+0000","last_became_peered":"2024-09-21T02:32:41.462056+0000","last_unstale":"2024-09-21T02:34:31.407318+0000","last_undegraded":"2024-09-21T02:34:31.407318+0000","last_fullsized":"2024-09-21T02:34:31.407318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:05.447554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416578+0000","last_change":"2024-09-21T02:32:41.475111+0000","last_active":"2024-09-21T02:34:31.416578+0000","last_peered":"2024-09-21T02:34:31.416578+0000","last_clean":"2024-09-21T02:34:31.416578+0000","last_became_active":"2024-09-21T02:32:41.474634+0000","last_became_peered":"2024-09-21T02:32:41.474634+0000","last_unstale":"2024-09-21T02:34:31.416578+0000","last_undegraded":"2024-09-21T02:34:31.416578+0000","last_fullsized":"2024-09-21T02:34:31.416578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:07.750970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408080+0000","last_change":"2024-09-21T02:32:41.479702+0000","last_active":"2024-09-21T02:34:31.408080+0000","last_peered":"2024-09-21T02:34:31.408080+0000","last_clean":"2024-09-21T02:34:31.408080+0000","last_became_active":"2024-09-21T02:32:41.479378+0000","last_became_peered":"2024-09-21T02:32:41.479378+0000","last_unstale":"2024-09-21T02:34:31.408080+0000","last_undegraded":"2024-09-21T02:34:31.408080+0000","last_fullsized":"2024-09-21T02:34:31.408080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:56.687641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407944+0000","last_change":"2024-09-21T02:32:41.475567+0000","last_active":"2024-09-21T02:34:31.407944+0000","last_peered":"2024-09-21T02:34:31.407944+0000","last_clean":"2024-09-21T02:34:31.407944+0000","last_became_active":"2024-09-21T02:32:41.475207+0000","last_became_peered":"2024-09-21T02:32:41.475207+0000","last_unstale":"2024-09-21T02:34:31.407944+0000","last_undegraded":"2024-09-21T02:34:31.407944+0000","last_fullsized":"2024-09-21T02:34:31.407944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:33.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415571+0000","last_change":"2024-09-21T02:32:41.483518+0000","last_active":"2024-09-21T02:34:31.415571+0000","last_peered":"2024-09-21T02:34:31.415571+0000","last_clean":"2024-09-21T02:34:31.415571+0000","last_became_active":"2024-09-21T02:32:41.483088+0000","last_became_peered":"2024-09-21T02:32:41.483088+0000","last_unstale":"2024-09-21T02:34:31.415571+0000","last_undegraded":"2024-09-21T02:34:31.415571+0000","last_fullsized":"2024-09-21T02:34:31.415571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:23.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601610+0000","last_change":"2024-09-21T02:32:41.482113+0000","last_active":"2024-09-21T02:34:31.601610+0000","last_peered":"2024-09-21T02:34:31.601610+0000","last_clean":"2024-09-21T02:34:31.601610+0000","last_became_active":"2024-09-21T02:32:41.479123+0000","last_became_peered":"2024-09-21T02:32:41.479123+0000","last_unstale":"2024-09-21T02:34:31.601610+0000","last_undegraded":"2024-09-21T02:34:31.601610+0000","last_fullsized":"2024-09-21T02:34:31.601610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:48.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601584+0000","last_change":"2024-09-21T02:32:41.470429+0000","last_active":"2024-09-21T02:34:31.601584+0000","last_peered":"2024-09-21T02:34:31.601584+0000","last_clean":"2024-09-21T02:34:31.601584+0000","last_became_active":"2024-09-21T02:32:41.469421+0000","last_became_peered":"2024-09-21T02:32:41.469421+0000","last_unstale":"2024-09-21T02:34:31.601584+0000","last_undegraded":"2024-09-21T02:34:31.601584+0000","last_fullsized":"2024-09-21T02:34:31.601584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:00.952030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601265+0000","last_change":"2024-09-21T02:32:41.470361+0000","last_active":"2024-09-21T02:34:31.601265+0000","last_peered":"2024-09-21T02:34:31.601265+0000","last_clean":"2024-09-21T02:34:31.601265+0000","last_became_active":"2024-09-21T02:32:41.469983+0000","last_became_peered":"2024-09-21T02:32:41.469983+0000","last_unstale":"2024-09-21T02:34:31.601265+0000","last_undegraded":"2024-09-21T02:34:31.601265+0000","last_fullsized":"2024-09-21T02:34:31.601265+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:02.703688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410341+0000","last_change":"2024-09-21T02:32:41.468975+0000","last_active":"2024-09-21T02:34:31.410341+0000","last_peered":"2024-09-21T02:34:31.410341+0000","last_clean":"2024-09-21T02:34:31.410341+0000","last_became_active":"2024-09-21T02:32:41.468612+0000","last_became_peered":"2024-09-21T02:32:41.468612+0000","last_unstale":"2024-09-21T02:34:31.410341+0000","last_undegraded":"2024-09-21T02:34:31.410341+0000","last_fullsized":"2024-09-21T02:34:31.410341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:04.442257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411965+0000","last_change":"2024-09-21T02:32:41.471444+0000","last_active":"2024-09-21T02:34:31.411965+0000","last_peered":"2024-09-21T02:34:31.411965+0000","last_clean":"2024-09-21T02:34:31.411965+0000","last_became_active":"2024-09-21T02:32:41.470437+0000","last_became_peered":"2024-09-21T02:32:41.470437+0000","last_unstale":"2024-09-21T02:34:31.411965+0000","last_undegraded":"2024-09-21T02:34:31.411965+0000","last_fullsized":"2024-09-21T02:34:31.411965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:13.933069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413672+0000","last_change":"2024-09-21T02:32:41.475397+0000","last_active":"2024-09-21T02:34:31.413672+0000","last_peered":"2024-09-21T02:34:31.413672+0000","last_clean":"2024-09-21T02:34:31.413672+0000","last_became_active":"2024-09-21T02:32:41.475034+0000","last_became_peered":"2024-09-21T02:32:41.475034+0000","last_unstale":"2024-09-21T02:34:31.413672+0000","last_undegraded":"2024-09-21T02:34:31.413672+0000","last_fullsized":"2024-09-21T02:34:31.413672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:24.944289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416907+0000","last_change":"2024-09-21T02:32:41.470297+0000","last_active":"2024-09-21T02:34:31.416907+0000","last_peered":"2024-09-21T02:34:31.416907+0000","last_clean":"2024-09-21T02:34:31.416907+0000","last_became_active":"2024-09-21T02:32:41.469843+0000","last_became_peered":"2024-09-21T02:32:41.469843+0000","last_unstale":"2024-09-21T02:34:31.416907+0000","last_undegraded":"2024-09-21T02:34:31.416907+0000","last_fullsized":"2024-09-21T02:34:31.416907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407203+0000","last_change":"2024-09-21T02:33:30.535828+0000","last_active":"2024-09-21T02:34:31.407203+0000","last_peered":"2024-09-21T02:34:31.407203+0000","last_clean":"2024-09-21T02:34:31.407203+0000","last_became_active":"2024-09-21T02:33:30.535576+0000","last_became_peered":"2024-09-21T02:33:30.535576+0000","last_unstale":"2024-09-21T02:34:31.407203+0000","last_undegraded":"2024-09-21T02:34:31.407203+0000","last_fullsized":"2024-09-21T02:34:31.407203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:05.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411109+0000","last_change":"2024-09-21T02:32:41.466073+0000","last_active":"2024-09-21T02:34:31.411109+0000","last_peered":"2024-09-21T02:34:31.411109+0000","last_clean":"2024-09-21T02:34:31.411109+0000","last_became_active":"2024-09-21T02:32:41.465664+0000","last_became_peered":"2024-09-21T02:32:41.465664+0000","last_unstale":"2024-09-21T02:34:31.411109+0000","last_undegraded":"2024-09-21T02:34:31.411109+0000","last_fullsized":"2024-09-21T02:34:31.411109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:25.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412809+0000","last_change":"2024-09-21T02:32:41.471006+0000","last_active":"2024-09-21T02:34:31.412809+0000","last_peered":"2024-09-21T02:34:31.412809+0000","last_clean":"2024-09-21T02:34:31.412809+0000","last_became_active":"2024-09-21T02:32:41.469780+0000","last_became_peered":"2024-09-21T02:32:41.469780+0000","last_unstale":"2024-09-21T02:34:31.412809+0000","last_undegraded":"2024-09-21T02:34:31.412809+0000","last_fullsized":"2024-09-21T02:34:31.412809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:18.604729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410176+0000","last_change":"2024-09-21T02:32:41.476169+0000","last_active":"2024-09-21T02:34:31.410176+0000","last_peered":"2024-09-21T02:34:31.410176+0000","last_clean":"2024-09-21T02:34:31.410176+0000","last_became_active":"2024-09-21T02:32:41.475754+0000","last_became_peered":"2024-09-21T02:32:41.475754+0000","last_unstale":"2024-09-21T02:34:31.410176+0000","last_undegraded":"2024-09-21T02:34:31.410176+0000","last_fullsized":"2024-09-21T02:34:31.410176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:18.532122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410190+0000","last_change":"2024-09-21T02:32:41.467078+0000","last_active":"2024-09-21T02:34:31.410190+0000","last_peered":"2024-09-21T02:34:31.410190+0000","last_clean":"2024-09-21T02:34:31.410190+0000","last_became_active":"2024-09-21T02:32:41.466702+0000","last_became_peered":"2024-09-21T02:32:41.466702+0000","last_unstale":"2024-09-21T02:34:31.410190+0000","last_undegraded":"2024-09-21T02:34:31.410190+0000","last_fullsized":"2024-09-21T02:34:31.410190+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:43.409390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602252+0000","last_change":"2024-09-21T02:32:41.467476+0000","last_active":"2024-09-21T02:34:31.602252+0000","last_peered":"2024-09-21T02:34:31.602252+0000","last_clean":"2024-09-21T02:34:31.602252+0000","last_became_active":"2024-09-21T02:32:41.466901+0000","last_became_peered":"2024-09-21T02:32:41.466901+0000","last_unstale":"2024-09-21T02:34:31.602252+0000","last_undegraded":"2024-09-21T02:34:31.602252+0000","last_fullsized":"2024-09-21T02:34:31.602252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:46.207507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602380+0000","last_change":"2024-09-21T02:32:41.486528+0000","last_active":"2024-09-21T02:34:31.602380+0000","last_peered":"2024-09-21T02:34:31.602380+0000","last_clean":"2024-09-21T02:34:31.602380+0000","last_became_active":"2024-09-21T02:32:41.484370+0000","last_became_peered":"2024-09-21T02:32:41.484370+0000","last_unstale":"2024-09-21T02:34:31.602380+0000","last_undegraded":"2024-09-21T02:34:31.602380+0000","last_fullsized":"2024-09-21T02:34:31.602380+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:28.978540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407849+0000","last_change":"2024-09-21T02:32:41.474525+0000","last_active":"2024-09-21T02:34:31.407849+0000","last_peered":"2024-09-21T02:34:31.407849+0000","last_clean":"2024-09-21T02:34:31.407849+0000","last_became_active":"2024-09-21T02:32:41.474147+0000","last_became_peered":"2024-09-21T02:32:41.474147+0000","last_unstale":"2024-09-21T02:34:31.407849+0000","last_undegraded":"2024-09-21T02:34:31.407849+0000","last_fullsized":"2024-09-21T02:34:31.407849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:26.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":145,"num_read_kb":143,"num_write":94,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":69871,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":210195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710757,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1011712,"data_stored":505903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906986,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1683456,"data_stored":1161032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070511,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1011712,"data_stored":509977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":505881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1601536,"data_stored":1099763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626497,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":501203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822727,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36924,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708228,"statfs":{"total":95995035648,"available":95957225472,"internally_reserved":0,"allocated":1609728,"data_stored":1095849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1085440,"data_stored":574588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1007616,"data_stored":501307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":501237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1077248,"data_stored":570470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":501293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:34:41.480 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:34:41.480 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T02:34:41.480 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T02:34:41.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T02:34:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:41 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:41 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:41.877 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:41 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 -- 172.21.15.79:0/3243808988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8109df0 msgr2=0x7f2bb8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 --2- 172.21.15.79:0/3243808988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8109df0 0x7f2bb8110620 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009be0 tx=0x7f2bb002a6c0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 -- 172.21.15.79:0/3243808988 shutdown_connections 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 --2- 172.21.15.79:0/3243808988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8109df0 0x7f2bb8110620 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 --2- 172.21.15.79:0/3243808988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 0x7f2bb81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 --2- 172.21.15.79:0/3243808988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb8103b60 0x7f2bb8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 -- 172.21.15.79:0/3243808988 >> 172.21.15.79:0/3243808988 conn(0x7f2bb807b850 msgr2=0x7f2bb807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 -- 172.21.15.79:0/3243808988 shutdown_connections 2024-09-21T02:34:42.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.532+0000 7f2bbe800640 1 -- 172.21.15.79:0/3243808988 wait complete. 2024-09-21T02:34:42.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.533+0000 7f2bbe800640 1 Processor -- start 2024-09-21T02:34:42.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.533+0000 7f2bbe800640 1 -- start start 2024-09-21T02:34:42.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bbe800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8103b60 0x7f2bb819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bbe800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 0x7f2bb819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bbe800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb8109df0 0x7f2bb81a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bbe800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8113ab0 con 0x7f2bb8109df0 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bbe800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8113930 con 0x7f2bb81094a0 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bbe800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8113c30 con 0x7f2bb8103b60 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8103b60 0x7f2bb819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bb6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 0x7f2bb819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bb6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 0x7f2bb819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:45218/0 (socket says 172.21.15.79:45218) 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8103b60 0x7f2bb819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54490/0 (socket says 172.21.15.79:54490) 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bb6a00640 1 -- 172.21.15.79:0/2684502116 learned_addr learned my addr 172.21.15.79:0/2684502116 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:42.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.534+0000 7f2bb7e00640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb8109df0 0x7f2bb81a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:42.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.535+0000 7f2bb7400640 1 -- 172.21.15.79:0/2684502116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 msgr2=0x7f2bb819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:42.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.535+0000 7f2bb7400640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 0x7f2bb819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.535+0000 7f2bb7400640 1 -- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb8109df0 msgr2=0x7f2bb81a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:42.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.535+0000 7f2bb7400640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb8109df0 0x7f2bb81a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.535+0000 7f2bb7400640 1 -- 172.21.15.79:0/2684502116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb81a25b0 con 0x7f2bb8103b60 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.535+0000 7f2bb6a00640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 0x7f2bb819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.535+0000 7f2bb7400640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8103b60 0x7f2bb819c640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800e9f0 tx=0x7f2ba800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.536+0000 7f2bafe00640 1 -- 172.21.15.79:0/2684502116 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800cd80 con 0x7f2bb8103b60 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.536+0000 7f2bafe00640 1 -- 172.21.15.79:0/2684502116 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ba80035f0 con 0x7f2bb8103b60 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.536+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb81a28a0 con 0x7f2bb8103b60 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.536+0000 7f2bafe00640 1 -- 172.21.15.79:0/2684502116 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8010670 con 0x7f2bb8103b60 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.536+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb81a9000 con 0x7f2bb8103b60 2024-09-21T02:34:42.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.537+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb8103f70 con 0x7f2bb8103b60 2024-09-21T02:34:42.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.539+0000 7f2bafe00640 1 -- 172.21.15.79:0/2684502116 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2ba80037a0 con 0x7f2bb8103b60 2024-09-21T02:34:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.541+0000 7f2bafe00640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b9c0b6620 0x7f2b9c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.542+0000 7f2bafe00640 1 -- 172.21.15.79:0/2684502116 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2ba80e7eb0 con 0x7f2bb8103b60 2024-09-21T02:34:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.542+0000 7f2bb6a00640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b9c0b6620 0x7f2b9c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:42.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.543+0000 7f2bb6a00640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b9c0b6620 0x7f2b9c0b8b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8108ef0 tx=0x7f2ba4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:42.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.543+0000 7f2bafe00640 1 -- 172.21.15.79:0/2684502116 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ba80ae1d0 con 0x7f2bb8103b60 2024-09-21T02:34:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:42 smithi079 ceph-mon[30788]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:34:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:42 smithi079 ceph-mon[30788]: pgmap v384: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s; 6.8 KiB/s, 0 objects/s recovering 2024-09-21T02:34:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:42 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:42.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:42 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:42 smithi148 ceph-mon[34626]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:34:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:42 smithi148 ceph-mon[34626]: pgmap v384: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s; 6.8 KiB/s, 0 objects/s recovering 2024-09-21T02:34:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:42 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:42.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:42 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.824+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2bb819d770 con 0x7f2bb8103b60 2024-09-21T02:34:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.825+0000 7f2bafe00640 1 -- 172.21.15.79:0/2684502116 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2bb819d770 con 0x7f2bb8103b60 2024-09-21T02:34:42.826 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:42.826 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T02:34:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b9c0b6620 msgr2=0x7f2b9c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b9c0b6620 0x7f2b9c0b8b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8108ef0 tx=0x7f2ba4009260 comp rx=0 tx=0).stop 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8103b60 msgr2=0x7f2bb819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8103b60 0x7f2bb819c640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800e9f0 tx=0x7f2ba800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 shutdown_connections 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b9c0b6620 0x7f2b9c0b8b30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bb8109df0 0x7f2bb81a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bb81094a0 0x7f2bb819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 --2- 172.21.15.79:0/2684502116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb8103b60 0x7f2bb819c640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 >> 172.21.15.79:0/2684502116 conn(0x7f2bb807b850 msgr2=0x7f2bb81072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 shutdown_connections 2024-09-21T02:34:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:42.827+0000 7f2bbe800640 1 -- 172.21.15.79:0/2684502116 wait complete. 2024-09-21T02:34:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:42 smithi098 ceph-mon[34832]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:34:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:42 smithi098 ceph-mon[34832]: pgmap v384: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s; 6.8 KiB/s, 0 objects/s recovering 2024-09-21T02:34:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:42 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:42 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:43.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:43.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:43.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:43 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2684502116' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:34:43.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:43.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:43 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:43.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:43 smithi079 ceph-mon[30788]: pgmap v385: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 5.7 KiB/s, 0 objects/s recovering 2024-09-21T02:34:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:43 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2684502116' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:34:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:43 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:43 smithi098 ceph-mon[34832]: pgmap v385: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 5.7 KiB/s, 0 objects/s recovering 2024-09-21T02:34:44.259 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T02:34:44.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:34:44.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:43 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2684502116' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:34:44.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:43 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:44.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:43 smithi148 ceph-mon[34626]: pgmap v385: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 5.7 KiB/s, 0 objects/s recovering 2024-09-21T02:34:44.663 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:45.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 -- 172.21.15.79:0/3650799565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410103b60 msgr2=0x7fd410103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:45.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 --2- 172.21.15.79:0/3650799565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410103b60 0x7fd410103f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd404009900 tx=0x7fd40402a400 comp rx=0 tx=0).stop 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 -- 172.21.15.79:0/3650799565 shutdown_connections 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 --2- 172.21.15.79:0/3650799565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd410109df0 0x7fd410110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 --2- 172.21.15.79:0/3650799565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 0x7fd4101098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 --2- 172.21.15.79:0/3650799565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410103b60 0x7fd410103f70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 -- 172.21.15.79:0/3650799565 >> 172.21.15.79:0/3650799565 conn(0x7fd41007b850 msgr2=0x7fd41007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 -- 172.21.15.79:0/3650799565 shutdown_connections 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.314+0000 7fd417a00640 1 -- 172.21.15.79:0/3650799565 wait complete. 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.315+0000 7fd417a00640 1 Processor -- start 2024-09-21T02:34:45.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.315+0000 7fd417a00640 1 -- start start 2024-09-21T02:34:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd417a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd410103b60 0x7fd41019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd417a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 0x7fd41019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd417a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410109df0 0x7fd4101a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd417a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd410113ab0 con 0x7fd410109df0 2024-09-21T02:34:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd417a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd410113930 con 0x7fd410103b60 2024-09-21T02:34:45.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd417a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd410113c30 con 0x7fd4101094a0 2024-09-21T02:34:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd415a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410109df0 0x7fd4101a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd40fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 0x7fd41019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd40fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 0x7fd41019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:59596/0 (socket says 172.21.15.79:59596) 2024-09-21T02:34:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd40fe00640 1 -- 172.21.15.79:0/675375423 learned_addr learned my addr 172.21.15.79:0/675375423 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd415a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410109df0 0x7fd4101a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50382/0 (socket says 172.21.15.79:50382) 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.316+0000 7fd415000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd410103b60 0x7fd41019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.317+0000 7fd40fe00640 1 -- 172.21.15.79:0/675375423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd410103b60 msgr2=0x7fd41019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.317+0000 7fd40fe00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd410103b60 0x7fd41019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.317+0000 7fd40fe00640 1 -- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410109df0 msgr2=0x7fd4101a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.317+0000 7fd40fe00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410109df0 0x7fd4101a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.317+0000 7fd40fe00640 1 -- 172.21.15.79:0/675375423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4101a2710 con 0x7fd4101094a0 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.317+0000 7fd415a00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410109df0 0x7fd4101a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:45.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.317+0000 7fd40fe00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 0x7fd41019cd40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00e9f0 tx=0x7fd3fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:45.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.318+0000 7fd40d600640 1 -- 172.21.15.79:0/675375423 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00ccc0 con 0x7fd4101094a0 2024-09-21T02:34:45.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.318+0000 7fd40d600640 1 -- 172.21.15.79:0/675375423 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3fc0108e0 con 0x7fd4101094a0 2024-09-21T02:34:45.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.318+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4101a2a00 con 0x7fd4101094a0 2024-09-21T02:34:45.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.318+0000 7fd40d600640 1 -- 172.21.15.79:0/675375423 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc018860 con 0x7fd4101094a0 2024-09-21T02:34:45.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.318+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4101a9160 con 0x7fd4101094a0 2024-09-21T02:34:45.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.319+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd410103f70 con 0x7fd4101094a0 2024-09-21T02:34:45.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.322+0000 7fd40d600640 1 -- 172.21.15.79:0/675375423 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fd3fc010430 con 0x7fd4101094a0 2024-09-21T02:34:45.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.323+0000 7fd40d600640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd3f80b65a0 0x7fd3f80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.323+0000 7fd40d600640 1 -- 172.21.15.79:0/675375423 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fd3fc0e7fe0 con 0x7fd4101094a0 2024-09-21T02:34:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.324+0000 7fd415000640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd3f80b65a0 0x7fd3f80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.324+0000 7fd415000640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd3f80b65a0 0x7fd3f80b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd404031440 tx=0x7fd404009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.325+0000 7fd40d600640 1 -- 172.21.15.79:0/675375423 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd3fc0b2700 con 0x7fd4101094a0 2024-09-21T02:34:45.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.598+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4101a93c0 con 0x7fd4101094a0 2024-09-21T02:34:45.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.599+0000 7fd40d600640 1 -- 172.21.15.79:0/675375423 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fd3fc0b7640 con 0x7fd4101094a0 2024-09-21T02:34:45.601 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:34:45.602 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:34:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd3f80b65a0 msgr2=0x7fd3f80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd3f80b65a0 0x7fd3f80b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd404031440 tx=0x7fd404009560 comp rx=0 tx=0).stop 2024-09-21T02:34:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 msgr2=0x7fd41019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 0x7fd41019cd40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00e9f0 tx=0x7fd3fc00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 shutdown_connections 2024-09-21T02:34:45.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd3f80b65a0 0x7fd3f80b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd410109df0 0x7fd4101a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4101094a0 0x7fd41019cd40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 --2- 172.21.15.79:0/675375423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd410103b60 0x7fd41019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 >> 172.21.15.79:0/675375423 conn(0x7fd41007b850 msgr2=0x7fd410107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 shutdown_connections 2024-09-21T02:34:45.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:45.602+0000 7fd417a00640 1 -- 172.21.15.79:0/675375423 wait complete. 2024-09-21T02:34:46.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:34:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:46 smithi079 ceph-mon[30788]: pgmap v386: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 5.6 KiB/s, 0 objects/s recovering 2024-09-21T02:34:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:46 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:46 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:46.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:46 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/675375423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:46.806 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:46.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:46 smithi148 ceph-mon[34626]: pgmap v386: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 5.6 KiB/s, 0 objects/s recovering 2024-09-21T02:34:46.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:46 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:46.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:46 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:46.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:46 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/675375423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:46 smithi098 ceph-mon[34832]: pgmap v386: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 5.6 KiB/s, 0 objects/s recovering 2024-09-21T02:34:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:46 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:46 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:46 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/675375423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:47.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.465+0000 7fe8b3e00640 1 -- 172.21.15.79:0/926518859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac103b60 msgr2=0x7fe8ac103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.465+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/926518859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac103b60 0x7fe8ac103f70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009900 tx=0x7fe8a002a410 comp rx=0 tx=0).stop 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.466+0000 7fe8b3e00640 1 -- 172.21.15.79:0/926518859 shutdown_connections 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.466+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/926518859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8ac109df0 0x7fe8ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.466+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/926518859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8ac1094a0 0x7fe8ac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.466+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/926518859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac103b60 0x7fe8ac103f70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.466+0000 7fe8b3e00640 1 -- 172.21.15.79:0/926518859 >> 172.21.15.79:0/926518859 conn(0x7fe8ac07b850 msgr2=0x7fe8ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.466+0000 7fe8b3e00640 1 -- 172.21.15.79:0/926518859 shutdown_connections 2024-09-21T02:34:47.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.466+0000 7fe8b3e00640 1 -- 172.21.15.79:0/926518859 wait complete. 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 Processor -- start 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 -- start start 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8ac103b60 0x7fe8ac19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8ac1094a0 0x7fe8ac19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac109df0 0x7fe8ac1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac113ab0 con 0x7fe8ac109df0 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac113930 con 0x7fe8ac1094a0 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.467+0000 7fe8b3e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac113c30 con 0x7fe8ac103b60 2024-09-21T02:34:47.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac109df0 0x7fe8ac1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:47.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac109df0 0x7fe8ac1a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50394/0 (socket says 172.21.15.79:50394) 2024-09-21T02:34:47.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 -- 172.21.15.79:0/3046025896 learned_addr learned my addr 172.21.15.79:0/3046025896 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:47.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1400640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8ac103b60 0x7fe8ac19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:47.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b0a00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8ac1094a0 0x7fe8ac19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 -- 172.21.15.79:0/3046025896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8ac103b60 msgr2=0x7fe8ac19c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8ac103b60 0x7fe8ac19c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 -- 172.21.15.79:0/3046025896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8ac1094a0 msgr2=0x7fe8ac19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8ac1094a0 0x7fe8ac19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.468+0000 7fe8b1e00640 1 -- 172.21.15.79:0/3046025896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac1a2630 con 0x7fe8ac109df0 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.469+0000 7fe8b1e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac109df0 0x7fe8ac1a1f00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400eb10 tx=0x7fe8a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.469+0000 7fe8aa000640 1 -- 172.21.15.79:0/3046025896 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4004b20 con 0x7fe8ac109df0 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.469+0000 7fe8aa000640 1 -- 172.21.15.79:0/3046025896 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8a4004cc0 con 0x7fe8ac109df0 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.469+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac1a2920 con 0x7fe8ac109df0 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.469+0000 7fe8aa000640 1 -- 172.21.15.79:0/3046025896 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4010670 con 0x7fe8ac109df0 2024-09-21T02:34:47.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.469+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac1a9080 con 0x7fe8ac109df0 2024-09-21T02:34:47.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.470+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ac103f70 con 0x7fe8ac109df0 2024-09-21T02:34:47.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.473+0000 7fe8aa000640 1 -- 172.21.15.79:0/3046025896 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe8a4005000 con 0x7fe8ac109df0 2024-09-21T02:34:47.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.475+0000 7fe8aa000640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe8940b65a0 0x7fe8940b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:47.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.475+0000 7fe8aa000640 1 -- 172.21.15.79:0/3046025896 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe8a40e7fa0 con 0x7fe8ac109df0 2024-09-21T02:34:47.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.475+0000 7fe8b1400640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe8940b65a0 0x7fe8940b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:47.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.476+0000 7fe8b1400640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe8940b65a0 0x7fe8940b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0031440 tx=0x7fe8a0009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:47.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.477+0000 7fe8aa000640 1 -- 172.21.15.79:0/3046025896 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8a4056710 con 0x7fe8ac109df0 2024-09-21T02:34:47.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.713+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8ac19d7f0 con 0x7fe8ac109df0 2024-09-21T02:34:47.714 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:47.714 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:47.715 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:47.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.713+0000 7fe8aa000640 1 -- 172.21.15.79:0/3046025896 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fe8ac19d7f0 con 0x7fe8ac109df0 2024-09-21T02:34:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:47.715 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:34:47.716 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:34:47.716 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:47.716 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:47.716 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe8940b65a0 msgr2=0x7fe8940b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe8940b65a0 0x7fe8940b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0031440 tx=0x7fe8a0009560 comp rx=0 tx=0).stop 2024-09-21T02:34:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac109df0 msgr2=0x7fe8ac1a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:47.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac109df0 0x7fe8ac1a1f00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400eb10 tx=0x7fe8a400c2d0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 shutdown_connections 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe8940b65a0 0x7fe8940b8ab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8ac109df0 0x7fe8ac1a1f00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8ac1094a0 0x7fe8ac19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 --2- 172.21.15.79:0/3046025896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8ac103b60 0x7fe8ac19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 >> 172.21.15.79:0/3046025896 conn(0x7fe8ac07b850 msgr2=0x7fe8ac1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.717+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 shutdown_connections 2024-09-21T02:34:47.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:47.718+0000 7fe8b3e00640 1 -- 172.21.15.79:0/3046025896 wait complete. 2024-09-21T02:34:47.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:47.807 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:47.807 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:34:48.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:34:48.700 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:48 smithi079 ceph-mon[30788]: pgmap v387: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T02:34:48.700 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:48 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3046025896' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:48 smithi148 ceph-mon[34626]: pgmap v387: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T02:34:48.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:48 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3046025896' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:48 smithi098 ceph-mon[34832]: pgmap v387: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T02:34:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:48 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3046025896' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:48.948 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 -- 172.21.15.79:0/3179369645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6810faf0 msgr2=0x7f2e6810ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 --2- 172.21.15.79:0/3179369645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6810faf0 0x7f2e6810ff00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009900 tx=0x7f2e5002a410 comp rx=0 tx=0).stop 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 -- 172.21.15.79:0/3179369645 shutdown_connections 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 --2- 172.21.15.79:0/3179369645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68110440 0x7f2e68116c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 --2- 172.21.15.79:0/3179369645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e6810faf0 0x7f2e6810ff00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 --2- 172.21.15.79:0/3179369645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e6810a1b0 0x7f2e6810a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 -- 172.21.15.79:0/3179369645 >> 172.21.15.79:0/3179369645 conn(0x7f2e680780e0 msgr2=0x7f2e681081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:49.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 -- 172.21.15.79:0/3179369645 shutdown_connections 2024-09-21T02:34:49.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.597+0000 7f2e6de00640 1 -- 172.21.15.79:0/3179369645 wait complete. 2024-09-21T02:34:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.598+0000 7f2e6de00640 1 Processor -- start 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.598+0000 7f2e6de00640 1 -- start start 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e6de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e6810a1b0 0x7f2e681a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e6de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e6810faf0 0x7f2e681a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e6de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e68110440 0x7f2e681a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e6de00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6811a0b0 con 0x7f2e68110440 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e6de00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e68119f30 con 0x7f2e6810faf0 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e6de00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6811a230 con 0x7f2e6810a1b0 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e67400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e68110440 0x7f2e681a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e5fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e6810faf0 0x7f2e681a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e67400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e68110440 0x7f2e681a6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50406/0 (socket says 172.21.15.79:50406) 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e67400640 1 -- 172.21.15.79:0/1451000737 learned_addr learned my addr 172.21.15.79:0/1451000737 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:49.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.599+0000 7f2e66a00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e6810a1b0 0x7f2e681a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e66a00640 1 -- 172.21.15.79:0/1451000737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e6810faf0 msgr2=0x7f2e681a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e66a00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e6810faf0 0x7f2e681a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e66a00640 1 -- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e68110440 msgr2=0x7f2e681a6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e66a00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e68110440 0x7f2e681a6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e66a00640 1 -- 172.21.15.79:0/1451000737 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e681a6ab0 con 0x7f2e6810a1b0 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e67400640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e68110440 0x7f2e681a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e66a00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e6810a1b0 0x7f2e681a0b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e9f0 tx=0x7f2e5800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e6ca00640 1 -- 172.21.15.79:0/1451000737 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800ccc0 con 0x7f2e6810a1b0 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e6ca00640 1 -- 172.21.15.79:0/1451000737 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e580108e0 con 0x7f2e6810a1b0 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e6ca00640 1 -- 172.21.15.79:0/1451000737 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58018880 con 0x7f2e6810a1b0 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.600+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e681a6da0 con 0x7f2e6810a1b0 2024-09-21T02:34:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.601+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e681ad500 con 0x7f2e6810a1b0 2024-09-21T02:34:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.602+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6810a5c0 con 0x7f2e6810a1b0 2024-09-21T02:34:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.604+0000 7f2e6ca00640 1 -- 172.21.15.79:0/1451000737 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2e58010430 con 0x7f2e6810a1b0 2024-09-21T02:34:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.605+0000 7f2e6ca00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e4c0b65a0 0x7f2e4c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.606+0000 7f2e6ca00640 1 -- 172.21.15.79:0/1451000737 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2e580e8070 con 0x7f2e6810a1b0 2024-09-21T02:34:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.606+0000 7f2e5fe00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e4c0b65a0 0x7f2e4c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.606+0000 7f2e5fe00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e4c0b65a0 0x7f2e4c0b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009230 tx=0x7f2e50031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:49.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.607+0000 7f2e6ca00640 1 -- 172.21.15.79:0/1451000737 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e580b2770 con 0x7f2e6810a1b0 2024-09-21T02:34:49.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.796+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e68111c60 con 0x7f2e6810a1b0 2024-09-21T02:34:49.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.798+0000 7f2e6ca00640 1 -- 172.21.15.79:0/1451000737 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24834 (secure 0 0 0) 0x7f2e580b76b0 con 0x7f2e6810a1b0 2024-09-21T02:34:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:49.800 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:34:31.402384+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.800+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e4c0b65a0 msgr2=0x7f2e4c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.800+0000 7f2e6de00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e4c0b65a0 0x7f2e4c0b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009230 tx=0x7f2e50031400 comp rx=0 tx=0).stop 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.800+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e6810a1b0 msgr2=0x7f2e681a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.800+0000 7f2e6de00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e6810a1b0 0x7f2e681a0b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e9f0 tx=0x7f2e5800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 shutdown_connections 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2e4c0b65a0 0x7f2e4c0b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e68110440 0x7f2e681a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e6810faf0 0x7f2e681a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 --2- 172.21.15.79:0/1451000737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e6810a1b0 0x7f2e681a0b40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:49.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 >> 172.21.15.79:0/1451000737 conn(0x7f2e680780e0 msgr2=0x7f2e681086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:49.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 shutdown_connections 2024-09-21T02:34:49.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:49.801+0000 7f2e6de00640 1 -- 172.21.15.79:0/1451000737 wait complete. 2024-09-21T02:34:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:50 smithi079 ceph-mon[30788]: pgmap v388: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:50.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:50 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1451000737' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:50.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:34:50.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:50 smithi148 ceph-mon[34626]: pgmap v388: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:50.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:50 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1451000737' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:50.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:50 smithi098 ceph-mon[34832]: pgmap v388: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:50.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:50 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1451000737' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:34:50.971 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 -- 172.21.15.79:0/1754948329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010c020 msgr2=0x7fc060112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 --2- 172.21.15.79:0/1754948329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010c020 0x7fc060112850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc058009ca0 tx=0x7fc05802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 -- 172.21.15.79:0/1754948329 shutdown_connections 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 --2- 172.21.15.79:0/1754948329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010c020 0x7fc060112850 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 --2- 172.21.15.79:0/1754948329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc06010b6d0 0x7fc06010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 --2- 172.21.15.79:0/1754948329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc060105d90 0x7fc0601061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 -- 172.21.15.79:0/1754948329 >> 172.21.15.79:0/1754948329 conn(0x7fc0601017c0 msgr2=0x7fc060103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 -- 172.21.15.79:0/1754948329 shutdown_connections 2024-09-21T02:34:51.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.587+0000 7fc067200640 1 -- 172.21.15.79:0/1754948329 wait complete. 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.588+0000 7fc067200640 1 Processor -- start 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc067200640 1 -- start start 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc067200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc060105d90 0x7fc06019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc067200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010b6d0 0x7fc06019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc067200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc06010c020 0x7fc0601a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc067200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc060115d30 con 0x7fc06010b6d0 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc067200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc060115bb0 con 0x7fc06010c020 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc067200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc060115eb0 con 0x7fc060105d90 2024-09-21T02:34:51.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc057400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010b6d0 0x7fc06019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc057400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010b6d0 0x7fc06019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50426/0 (socket says 172.21.15.79:50426) 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc057400640 1 -- 172.21.15.79:0/2128597964 learned_addr learned my addr 172.21.15.79:0/2128597964 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.589+0000 7fc05fe00640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc060105d90 0x7fc06019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc065200640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc06010c020 0x7fc0601a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc057400640 1 -- 172.21.15.79:0/2128597964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc060105d90 msgr2=0x7fc06019c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc057400640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc060105d90 0x7fc06019c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc057400640 1 -- 172.21.15.79:0/2128597964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc06010c020 msgr2=0x7fc0601a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc057400640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc06010c020 0x7fc0601a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc057400640 1 -- 172.21.15.79:0/2128597964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0601a25d0 con 0x7fc06010b6d0 2024-09-21T02:34:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc057400640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010b6d0 0x7fc06019cc00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc04800d950 tx=0x7fc04800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc05d600640 1 -- 172.21.15.79:0/2128597964 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048017070 con 0x7fc06010b6d0 2024-09-21T02:34:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.590+0000 7fc05d600640 1 -- 172.21.15.79:0/2128597964 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc048009c30 con 0x7fc06010b6d0 2024-09-21T02:34:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.591+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0601a28c0 con 0x7fc06010b6d0 2024-09-21T02:34:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.591+0000 7fc05d600640 1 -- 172.21.15.79:0/2128597964 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0480047a0 con 0x7fc06010b6d0 2024-09-21T02:34:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.591+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601a9020 con 0x7fc06010b6d0 2024-09-21T02:34:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.592+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0601061a0 con 0x7fc06010b6d0 2024-09-21T02:34:51.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.594+0000 7fc05d600640 1 -- 172.21.15.79:0/2128597964 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc048004020 con 0x7fc06010b6d0 2024-09-21T02:34:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.595+0000 7fc05d600640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc0440b65a0 0x7fc0440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.596+0000 7fc05d600640 1 -- 172.21.15.79:0/2128597964 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fc0480e74d0 con 0x7fc06010b6d0 2024-09-21T02:34:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.596+0000 7fc05fe00640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc0440b65a0 0x7fc0440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:51.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.597+0000 7fc05fe00640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc0440b65a0 0x7fc0440b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc050009bd0 tx=0x7fc050005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.600+0000 7fc05d600640 1 -- 172.21.15.79:0/2128597964 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc048020020 con 0x7fc06010b6d0 2024-09-21T02:34:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.828+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc06002e640 con 0x7fc06010b6d0 2024-09-21T02:34:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.829+0000 7fc05d600640 1 -- 172.21.15.79:0/2128597964 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fc0480ad7f0 con 0x7fc06010b6d0 2024-09-21T02:34:51.830 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:34:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:34:51.830 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:34:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc0440b65a0 msgr2=0x7fc0440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc0440b65a0 0x7fc0440b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc050009bd0 tx=0x7fc050005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010b6d0 msgr2=0x7fc06019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010b6d0 0x7fc06019cc00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc04800d950 tx=0x7fc04800de10 comp rx=0 tx=0).stop 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 shutdown_connections 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc0440b65a0 0x7fc0440b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc06010c020 0x7fc0601a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc06010b6d0 0x7fc06019cc00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 --2- 172.21.15.79:0/2128597964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc060105d90 0x7fc06019c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 >> 172.21.15.79:0/2128597964 conn(0x7fc0601017c0 msgr2=0x7fc060108c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 shutdown_connections 2024-09-21T02:34:51.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:51.831+0000 7fc067200640 1 -- 172.21.15.79:0/2128597964 wait complete. 2024-09-21T02:34:52.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:52 smithi079 ceph-mon[30788]: pgmap v389: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:52.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:52 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2128597964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:52.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:32:42.479233+0000', 'modified': '2024-09-21T02:33:34.630634+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24668': {'gid': 24668, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6837/2031151027', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 2031151027}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 2031151027}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.98:6839/413408652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 413408652}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 413408652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24704]} 2024-09-21T02:34:52.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T02:34:52.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:34:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:52 smithi148 ceph-mon[34626]: pgmap v389: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:52.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:52 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2128597964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:52.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:52 smithi098 ceph-mon[34832]: pgmap v389: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:52.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:52 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2128597964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:34:53.004 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:53.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 -- 172.21.15.79:0/2451193554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 msgr2=0x7f4990103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 --2- 172.21.15.79:0/2451193554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f4990103dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4980009ca0 tx=0x7f498002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 -- 172.21.15.79:0/2451193554 shutdown_connections 2024-09-21T02:34:53.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 --2- 172.21.15.79:0/2451193554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4990109c40 0x7f4990110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 --2- 172.21.15.79:0/2451193554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49901092f0 0x7f4990109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 --2- 172.21.15.79:0/2451193554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f4990103dc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 -- 172.21.15.79:0/2451193554 >> 172.21.15.79:0/2451193554 conn(0x7f49900ff440 msgr2=0x7f4990101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:53.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 -- 172.21.15.79:0/2451193554 shutdown_connections 2024-09-21T02:34:53.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.654+0000 7f4995c00640 1 -- 172.21.15.79:0/2451193554 wait complete. 2024-09-21T02:34:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 Processor -- start 2024-09-21T02:34:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 -- start start 2024-09-21T02:34:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f499019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49901092f0 0x7f499019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4990109c40 0x7f49901a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4990113950 con 0x7f49901039b0 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f49901137d0 con 0x7f4990109c40 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.656+0000 7f4995c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4990113ad0 con 0x7f49901092f0 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f499019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f499019c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50440/0 (socket says 172.21.15.79:50440) 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 -- 172.21.15.79:0/1294548327 learned_addr learned my addr 172.21.15.79:0/1294548327 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f4987400640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49901092f0 0x7f499019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f4995200640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4990109c40 0x7f49901a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 -- 172.21.15.79:0/1294548327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49901092f0 msgr2=0x7f499019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49901092f0 0x7f499019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 -- 172.21.15.79:0/1294548327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4990109c40 msgr2=0x7f49901a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4990109c40 0x7f49901a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 -- 172.21.15.79:0/1294548327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49901a24b0 con 0x7f49901039b0 2024-09-21T02:34:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.657+0000 7f498fe00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f499019c540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4980005e30 tx=0x7f4980031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.658+0000 7f498d600640 1 -- 172.21.15.79:0/1294548327 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980003b70 con 0x7f49901039b0 2024-09-21T02:34:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.658+0000 7f498d600640 1 -- 172.21.15.79:0/1294548327 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4980003d10 con 0x7f49901039b0 2024-09-21T02:34:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.658+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49901a2740 con 0x7f49901039b0 2024-09-21T02:34:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.658+0000 7f498d600640 1 -- 172.21.15.79:0/1294548327 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498002fa30 con 0x7f49901039b0 2024-09-21T02:34:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.658+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49901a8f00 con 0x7f49901039b0 2024-09-21T02:34:53.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.661+0000 7f499dfce740 1 Processor -- start 2024-09-21T02:34:53.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.661+0000 7f499dfce740 1 -- start start 2024-09-21T02:34:53.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.661+0000 7f498d600640 1 -- 172.21.15.79:0/1294548327 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f498002fbd0 con 0x7f49901039b0 2024-09-21T02:34:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f499dfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e2714f60 0x5616e2abb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f499dfce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26ec0a0 0x5616e2abbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f499dfce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2abc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f499dfce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5616e2a32d50 con 0x5616e26f4280 2024-09-21T02:34:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f499dfce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616e2a22180 con 0x5616e2714f60 2024-09-21T02:34:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f499dfce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5616e2a25f90 con 0x5616e26ec0a0 2024-09-21T02:34:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f4987400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2abc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f4995200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e2714f60 0x5616e2abb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f498fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26ec0a0 0x5616e2abbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f4995200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e2714f60 0x5616e2abb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57056/0 (socket says 172.21.15.79:57056) 2024-09-21T02:34:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f4995200640 1 -- 172.21.15.79:0/68028235 learned_addr learned my addr 172.21.15.79:0/68028235 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f4995200640 1 -- 172.21.15.79:0/68028235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26ec0a0 msgr2=0x5616e2abbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f4995200640 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26ec0a0 0x5616e2abbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.662+0000 7f4995200640 1 -- 172.21.15.79:0/68028235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 msgr2=0x5616e2abc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f4995200640 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2abc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f4995200640 1 -- 172.21.15.79:0/68028235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e29eca70 con 0x5616e2714f60 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f4987400640 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2abc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f4995200640 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e2714f60 0x5616e2abb670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4988009ca0 tx=0x7f4988011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49642088f398d47b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f4985600640 1 -- 172.21.15.79:0/68028235 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498801e070 con 0x5616e2714f60 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f498d600640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f49740b65a0 0x7f49740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f4985600640 1 -- 172.21.15.79:0/68028235 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4988009e50 con 0x5616e2714f60 2024-09-21T02:34:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f4985600640 1 -- 172.21.15.79:0/68028235 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498800ea10 con 0x5616e2714f60 2024-09-21T02:34:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.663+0000 7f498d600640 1 -- 172.21.15.79:0/1294548327 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4980108950 con 0x7f49901039b0 2024-09-21T02:34:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f498fe00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f49740b65a0 0x7f49740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f499dfce740 1 -- 172.21.15.79:0/68028235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e2714f60 msgr2=0x5616e2abb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f498fe00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f49740b65a0 0x7f49740b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f49800ce270 tx=0x7f498010e530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f499dfce740 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e2714f60 0x5616e2abb670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4988009ca0 tx=0x7f4988011810 comp rx=0 tx=0).stop 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f499dfce740 1 -- 172.21.15.79:0/68028235 shutdown_connections 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f499dfce740 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2abc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f499dfce740 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26ec0a0 0x5616e2abbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f499dfce740 1 --2- 172.21.15.79:0/68028235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e2714f60 0x5616e2abb670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.664+0000 7f499dfce740 1 -- 172.21.15.79:0/68028235 >> 172.21.15.79:0/68028235 conn(0x5616e2709350 msgr2=0x5616e2ab9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.665+0000 7f499dfce740 1 -- 172.21.15.79:0/68028235 shutdown_connections 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.665+0000 7f499dfce740 1 -- 172.21.15.79:0/68028235 wait complete. 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.665+0000 7f499dfce740 1 -- start start 2024-09-21T02:34:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.665+0000 7f499dfce740 1 Processor -- start 2024-09-21T02:34:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f499dfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ac7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f499dfce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f499dfce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ad31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f499dfce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5616e28835f0 con 0x5616e26f4280 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f499dfce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616e29bd460 con 0x5616e26ec0a0 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f499dfce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5616e2ac9e50 con 0x5616e2714f60 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f499dfce740 10 client.0 _ll_register_callbacks cb 0x5616e29cd210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f4987400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f4987400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50450/0 (socket says 172.21.15.79:50450) 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f4987400640 1 -- 172.21.15.79:0/3966530989 learned_addr learned my addr 172.21.15.79:0/3966530989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f4995200640 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ac7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.666+0000 7f4995200640 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ad31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f4987400640 1 -- 172.21.15.79:0/3966530989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 msgr2=0x5616e2ad31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f4987400640 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ad31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f4987400640 1 -- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 msgr2=0x5616e2ac7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f4987400640 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ac7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f4987400640 1 -- 172.21.15.79:0/3966530989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e2780540 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f4987400640 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac7770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4978012700 tx=0x7f4978012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42797759df309727 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f497e000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f497e000640 1 -- 172.21.15.79:0/3966530989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978004050 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f497e000640 1 -- 172.21.15.79:0/3966530989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f49780041f0 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.667+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616e29bfa70 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f497e000640 1 -- 172.21.15.79:0/3966530989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4978025050 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 10 client.15135 fetch_fsmap learned FSMap version 21 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5616e29da6f0 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f497e000640 1 -- 172.21.15.79:0/3966530989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5616e29bfa70 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f497e000640 1 -- 172.21.15.79:0/3966530989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f49780039e0 con 0x5616e26f4280 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 10 client.15135 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:34:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:34:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 20 client.15135 populate_metadata read hostname 'smithi079' 2024-09-21T02:34:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26d38e0 0x5616e2ad9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 4 client.15135 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:34:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.668+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616e2a34ca0 con 0x5616e26d38e0 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.669+0000 7f4995200640 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26d38e0 0x5616e2ad9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.669+0000 7f4995200640 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26d38e0 0x5616e2ad9810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89dd23ac832fee52 server_cookie=db6d68746a1740be in_seq=0 out_seq=0 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.669+0000 7f497e000640 10 client.15135 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.670+0000 7f497e000640 1 -- 172.21.15.79:0/3966530989 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616e2a34ca0 con 0x5616e26d38e0 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.670+0000 7f497e000640 10 client.15135 handle_command_reply: tid=0 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.670+0000 7f499dfce740 1 client.15135 shutdown 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 msgr2=0x5616e2ac7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac7770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4978012700 tx=0x7f4978012bc0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 shutdown_connections 2024-09-21T02:34:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26d38e0 0x5616e2ad9810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ad31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f497e000640 0 client.15135 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac7770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 --2- 172.21.15.79:0/3966530989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ac7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 >> 172.21.15.79:0/3966530989 conn(0x5616e2709350 msgr2=0x5616e2abe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 shutdown_connections 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 1 -- 172.21.15.79:0/3966530989 wait complete. 2024-09-21T02:34:53.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.671+0000 7f499dfce740 20 client.15135 trim_cache size 0 max 16384 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 Processor -- start 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 -- start start 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ad9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ac2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5616e2ad7b50 con 0x5616e26f4280 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616e2ad8220 con 0x5616e26ec0a0 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f499dfce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5616e2ad88f0 con 0x5616e2714f60 2024-09-21T02:34:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f4987400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f4987400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50456/0 (socket says 172.21.15.79:50456) 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.690+0000 7f4987400640 1 -- 172.21.15.79:0/1970332378 learned_addr learned my addr 172.21.15.79:0/1970332378 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4995200640 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ad9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4995200640 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ac2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4987400640 1 -- 172.21.15.79:0/1970332378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 msgr2=0x5616e2ac2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4987400640 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ac2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4987400640 1 -- 172.21.15.79:0/1970332378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 msgr2=0x5616e2ad9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4987400640 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ad9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4987400640 1 -- 172.21.15.79:0/1970332378 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e2abd960 con 0x5616e26f4280 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4995200640 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ad9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4987400640 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac21e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4978012420 tx=0x7f4978010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3c4be2fa45e5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.691+0000 7f4984c00640 1 -- 172.21.15.79:0/1970332378 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497800f920 con 0x5616e26f4280 2024-09-21T02:34:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f4984c00640 1 -- 172.21.15.79:0/1970332378 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f497802e070 con 0x5616e26f4280 2024-09-21T02:34:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f4984c00640 1 -- 172.21.15.79:0/1970332378 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49780035f0 con 0x5616e26f4280 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f499dfce740 1 -- 172.21.15.79:0/1970332378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 msgr2=0x5616e2ac21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f499dfce740 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac21e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4978012420 tx=0x7f4978010610 comp rx=0 tx=0).stop 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f499dfce740 1 -- 172.21.15.79:0/1970332378 shutdown_connections 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f499dfce740 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e2714f60 0x5616e2ac2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f499dfce740 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e26f4280 0x5616e2ac21e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f499dfce740 1 --2- 172.21.15.79:0/1970332378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ad9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.692+0000 7f499dfce740 1 -- 172.21.15.79:0/1970332378 >> 172.21.15.79:0/1970332378 conn(0x5616e2709350 msgr2=0x5616e2ad7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.693+0000 7f499dfce740 1 -- 172.21.15.79:0/1970332378 shutdown_connections 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.693+0000 7f499dfce740 1 -- 172.21.15.79:0/1970332378 wait complete. 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.693+0000 7f499dfce740 1 -- start start 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.693+0000 7f499dfce740 1 Processor -- start 2024-09-21T02:34:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f499dfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ae2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f499dfce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26f4280 0x5616e2adba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f499dfce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e2714f60 0x5616e2adc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f499dfce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5616e2ad9690 con 0x5616e2714f60 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f499dfce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616e2ad8fc0 con 0x5616e26ec0a0 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f499dfce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5616e2ad9d60 con 0x5616e26f4280 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f499dfce740 10 client.0 _ll_register_callbacks cb 0x7f4978009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e2714f60 0x5616e2adc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ae2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4987400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26f4280 0x5616e2adba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ae2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57082/0 (socket says 172.21.15.79:57082) 2024-09-21T02:34:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 -- 172.21.15.79:0/2192062722 learned_addr learned my addr 172.21.15.79:0/2192062722 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 -- 172.21.15.79:0/2192062722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26f4280 msgr2=0x5616e2adba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26f4280 0x5616e2adba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 -- 172.21.15.79:0/2192062722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e2714f60 msgr2=0x5616e2adc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e2714f60 0x5616e2adc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4995200640 1 -- 172.21.15.79:0/2192062722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e2adc840 con 0x5616e26ec0a0 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.694+0000 7f4987400640 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26f4280 0x5616e2adba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f4995200640 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ae2350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f498800e5c0 tx=0x7f4988005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86831a0df872a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f497e000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f497e000640 1 -- 172.21.15.79:0/2192062722 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498801e040 con 0x5616e26ec0a0 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f497802e070 con 0x5616e26ec0a0 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f497e000640 1 -- 172.21.15.79:0/2192062722 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f498800e720 con 0x5616e26ec0a0 2024-09-21T02:34:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f497e000640 1 -- 172.21.15.79:0/2192062722 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4988005600 con 0x5616e26ec0a0 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f499dfce740 10 client.25151 fetch_fsmap learned FSMap version 21 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.695+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5616e2b44ce0 con 0x5616e26ec0a0 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f497e000640 1 -- 172.21.15.79:0/2192062722 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f497802e070 con 0x5616e26ec0a0 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f497e000640 1 -- 172.21.15.79:0/2192062722 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f49880198e0 con 0x5616e26ec0a0 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f499dfce740 10 client.25151 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f499dfce740 10 client.25151 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f499dfce740 20 client.25151 populate_metadata read hostname 'smithi079' 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f499dfce740 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26a8c90 0x5616e2b48360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f499dfce740 4 client.25151 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "status"}) -- 0x5616e2a30750 con 0x5616e26a8c90 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.696+0000 7f4987400640 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26a8c90 0x5616e2b48360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f4987400640 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26a8c90 0x5616e2b48360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a33cf9aae3651f6a server_cookie=a6969e0f3a6e1567 in_seq=0 out_seq=0 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f497e000640 10 client.25151 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f497e000640 1 -- 172.21.15.79:0/2192062722 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5616e2a30750 con 0x5616e26a8c90 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f497e000640 10 client.25151 handle_command_reply: tid=0 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 client.25151 shutdown 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 msgr2=0x5616e2ae2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ae2350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f498800e5c0 tx=0x7f4988005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 shutdown_connections 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5616e26a8c90 0x5616e2b48360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616e2714f60 0x5616e2adc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5616e26f4280 0x5616e2adba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f497e000640 0 client.25151 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 --2- 172.21.15.79:0/2192062722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616e26ec0a0 0x5616e2ae2350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.697+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 >> 172.21.15.79:0/2192062722 conn(0x5616e2709350 msgr2=0x5616e2ac57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 shutdown_connections 2024-09-21T02:34:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f499dfce740 1 -- 172.21.15.79:0/2192062722 wait complete. 2024-09-21T02:34:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f499dfce740 20 client.25151 trim_cache size 0 max 16384 2024-09-21T02:34:53.704 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:34:53.704 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "56d10306-77c0-11ef-baf5-efdc52797490", 2024-09-21T02:34:53.704 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24704, 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 130.22898814300001, 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 21, 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 88, 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 144.20061051600001 2024-09-21T02:34:53.705 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f49740b65a0 msgr2=0x7f49740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f4995c00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f49740b65a0 0x7f49740b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f49800ce270 tx=0x7f498010e530 comp rx=0 tx=0).stop 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 msgr2=0x7f499019c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f4995c00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f499019c540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4980005e30 tx=0x7f4980031840 comp rx=0 tx=0).stop 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 shutdown_connections 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f4995c00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f49740b65a0 0x7f49740b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.698+0000 7f4995c00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4990109c40 0x7f49901a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.699+0000 7f4995c00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49901092f0 0x7f499019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.699+0000 7f4995c00640 1 --2- 172.21.15.79:0/1294548327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49901039b0 0x7f499019c540 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:53.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.699+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 >> 172.21.15.79:0/1294548327 conn(0x7f49900ff440 msgr2=0x7f4990108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:53.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.699+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 shutdown_connections 2024-09-21T02:34:53.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:53.699+0000 7f4995c00640 1 -- 172.21.15.79:0/1294548327 wait complete. 2024-09-21T02:34:54.559 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T02:34:54.559 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T02:34:54.569 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:34:54.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T02:34:54.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:54 smithi079 ceph-mon[30788]: pgmap v390: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:54.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:54 smithi148 ceph-mon[34626]: pgmap v390: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:54.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:54 smithi098 ceph-mon[34832]: pgmap v390: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:54.940 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.582+0000 7f2531200640 1 -- 172.21.15.79:0/3358165824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104600 msgr2=0x7f252c104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.582+0000 7f2531200640 1 --2- 172.21.15.79:0/3358165824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104600 0x7f252c104a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2518009860 tx=0x7f251802a3d0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.582+0000 7f2531200640 1 -- 172.21.15.79:0/3358165824 shutdown_connections 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.582+0000 7f2531200640 1 --2- 172.21.15.79:0/3358165824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f252c104fa0 0x7f252c10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.582+0000 7f2531200640 1 --2- 172.21.15.79:0/3358165824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104600 0x7f252c104a10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.582+0000 7f2531200640 1 --2- 172.21.15.79:0/3358165824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c103570 0x7f252c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.582+0000 7f2531200640 1 -- 172.21.15.79:0/3358165824 >> 172.21.15.79:0/3358165824 conn(0x7f252c0feec0 msgr2=0x7f252c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.583+0000 7f2531200640 1 -- 172.21.15.79:0/3358165824 shutdown_connections 2024-09-21T02:34:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.583+0000 7f2531200640 1 -- 172.21.15.79:0/3358165824 wait complete. 2024-09-21T02:34:55.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 Processor -- start 2024-09-21T02:34:55.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 -- start start 2024-09-21T02:34:55.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f252c103570 0x7f252c19c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:55.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c104600 0x7f252c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:55.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104fa0 0x7f252c19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:55.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f252c10f220 con 0x7f252c104600 2024-09-21T02:34:55.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f252c10f0a0 con 0x7f252c104fa0 2024-09-21T02:34:55.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f2531200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f252c10f3a0 con 0x7f252c103570 2024-09-21T02:34:55.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f252aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c104600 0x7f252c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:55.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.584+0000 7f252aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c104600 0x7f252c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37656/0 (socket says 172.21.15.79:37656) 2024-09-21T02:34:55.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252aa00640 1 -- 172.21.15.79:0/485630162 learned_addr learned my addr 172.21.15.79:0/485630162 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:55.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252b400640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f252c103570 0x7f252c19c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:55.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252be00640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104fa0 0x7f252c19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:55.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252aa00640 1 -- 172.21.15.79:0/485630162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f252c103570 msgr2=0x7f252c19c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:55.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252aa00640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f252c103570 0x7f252c19c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252aa00640 1 -- 172.21.15.79:0/485630162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104fa0 msgr2=0x7f252c19d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252aa00640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104fa0 0x7f252c19d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252aa00640 1 -- 172.21.15.79:0/485630162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c19da30 con 0x7f252c104600 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.585+0000 7f252aa00640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c104600 0x7f252c19c670 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2518009980 tx=0x7f2518032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.586+0000 7f2523e00640 1 -- 172.21.15.79:0/485630162 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518004460 con 0x7f252c104600 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.586+0000 7f2523e00640 1 -- 172.21.15.79:0/485630162 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2518031400 con 0x7f252c104600 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.586+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252c19dcc0 con 0x7f252c104600 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.586+0000 7f2523e00640 1 -- 172.21.15.79:0/485630162 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518004920 con 0x7f252c104600 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.586+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f252c1a4250 con 0x7f252c104600 2024-09-21T02:34:55.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.587+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252c1a44b0 con 0x7f252c104600 2024-09-21T02:34:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.590+0000 7f2523e00640 1 -- 172.21.15.79:0/485630162 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2518039040 con 0x7f252c104600 2024-09-21T02:34:55.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.592+0000 7f2523e00640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f25100b65a0 0x7f25100b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:55.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.592+0000 7f2523e00640 1 -- 172.21.15.79:0/485630162 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2518108b70 con 0x7f252c104600 2024-09-21T02:34:55.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.592+0000 7f252b400640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f25100b65a0 0x7f25100b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.593+0000 7f252b400640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f25100b65a0 0x7f25100b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f251c005fd0 tx=0x7f251c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.594+0000 7f2523e00640 1 -- 172.21.15.79:0/485630162 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2518040030 con 0x7f252c104600 2024-09-21T02:34:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.798+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f252c076d10 con 0x7f25100b65a0 2024-09-21T02:34:55.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.799+0000 7f2523e00640 1 -- 172.21.15.79:0/485630162 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f252c076d10 con 0x7f25100b65a0 2024-09-21T02:34:55.800 INFO:teuthology.orchestra.run.smithi079.stdout:Backend: cephadm 2024-09-21T02:34:55.801 INFO:teuthology.orchestra.run.smithi079.stdout:Available: Yes 2024-09-21T02:34:55.801 INFO:teuthology.orchestra.run.smithi079.stdout:Paused: No 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f25100b65a0 msgr2=0x7f25100b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f25100b65a0 0x7f25100b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f251c005fd0 tx=0x7f251c009260 comp rx=0 tx=0).stop 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c104600 msgr2=0x7f252c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c104600 0x7f252c19c670 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2518009980 tx=0x7f2518032fb0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 shutdown_connections 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f25100b65a0 0x7f25100b8ab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f252c104fa0 0x7f252c19d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f252c104600 0x7f252c19c670 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 --2- 172.21.15.79:0/485630162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f252c103570 0x7f252c19c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 >> 172.21.15.79:0/485630162 conn(0x7f252c0feec0 msgr2=0x7f252c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 shutdown_connections 2024-09-21T02:34:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:55.802+0000 7f2531200640 1 -- 172.21.15.79:0/485630162 wait complete. 2024-09-21T02:34:56.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:56 smithi079 ceph-mon[30788]: pgmap v391: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:56.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T02:34:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:56 smithi148 ceph-mon[34626]: pgmap v391: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:56 smithi098 ceph-mon[34832]: pgmap v391: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 -- 172.21.15.79:0/2931615689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70101047e0 msgr2=0x7f7010104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 --2- 172.21.15.79:0/2931615689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70101047e0 0x7f7010104bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009900 tx=0x7f6ffc02a480 comp rx=0 tx=0).stop 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 -- 172.21.15.79:0/2931615689 shutdown_connections 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 --2- 172.21.15.79:0/2931615689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7010105180 0x7f701010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 --2- 172.21.15.79:0/2931615689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70101047e0 0x7f7010104bf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 --2- 172.21.15.79:0/2931615689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7010103750 0x7f7010103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 -- 172.21.15.79:0/2931615689 >> 172.21.15.79:0/2931615689 conn(0x7f70100ff0c0 msgr2=0x7f7010101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 -- 172.21.15.79:0/2931615689 shutdown_connections 2024-09-21T02:34:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.637+0000 7f7017a00640 1 -- 172.21.15.79:0/2931615689 wait complete. 2024-09-21T02:34:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.638+0000 7f7017a00640 1 Processor -- start 2024-09-21T02:34:57.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.638+0000 7f7017a00640 1 -- start start 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7017a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7010103750 0x7f7010199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7017a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70101047e0 0x7f701019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7017a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7010105180 0x7f701019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7017a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f701010f3a0 con 0x7f7010105180 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7017a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f701010f220 con 0x7f7010103750 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7017a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f701010f520 con 0x7f70101047e0 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7015000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7010103750 0x7f7010199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7015a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7010105180 0x7f701019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7015a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7010105180 0x7f701019b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37676/0 (socket says 172.21.15.79:37676) 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f7015a00640 1 -- 172.21.15.79:0/1942999177 learned_addr learned my addr 172.21.15.79:0/1942999177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.639+0000 7f700fe00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70101047e0 0x7f701019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f7015000640 1 -- 172.21.15.79:0/1942999177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70101047e0 msgr2=0x7f701019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f7015000640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70101047e0 0x7f701019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f7015000640 1 -- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7010105180 msgr2=0x7f701019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f7015000640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7010105180 0x7f701019b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f7015000640 1 -- 172.21.15.79:0/1942999177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701019b9f0 con 0x7f7010103750 2024-09-21T02:34:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f7015a00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7010105180 0x7f701019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:57.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f7015000640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7010103750 0x7f7010199fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f700400e9f0 tx=0x7f700400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.640+0000 7f700d600640 1 -- 172.21.15.79:0/1942999177 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700400ccc0 con 0x7f7010103750 2024-09-21T02:34:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.641+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701019bce0 con 0x7f7010103750 2024-09-21T02:34:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.641+0000 7f700d600640 1 -- 172.21.15.79:0/1942999177 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7004005020 con 0x7f7010103750 2024-09-21T02:34:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.641+0000 7f700d600640 1 -- 172.21.15.79:0/1942999177 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004004a00 con 0x7f7010103750 2024-09-21T02:34:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.641+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70101a23e0 con 0x7f7010103750 2024-09-21T02:34:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.642+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f701010a930 con 0x7f7010103750 2024-09-21T02:34:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.644+0000 7f700d600640 1 -- 172.21.15.79:0/1942999177 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7004004ba0 con 0x7f7010103750 2024-09-21T02:34:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.646+0000 7f700d600640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6ff80b6620 0x7f6ff80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.646+0000 7f700d600640 1 -- 172.21.15.79:0/1942999177 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f70040e7b90 con 0x7f7010103750 2024-09-21T02:34:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.646+0000 7f700fe00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6ff80b6620 0x7f6ff80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:57.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.647+0000 7f700fe00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6ff80b6620 0x7f6ff80b8b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc000c00 tx=0x7f6ffc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:57.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.648+0000 7f700d600640 1 -- 172.21.15.79:0/1942999177 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70040adeb0 con 0x7f7010103750 2024-09-21T02:34:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:57 smithi079 ceph-mon[30788]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:57.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:57 smithi148 ceph-mon[34626]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.845+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7010063800 con 0x7f6ff80b6620 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.857+0000 7f700d600640 1 -- 172.21.15.79:0/1942999177 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f7010063800 con 0x7f6ff80b6620 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:mds.a smithi079 running (2m) 12s ago 2m 80.7M - 19.3.0-5120-g18432218 ddce307e1f32 40a73dbd045f 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:mds.b smithi098 running (2m) 14s ago 2m 93.9M - 19.3.0-5120-g18432218 ddce307e1f32 6189e3c1b5a9 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:mds.c smithi148 running (2m) 15s ago 2m 82.5M - 19.3.0-5120-g18432218 ddce307e1f32 315e4d7f6a75 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:mds.d smithi079 running (2m) 12s ago 2m 80.8M - 19.3.0-5120-g18432218 ddce307e1f32 09ee1b3d1d6b 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:mds.e smithi098 running (2m) 14s ago 2m 82.5M - 19.3.0-5120-g18432218 ddce307e1f32 facff1ce114b 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:mds.f smithi148 running (2m) 15s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 bde048cdf11d 2024-09-21T02:34:57.859 INFO:teuthology.orchestra.run.smithi079.stdout:mds.g smithi079 running (2m) 12s ago 2m 80.7M - 19.3.0-5120-g18432218 ddce307e1f32 bc562a0740aa 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mds.h smithi098 running (2m) 14s ago 2m 89.7M - 19.3.0-5120-g18432218 ddce307e1f32 33becbff2747 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mds.i smithi148 running (2m) 15s ago 2m 81.8M - 19.3.0-5120-g18432218 ddce307e1f32 f1459e8f61b2 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mds.j smithi079 running (2m) 12s ago 2m 80.8M - 19.3.0-5120-g18432218 ddce307e1f32 03a9d34197bd 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mds.k smithi098 running (2m) 14s ago 2m 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 c26334e48986 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mds.l smithi148 running (3m) 15s ago 3m 82.6M - 19.3.0-5120-g18432218 ddce307e1f32 93fb027e6ddd 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.x smithi079 *:9283,8765 running (11m) 12s ago 11m 592M - 19.3.0-5120-g18432218 ddce307e1f32 be1dafa6756b 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.y smithi098 *:8443,8765 running (9m) 14s ago 9m 527M - 19.3.0-5120-g18432218 ddce307e1f32 b5c217b38a53 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.z smithi148 *:8443,8765 running (9m) 15s ago 9m 527M - 19.3.0-5120-g18432218 ddce307e1f32 4985fdf89efa 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mon.a smithi079 running (11m) 12s ago 11m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 b8599cd87a62 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mon.b smithi098 running (9m) 14s ago 9m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 fb0061163c22 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:mon.c smithi148 running (9m) 15s ago 9m 117M 2048M 19.3.0-5120-g18432218 ddce307e1f32 05eb18de48fb 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (8m) 12s ago 8m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ddaad839063e 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi098 running (7m) 14s ago 7m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6ee738266b5a 2024-09-21T02:34:57.860 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi148 running (7m) 15s ago 7m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ba5f1d39c1af 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi079 running (7m) 12s ago 7m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 7aae9077ffb1 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi098 running (6m) 14s ago 6m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f766cdc31048 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi148 running (6m) 15s ago 6m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 7d58f870ee7f 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6 smithi079 running (5m) 12s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 2f8296cdaa4a 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7 smithi098 running (5m) 14s ago 5m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 bd4769136982 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.8 smithi148 running (4m) 15s ago 4m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 49b6ef968cdb 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.9 smithi079 running (4m) 12s ago 4m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d93cfd6d119c 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.10 smithi098 running (3m) 14s ago 3m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 fff1fa6cae98 2024-09-21T02:34:57.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.11 smithi148 running (3m) 15s ago 3m 117M 4272M 19.3.0-5120-g18432218 ddce307e1f32 74534bfa7dc0 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6ff80b6620 msgr2=0x7f6ff80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6ff80b6620 0x7f6ff80b8b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc000c00 tx=0x7f6ffc031400 comp rx=0 tx=0).stop 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7010103750 msgr2=0x7f7010199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7010103750 0x7f7010199fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f700400e9f0 tx=0x7f700400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 shutdown_connections 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6ff80b6620 0x7f6ff80b8b30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7010105180 0x7f701019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70101047e0 0x7f701019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 --2- 172.21.15.79:0/1942999177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7010103750 0x7f7010199fc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 >> 172.21.15.79:0/1942999177 conn(0x7f70100ff0c0 msgr2=0x7f7010107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 shutdown_connections 2024-09-21T02:34:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:57.860+0000 7f7017a00640 1 -- 172.21.15.79:0/1942999177 wait complete. 2024-09-21T02:34:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:57 smithi098 ceph-mon[34832]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:58.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T02:34:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:58 smithi079 ceph-mon[30788]: pgmap v392: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:58.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:58 smithi079 ceph-mon[30788]: from='client.25163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:58.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:58 smithi148 ceph-mon[34626]: pgmap v392: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:58.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:58 smithi148 ceph-mon[34626]: from='client.25163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:58.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:58 smithi098 ceph-mon[34832]: pgmap v392: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:34:58.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:58 smithi098 ceph-mon[34832]: from='client.25163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:59.053 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:59.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 -- 172.21.15.79:0/1399444410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50103570 msgr2=0x7f0e501039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1399444410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50103570 0x7f0e501039e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009900 tx=0x7f0e4002a480 comp rx=0 tx=0).stop 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 -- 172.21.15.79:0/1399444410 shutdown_connections 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1399444410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e50104fa0 0x7f0e5010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1399444410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e50104600 0x7f0e50104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1399444410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50103570 0x7f0e501039e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 -- 172.21.15.79:0/1399444410 >> 172.21.15.79:0/1399444410 conn(0x7f0e500feee0 msgr2=0x7f0e50101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 -- 172.21.15.79:0/1399444410 shutdown_connections 2024-09-21T02:34:59.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.729+0000 7f0e54a00640 1 -- 172.21.15.79:0/1399444410 wait complete. 2024-09-21T02:34:59.732 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:34:59 smithi079 ceph-mon[30788]: pgmap v393: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.730+0000 7f0e54a00640 1 Processor -- start 2024-09-21T02:34:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e54a00640 1 -- start start 2024-09-21T02:34:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e54a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e50103570 0x7f0e5019c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e54a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e50104600 0x7f0e5019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:59.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e54a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50104fa0 0x7f0e5019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e54a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5010f210 con 0x7f0e50104fa0 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e54a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5010f090 con 0x7f0e50104600 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e54a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5010f390 con 0x7f0e50103570 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e4f200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50104fa0 0x7f0e5019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e4f200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50104fa0 0x7f0e5019d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37694/0 (socket says 172.21.15.79:37694) 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e4f200640 1 -- 172.21.15.79:0/1050589786 learned_addr learned my addr 172.21.15.79:0/1050589786 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.731+0000 7f0e4e800640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e50103570 0x7f0e5019c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e45e00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e50104600 0x7f0e5019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e4f200640 1 -- 172.21.15.79:0/1050589786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e50103570 msgr2=0x7f0e5019c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e4f200640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e50103570 0x7f0e5019c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e4f200640 1 -- 172.21.15.79:0/1050589786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e50104600 msgr2=0x7f0e5019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e4f200640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e50104600 0x7f0e5019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e4f200640 1 -- 172.21.15.79:0/1050589786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5019da70 con 0x7f0e50104fa0 2024-09-21T02:34:59.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e45e00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e50104600 0x7f0e5019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:34:59.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e4e800640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e50103570 0x7f0e5019c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:34:59.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.732+0000 7f0e4f200640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50104fa0 0x7f0e5019d250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800eb10 tx=0x7f0e4800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:59.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.733+0000 7f0e47e00640 1 -- 172.21.15.79:0/1050589786 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48004b20 con 0x7f0e50104fa0 2024-09-21T02:34:59.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.733+0000 7f0e47e00640 1 -- 172.21.15.79:0/1050589786 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e48004cc0 con 0x7f0e50104fa0 2024-09-21T02:34:59.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.733+0000 7f0e47e00640 1 -- 172.21.15.79:0/1050589786 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48010670 con 0x7f0e50104fa0 2024-09-21T02:34:59.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.733+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5019dd60 con 0x7f0e50104fa0 2024-09-21T02:34:59.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.733+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e501a4460 con 0x7f0e50104fa0 2024-09-21T02:34:59.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.734+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e501a4630 con 0x7f0e50104fa0 2024-09-21T02:34:59.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.736+0000 7f0e47e00640 1 -- 172.21.15.79:0/1050589786 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f0e48005020 con 0x7f0e50104fa0 2024-09-21T02:34:59.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.738+0000 7f0e47e00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e340b65a0 0x7f0e340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:59.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.738+0000 7f0e47e00640 1 -- 172.21.15.79:0/1050589786 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f0e480e7ec0 con 0x7f0e50104fa0 2024-09-21T02:34:59.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.738+0000 7f0e4e800640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e340b65a0 0x7f0e340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:59.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.739+0000 7f0e4e800640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e340b65a0 0x7f0e340b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e40004770 tx=0x7f0e400314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:59.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.742+0000 7f0e47e00640 1 -- 172.21.15.79:0/1050589786 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e480ae1e0 con 0x7f0e50104fa0 2024-09-21T02:34:59.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:34:59 smithi148 ceph-mon[34626]: pgmap v393: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:34:59 smithi098 ceph-mon[34832]: pgmap v393: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:34:59.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.937+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0e50076d10 con 0x7f0e340b65a0 2024-09-21T02:34:59.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.943+0000 7f0e47e00640 1 -- 172.21.15.79:0/1050589786 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0e50076d10 con 0x7f0e340b65a0 2024-09-21T02:34:59.945 INFO:teuthology.orchestra.run.smithi079.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T02:34:59.945 INFO:teuthology.orchestra.run.smithi079.stdout:mds.all 12/12 17s ago 3m smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T02:34:59.945 INFO:teuthology.orchestra.run.smithi079.stdout:mgr 3/3 17s ago 9m smithi079=x;smithi098=y;smithi148=z;count:3 2024-09-21T02:34:59.945 INFO:teuthology.orchestra.run.smithi079.stdout:mon 3/3 17s ago 9m smithi079:172.21.15.79=a;smithi098:172.21.15.98=b;smithi148:172.21.15.148=c;count:3 2024-09-21T02:34:59.945 INFO:teuthology.orchestra.run.smithi079.stdout:osd 12 17s ago - 2024-09-21T02:34:59.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e340b65a0 msgr2=0x7f0e340b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:59.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e340b65a0 0x7f0e340b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e40004770 tx=0x7f0e400314a0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50104fa0 msgr2=0x7f0e5019d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50104fa0 0x7f0e5019d250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800eb10 tx=0x7f0e4800c2d0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 shutdown_connections 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0e340b65a0 0x7f0e340b8ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e50104fa0 0x7f0e5019d250 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e50104600 0x7f0e5019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 --2- 172.21.15.79:0/1050589786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e50103570 0x7f0e5019c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 >> 172.21.15.79:0/1050589786 conn(0x7f0e500feee0 msgr2=0x7f0e500755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 shutdown_connections 2024-09-21T02:34:59.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:34:59.946+0000 7f0e54a00640 1 -- 172.21.15.79:0/1050589786 wait complete. 2024-09-21T02:35:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:00 smithi079 ceph-mon[30788]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:00.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T02:35:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:00 smithi148 ceph-mon[34626]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:00 smithi098 ceph-mon[34832]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:01.744 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:01 smithi079 ceph-mon[30788]: pgmap v394: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:01.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:01 smithi148 ceph-mon[34626]: pgmap v394: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 -- 172.21.15.79:0/2253335508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec106820 msgr2=0x7fcdec106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/2253335508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec106820 0x7fcdec106c30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009900 tx=0x7fcdd402a480 comp rx=0 tx=0).stop 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 -- 172.21.15.79:0/2253335508 shutdown_connections 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/2253335508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdec1071c0 0x7fcdec10db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/2253335508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec106820 0x7fcdec106c30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/2253335508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdec105790 0x7fcdec105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 -- 172.21.15.79:0/2253335508 >> 172.21.15.79:0/2253335508 conn(0x7fcdec1010e0 msgr2=0x7fcdec1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 -- 172.21.15.79:0/2253335508 shutdown_connections 2024-09-21T02:35:01.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.828+0000 7fcdf0c00640 1 -- 172.21.15.79:0/2253335508 wait complete. 2024-09-21T02:35:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.829+0000 7fcdf0c00640 1 Processor -- start 2024-09-21T02:35:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.829+0000 7fcdf0c00640 1 -- start start 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdf0c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec105790 0x7fcdec19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdf0c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdec106820 0x7fcdec19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdf0c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdec1071c0 0x7fcdec19d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdf0c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec111430 con 0x7fcdec105790 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdf0c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec1112b0 con 0x7fcdec1071c0 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdf0c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec1115b0 con 0x7fcdec106820 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdec106820 0x7fcdec19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdeb400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec105790 0x7fcdec19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdec106820 0x7fcdec19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39180/0 (socket says 172.21.15.79:39180) 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcdebe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdec1071c0 0x7fcdec19d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:01.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.830+0000 7fcde3e00640 1 -- 172.21.15.79:0/1061656790 learned_addr learned my addr 172.21.15.79:0/1061656790 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdebe00640 1 -- 172.21.15.79:0/1061656790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdec106820 msgr2=0x7fcdec19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:01.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdebe00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdec106820 0x7fcdec19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdebe00640 1 -- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec105790 msgr2=0x7fcdec19bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdebe00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec105790 0x7fcdec19bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdebe00640 1 -- 172.21.15.79:0/1061656790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec19da20 con 0x7fcdec1071c0 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdebe00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdec1071c0 0x7fcdec19d200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009fd0 tx=0x7fcde400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcde8c00640 1 -- 172.21.15.79:0/1061656790 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde400ce20 con 0x7fcdec1071c0 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdec19dd10 con 0x7fcdec1071c0 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcde8c00640 1 -- 172.21.15.79:0/1061656790 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcde4005020 con 0x7fcdec1071c0 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcde8c00640 1 -- 172.21.15.79:0/1061656790 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4010690 con 0x7fcdec1071c0 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.831+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdec1a4410 con 0x7fcdec1071c0 2024-09-21T02:35:01.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.832+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdec10c950 con 0x7fcdec1071c0 2024-09-21T02:35:01.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.835+0000 7fcde8c00640 1 -- 172.21.15.79:0/1061656790 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fcde40054d0 con 0x7fcdec1071c0 2024-09-21T02:35:01.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.836+0000 7fcde8c00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcdd00b65a0 0x7fcdd00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:01.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.837+0000 7fcde8c00640 1 -- 172.21.15.79:0/1061656790 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcde40e7f60 con 0x7fcdec1071c0 2024-09-21T02:35:01.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.837+0000 7fcdeb400640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcdd00b65a0 0x7fcdd00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:01.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.837+0000 7fcdeb400640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcdd00b65a0 0x7fcdd00b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009bd0 tx=0x7fcddc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:01.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:01.838+0000 7fcde8c00640 1 -- 172.21.15.79:0/1061656790 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcde40ae280 con 0x7fcdec1071c0 2024-09-21T02:35:01.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:01 smithi098 ceph-mon[34832]: pgmap v394: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.045+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fcdec063800 con 0x7fcdd00b65a0 2024-09-21T02:35:02.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.047+0000 7fcde8c00640 1 -- 172.21.15.79:0/1061656790 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fcdec063800 con 0x7fcdd00b65a0 2024-09-21T02:35:02.049 INFO:teuthology.orchestra.run.smithi079.stdout:HOST ADDR LABELS STATUS 2024-09-21T02:35:02.049 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 172.21.15.79 2024-09-21T02:35:02.049 INFO:teuthology.orchestra.run.smithi079.stdout:smithi098 172.21.15.98 2024-09-21T02:35:02.049 INFO:teuthology.orchestra.run.smithi079.stdout:smithi148 172.21.15.148 2024-09-21T02:35:02.049 INFO:teuthology.orchestra.run.smithi079.stdout:3 hosts in cluster 2024-09-21T02:35:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcdd00b65a0 msgr2=0x7fcdd00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcdd00b65a0 0x7fcdd00b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009bd0 tx=0x7fcddc005f90 comp rx=0 tx=0).stop 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdec1071c0 msgr2=0x7fcdec19d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdec1071c0 0x7fcdec19d200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009fd0 tx=0x7fcde400ef10 comp rx=0 tx=0).stop 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 shutdown_connections 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcdd00b65a0 0x7fcdd00b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdec1071c0 0x7fcdec19d200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdec106820 0x7fcdec19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 --2- 172.21.15.79:0/1061656790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdec105790 0x7fcdec19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 >> 172.21.15.79:0/1061656790 conn(0x7fcdec1010e0 msgr2=0x7fcdec109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 shutdown_connections 2024-09-21T02:35:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:02.050+0000 7fcdf0c00640 1 -- 172.21.15.79:0/1061656790 wait complete. 2024-09-21T02:35:02.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:02 smithi079 ceph-mon[30788]: from='client.25175 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:02.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:02 smithi148 ceph-mon[34626]: from='client.25175 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:02.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:02 smithi098 ceph-mon[34832]: from='client.25175 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:03.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T02:35:03.403 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:03.765 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:03 smithi079 ceph-mon[30788]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T02:35:03.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:03 smithi079 ceph-mon[30788]: pgmap v395: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T02:35:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:03 smithi148 ceph-mon[34626]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T02:35:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:03 smithi148 ceph-mon[34626]: pgmap v395: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T02:35:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:03 smithi098 ceph-mon[34832]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T02:35:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:03 smithi098 ceph-mon[34832]: pgmap v395: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T02:35:04.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 -- 172.21.15.79:0/1922326505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 msgr2=0x7f910010b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:04.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 --2- 172.21.15.79:0/1922326505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 0x7f910010b990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009ca0 tx=0x7f90f802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 -- 172.21.15.79:0/1922326505 shutdown_connections 2024-09-21T02:35:04.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 --2- 172.21.15.79:0/1922326505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 0x7f910010b990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 --2- 172.21.15.79:0/1922326505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91001068e0 0x7f9100108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 --2- 172.21.15.79:0/1922326505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f910006c660 0x7f91001063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 -- 172.21.15.79:0/1922326505 >> 172.21.15.79:0/1922326505 conn(0x7f91000fdfe0 msgr2=0x7f9100100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 -- 172.21.15.79:0/1922326505 shutdown_connections 2024-09-21T02:35:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.036+0000 7f9105c00640 1 -- 172.21.15.79:0/1922326505 wait complete. 2024-09-21T02:35:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.037+0000 7f9105c00640 1 Processor -- start 2024-09-21T02:35:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f9105c00640 1 -- start start 2024-09-21T02:35:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f9105c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f910006c660 0x7f9100199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f9105c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91001068e0 0x7f910019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f9105c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 0x7f910019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f9105c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f910010f3a0 con 0x7f910006c660 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f9105c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f910010f220 con 0x7f91001068e0 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f9105c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f910010f520 con 0x7f9100109480 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f90fea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f910006c660 0x7f9100199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f90fea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f910006c660 0x7f9100199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37390/0 (socket says 172.21.15.79:37390) 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f90f6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91001068e0 0x7f910019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f90fea00640 1 -- 172.21.15.79:0/1424568730 learned_addr learned my addr 172.21.15.79:0/1424568730 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.038+0000 7f90ff400640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 0x7f910019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90f6000640 1 -- 172.21.15.79:0/1424568730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 msgr2=0x7f910019b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90f6000640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 0x7f910019b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90f6000640 1 -- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f910006c660 msgr2=0x7f9100199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90f6000640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f910006c660 0x7f9100199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90f6000640 1 -- 172.21.15.79:0/1424568730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910019b9a0 con 0x7f91001068e0 2024-09-21T02:35:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90ff400640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 0x7f910019b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90f6000640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91001068e0 0x7f910019a5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90e800e9f0 tx=0x7f90e800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.039+0000 7f90f7e00640 1 -- 172.21.15.79:0/1424568730 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e800cd80 con 0x7f91001068e0 2024-09-21T02:35:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.040+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910019bc90 con 0x7f91001068e0 2024-09-21T02:35:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.040+0000 7f90f7e00640 1 -- 172.21.15.79:0/1424568730 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e80035f0 con 0x7f91001068e0 2024-09-21T02:35:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.040+0000 7f90f7e00640 1 -- 172.21.15.79:0/1424568730 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8010690 con 0x7f91001068e0 2024-09-21T02:35:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.040+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91001a2390 con 0x7f91001068e0 2024-09-21T02:35:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.041+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91000ffb00 con 0x7f91001068e0 2024-09-21T02:35:04.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.043+0000 7f90f7e00640 1 -- 172.21.15.79:0/1424568730 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f90e80037a0 con 0x7f91001068e0 2024-09-21T02:35:04.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.044+0000 7f90f7e00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90e40b6510 0x7f90e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:04.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.045+0000 7f90f7e00640 1 -- 172.21.15.79:0/1424568730 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f90e80e7a30 con 0x7f91001068e0 2024-09-21T02:35:04.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.045+0000 7f90fea00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90e40b6510 0x7f90e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:04.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.045+0000 7f90fea00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90e40b6510 0x7f90e40b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009cd0 tx=0x7f90f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:04.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.047+0000 7f90f7e00640 1 -- 172.21.15.79:0/1424568730 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90e80adfa0 con 0x7f91001068e0 2024-09-21T02:35:04.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.240+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f9100063800 con 0x7f90e40b6510 2024-09-21T02:35:04.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.242+0000 7f90f7e00640 1 -- 172.21.15.79:0/1424568730 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f9100063800 con 0x7f90e40b6510 2024-09-21T02:35:04.243 INFO:teuthology.orchestra.run.smithi079.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T02:35:04.243 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013G400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-21T02:35:04.243 INFO:teuthology.orchestra.run.smithi079.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T02:35:04.243 INFO:teuthology.orchestra.run.smithi079.stdout:smithi148 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T02:35:04.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90e40b6510 msgr2=0x7f90e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:04.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90e40b6510 0x7f90e40b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009cd0 tx=0x7f90f0005f90 comp rx=0 tx=0).stop 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91001068e0 msgr2=0x7f910019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91001068e0 0x7f910019a5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90e800e9f0 tx=0x7f90e800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 shutdown_connections 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90e40b6510 0x7f90e40b8a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9100109480 0x7f910019b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91001068e0 0x7f910019a5e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 --2- 172.21.15.79:0/1424568730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f910006c660 0x7f9100199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 >> 172.21.15.79:0/1424568730 conn(0x7f91000fdfe0 msgr2=0x7f9100104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 shutdown_connections 2024-09-21T02:35:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:04.244+0000 7f9105c00640 1 -- 172.21.15.79:0/1424568730 wait complete. 2024-09-21T02:35:04.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:04 smithi148 ceph-mon[34626]: from='client.25181 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:04.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:04 smithi098 ceph-mon[34832]: from='client.25181 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:04.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:04 smithi079 ceph-mon[30788]: from='client.25181 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:05.072 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T02:35:05.082 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:35:05.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T02:35:05.452 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:05.774 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:05 smithi079 ceph-mon[30788]: pgmap v396: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:05 smithi148 ceph-mon[34626]: pgmap v396: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:05 smithi098 ceph-mon[34832]: pgmap v396: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:06.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 -- 172.21.15.79:0/3955672557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104600 msgr2=0x7f37c0104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 --2- 172.21.15.79:0/3955672557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104600 0x7f37c0104a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009860 tx=0x7f37a802a3d0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 -- 172.21.15.79:0/3955672557 shutdown_connections 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 --2- 172.21.15.79:0/3955672557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37c0104fa0 0x7f37c010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 --2- 172.21.15.79:0/3955672557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104600 0x7f37c0104a10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 --2- 172.21.15.79:0/3955672557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 0x7f37c01039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 -- 172.21.15.79:0/3955672557 >> 172.21.15.79:0/3955672557 conn(0x7f37c00feec0 msgr2=0x7f37c0101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 -- 172.21.15.79:0/3955672557 shutdown_connections 2024-09-21T02:35:06.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.091+0000 7f37c4c00640 1 -- 172.21.15.79:0/3955672557 wait complete. 2024-09-21T02:35:06.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.092+0000 7f37c4c00640 1 Processor -- start 2024-09-21T02:35:06.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.092+0000 7f37c4c00640 1 -- start start 2024-09-21T02:35:06.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37c4c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 0x7f37c0105ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:06.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37c4c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37c0104600 0x7f37c0106310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:06.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37c4c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104fa0 0x7f37c0106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:06.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37c4c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f37c010f220 con 0x7f37c0104fa0 2024-09-21T02:35:06.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37c4c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f37c010f0a0 con 0x7f37c0103570 2024-09-21T02:35:06.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37c4c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f37c010f3a0 con 0x7f37c0104600 2024-09-21T02:35:06.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37bfe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104fa0 0x7f37c0106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:06.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37bf400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 0x7f37c0105ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:06.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37bf400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 0x7f37c0105ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:42650/0 (socket says 172.21.15.79:42650) 2024-09-21T02:35:06.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37bf400640 1 -- 172.21.15.79:0/2810010113 learned_addr learned my addr 172.21.15.79:0/2810010113 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:06.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37bfe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104fa0 0x7f37c0106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37418/0 (socket says 172.21.15.79:37418) 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.093+0000 7f37bea00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37c0104600 0x7f37c0106310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37bf400640 1 -- 172.21.15.79:0/2810010113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37c0104600 msgr2=0x7f37c0106310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37bf400640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37c0104600 0x7f37c0106310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37bf400640 1 -- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104fa0 msgr2=0x7f37c0106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37bf400640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104fa0 0x7f37c0106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37bf400640 1 -- 172.21.15.79:0/2810010113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c01076d0 con 0x7f37c0103570 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37bf400640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 0x7f37c0105ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37b000efb0 tx=0x7f37b000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37b7e00640 1 -- 172.21.15.79:0/2810010113 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b001b070 con 0x7f37c0103570 2024-09-21T02:35:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c01079c0 con 0x7f37c0103570 2024-09-21T02:35:06.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37b7e00640 1 -- 172.21.15.79:0/2810010113 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37b000ba20 con 0x7f37c0103570 2024-09-21T02:35:06.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37b7e00640 1 -- 172.21.15.79:0/2810010113 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0016b30 con 0x7f37c0103570 2024-09-21T02:35:06.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.094+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c0108090 con 0x7f37c0103570 2024-09-21T02:35:06.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.095+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c01039e0 con 0x7f37c0103570 2024-09-21T02:35:06.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.098+0000 7f37b7e00640 1 -- 172.21.15.79:0/2810010113 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f37b001e070 con 0x7f37c0103570 2024-09-21T02:35:06.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.099+0000 7f37b7e00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f37a40b6510 0x7f37a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:06.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.099+0000 7f37b7e00640 1 -- 172.21.15.79:0/2810010113 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f37b00e7bc0 con 0x7f37c0103570 2024-09-21T02:35:06.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.099+0000 7f37bea00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f37a40b6510 0x7f37a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:06.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.100+0000 7f37bea00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f37a40b6510 0x7f37a40b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f37a802a9c0 tx=0x7f37a8030980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:06.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.101+0000 7f37b7e00640 1 -- 172.21.15.79:0/2810010113 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37b00b2420 con 0x7f37c0103570 2024-09-21T02:35:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.324+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f37c0108950 con 0x7f37c0103570 2024-09-21T02:35:06.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.325+0000 7f37b7e00640 1 -- 172.21.15.79:0/2810010113 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3042 (secure 0 0 0) 0x7f37b00b7360 con 0x7f37c0103570 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:e21 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:btime 2024-09-21T02:33:34:644799+0000 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 21 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-21T02:32:42.479233+0000 2024-09-21T02:35:06.328 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-21T02:33:34.630634+0000 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 300 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 0 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24704} 2024-09-21T02:35:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3,4] 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data disabled 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 0 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 24704 members: 24704 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b{0:24704} state up:active seq 5 addr [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.h{0:24668} state up:standby-replay seq 1 addr [v2:172.21.15.98:6836/2031151027,v1:172.21.15.98:6837/2031151027] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:06.330 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.j{-1:14631} state up:standby seq 1 addr [v2:172.21.15.79:6834/209829654,v1:172.21.15.79:6835/209829654] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.g{-1:14682} state up:standby seq 1 addr [v2:172.21.15.79:6838/3299395115,v1:172.21.15.79:6839/3299395115] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a{-1:14688} state up:standby seq 1 addr [v2:172.21.15.79:6840/1013037631,v1:172.21.15.79:6841/1013037631] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.l{-1:24592} state up:standby seq 1 addr [v2:172.21.15.148:6832/4025923803,v1:172.21.15.148:6833/4025923803] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.k{-1:24614} state up:standby seq 1 addr [v2:172.21.15.98:6832/2247079967,v1:172.21.15.98:6833/2247079967] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d{-1:24622} state up:standby seq 1 addr [v2:172.21.15.79:6836/4018398914,v1:172.21.15.79:6837/4018398914] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.f{-1:24637} state up:standby seq 1 addr [v2:172.21.15.148:6834/1431054933,v1:172.21.15.148:6835/1431054933] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.e{-1:24641} state up:standby seq 1 addr [v2:172.21.15.98:6834/265425700,v1:172.21.15.98:6835/265425700] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c{-1:24649} state up:standby seq 1 addr [v2:172.21.15.148:6836/4145654738,v1:172.21.15.148:6837/4145654738] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.i{-1:24667} state up:standby seq 1 addr [v2:172.21.15.148:6838/566296306,v1:172.21.15.148:6839/566296306] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f37a40b6510 msgr2=0x7f37a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f37a40b6510 0x7f37a40b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f37a802a9c0 tx=0x7f37a8030980 comp rx=0 tx=0).stop 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 msgr2=0x7f37c0105ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 0x7f37c0105ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37b000efb0 tx=0x7f37b000c800 comp rx=0 tx=0).stop 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 shutdown_connections 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f37a40b6510 0x7f37a40b8a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37c0104fa0 0x7f37c0106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37c0104600 0x7f37c0106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 --2- 172.21.15.79:0/2810010113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37c0103570 0x7f37c0105ca0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 >> 172.21.15.79:0/2810010113 conn(0x7f37c00feec0 msgr2=0x7f37c00755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 shutdown_connections 2024-09-21T02:35:06.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:06.327+0000 7f37c4c00640 1 -- 172.21.15.79:0/2810010113 wait complete. 2024-09-21T02:35:06.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:06 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2810010113' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T02:35:06.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:06 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2810010113' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T02:35:06.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:06 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2810010113' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T02:35:07.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T02:35:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:07 smithi148 ceph-mon[34626]: pgmap v397: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:07.818 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:07 smithi079 ceph-mon[30788]: pgmap v397: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:07 smithi098 ceph-mon[34832]: pgmap v397: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 -- 172.21.15.79:0/3315885075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c1069e0 msgr2=0x7f980c106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 --2- 172.21.15.79:0/3315885075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c1069e0 0x7f980c106df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009860 tx=0x7f97f802a3d0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 -- 172.21.15.79:0/3315885075 shutdown_connections 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 --2- 172.21.15.79:0/3315885075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f980c107380 0x7f980c10dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 --2- 172.21.15.79:0/3315885075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c1069e0 0x7f980c106df0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 --2- 172.21.15.79:0/3315885075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f980c105950 0x7f980c105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 -- 172.21.15.79:0/3315885075 >> 172.21.15.79:0/3315885075 conn(0x7f980c1012c0 msgr2=0x7f980c103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.118+0000 7f9813200640 1 -- 172.21.15.79:0/3315885075 shutdown_connections 2024-09-21T02:35:08.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.119+0000 7f9813200640 1 -- 172.21.15.79:0/3315885075 wait complete. 2024-09-21T02:35:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 Processor -- start 2024-09-21T02:35:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 -- start start 2024-09-21T02:35:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c105950 0x7f980c19c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f980c1069e0 0x7f980c19c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:08.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f980c107380 0x7f980c19d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f980c1115f0 con 0x7f980c107380 2024-09-21T02:35:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f980c111470 con 0x7f980c1069e0 2024-09-21T02:35:08.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9813200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f980c111770 con 0x7f980c105950 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f980be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c105950 0x7f980c19c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f980be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c105950 0x7f980c19c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:32802/0 (socket says 172.21.15.79:32802) 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f980be00640 1 -- 172.21.15.79:0/360432942 learned_addr learned my addr 172.21.15.79:0/360432942 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f9811200640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f980c107380 0x7f980c19d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.120+0000 7f980b400640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f980c1069e0 0x7f980c19c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.121+0000 7f980be00640 1 -- 172.21.15.79:0/360432942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f980c1069e0 msgr2=0x7f980c19c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.121+0000 7f980be00640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f980c1069e0 0x7f980c19c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.121+0000 7f980be00640 1 -- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f980c107380 msgr2=0x7f980c19d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.121+0000 7f980be00640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f980c107380 0x7f980c19d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.121+0000 7f980be00640 1 -- 172.21.15.79:0/360432942 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c19dbf0 con 0x7f980c105950 2024-09-21T02:35:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.121+0000 7f980be00640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c105950 0x7f980c19c1c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00e9c0 tx=0x7f97fc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.121+0000 7f9808c00640 1 -- 172.21.15.79:0/360432942 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00ccc0 con 0x7f980c105950 2024-09-21T02:35:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.122+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980c19dee0 con 0x7f980c105950 2024-09-21T02:35:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.122+0000 7f9808c00640 1 -- 172.21.15.79:0/360432942 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97fc0054d0 con 0x7f980c105950 2024-09-21T02:35:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.122+0000 7f9808c00640 1 -- 172.21.15.79:0/360432942 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc010430 con 0x7f980c105950 2024-09-21T02:35:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.122+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980c1a45e0 con 0x7f980c105950 2024-09-21T02:35:08.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.123+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980c105dc0 con 0x7f980c105950 2024-09-21T02:35:08.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.125+0000 7f9808c00640 1 -- 172.21.15.79:0/360432942 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f97fc004f80 con 0x7f980c105950 2024-09-21T02:35:08.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.126+0000 7f9808c00640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97f00b6510 0x7f97f00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:08.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.127+0000 7f9808c00640 1 -- 172.21.15.79:0/360432942 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f97fc0e7e20 con 0x7f980c105950 2024-09-21T02:35:08.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.127+0000 7f980b400640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97f00b6510 0x7f97f00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:08.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.127+0000 7f980b400640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97f00b6510 0x7f97f00b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f97f802a9c0 tx=0x7f97f8030980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:08.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.129+0000 7f9808c00640 1 -- 172.21.15.79:0/360432942 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97fc0ae2a0 con 0x7f980c105950 2024-09-21T02:35:08.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.317+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f980c02e640 con 0x7f980c105950 2024-09-21T02:35:08.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.318+0000 7f9808c00640 1 -- 172.21.15.79:0/360432942 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5662 (secure 0 0 0) 0x7f97fc0b2680 con 0x7f980c105950 2024-09-21T02:35:08.321 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 88 2024-09-21T02:35:08.321 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:35:08.321 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-21T02:23:32.342666+0000 2024-09-21T02:35:08.321 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-21T02:34:31.402384+0000 2024-09-21T02:35:08.321 INFO:teuthology.orchestra.run.smithi079.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T02:35:08.321 INFO:teuthology.orchestra.run.smithi079.stdout:crush_version 27 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:full_ratio 0.95 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:backfillfull_ratio 0.9 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:nearfull_ratio 0.85 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:require_min_compat_client luminous 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:min_compat_client luminous 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:require_osd_release squid 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:stretch_mode_enabled false 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:max_osd 12 2024-09-21T02:35:08.322 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6802/3943221665,v1:172.21.15.79:6803/3943221665] [v2:172.21.15.79:6804/3943221665,v1:172.21.15.79:6805/3943221665] exists,up 054c4c62-2d11-4950-ae9e-2eae3c70d216 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/1838130596,v1:172.21.15.98:6801/1838130596] [v2:172.21.15.98:6802/1838130596,v1:172.21.15.98:6803/1838130596] exists,up d15ddd7c-8be1-4eec-904a-88fb150baae8 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/1764684633,v1:172.21.15.148:6801/1764684633] [v2:172.21.15.148:6802/1764684633,v1:172.21.15.148:6803/1764684633] exists,up 152e63e3-25e3-4219-bea1-94fdb639be4d 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 up in weight 1 up_from 25 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6810/748592463,v1:172.21.15.79:6811/748592463] [v2:172.21.15.79:6812/748592463,v1:172.21.15.79:6813/748592463] exists,up 37557004-b63b-4a46-8eb8-4925af257828 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 up in weight 1 up_from 31 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/1179399736,v1:172.21.15.98:6809/1179399736] [v2:172.21.15.98:6810/1179399736,v1:172.21.15.98:6811/1179399736] exists,up cf8be53e-2fbd-4ba9-8186-73a91f978b03 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 up in weight 1 up_from 36 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6808/517086756,v1:172.21.15.148:6809/517086756] [v2:172.21.15.148:6810/517086756,v1:172.21.15.148:6811/517086756] exists,up 446809f9-3274-40e0-a46d-0537ad693e9b 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6 up in weight 1 up_from 42 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6818/1578312751,v1:172.21.15.79:6819/1578312751] [v2:172.21.15.79:6820/1578312751,v1:172.21.15.79:6821/1578312751] exists,up 6873243a-bb31-4cea-a715-e58b6a9a0141 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/3242795120,v1:172.21.15.98:6817/3242795120] [v2:172.21.15.98:6818/3242795120,v1:172.21.15.98:6819/3242795120] exists,up 0ed3149d-a298-4054-98cd-4eead484fcec 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.8 up in weight 1 up_from 53 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6816/2813432297,v1:172.21.15.148:6817/2813432297] [v2:172.21.15.148:6818/2813432297,v1:172.21.15.148:6819/2813432297] exists,up a779fd91-38a2-419c-922e-2103f448b87c 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.9 up in weight 1 up_from 59 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6826/89755781,v1:172.21.15.79:6827/89755781] [v2:172.21.15.79:6828/89755781,v1:172.21.15.79:6829/89755781] exists,up 23af2a6a-e9f6-46b4-97ce-cb34126eae65 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.10 up in weight 1 up_from 64 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/3998530479,v1:172.21.15.98:6825/3998530479] [v2:172.21.15.98:6826/3998530479,v1:172.21.15.98:6827/3998530479] exists,up c22ae343-edd0-4ed8-861d-f2ca54d92b5a 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.11 up in weight 1 up_from 70 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6824/2210220942,v1:172.21.15.148:6825/2210220942] [v2:172.21.15.148:6826/2210220942,v1:172.21.15.148:6827/2210220942] exists,up a9592a1c-5ad9-4b3a-8161-c213cf18a3cf 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 2.f [8,11] 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 2.14 [2,4] 2024-09-21T02:35:08.323 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 2.1f [7,11] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.3 [4,9] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.11 [4,8] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.1b [4,6] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.25 [5,9] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.38 [3,9] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 4.8 [5,8] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 4.12 [9,10] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 4.13 [9,8] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 4.1b [9,8] 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/4255899352 expires 2024-09-22T02:24:29.283557+0000 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/1266728310 expires 2024-09-22T02:24:29.283557+0000 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6800/1983375903 expires 2024-09-22T02:24:29.283557+0000 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/1676746603 expires 2024-09-22T02:23:58.098675+0000 2024-09-21T02:35:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/467580513 expires 2024-09-22T02:23:58.098675+0000 2024-09-21T02:35:08.325 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/1861363948 expires 2024-09-22T02:24:29.283557+0000 2024-09-21T02:35:08.325 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6801/4027877964 expires 2024-09-22T02:23:58.098675+0000 2024-09-21T02:35:08.325 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6801/1983375903 expires 2024-09-22T02:24:29.283557+0000 2024-09-21T02:35:08.325 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6800/4027877964 expires 2024-09-22T02:23:58.098675+0000 2024-09-21T02:35:08.325 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/3080648711 expires 2024-09-22T02:23:58.098675+0000 2024-09-21T02:35:08.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97f00b6510 msgr2=0x7f97f00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97f00b6510 0x7f97f00b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f97f802a9c0 tx=0x7f97f8030980 comp rx=0 tx=0).stop 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c105950 msgr2=0x7f980c19c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c105950 0x7f980c19c1c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00e9c0 tx=0x7f97fc00ee80 comp rx=0 tx=0).stop 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 shutdown_connections 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97f00b6510 0x7f97f00b8a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f980c107380 0x7f980c19d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f980c1069e0 0x7f980c19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 --2- 172.21.15.79:0/360432942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f980c105950 0x7f980c19c1c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 >> 172.21.15.79:0/360432942 conn(0x7f980c1012c0 msgr2=0x7f980c109ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 shutdown_connections 2024-09-21T02:35:08.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:08.321+0000 7f9813200640 1 -- 172.21.15.79:0/360432942 wait complete. 2024-09-21T02:35:08.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:08 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/360432942' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T02:35:08.835 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:08 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/360432942' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T02:35:08.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:08 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/360432942' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T02:35:09.212 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T02:35:09.229 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:35:09.597 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:09.802 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:09 smithi079 ceph-mon[30788]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:09.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:09 smithi148 ceph-mon[34626]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:09.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:09 smithi098 ceph-mon[34832]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 -- 172.21.15.79:0/1441754779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 msgr2=0x7fa318109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 --2- 172.21.15.79:0/1441754779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 0x7fa318109700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa304009860 tx=0x7fa30402a340 comp rx=0 tx=0).stop 2024-09-21T02:35:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 -- 172.21.15.79:0/1441754779 shutdown_connections 2024-09-21T02:35:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 --2- 172.21.15.79:0/1441754779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa318109c40 0x7fa318110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 --2- 172.21.15.79:0/1441754779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 0x7fa318109700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 --2- 172.21.15.79:0/1441754779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 0x7fa318103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 -- 172.21.15.79:0/1441754779 >> 172.21.15.79:0/1441754779 conn(0x7fa3180ff400 msgr2=0x7fa318101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 -- 172.21.15.79:0/1441754779 shutdown_connections 2024-09-21T02:35:10.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.251+0000 7fa31d600640 1 -- 172.21.15.79:0/1441754779 wait complete. 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.252+0000 7fa31d600640 1 Processor -- start 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa31d600640 1 -- start start 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa31d600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 0x7fa31819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa31d600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 0x7fa31819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa31d600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa318109c40 0x7fa31819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa31d600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa318113900 con 0x7fa3181039b0 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa31d600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa318113780 con 0x7fa3181092f0 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa31d600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa318113a80 con 0x7fa318109c40 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa317e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 0x7fa31819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa317e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 0x7fa31819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37442/0 (socket says 172.21.15.79:37442) 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.253+0000 7fa317e00640 1 -- 172.21.15.79:0/1099674897 learned_addr learned my addr 172.21.15.79:0/1099674897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa317400640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 0x7fa31819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa31cc00640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa318109c40 0x7fa31819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa317e00640 1 -- 172.21.15.79:0/1099674897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa318109c40 msgr2=0x7fa31819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa317e00640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa318109c40 0x7fa31819faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa317e00640 1 -- 172.21.15.79:0/1099674897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 msgr2=0x7fa31819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa317e00640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 0x7fa31819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa317e00640 1 -- 172.21.15.79:0/1099674897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3181a0220 con 0x7fa3181039b0 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.254+0000 7fa317e00640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 0x7fa31819a2b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa30800e9c0 tx=0x7fa30800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.255+0000 7fa314c00640 1 -- 172.21.15.79:0/1099674897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30800cde0 con 0x7fa3181039b0 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.255+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3181a0510 con 0x7fa3181039b0 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.255+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181a6c70 con 0x7fa3181039b0 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.255+0000 7fa314c00640 1 -- 172.21.15.79:0/1099674897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3080035f0 con 0x7fa3181039b0 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.255+0000 7fa314c00640 1 -- 172.21.15.79:0/1099674897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308010690 con 0x7fa3181039b0 2024-09-21T02:35:10.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.256+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f80052c0 con 0x7fa3181039b0 2024-09-21T02:35:10.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.258+0000 7fa314c00640 1 -- 172.21.15.79:0/1099674897 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa308004000 con 0x7fa3181039b0 2024-09-21T02:35:10.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.259+0000 7fa314c00640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa2fc0b6590 0x7fa2fc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.260+0000 7fa314c00640 1 -- 172.21.15.79:0/1099674897 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa3080e7670 con 0x7fa3181039b0 2024-09-21T02:35:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.260+0000 7fa317400640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa2fc0b6590 0x7fa2fc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.261+0000 7fa317400640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa2fc0b6590 0x7fa2fc0b8aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa304005940 tx=0x7fa3040058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:10.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.264+0000 7fa314c00640 1 -- 172.21.15.79:0/1099674897 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3080adb50 con 0x7fa3181039b0 2024-09-21T02:35:10.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.489+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2f80055b0 con 0x7fa3181039b0 2024-09-21T02:35:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.490+0000 7fa314c00640 1 -- 172.21.15.79:0/1099674897 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fa3080b1f30 con 0x7fa3181039b0 2024-09-21T02:35:10.491 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:10.491 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:35:10.491 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:35:10.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa2fc0b6590 msgr2=0x7fa2fc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:10.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa2fc0b6590 0x7fa2fc0b8aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa304005940 tx=0x7fa3040058d0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 msgr2=0x7fa31819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 0x7fa31819a2b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa30800e9c0 tx=0x7fa30800ee80 comp rx=0 tx=0).stop 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 shutdown_connections 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa2fc0b6590 0x7fa2fc0b8aa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa318109c40 0x7fa31819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3181092f0 0x7fa31819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 --2- 172.21.15.79:0/1099674897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3181039b0 0x7fa31819a2b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 >> 172.21.15.79:0/1099674897 conn(0x7fa3180ff400 msgr2=0x7fa318101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.492+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 shutdown_connections 2024-09-21T02:35:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:10.493+0000 7fa31d600640 1 -- 172.21.15.79:0/1099674897 wait complete. 2024-09-21T02:35:10.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:10 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1099674897' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:10.899 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:10 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1099674897' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:10 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1099674897' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:11.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:35:11.678 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:11 smithi148 ceph-mon[34626]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T02:35:11.816 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:11 smithi079 ceph-mon[30788]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T02:35:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:11 smithi098 ceph-mon[34832]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T02:35:12.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 -- 172.21.15.79:0/3873525527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274078290 msgr2=0x7f4274114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 --2- 172.21.15.79:0/3873525527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274078290 0x7f4274114200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f425c009900 tx=0x7f425c02a410 comp rx=0 tx=0).stop 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 -- 172.21.15.79:0/3873525527 shutdown_connections 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 --2- 172.21.15.79:0/3873525527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4274114740 0x7f4274116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 --2- 172.21.15.79:0/3873525527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274078290 0x7f4274114200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 --2- 172.21.15.79:0/3873525527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4274077940 0x7f4274077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 -- 172.21.15.79:0/3873525527 >> 172.21.15.79:0/3873525527 conn(0x7f4274101810 msgr2=0x7f4274103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 -- 172.21.15.79:0/3873525527 shutdown_connections 2024-09-21T02:35:12.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.348+0000 7f427ba00640 1 -- 172.21.15.79:0/3873525527 wait complete. 2024-09-21T02:35:12.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.349+0000 7f427ba00640 1 Processor -- start 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.349+0000 7f427ba00640 1 -- start start 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f427ba00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274077940 0x7f42741a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f427ba00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4274078290 0x7f42741a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f427ba00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4274114740 0x7f42741a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f427ba00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f427411a090 con 0x7f4274077940 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f427ba00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4274119f10 con 0x7f4274114740 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f427ba00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f427411a210 con 0x7f4274078290 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f4279000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274077940 0x7f42741a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f4279000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274077940 0x7f42741a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37464/0 (socket says 172.21.15.79:37464) 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f4279000640 1 -- 172.21.15.79:0/1002885998 learned_addr learned my addr 172.21.15.79:0/1002885998 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f426be00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4274078290 0x7f42741a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.350+0000 7f4279a00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4274114740 0x7f42741a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4279000640 1 -- 172.21.15.79:0/1002885998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4274078290 msgr2=0x7f42741a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4279000640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4274078290 0x7f42741a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4279000640 1 -- 172.21.15.79:0/1002885998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4274114740 msgr2=0x7f42741a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4279000640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4274114740 0x7f42741a6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4279000640 1 -- 172.21.15.79:0/1002885998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42741a6a90 con 0x7f4274077940 2024-09-21T02:35:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4279000640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274077940 0x7f42741a0b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f426400e9f0 tx=0x7f426400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4272000640 1 -- 172.21.15.79:0/1002885998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426400cd80 con 0x7f4274077940 2024-09-21T02:35:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4272000640 1 -- 172.21.15.79:0/1002885998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42640108e0 con 0x7f4274077940 2024-09-21T02:35:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42741a6d80 con 0x7f4274077940 2024-09-21T02:35:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f4272000640 1 -- 172.21.15.79:0/1002885998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264018980 con 0x7f4274077940 2024-09-21T02:35:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.351+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42741ad4e0 con 0x7f4274077940 2024-09-21T02:35:12.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.352+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4274078e50 con 0x7f4274077940 2024-09-21T02:35:12.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.355+0000 7f4272000640 1 -- 172.21.15.79:0/1002885998 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4264010430 con 0x7f4274077940 2024-09-21T02:35:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.356+0000 7f4272000640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42580b6510 0x7f42580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.357+0000 7f4272000640 1 -- 172.21.15.79:0/1002885998 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f42640e7ec0 con 0x7f4274077940 2024-09-21T02:35:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.357+0000 7f426be00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42580b6510 0x7f42580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.357+0000 7f426be00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42580b6510 0x7f42580b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f425c009230 tx=0x7f425c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:12.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.359+0000 7f4272000640 1 -- 172.21.15.79:0/1002885998 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42640b2720 con 0x7f4274077940 2024-09-21T02:35:12.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.586+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4274077d50 con 0x7f4274077940 2024-09-21T02:35:12.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.587+0000 7f4272000640 1 -- 172.21.15.79:0/1002885998 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f42640b7660 con 0x7f4274077940 2024-09-21T02:35:12.588 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:12.588 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:35:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:35:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42580b6510 msgr2=0x7f42580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42580b6510 0x7f42580b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f425c009230 tx=0x7f425c031400 comp rx=0 tx=0).stop 2024-09-21T02:35:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274077940 msgr2=0x7f42741a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274077940 0x7f42741a0b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f426400e9f0 tx=0x7f426400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 shutdown_connections 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42580b6510 0x7f42580b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4274114740 0x7f42741a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4274078290 0x7f42741a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 --2- 172.21.15.79:0/1002885998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4274077940 0x7f42741a0b20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 >> 172.21.15.79:0/1002885998 conn(0x7f4274101810 msgr2=0x7f42741167d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 shutdown_connections 2024-09-21T02:35:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:12.589+0000 7f427ba00640 1 -- 172.21.15.79:0/1002885998 wait complete. 2024-09-21T02:35:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:12 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1002885998' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:12.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:12 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1002885998' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:13.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:12 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1002885998' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:13.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:35:13.752 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:13 smithi098 ceph-mon[34832]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T02:35:13.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:13 smithi079 ceph-mon[30788]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T02:35:14.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:13 smithi148 ceph-mon[34626]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T02:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 -- 172.21.15.79:0/1230041834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec103b60 msgr2=0x7f22ec103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 --2- 172.21.15.79:0/1230041834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec103b60 0x7f22ec103f70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009860 tx=0x7f22dc02a340 comp rx=0 tx=0).stop 2024-09-21T02:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 -- 172.21.15.79:0/1230041834 shutdown_connections 2024-09-21T02:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 --2- 172.21.15.79:0/1230041834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec109df0 0x7f22ec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 --2- 172.21.15.79:0/1230041834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1094a0 0x7f22ec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 --2- 172.21.15.79:0/1230041834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec103b60 0x7f22ec103f70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 -- 172.21.15.79:0/1230041834 >> 172.21.15.79:0/1230041834 conn(0x7f22ec07b850 msgr2=0x7f22ec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:14.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 -- 172.21.15.79:0/1230041834 shutdown_connections 2024-09-21T02:35:14.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.428+0000 7f22f1400640 1 -- 172.21.15.79:0/1230041834 wait complete. 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.429+0000 7f22f1400640 1 Processor -- start 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.429+0000 7f22f1400640 1 -- start start 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22f1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec103b60 0x7f22ec19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22f1400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1094a0 0x7f22ec19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22f1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec109df0 0x7f22ec19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22f1400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec113ab0 con 0x7f22ec1094a0 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22f1400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec113930 con 0x7f22ec109df0 2024-09-21T02:35:14.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22f1400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec113c30 con 0x7f22ec103b60 2024-09-21T02:35:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec103b60 0x7f22ec19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22e1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1094a0 0x7f22ec19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec103b60 0x7f22ec19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57690/0 (socket says 172.21.15.79:57690) 2024-09-21T02:35:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 -- 172.21.15.79:0/1105767178 learned_addr learned my addr 172.21.15.79:0/1105767178 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:14.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22eb200640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec109df0 0x7f22ec19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 -- 172.21.15.79:0/1105767178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec109df0 msgr2=0x7f22ec19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec109df0 0x7f22ec19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 -- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1094a0 msgr2=0x7f22ec19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1094a0 0x7f22ec19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22ea800640 1 -- 172.21.15.79:0/1105767178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec1a03b0 con 0x7f22ec103b60 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.430+0000 7f22e1e00640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1094a0 0x7f22ec19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.431+0000 7f22ea800640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec103b60 0x7f22ec19a440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0303f0 tx=0x7f22dc032da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.431+0000 7f22e3e00640 1 -- 172.21.15.79:0/1105767178 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc040020 con 0x7f22ec103b60 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.431+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec1a0640 con 0x7f22ec103b60 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.431+0000 7f22e3e00640 1 -- 172.21.15.79:0/1105767178 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22dc030dd0 con 0x7f22ec103b60 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.431+0000 7f22e3e00640 1 -- 172.21.15.79:0/1105767178 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc037040 con 0x7f22ec103b60 2024-09-21T02:35:14.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.431+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec1a6e00 con 0x7f22ec103b60 2024-09-21T02:35:14.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.432+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec103f70 con 0x7f22ec103b60 2024-09-21T02:35:14.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.435+0000 7f22e3e00640 1 -- 172.21.15.79:0/1105767178 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f22dc043020 con 0x7f22ec103b60 2024-09-21T02:35:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.436+0000 7f22e3e00640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f22d00b6510 0x7f22d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.436+0000 7f22e3e00640 1 -- 172.21.15.79:0/1105767178 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f22dc1079d0 con 0x7f22ec103b60 2024-09-21T02:35:14.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.436+0000 7f22e1e00640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f22d00b6510 0x7f22d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:14.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.437+0000 7f22e1e00640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f22d00b6510 0x7f22d00b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22d40096c0 tx=0x7f22d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:14.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.438+0000 7f22e3e00640 1 -- 172.21.15.79:0/1105767178 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22dc04a020 con 0x7f22ec103b60 2024-09-21T02:35:14.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.629+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22ec19b570 con 0x7f22ec103b60 2024-09-21T02:35:14.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.630+0000 7f22e3e00640 1 -- 172.21.15.79:0/1105767178 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24834 (secure 0 0 0) 0x7f22dc0e8e20 con 0x7f22ec103b60 2024-09-21T02:35:14.632 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:14.632 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:34:31.402384+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f22d00b6510 msgr2=0x7f22d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f22d00b6510 0x7f22d00b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22d40096c0 tx=0x7f22d4009260 comp rx=0 tx=0).stop 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec103b60 msgr2=0x7f22ec19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec103b60 0x7f22ec19a440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0303f0 tx=0x7f22dc032da0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 shutdown_connections 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f22d00b6510 0x7f22d00b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22ec109df0 0x7f22ec19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22ec1094a0 0x7f22ec19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 --2- 172.21.15.79:0/1105767178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22ec103b60 0x7f22ec19a440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.634+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 >> 172.21.15.79:0/1105767178 conn(0x7f22ec07b850 msgr2=0x7f22ec1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.635+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 shutdown_connections 2024-09-21T02:35:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:14.635+0000 7f22f1400640 1 -- 172.21.15.79:0/1105767178 wait complete. 2024-09-21T02:35:14.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:14 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1105767178' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:35:14.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:14 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1105767178' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:35:15.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:14 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1105767178' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:35:15.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:32:42.479233+0000', 'modified': '2024-09-21T02:33:34.630634+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24668': {'gid': 24668, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6837/2031151027', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 2031151027}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 2031151027}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.98:6839/413408652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 413408652}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 413408652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24704]} 2024-09-21T02:35:15.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T02:35:15.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:35:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:15 smithi079 ceph-mon[30788]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:15.821 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:15.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:15 smithi098 ceph-mon[34832]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:16.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:15 smithi148 ceph-mon[34626]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T02:35:16.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 -- 172.21.15.79:0/3541735176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 msgr2=0x7fbf50112370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 --2- 172.21.15.79:0/3541735176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 0x7fbf50112370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009ca0 tx=0x7fbf4802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 -- 172.21.15.79:0/3541735176 shutdown_connections 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 --2- 172.21.15.79:0/3541735176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 0x7fbf50112370 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 --2- 172.21.15.79:0/3541735176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 0x7fbf5010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 --2- 172.21.15.79:0/3541735176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf50075750 0x7fbf50075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 -- 172.21.15.79:0/3541735176 >> 172.21.15.79:0/3541735176 conn(0x7fbf500ff3e0 msgr2=0x7fbf50101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 -- 172.21.15.79:0/3541735176 shutdown_connections 2024-09-21T02:35:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.471+0000 7fbf56a00640 1 -- 172.21.15.79:0/3541735176 wait complete. 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.472+0000 7fbf56a00640 1 Processor -- start 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.472+0000 7fbf56a00640 1 -- start start 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf56a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf50075750 0x7fbf5019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf56a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 0x7fbf5019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf56a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 0x7fbf501a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf56a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf50115ac0 con 0x7fbf5010ff50 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf56a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbf50115940 con 0x7fbf500760a0 2024-09-21T02:35:16.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf56a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf50115c40 con 0x7fbf50075750 2024-09-21T02:35:16.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf56000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 0x7fbf501a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf54c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 0x7fbf5019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf54c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 0x7fbf5019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:39966/0 (socket says 172.21.15.79:39966) 2024-09-21T02:35:16.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf54c00640 1 -- 172.21.15.79:0/1650430152 learned_addr learned my addr 172.21.15.79:0/1650430152 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:16.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.473+0000 7fbf55600640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf50075750 0x7fbf5019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf54c00640 1 -- 172.21.15.79:0/1650430152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf50075750 msgr2=0x7fbf5019c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf54c00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf50075750 0x7fbf5019c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf54c00640 1 -- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 msgr2=0x7fbf501a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf54c00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 0x7fbf501a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf54c00640 1 -- 172.21.15.79:0/1650430152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf501a23c0 con 0x7fbf500760a0 2024-09-21T02:35:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf56000640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 0x7fbf501a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf54c00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 0x7fbf5019c9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00d950 tx=0x7fbf3c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf4e000640 1 -- 172.21.15.79:0/1650430152 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c017070 con 0x7fbf500760a0 2024-09-21T02:35:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.474+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf501a26b0 con 0x7fbf500760a0 2024-09-21T02:35:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.475+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf501a8e10 con 0x7fbf500760a0 2024-09-21T02:35:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.475+0000 7fbf4e000640 1 -- 172.21.15.79:0/1650430152 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf3c009c30 con 0x7fbf500760a0 2024-09-21T02:35:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.475+0000 7fbf4e000640 1 -- 172.21.15.79:0/1650430152 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c004cc0 con 0x7fbf500760a0 2024-09-21T02:35:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 Processor -- start 2024-09-21T02:35:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 -- start start 2024-09-21T02:35:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5aa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56033e521d50 con 0x56033e1db0a0 2024-09-21T02:35:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56033e511180 con 0x56033e203f60 2024-09-21T02:35:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56033e514f90 con 0x56033e1e3280 2024-09-21T02:35:16.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf55600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.478+0000 7fbf55600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59662/0 (socket says 172.21.15.79:59662) 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf55600640 1 -- 172.21.15.79:0/1376365791 learned_addr learned my addr 172.21.15.79:0/1376365791 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf56000640 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf4e000640 1 -- 172.21.15.79:0/1650430152 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbf3c005020 con 0x7fbf500760a0 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf55600640 1 -- 172.21.15.79:0/1376365791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 msgr2=0x56033e5ab0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf55600640 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5ab0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf55600640 1 -- 172.21.15.79:0/1376365791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 msgr2=0x56033e5aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf55600640 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf55600640 1 -- 172.21.15.79:0/1376365791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033e4dba70 con 0x56033e1db0a0 2024-09-21T02:35:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.479+0000 7fbf55600640 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5aabb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009cf0 tx=0x7fbf44011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde930adb953ec4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.480+0000 7fbf42600640 1 -- 172.21.15.79:0/1376365791 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44004230 con 0x56033e1db0a0 2024-09-21T02:35:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.480+0000 7fbf42600640 1 -- 172.21.15.79:0/1376365791 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf440043d0 con 0x56033e1db0a0 2024-09-21T02:35:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.480+0000 7fbf42600640 1 -- 172.21.15.79:0/1376365791 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44019880 con 0x56033e1db0a0 2024-09-21T02:35:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf4e000640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbf380b6590 0x7fbf380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1376365791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 msgr2=0x56033e5aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5aabb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009cf0 tx=0x7fbf44011810 comp rx=0 tx=0).stop 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf4e000640 1 -- 172.21.15.79:0/1650430152 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbf3c0e70e0 con 0x7fbf500760a0 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1376365791 shutdown_connections 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5aabb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1376365791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.481+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1376365791 >> 172.21.15.79:0/1376365791 conn(0x56033e1f8350 msgr2=0x56033e5a8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.482+0000 7fbf56000640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbf380b6590 0x7fbf380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.482+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1376365791 shutdown_connections 2024-09-21T02:35:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.482+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1376365791 wait complete. 2024-09-21T02:35:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.483+0000 7fbf56000640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbf380b6590 0x7fbf380b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf480094e0 tx=0x7fbf48009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.483+0000 7fbf5ec47740 1 -- start start 2024-09-21T02:35:16.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.483+0000 7fbf5ec47740 1 Processor -- start 2024-09-21T02:35:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56033e3725f0 con 0x56033e1db0a0 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56033e4ac460 con 0x56033e203f60 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56033e5b8e50 con 0x56033e1e3280 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf5ec47740 10 client.0 _ll_register_callbacks cb 0x56033e4bc210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf55600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf54c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf55600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59666/0 (socket says 172.21.15.79:59666) 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf55600640 1 -- 172.21.15.79:0/930171450 learned_addr learned my addr 172.21.15.79:0/930171450 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.484+0000 7fbf56000640 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf54c00640 1 -- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 msgr2=0x56033e5c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf54c00640 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf54c00640 1 -- 172.21.15.79:0/930171450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 msgr2=0x56033e5bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf54c00640 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf54c00640 1 -- 172.21.15.79:0/930171450 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56033e26f540 con 0x56033e1e3280 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf54c00640 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5bf760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0e4830 tx=0x7fbf3c0ac6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c14ee915422cf9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf36a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf36a00640 1 -- 172.21.15.79:0/930171450 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0942b0 con 0x56033e1e3280 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf36a00640 1 -- 172.21.15.79:0/930171450 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbf3c0a8810 con 0x56033e1e3280 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.485+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56033e4aea70 con 0x56033e1e3280 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf36a00640 1 -- 172.21.15.79:0/930171450 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbf3c009de0 con 0x56033e1e3280 2024-09-21T02:35:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 10 client.25210 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56033e4c96f0 con 0x56033e1e3280 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf36a00640 1 -- 172.21.15.79:0/930171450 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56033e4aea70 con 0x56033e1e3280 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf36a00640 1 -- 172.21.15.79:0/930171450 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbf3c0b1060 con 0x56033e1e3280 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 10 client.25210 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 10 client.25210 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 20 client.25210 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e1c28e0 0x56033e5d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 4 client.25210 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.486+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56033e523ca0 con 0x56033e1c28e0 2024-09-21T02:35:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.487+0000 7fbf55600640 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e1c28e0 0x56033e5d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.487+0000 7fbf55600640 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e1c28e0 0x56033e5d0f80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b766cd3a1ebeca14 server_cookie=e310ecad4c04ac0e in_seq=0 out_seq=0 2024-09-21T02:35:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.487+0000 7fbf36a00640 10 client.25210 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf36a00640 1 -- 172.21.15.79:0/930171450 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56033e523ca0 con 0x56033e1c28e0 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf36a00640 10 client.25210 handle_command_reply: tid=0 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 client.25210 shutdown 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 msgr2=0x56033e5bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5bf760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0e4830 tx=0x7fbf3c0ac6f0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 shutdown_connections 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e1c28e0 0x56033e5d0f80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e203f60 0x56033e5c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1e3280 0x56033e5bf760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/930171450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1db0a0 0x56033e5bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf36a00640 0 client.25210 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.488+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 >> 172.21.15.79:0/930171450 conn(0x56033e1f8350 msgr2=0x56033e5ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.489+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 shutdown_connections 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.489+0000 7fbf5ec47740 1 -- 172.21.15.79:0/930171450 wait complete. 2024-09-21T02:35:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.489+0000 7fbf5ec47740 20 client.25210 trim_cache size 0 max 16384 2024-09-21T02:35:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.507+0000 7fbf5ec47740 1 Processor -- start 2024-09-21T02:35:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf5ec47740 1 -- start start 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1db0a0 0x56033e5ba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1e3280 0x56033e5ba670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e203f60 0x56033e5bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56033e5cf2c0 con 0x56033e203f60 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56033e5cf990 con 0x56033e1e3280 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56033e5d0060 con 0x56033e1db0a0 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf56000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e203f60 0x56033e5bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf55600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1db0a0 0x56033e5ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf55600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1db0a0 0x56033e5ba130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57750/0 (socket says 172.21.15.79:57750) 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf55600640 1 -- 172.21.15.79:0/2949404170 learned_addr learned my addr 172.21.15.79:0/2949404170 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.508+0000 7fbf54c00640 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1e3280 0x56033e5ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf55600640 1 -- 172.21.15.79:0/2949404170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1e3280 msgr2=0x56033e5ba670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf55600640 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1e3280 0x56033e5ba670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf55600640 1 -- 172.21.15.79:0/2949404170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e203f60 msgr2=0x56033e5bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf55600640 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e203f60 0x56033e5bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf55600640 1 -- 172.21.15.79:0/2949404170 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033e5ae780 con 0x56033e1db0a0 2024-09-21T02:35:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf55600640 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1db0a0 0x56033e5ba130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009230 tx=0x7fbf44011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e2e0fa50b52f96c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf41c00640 1 -- 172.21.15.79:0/2949404170 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44031070 con 0x56033e1db0a0 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf41c00640 1 -- 172.21.15.79:0/2949404170 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf44005450 con 0x56033e1db0a0 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.509+0000 7fbf41c00640 1 -- 172.21.15.79:0/2949404170 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf440197b0 con 0x56033e1db0a0 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 -- 172.21.15.79:0/2949404170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1db0a0 msgr2=0x56033e5ba130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1db0a0 0x56033e5ba130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009230 tx=0x7fbf44011810 comp rx=0 tx=0).stop 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 -- 172.21.15.79:0/2949404170 shutdown_connections 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e203f60 0x56033e5bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1e3280 0x56033e5ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/2949404170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e1db0a0 0x56033e5ba130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 -- 172.21.15.79:0/2949404170 >> 172.21.15.79:0/2949404170 conn(0x56033e1f8350 msgr2=0x56033e5ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 -- 172.21.15.79:0/2949404170 shutdown_connections 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.510+0000 7fbf5ec47740 1 -- 172.21.15.79:0/2949404170 wait complete. 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.511+0000 7fbf5ec47740 1 -- start start 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.511+0000 7fbf5ec47740 1 Processor -- start 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.511+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1db0a0 0x56033e5cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1e3280 0x56033e5cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf5ec47740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e203f60 0x56033e5c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56033e5d0e00 con 0x56033e1e3280 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56033e5d0730 con 0x56033e1db0a0 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf5ec47740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56033e5d14d0 con 0x56033e203f60 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf5ec47740 10 client.0 _ll_register_callbacks cb 0x7fbf3c0ac810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1db0a0 0x56033e5cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1db0a0 0x56033e5cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:39992/0 (socket says 172.21.15.79:39992) 2024-09-21T02:35:16.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 -- 172.21.15.79:0/1861841056 learned_addr learned my addr 172.21.15.79:0/1861841056 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:16.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf54c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1e3280 0x56033e5cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf56000640 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e203f60 0x56033e5c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 -- 172.21.15.79:0/1861841056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e203f60 msgr2=0x56033e5c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e203f60 0x56033e5c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 -- 172.21.15.79:0/1861841056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1e3280 msgr2=0x56033e5cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1e3280 0x56033e5cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.512+0000 7fbf55600640 1 -- 172.21.15.79:0/1861841056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56033e5c74c0 con 0x56033e1db0a0 2024-09-21T02:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf55600640 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1db0a0 0x56033e5cad10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf44000c00 tx=0x7fbf44005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d261ceb5dd104ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:16.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf36a00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf36a00640 1 -- 172.21.15.79:0/1861841056 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44031070 con 0x56033e1db0a0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf44005450 con 0x56033e1db0a0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf36a00640 1 -- 172.21.15.79:0/1861841056 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbf440035f0 con 0x56033e1db0a0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf36a00640 1 -- 172.21.15.79:0/1861841056 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbf440037f0 con 0x56033e1db0a0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf5ec47740 10 client.25229 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.513+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56033e5ac220 con 0x56033e1db0a0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf36a00640 1 -- 172.21.15.79:0/1861841056 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf44005450 con 0x56033e1db0a0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf36a00640 1 -- 172.21.15.79:0/1861841056 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbf4403f030 con 0x56033e1db0a0 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf5ec47740 10 client.25229 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf5ec47740 10 client.25229 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf5ec47740 20 client.25229 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e197c90 0x56033e63f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf5ec47740 4 client.25229 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "status"}) -- 0x56033e5b8920 con 0x56033e197c90 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.514+0000 7fbf54c00640 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e197c90 0x56033e63f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf54c00640 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e197c90 0x56033e63f2e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72d7071f3aceeba6 server_cookie=52bde0c114e71642 in_seq=0 out_seq=0 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf36a00640 10 client.25229 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf36a00640 1 -- 172.21.15.79:0/1861841056 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56033e5b8920 con 0x56033e197c90 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf36a00640 10 client.25229 handle_command_reply: tid=0 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 client.25229 shutdown 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1db0a0 msgr2=0x56033e5cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1db0a0 0x56033e5cad10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf44000c00 tx=0x7fbf44005040 comp rx=0 tx=0).stop 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 shutdown_connections 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56033e197c90 0x56033e63f2e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56033e203f60 0x56033e5c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56033e1e3280 0x56033e5cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 --2- 172.21.15.79:0/1861841056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033e1db0a0 0x56033e5cad10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 >> 172.21.15.79:0/1861841056 conn(0x56033e1f8350 msgr2=0x56033e5ba130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.515+0000 7fbf36a00640 0 client.25229 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 shutdown_connections 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf5ec47740 1 -- 172.21.15.79:0/1861841056 wait complete. 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf5ec47740 20 client.25229 trim_cache size 0 max 16384 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "56d10306-77c0-11ef-baf5-efdc52797490", 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24704, 2024-09-21T02:35:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 153.04699562600001, 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 21, 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 88, 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 167.01861815300001 2024-09-21T02:35:16.521 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbf380b6590 msgr2=0x7fbf380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbf380b6590 0x7fbf380b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf480094e0 tx=0x7fbf48009800 comp rx=0 tx=0).stop 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 msgr2=0x7fbf5019c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 0x7fbf5019c9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00d950 tx=0x7fbf3c00de10 comp rx=0 tx=0).stop 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 shutdown_connections 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbf380b6590 0x7fbf380b8aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5010ff50 0x7fbf501a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf500760a0 0x7fbf5019c9f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 --2- 172.21.15.79:0/1650430152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf50075750 0x7fbf5019c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.516+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 >> 172.21.15.79:0/1650430152 conn(0x7fbf500ff3e0 msgr2=0x7fbf50109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.517+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 shutdown_connections 2024-09-21T02:35:16.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:16.517+0000 7fbf56a00640 1 -- 172.21.15.79:0/1650430152 wait complete. 2024-09-21T02:35:17.376 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T02:35:17.389 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T02:35:17.390 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T02:35:17.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:17.390 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-09-21T02:35:17.427 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T02:35:17.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:17.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:35:17.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:17.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-09-21T02:35:17.768 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:17 smithi079 ceph-mon[30788]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T02:35:17.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:17 smithi148 ceph-mon[34626]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T02:35:17.853 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-21T02:35:17.854 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T02:35:17.854 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-21T02:35:17.854 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-21T02:35:17.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T02:35:17.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:17 smithi098 ceph-mon[34832]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T02:35:18.222 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:18.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 -- 172.21.15.79:0/735428853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd00757b0 msgr2=0x7f8cd0075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:18.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 --2- 172.21.15.79:0/735428853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd00757b0 0x7f8cd0075bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009900 tx=0x7f8cc402a400 comp rx=0 tx=0).stop 2024-09-21T02:35:18.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 -- 172.21.15.79:0/735428853 shutdown_connections 2024-09-21T02:35:18.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 --2- 172.21.15.79:0/735428853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd010ff10 0x7f8cd0112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:18.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 --2- 172.21.15.79:0/735428853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cd0076100 0x7f8cd010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:18.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 --2- 172.21.15.79:0/735428853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd00757b0 0x7f8cd0075bc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:18.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 -- 172.21.15.79:0/735428853 >> 172.21.15.79:0/735428853 conn(0x7f8cd00ff440 msgr2=0x7f8cd0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:18.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 -- 172.21.15.79:0/735428853 shutdown_connections 2024-09-21T02:35:18.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.828+0000 7f8cd7000640 1 -- 172.21.15.79:0/735428853 wait complete. 2024-09-21T02:35:18.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.829+0000 7f8cd7000640 1 Processor -- start 2024-09-21T02:35:18.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.829+0000 7f8cd7000640 1 -- start start 2024-09-21T02:35:18.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd7000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd00757b0 0x7f8cd019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:18.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd7000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cd0076100 0x7f8cd019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:18.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd7000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd010ff10 0x7f8cd01a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:18.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd7000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0115ac0 con 0x7f8cd0076100 2024-09-21T02:35:18.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd7000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0115940 con 0x7f8cd010ff10 2024-09-21T02:35:18.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd7000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0115c40 con 0x7f8cd00757b0 2024-09-21T02:35:18.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cd0076100 0x7f8cd019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd00757b0 0x7f8cd019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd00757b0 0x7f8cd019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57776/0 (socket says 172.21.15.79:57776) 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd5c00640 1 -- 172.21.15.79:0/1443105957 learned_addr learned my addr 172.21.15.79:0/1443105957 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.830+0000 7f8cd6600640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd010ff10 0x7f8cd01a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd5c00640 1 -- 172.21.15.79:0/1443105957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd010ff10 msgr2=0x7f8cd01a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd5c00640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd010ff10 0x7f8cd01a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd5c00640 1 -- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cd0076100 msgr2=0x7f8cd019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd5c00640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cd0076100 0x7f8cd019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd5c00640 1 -- 172.21.15.79:0/1443105957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd01a23e0 con 0x7f8cd00757b0 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd5200640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cd0076100 0x7f8cd019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:18.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd5c00640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd00757b0 0x7f8cd019c470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4005940 tx=0x7f8cc4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:18.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cce000640 1 -- 172.21.15.79:0/1443105957 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc403f030 con 0x7f8cd00757b0 2024-09-21T02:35:18.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.831+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd01a2670 con 0x7f8cd00757b0 2024-09-21T02:35:18.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.832+0000 7f8cce000640 1 -- 172.21.15.79:0/1443105957 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cc4003aa0 con 0x7f8cd00757b0 2024-09-21T02:35:18.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.832+0000 7f8cce000640 1 -- 172.21.15.79:0/1443105957 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4035070 con 0x7f8cd00757b0 2024-09-21T02:35:18.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.832+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd01a8e30 con 0x7f8cd00757b0 2024-09-21T02:35:18.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.833+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd0076cc0 con 0x7f8cd00757b0 2024-09-21T02:35:18.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.836+0000 7f8cce000640 1 -- 172.21.15.79:0/1443105957 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8cc4042030 con 0x7f8cd00757b0 2024-09-21T02:35:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.837+0000 7f8cce000640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.837+0000 7f8cce000640 1 -- 172.21.15.79:0/1443105957 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8cc4107fe0 con 0x7f8cd00757b0 2024-09-21T02:35:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.837+0000 7f8cd5200640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:18.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.838+0000 7f8cd5200640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0101c60 tx=0x7f8cbc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:18.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:18.839+0000 7f8cce000640 1 -- 172.21.15.79:0/1443105957 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8cc40d2840 con 0x7f8cd00757b0 2024-09-21T02:35:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.074+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8cd0075bc0 con 0x7f8cd00757b0 2024-09-21T02:35:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.075+0000 7f8cce000640 1 -- 172.21.15.79:0/1443105957 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7f8cc40d7780 con 0x7f8cd00757b0 2024-09-21T02:35:19.076 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T02:35:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cb80b6590 msgr2=0x7f8cb80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0101c60 tx=0x7f8cbc005f90 comp rx=0 tx=0).stop 2024-09-21T02:35:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd00757b0 msgr2=0x7f8cd019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd00757b0 0x7f8cd019c470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4005940 tx=0x7f8cc4004270 comp rx=0 tx=0).stop 2024-09-21T02:35:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 shutdown_connections 2024-09-21T02:35:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cd010ff10 0x7f8cd01a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cd0076100 0x7f8cd019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 --2- 172.21.15.79:0/1443105957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd00757b0 0x7f8cd019c470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 >> 172.21.15.79:0/1443105957 conn(0x7f8cd00ff440 msgr2=0x7f8cd0109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 shutdown_connections 2024-09-21T02:35:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:19.078+0000 7f8cd7000640 1 -- 172.21.15.79:0/1443105957 wait complete. 2024-09-21T02:35:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:19 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1443105957' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:35:19.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:19 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1443105957' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:35:19.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:19 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1443105957' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:35:20.034 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T02:35:20.034 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T02:35:20.034 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-09-21T02:35:20.034 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T02:35:20.035 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-21T02:35:20.035 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T02:35:20.035 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T02:35:20.035 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T02:35:20.035 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-21T02:35:20.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:20.035 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-09-21T02:35:20.072 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:35:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:35:20.073 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T02:35:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:35:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T02:35:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42032sec preferred_lft 42032sec 2024-09-21T02:35:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link noprefixroute 2024-09-21T02:35:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:35:20.073 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T02:35:20.073 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:35:20.073 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:35:20.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-09-21T02:35:20.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-09-21T02:35:20.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-09-21T02:35:20.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T02:35:20.074 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:35:20.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:35:20.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:20 smithi079 ceph-mon[30788]: pgmap v403: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:35:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:20.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:20.300 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T02:35:20.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:20 smithi148 ceph-mon[34626]: pgmap v403: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:35:20.354 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-09-21T02:35:20.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:20.357 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-09-21T02:35:20.393 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-09-21T02:35:20.393 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T02:35:20.393 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T02:35:20.393 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T02:35:20.393 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T02:35:20.394 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:35:20.394 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:35:20.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T02:35:20.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T02:35:20.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T02:35:20.394 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:35:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:20 smithi098 ceph-mon[34832]: pgmap v403: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T02:35:20.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:35:20.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:20.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:20.590 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-09-21T02:35:20.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:20.626 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-09-21T02:35:20.701 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:35:20.701 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:35:20.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-21T02:35:20.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-21T02:35:20.702 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:35:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:35:20.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:20.880 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-21T02:35:20.881 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:35:20.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:35:21.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:21.106 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:35:21.106 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-21T02:35:21.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-09-21T02:35:21.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T02:35:21.107 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-21T02:35:21.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:35:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:21.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:35:21.273 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /tmp/cephfs 2024-09-21T02:35:21.308 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-21T02:35:21.308 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:35:21.308 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /tmp/cephfs 2024-09-21T02:35:21.382 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T02:35:21.383 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T02:35:21.383 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/269a1161-9dbe-40e4-b6ca-6cedc21ad806 2024-09-21T02:35:21.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:21.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/269a1161-9dbe-40e4-b6ca-6cedc21ad806 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-09-21T02:35:21.583 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-21T02:35:21.583 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-21T02:35:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:21 smithi079 ceph-mon[30788]: pgmap v404: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:21.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:21 smithi148 ceph-mon[34626]: pgmap v404: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:21.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:21 smithi098 ceph-mon[34832]: pgmap v404: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:22.242 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-21T02:35:22.242 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-21T02:35:22.242 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.98:6789,172.21.15.148:6789" 2024-09-21T02:35:22.242 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 0@56d10306-77c0-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/269a1161-9dbe-40e4-b6ca-6cedc21ad806 2024-09-21T02:35:22.242 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.79:6789/172.21.15.98:6789/172.21.15.148:6789" will pass to kernel 2024-09-21T02:35:22.247 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T02:35:22.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:35:22.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /tmp/cephfs 2024-09-21T02:35:22.307 DEBUG:teuthology.orchestra.run.smithi079:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T02:35:22.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:35:22.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:22.399 INFO:teuthology.orchestra.run.smithi079.stdout:client25238 2024-09-21T02:35:22.400 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:35:22.400 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:35:22.436 DEBUG:teuthology.orchestra.run.smithi079:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T02:35:22.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:35:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:22.567 INFO:teuthology.orchestra.run.smithi079.stdout:client25238 2024-09-21T02:35:22.567 DEBUG:teuthology.orchestra.run.smithi079:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T02:35:22.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:35:22.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:22.656 INFO:teuthology.orchestra.run.smithi079.stdout:client25238 2024-09-21T02:35:22.657 DEBUG:teuthology.orchestra.run.smithi079:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/56d10306-77c0-11ef-baf5-efdc52797490.client25238/status') 2024-09-21T02:35:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:35:22.758 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.25238 (3)172.21.15.79:0/626427225 2024-09-21T02:35:22.759 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2024-09-21T02:35:22.759 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2024-09-21T02:35:22.759 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2024-09-21T02:35:22.759 INFO:teuthology.orchestra.run.smithi079.stderr:70 bytes copied, 5.5607e-05 s, 1.3 MB/s 2024-09-21T02:35:22.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:35:22.769 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T02:35:22.780 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T02:35:22.788 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:35:22.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T02:35:22.793 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T02:35:22.804 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:35:22.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:35:23.177 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:23.696 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:23 smithi079 ceph-mon[30788]: pgmap v405: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:23.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:23 smithi148 ceph-mon[34626]: pgmap v405: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:23.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 -- 172.21.15.79:0/2028865232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3678109c40 msgr2=0x7f3678110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:23.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 --2- 172.21.15.79:0/2028865232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3678109c40 0x7f3678110470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3670009ca0 tx=0x7f367002a8e0 comp rx=0 tx=0).stop 2024-09-21T02:35:23.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 -- 172.21.15.79:0/2028865232 shutdown_connections 2024-09-21T02:35:23.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 --2- 172.21.15.79:0/2028865232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3678109c40 0x7f3678110470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:23.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 --2- 172.21.15.79:0/2028865232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36781092f0 0x7f3678109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:23.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 --2- 172.21.15.79:0/2028865232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36781039b0 0x7f3678103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:23.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 -- 172.21.15.79:0/2028865232 >> 172.21.15.79:0/2028865232 conn(0x7f36780ff440 msgr2=0x7f3678101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:23.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 -- 172.21.15.79:0/2028865232 shutdown_connections 2024-09-21T02:35:23.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.870+0000 7f367ca00640 1 -- 172.21.15.79:0/2028865232 wait complete. 2024-09-21T02:35:23.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.871+0000 7f367ca00640 1 Processor -- start 2024-09-21T02:35:23.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.871+0000 7f367ca00640 1 -- start start 2024-09-21T02:35:23.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f367ca00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36781039b0 0x7f367819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:23.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f367ca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36781092f0 0x7f367819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:23.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f367ca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3678109c40 0x7f36781a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:23.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f367ca00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3678113940 con 0x7f36781092f0 2024-09-21T02:35:23.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f367ca00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f36781137c0 con 0x7f36781039b0 2024-09-21T02:35:23.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f367ca00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3678113ac0 con 0x7f3678109c40 2024-09-21T02:35:23.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f3676a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36781092f0 0x7f367819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:23.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f3676a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36781092f0 0x7f367819cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56706/0 (socket says 172.21.15.79:56706) 2024-09-21T02:35:23.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f3676a00640 1 -- 172.21.15.79:0/104893565 learned_addr learned my addr 172.21.15.79:0/104893565 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:23.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f3677400640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36781039b0 0x7f367819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:23.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.872+0000 7f3677e00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3678109c40 0x7f36781a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:23.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f3676a00640 1 -- 172.21.15.79:0/104893565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3678109c40 msgr2=0x7f36781a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:23.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f3676a00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3678109c40 0x7f36781a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:23.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f3676a00640 1 -- 172.21.15.79:0/104893565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36781039b0 msgr2=0x7f367819c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:23.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f3676a00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36781039b0 0x7f367819c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f3676a00640 1 -- 172.21.15.79:0/104893565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36781a23e0 con 0x7f36781092f0 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f3676a00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36781092f0 0x7f367819cad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3664006fd0 tx=0x7f366400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f366fe00640 1 -- 172.21.15.79:0/104893565 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664015020 con 0x7f36781092f0 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36781a26d0 con 0x7f36781092f0 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f366fe00640 1 -- 172.21.15.79:0/104893565 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3664011ce0 con 0x7f36781092f0 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.873+0000 7f366fe00640 1 -- 172.21.15.79:0/104893565 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664010d90 con 0x7f36781092f0 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.874+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36781a8ef0 con 0x7f36781092f0 2024-09-21T02:35:23.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.875+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3678103dc0 con 0x7f36781092f0 2024-09-21T02:35:23.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.877+0000 7f366fe00640 1 -- 172.21.15.79:0/104893565 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3664018020 con 0x7f36781092f0 2024-09-21T02:35:23.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.878+0000 7f366fe00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f365c0b6540 0x7f365c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:23.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.878+0000 7f366fe00640 1 -- 172.21.15.79:0/104893565 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f36640e73a0 con 0x7f36781092f0 2024-09-21T02:35:23.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.879+0000 7f3677400640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f365c0b6540 0x7f365c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:23.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.879+0000 7f3677400640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f365c0b6540 0x7f365c0b8a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f366800abe0 tx=0x7f366800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:23.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:23.880+0000 7f366fe00640 1 -- 172.21.15.79:0/104893565 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f366401f020 con 0x7f36781092f0 2024-09-21T02:35:23.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:23 smithi098 ceph-mon[34832]: pgmap v405: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T02:35:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.064+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f367810f740 con 0x7f365c0b6540 2024-09-21T02:35:24.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.070+0000 7f366fe00640 1 -- 172.21.15.79:0/104893565 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340395 (secure 0 0 0) 0x7f367810f740 con 0x7f365c0b6540 2024-09-21T02:35:24.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:24.077 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T02:35:24.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f365c0b6540 msgr2=0x7f365c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f365c0b6540 0x7f365c0b8a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f366800abe0 tx=0x7f366800a2d0 comp rx=0 tx=0).stop 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36781092f0 msgr2=0x7f367819cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36781092f0 0x7f367819cad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3664006fd0 tx=0x7f366400b820 comp rx=0 tx=0).stop 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 shutdown_connections 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f365c0b6540 0x7f365c0b8a50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3678109c40 0x7f36781a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36781092f0 0x7f367819cad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 --2- 172.21.15.79:0/104893565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36781039b0 0x7f367819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 >> 172.21.15.79:0/104893565 conn(0x7f36780ff440 msgr2=0x7f3678108950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 shutdown_connections 2024-09-21T02:35:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:24.075+0000 7f367ca00640 1 -- 172.21.15.79:0/104893565 wait complete. 2024-09-21T02:35:24.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:24 smithi079 ceph-mon[30788]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:24.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:24 smithi148 ceph-mon[34626]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:24 smithi098 ceph-mon[34832]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:24.981 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-09-21T02:35:23.441689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660916,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":300,"num_read_kb":247,"num_write":224,"num_write_kb":2256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3021711,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":675,"ondisk_log_size":675,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387980,"kb_used_data":13772,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553844,"statfs":{"total":1151940427776,"available":1151543136256,"internally_reserved":0,"allocated":14102528,"data_stored":8029250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003559"},"pg_stats":[{"pgid":"2.1f","version":"78'4","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.422675+0000","last_change":"2024-09-21T02:34:31.422073+0000","last_active":"2024-09-21T02:34:31.422675+0000","last_peered":"2024-09-21T02:34:31.422675+0000","last_clean":"2024-09-21T02:34:31.422675+0000","last_became_active":"2024-09-21T02:34:31.412208+0000","last_became_peered":"2024-09-21T02:34:31.412208+0000","last_unstale":"2024-09-21T02:34:31.422675+0000","last_undegraded":"2024-09-21T02:34:31.422675+0000","last_fullsized":"2024-09-21T02:34:31.422675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.165710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628085+0000","last_change":"2024-09-21T02:32:41.473485+0000","last_active":"2024-09-21T02:34:59.628085+0000","last_peered":"2024-09-21T02:34:59.628085+0000","last_clean":"2024-09-21T02:34:59.628085+0000","last_became_active":"2024-09-21T02:32:41.473134+0000","last_became_peered":"2024-09-21T02:32:41.473134+0000","last_unstale":"2024-09-21T02:34:59.628085+0000","last_undegraded":"2024-09-21T02:34:59.628085+0000","last_fullsized":"2024-09-21T02:34:59.628085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415843+0000","last_change":"2024-09-21T02:32:50.687618+0000","last_active":"2024-09-21T02:34:31.415843+0000","last_peered":"2024-09-21T02:34:31.415843+0000","last_clean":"2024-09-21T02:34:31.415843+0000","last_became_active":"2024-09-21T02:32:50.687157+0000","last_became_peered":"2024-09-21T02:32:50.687157+0000","last_unstale":"2024-09-21T02:34:31.415843+0000","last_undegraded":"2024-09-21T02:34:31.415843+0000","last_fullsized":"2024-09-21T02:34:31.415843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:29.247287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409896+0000","last_change":"2024-09-21T02:32:38.512667+0000","last_active":"2024-09-21T02:34:31.409896+0000","last_peered":"2024-09-21T02:34:31.409896+0000","last_clean":"2024-09-21T02:34:31.409896+0000","last_became_active":"2024-09-21T02:32:38.512261+0000","last_became_peered":"2024-09-21T02:32:38.512261+0000","last_unstale":"2024-09-21T02:34:31.409896+0000","last_undegraded":"2024-09-21T02:34:31.409896+0000","last_fullsized":"2024-09-21T02:34:31.409896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:05.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644540+0000","last_change":"2024-09-21T02:32:41.481816+0000","last_active":"2024-09-21T02:34:59.644540+0000","last_peered":"2024-09-21T02:34:59.644540+0000","last_clean":"2024-09-21T02:34:59.644540+0000","last_became_active":"2024-09-21T02:32:41.478295+0000","last_became_peered":"2024-09-21T02:32:41.478295+0000","last_unstale":"2024-09-21T02:34:59.644540+0000","last_undegraded":"2024-09-21T02:34:59.644540+0000","last_fullsized":"2024-09-21T02:34:59.644540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:58.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409553+0000","last_change":"2024-09-21T02:32:50.692598+0000","last_active":"2024-09-21T02:34:31.409553+0000","last_peered":"2024-09-21T02:34:31.409553+0000","last_clean":"2024-09-21T02:34:31.409553+0000","last_became_active":"2024-09-21T02:32:50.692120+0000","last_became_peered":"2024-09-21T02:32:50.692120+0000","last_unstale":"2024-09-21T02:34:31.409553+0000","last_undegraded":"2024-09-21T02:34:31.409553+0000","last_fullsized":"2024-09-21T02:34:31.409553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:57.642195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411124+0000","last_change":"2024-09-21T02:32:38.435292+0000","last_active":"2024-09-21T02:34:31.411124+0000","last_peered":"2024-09-21T02:34:31.411124+0000","last_clean":"2024-09-21T02:34:31.411124+0000","last_became_active":"2024-09-21T02:32:38.434878+0000","last_became_peered":"2024-09-21T02:32:38.434878+0000","last_unstale":"2024-09-21T02:34:31.411124+0000","last_undegraded":"2024-09-21T02:34:31.411124+0000","last_fullsized":"2024-09-21T02:34:31.411124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:56.827844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.645301+0000","last_change":"2024-09-21T02:32:41.467834+0000","last_active":"2024-09-21T02:34:59.645301+0000","last_peered":"2024-09-21T02:34:59.645301+0000","last_clean":"2024-09-21T02:34:59.645301+0000","last_became_active":"2024-09-21T02:32:41.467440+0000","last_became_peered":"2024-09-21T02:32:41.467440+0000","last_unstale":"2024-09-21T02:34:59.645301+0000","last_undegraded":"2024-09-21T02:34:59.645301+0000","last_fullsized":"2024-09-21T02:34:59.645301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:16.857988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409856+0000","last_change":"2024-09-21T02:33:30.539580+0000","last_active":"2024-09-21T02:34:31.409856+0000","last_peered":"2024-09-21T02:34:31.409856+0000","last_clean":"2024-09-21T02:34:31.409856+0000","last_became_active":"2024-09-21T02:33:30.539088+0000","last_became_peered":"2024-09-21T02:33:30.539088+0000","last_unstale":"2024-09-21T02:34:31.409856+0000","last_undegraded":"2024-09-21T02:34:31.409856+0000","last_fullsized":"2024-09-21T02:34:31.409856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:42.437535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410618+0000","last_change":"2024-09-21T02:32:38.431645+0000","last_active":"2024-09-21T02:34:31.410618+0000","last_peered":"2024-09-21T02:34:31.410618+0000","last_clean":"2024-09-21T02:34:31.410618+0000","last_became_active":"2024-09-21T02:32:38.431069+0000","last_became_peered":"2024-09-21T02:32:38.431069+0000","last_unstale":"2024-09-21T02:34:31.410618+0000","last_undegraded":"2024-09-21T02:34:31.410618+0000","last_fullsized":"2024-09-21T02:34:31.410618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:34.893292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629116+0000","last_change":"2024-09-21T02:32:41.470506+0000","last_active":"2024-09-21T02:34:59.629116+0000","last_peered":"2024-09-21T02:34:59.629116+0000","last_clean":"2024-09-21T02:34:59.629116+0000","last_became_active":"2024-09-21T02:32:41.470165+0000","last_became_peered":"2024-09-21T02:32:41.470165+0000","last_unstale":"2024-09-21T02:34:59.629116+0000","last_undegraded":"2024-09-21T02:34:59.629116+0000","last_fullsized":"2024-09-21T02:34:59.629116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409749+0000","last_change":"2024-09-21T02:32:50.681923+0000","last_active":"2024-09-21T02:34:31.409749+0000","last_peered":"2024-09-21T02:34:31.409749+0000","last_clean":"2024-09-21T02:34:31.409749+0000","last_became_active":"2024-09-21T02:32:50.681374+0000","last_became_peered":"2024-09-21T02:32:50.681374+0000","last_unstale":"2024-09-21T02:34:31.409749+0000","last_undegraded":"2024-09-21T02:34:31.409749+0000","last_fullsized":"2024-09-21T02:34:31.409749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:46.060715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642808+0000","last_change":"2024-09-21T02:32:41.470550+0000","last_active":"2024-09-21T02:34:59.642808+0000","last_peered":"2024-09-21T02:34:59.642808+0000","last_clean":"2024-09-21T02:34:59.642808+0000","last_became_active":"2024-09-21T02:32:41.469282+0000","last_became_peered":"2024-09-21T02:32:41.469282+0000","last_unstale":"2024-09-21T02:34:59.642808+0000","last_undegraded":"2024-09-21T02:34:59.642808+0000","last_fullsized":"2024-09-21T02:34:59.642808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:34.619382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410335+0000","last_change":"2024-09-21T02:32:38.435261+0000","last_active":"2024-09-21T02:34:31.410335+0000","last_peered":"2024-09-21T02:34:31.410335+0000","last_clean":"2024-09-21T02:34:31.410335+0000","last_became_active":"2024-09-21T02:32:38.434795+0000","last_became_peered":"2024-09-21T02:32:38.434795+0000","last_unstale":"2024-09-21T02:34:31.410335+0000","last_undegraded":"2024-09-21T02:34:31.410335+0000","last_fullsized":"2024-09-21T02:34:31.410335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:05.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409940+0000","last_change":"2024-09-21T02:32:50.714657+0000","last_active":"2024-09-21T02:34:31.409940+0000","last_peered":"2024-09-21T02:34:31.409940+0000","last_clean":"2024-09-21T02:34:31.409940+0000","last_became_active":"2024-09-21T02:32:50.714077+0000","last_became_peered":"2024-09-21T02:32:50.714077+0000","last_unstale":"2024-09-21T02:34:31.409940+0000","last_undegraded":"2024-09-21T02:34:31.409940+0000","last_fullsized":"2024-09-21T02:34:31.409940+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.812785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638187+0000","last_change":"2024-09-21T02:32:41.473964+0000","last_active":"2024-09-21T02:34:59.638187+0000","last_peered":"2024-09-21T02:34:59.638187+0000","last_clean":"2024-09-21T02:34:59.638187+0000","last_became_active":"2024-09-21T02:32:41.473598+0000","last_became_peered":"2024-09-21T02:32:41.473598+0000","last_unstale":"2024-09-21T02:34:59.638187+0000","last_undegraded":"2024-09-21T02:34:59.638187+0000","last_fullsized":"2024-09-21T02:34:59.638187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415931+0000","last_change":"2024-09-21T02:32:38.435800+0000","last_active":"2024-09-21T02:34:31.415931+0000","last_peered":"2024-09-21T02:34:31.415931+0000","last_clean":"2024-09-21T02:34:31.415931+0000","last_became_active":"2024-09-21T02:32:38.434797+0000","last_became_peered":"2024-09-21T02:32:38.434797+0000","last_unstale":"2024-09-21T02:34:31.415931+0000","last_undegraded":"2024-09-21T02:34:31.415931+0000","last_fullsized":"2024-09-21T02:34:31.415931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:46.540597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410125+0000","last_change":"2024-09-21T02:32:50.693447+0000","last_active":"2024-09-21T02:34:31.410125+0000","last_peered":"2024-09-21T02:34:31.410125+0000","last_clean":"2024-09-21T02:34:31.410125+0000","last_became_active":"2024-09-21T02:32:50.692829+0000","last_became_peered":"2024-09-21T02:32:50.692829+0000","last_unstale":"2024-09-21T02:34:31.410125+0000","last_undegraded":"2024-09-21T02:34:31.410125+0000","last_fullsized":"2024-09-21T02:34:31.410125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:10.958279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.640800+0000","last_change":"2024-09-21T02:32:41.478053+0000","last_active":"2024-09-21T02:34:59.640800+0000","last_peered":"2024-09-21T02:34:59.640800+0000","last_clean":"2024-09-21T02:34:59.640800+0000","last_became_active":"2024-09-21T02:32:41.477631+0000","last_became_peered":"2024-09-21T02:32:41.477631+0000","last_unstale":"2024-09-21T02:34:59.640800+0000","last_undegraded":"2024-09-21T02:34:59.640800+0000","last_fullsized":"2024-09-21T02:34:59.640800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:19.548261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409617+0000","last_change":"2024-09-21T02:32:38.425388+0000","last_active":"2024-09-21T02:34:31.409617+0000","last_peered":"2024-09-21T02:34:31.409617+0000","last_clean":"2024-09-21T02:34:31.409617+0000","last_became_active":"2024-09-21T02:32:38.424975+0000","last_became_peered":"2024-09-21T02:32:38.424975+0000","last_unstale":"2024-09-21T02:34:31.409617+0000","last_undegraded":"2024-09-21T02:34:31.409617+0000","last_fullsized":"2024-09-21T02:34:31.409617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:43.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408187+0000","last_change":"2024-09-21T02:32:50.695406+0000","last_active":"2024-09-21T02:34:31.408187+0000","last_peered":"2024-09-21T02:34:31.408187+0000","last_clean":"2024-09-21T02:34:31.408187+0000","last_became_active":"2024-09-21T02:32:50.694958+0000","last_became_peered":"2024-09-21T02:32:50.694958+0000","last_unstale":"2024-09-21T02:34:31.408187+0000","last_undegraded":"2024-09-21T02:34:31.408187+0000","last_fullsized":"2024-09-21T02:34:31.408187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:49.038587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.586954+0000","last_change":"2024-09-21T02:32:41.463475+0000","last_active":"2024-09-21T02:34:59.586954+0000","last_peered":"2024-09-21T02:34:59.586954+0000","last_clean":"2024-09-21T02:34:59.586954+0000","last_became_active":"2024-09-21T02:32:41.462950+0000","last_became_peered":"2024-09-21T02:32:41.462950+0000","last_unstale":"2024-09-21T02:34:59.586954+0000","last_undegraded":"2024-09-21T02:34:59.586954+0000","last_fullsized":"2024-09-21T02:34:59.586954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:40.871522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415861+0000","last_change":"2024-09-21T02:32:38.512534+0000","last_active":"2024-09-21T02:34:31.415861+0000","last_peered":"2024-09-21T02:34:31.415861+0000","last_clean":"2024-09-21T02:34:31.415861+0000","last_became_active":"2024-09-21T02:32:38.512162+0000","last_became_peered":"2024-09-21T02:32:38.512162+0000","last_unstale":"2024-09-21T02:34:31.415861+0000","last_undegraded":"2024-09-21T02:34:31.415861+0000","last_fullsized":"2024-09-21T02:34:31.415861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:35.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410103+0000","last_change":"2024-09-21T02:32:50.716000+0000","last_active":"2024-09-21T02:34:31.410103+0000","last_peered":"2024-09-21T02:34:31.410103+0000","last_clean":"2024-09-21T02:34:31.410103+0000","last_became_active":"2024-09-21T02:32:50.715371+0000","last_became_peered":"2024-09-21T02:32:50.715371+0000","last_unstale":"2024-09-21T02:34:31.410103+0000","last_undegraded":"2024-09-21T02:34:31.410103+0000","last_fullsized":"2024-09-21T02:34:31.410103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:54.490957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642642+0000","last_change":"2024-09-21T02:32:41.479797+0000","last_active":"2024-09-21T02:34:59.642642+0000","last_peered":"2024-09-21T02:34:59.642642+0000","last_clean":"2024-09-21T02:34:59.642642+0000","last_became_active":"2024-09-21T02:32:41.479400+0000","last_became_peered":"2024-09-21T02:32:41.479400+0000","last_unstale":"2024-09-21T02:34:59.642642+0000","last_undegraded":"2024-09-21T02:34:59.642642+0000","last_fullsized":"2024-09-21T02:34:59.642642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:34.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410512+0000","last_change":"2024-09-21T02:32:38.748844+0000","last_active":"2024-09-21T02:34:31.410512+0000","last_peered":"2024-09-21T02:34:31.410512+0000","last_clean":"2024-09-21T02:34:31.410512+0000","last_became_active":"2024-09-21T02:32:38.748428+0000","last_became_peered":"2024-09-21T02:32:38.748428+0000","last_unstale":"2024-09-21T02:34:31.410512+0000","last_undegraded":"2024-09-21T02:34:31.410512+0000","last_fullsized":"2024-09-21T02:34:31.410512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:01.300290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415969+0000","last_change":"2024-09-21T02:32:50.681667+0000","last_active":"2024-09-21T02:34:31.415969+0000","last_peered":"2024-09-21T02:34:31.415969+0000","last_clean":"2024-09-21T02:34:31.415969+0000","last_became_active":"2024-09-21T02:32:50.681113+0000","last_became_peered":"2024-09-21T02:32:50.681113+0000","last_unstale":"2024-09-21T02:34:31.415969+0000","last_undegraded":"2024-09-21T02:34:31.415969+0000","last_fullsized":"2024-09-21T02:34:31.415969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:20.881199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626269+0000","last_change":"2024-09-21T02:32:41.466320+0000","last_active":"2024-09-21T02:34:59.626269+0000","last_peered":"2024-09-21T02:34:59.626269+0000","last_clean":"2024-09-21T02:34:59.626269+0000","last_became_active":"2024-09-21T02:32:41.462700+0000","last_became_peered":"2024-09-21T02:32:41.462700+0000","last_unstale":"2024-09-21T02:34:59.626269+0000","last_undegraded":"2024-09-21T02:34:59.626269+0000","last_fullsized":"2024-09-21T02:34:59.626269+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:05.324192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:47.474143+0000","last_change":"2024-09-21T02:32:38.432478+0000","last_active":"2024-09-21T02:34:47.474143+0000","last_peered":"2024-09-21T02:34:47.474143+0000","last_clean":"2024-09-21T02:34:47.474143+0000","last_became_active":"2024-09-21T02:32:38.431107+0000","last_became_peered":"2024-09-21T02:32:38.431107+0000","last_unstale":"2024-09-21T02:34:47.474143+0000","last_undegraded":"2024-09-21T02:34:47.474143+0000","last_fullsized":"2024-09-21T02:34:47.474143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:04.629078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408632+0000","last_change":"2024-09-21T02:32:50.715335+0000","last_active":"2024-09-21T02:34:31.408632+0000","last_peered":"2024-09-21T02:34:31.408632+0000","last_clean":"2024-09-21T02:34:31.408632+0000","last_became_active":"2024-09-21T02:32:50.714117+0000","last_became_peered":"2024-09-21T02:32:50.714117+0000","last_unstale":"2024-09-21T02:34:31.408632+0000","last_undegraded":"2024-09-21T02:34:31.408632+0000","last_fullsized":"2024-09-21T02:34:31.408632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:53.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.636091+0000","last_change":"2024-09-21T02:32:41.467613+0000","last_active":"2024-09-21T02:34:59.636091+0000","last_peered":"2024-09-21T02:34:59.636091+0000","last_clean":"2024-09-21T02:34:59.636091+0000","last_became_active":"2024-09-21T02:32:41.467136+0000","last_became_peered":"2024-09-21T02:32:41.467136+0000","last_unstale":"2024-09-21T02:34:59.636091+0000","last_undegraded":"2024-09-21T02:34:59.636091+0000","last_fullsized":"2024-09-21T02:34:59.636091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:16.929257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411240+0000","last_change":"2024-09-21T02:32:38.513591+0000","last_active":"2024-09-21T02:34:31.411240+0000","last_peered":"2024-09-21T02:34:31.411240+0000","last_clean":"2024-09-21T02:34:31.411240+0000","last_became_active":"2024-09-21T02:32:38.513169+0000","last_became_peered":"2024-09-21T02:32:38.513169+0000","last_unstale":"2024-09-21T02:34:31.411240+0000","last_undegraded":"2024-09-21T02:34:31.411240+0000","last_fullsized":"2024-09-21T02:34:31.411240+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:24.038894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407303+0000","last_change":"2024-09-21T02:32:50.680165+0000","last_active":"2024-09-21T02:34:31.407303+0000","last_peered":"2024-09-21T02:34:31.407303+0000","last_clean":"2024-09-21T02:34:31.407303+0000","last_became_active":"2024-09-21T02:32:50.679730+0000","last_became_peered":"2024-09-21T02:32:50.679730+0000","last_unstale":"2024-09-21T02:34:31.407303+0000","last_undegraded":"2024-09-21T02:34:31.407303+0000","last_fullsized":"2024-09-21T02:34:31.407303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:25.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633830+0000","last_change":"2024-09-21T02:32:41.483355+0000","last_active":"2024-09-21T02:34:59.633830+0000","last_peered":"2024-09-21T02:34:59.633830+0000","last_clean":"2024-09-21T02:34:59.633830+0000","last_became_active":"2024-09-21T02:32:41.482786+0000","last_became_peered":"2024-09-21T02:32:41.482786+0000","last_unstale":"2024-09-21T02:34:59.633830+0000","last_undegraded":"2024-09-21T02:34:59.633830+0000","last_fullsized":"2024-09-21T02:34:59.633830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:46.277233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407870+0000","last_change":"2024-09-21T02:32:38.515173+0000","last_active":"2024-09-21T02:34:31.407870+0000","last_peered":"2024-09-21T02:34:31.407870+0000","last_clean":"2024-09-21T02:34:31.407870+0000","last_became_active":"2024-09-21T02:32:38.513341+0000","last_became_peered":"2024-09-21T02:32:38.513341+0000","last_unstale":"2024-09-21T02:34:31.407870+0000","last_undegraded":"2024-09-21T02:34:31.407870+0000","last_fullsized":"2024-09-21T02:34:31.407870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.988203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410834+0000","last_change":"2024-09-21T02:32:50.714389+0000","last_active":"2024-09-21T02:34:31.410834+0000","last_peered":"2024-09-21T02:34:31.410834+0000","last_clean":"2024-09-21T02:34:31.410834+0000","last_became_active":"2024-09-21T02:32:50.713859+0000","last_became_peered":"2024-09-21T02:32:50.713859+0000","last_unstale":"2024-09-21T02:34:31.410834+0000","last_undegraded":"2024-09-21T02:34:31.410834+0000","last_fullsized":"2024-09-21T02:34:31.410834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:41.315205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638243+0000","last_change":"2024-09-21T02:33:30.613550+0000","last_active":"2024-09-21T02:34:59.638243+0000","last_peered":"2024-09-21T02:34:59.638243+0000","last_clean":"2024-09-21T02:34:59.638243+0000","last_became_active":"2024-09-21T02:33:30.613216+0000","last_became_peered":"2024-09-21T02:33:30.613216+0000","last_unstale":"2024-09-21T02:34:59.638243+0000","last_undegraded":"2024-09-21T02:34:59.638243+0000","last_fullsized":"2024-09-21T02:34:59.638243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:11.076824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411976+0000","last_change":"2024-09-21T02:32:38.428428+0000","last_active":"2024-09-21T02:34:31.411976+0000","last_peered":"2024-09-21T02:34:31.411976+0000","last_clean":"2024-09-21T02:34:31.411976+0000","last_became_active":"2024-09-21T02:32:38.428066+0000","last_became_peered":"2024-09-21T02:32:38.428066+0000","last_unstale":"2024-09-21T02:34:31.411976+0000","last_undegraded":"2024-09-21T02:34:31.411976+0000","last_fullsized":"2024-09-21T02:34:31.411976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:45.601916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601270+0000","last_change":"2024-09-21T02:32:50.691139+0000","last_active":"2024-09-21T02:34:31.601270+0000","last_peered":"2024-09-21T02:34:31.601270+0000","last_clean":"2024-09-21T02:34:31.601270+0000","last_became_active":"2024-09-21T02:32:50.690653+0000","last_became_peered":"2024-09-21T02:32:50.690653+0000","last_unstale":"2024-09-21T02:34:31.601270+0000","last_undegraded":"2024-09-21T02:34:31.601270+0000","last_fullsized":"2024-09-21T02:34:31.601270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:43.852916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.620886+0000","last_change":"2024-09-21T02:32:41.466857+0000","last_active":"2024-09-21T02:34:59.620886+0000","last_peered":"2024-09-21T02:34:59.620886+0000","last_clean":"2024-09-21T02:34:59.620886+0000","last_became_active":"2024-09-21T02:32:41.466467+0000","last_became_peered":"2024-09-21T02:32:41.466467+0000","last_unstale":"2024-09-21T02:34:59.620886+0000","last_undegraded":"2024-09-21T02:34:59.620886+0000","last_fullsized":"2024-09-21T02:34:59.620886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:29.369150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600894+0000","last_change":"2024-09-21T02:32:38.513999+0000","last_active":"2024-09-21T02:34:31.600894+0000","last_peered":"2024-09-21T02:34:31.600894+0000","last_clean":"2024-09-21T02:34:31.600894+0000","last_became_active":"2024-09-21T02:32:38.513605+0000","last_became_peered":"2024-09-21T02:32:38.513605+0000","last_unstale":"2024-09-21T02:34:31.600894+0000","last_undegraded":"2024-09-21T02:34:31.600894+0000","last_fullsized":"2024-09-21T02:34:31.600894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:45.616961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601236+0000","last_change":"2024-09-21T02:32:50.714830+0000","last_active":"2024-09-21T02:34:31.601236+0000","last_peered":"2024-09-21T02:34:31.601236+0000","last_clean":"2024-09-21T02:34:31.601236+0000","last_became_active":"2024-09-21T02:32:50.714166+0000","last_became_peered":"2024-09-21T02:32:50.714166+0000","last_unstale":"2024-09-21T02:34:31.601236+0000","last_undegraded":"2024-09-21T02:34:31.601236+0000","last_fullsized":"2024-09-21T02:34:31.601236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:35.418689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.632282+0000","last_change":"2024-09-21T02:32:41.468695+0000","last_active":"2024-09-21T02:34:59.632282+0000","last_peered":"2024-09-21T02:34:59.632282+0000","last_clean":"2024-09-21T02:34:59.632282+0000","last_became_active":"2024-09-21T02:32:41.468349+0000","last_became_peered":"2024-09-21T02:32:41.468349+0000","last_unstale":"2024-09-21T02:34:59.632282+0000","last_undegraded":"2024-09-21T02:34:59.632282+0000","last_fullsized":"2024-09-21T02:34:59.632282+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:51.935336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411151+0000","last_change":"2024-09-21T02:32:38.431187+0000","last_active":"2024-09-21T02:34:31.411151+0000","last_peered":"2024-09-21T02:34:31.411151+0000","last_clean":"2024-09-21T02:34:31.411151+0000","last_became_active":"2024-09-21T02:32:38.430790+0000","last_became_peered":"2024-09-21T02:32:38.430790+0000","last_unstale":"2024-09-21T02:34:31.411151+0000","last_undegraded":"2024-09-21T02:34:31.411151+0000","last_fullsized":"2024-09-21T02:34:31.411151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:05.004479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411407+0000","last_change":"2024-09-21T02:32:50.715728+0000","last_active":"2024-09-21T02:34:31.411407+0000","last_peered":"2024-09-21T02:34:31.411407+0000","last_clean":"2024-09-21T02:34:31.411407+0000","last_became_active":"2024-09-21T02:32:50.715329+0000","last_became_peered":"2024-09-21T02:32:50.715329+0000","last_unstale":"2024-09-21T02:34:31.411407+0000","last_undegraded":"2024-09-21T02:34:31.411407+0000","last_fullsized":"2024-09-21T02:34:31.411407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.790489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642681+0000","last_change":"2024-09-21T02:32:41.474885+0000","last_active":"2024-09-21T02:34:59.642681+0000","last_peered":"2024-09-21T02:34:59.642681+0000","last_clean":"2024-09-21T02:34:59.642681+0000","last_became_active":"2024-09-21T02:32:41.474599+0000","last_became_peered":"2024-09-21T02:32:41.474599+0000","last_unstale":"2024-09-21T02:34:59.642681+0000","last_undegraded":"2024-09-21T02:34:59.642681+0000","last_fullsized":"2024-09-21T02:34:59.642681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:43.006829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410433+0000","last_change":"2024-09-21T02:32:38.431168+0000","last_active":"2024-09-21T02:34:31.410433+0000","last_peered":"2024-09-21T02:34:31.410433+0000","last_clean":"2024-09-21T02:34:31.410433+0000","last_became_active":"2024-09-21T02:32:38.430743+0000","last_became_peered":"2024-09-21T02:32:38.430743+0000","last_unstale":"2024-09-21T02:34:31.410433+0000","last_undegraded":"2024-09-21T02:34:31.410433+0000","last_fullsized":"2024-09-21T02:34:31.410433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:54.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411399+0000","last_change":"2024-09-21T02:31:20.822638+0000","last_active":"2024-09-21T02:34:31.411399+0000","last_peered":"2024-09-21T02:34:31.411399+0000","last_clean":"2024-09-21T02:34:31.411399+0000","last_became_active":"2024-09-21T02:31:20.816679+0000","last_became_peered":"2024-09-21T02:31:20.816679+0000","last_unstale":"2024-09-21T02:34:31.411399+0000","last_undegraded":"2024-09-21T02:34:31.411399+0000","last_fullsized":"2024-09-21T02:34:31.411399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_clean_scrub_stamp":"2024-09-21T02:27:32.360535+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:51.568101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411722+0000","last_change":"2024-09-21T02:32:50.698437+0000","last_active":"2024-09-21T02:34:31.411722+0000","last_peered":"2024-09-21T02:34:31.411722+0000","last_clean":"2024-09-21T02:34:31.411722+0000","last_became_active":"2024-09-21T02:32:50.697814+0000","last_became_peered":"2024-09-21T02:32:50.697814+0000","last_unstale":"2024-09-21T02:34:31.411722+0000","last_undegraded":"2024-09-21T02:34:31.411722+0000","last_fullsized":"2024-09-21T02:34:31.411722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:51.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643644+0000","last_change":"2024-09-21T02:32:41.469539+0000","last_active":"2024-09-21T02:34:59.643644+0000","last_peered":"2024-09-21T02:34:59.643644+0000","last_clean":"2024-09-21T02:34:59.643644+0000","last_became_active":"2024-09-21T02:32:41.469060+0000","last_became_peered":"2024-09-21T02:32:41.469060+0000","last_unstale":"2024-09-21T02:34:59.643644+0000","last_undegraded":"2024-09-21T02:34:59.643644+0000","last_fullsized":"2024-09-21T02:34:59.643644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:36.699360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416542+0000","last_change":"2024-09-21T02:32:38.748487+0000","last_active":"2024-09-21T02:34:31.416542+0000","last_peered":"2024-09-21T02:34:31.416542+0000","last_clean":"2024-09-21T02:34:31.416542+0000","last_became_active":"2024-09-21T02:32:38.747956+0000","last_became_peered":"2024-09-21T02:32:38.747956+0000","last_unstale":"2024-09-21T02:34:31.416542+0000","last_undegraded":"2024-09-21T02:34:31.416542+0000","last_fullsized":"2024-09-21T02:34:31.416542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:15.745119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415910+0000","last_change":"2024-09-21T02:32:50.687412+0000","last_active":"2024-09-21T02:34:31.415910+0000","last_peered":"2024-09-21T02:34:31.415910+0000","last_clean":"2024-09-21T02:34:31.415910+0000","last_became_active":"2024-09-21T02:32:50.686819+0000","last_became_peered":"2024-09-21T02:32:50.686819+0000","last_unstale":"2024-09-21T02:34:31.415910+0000","last_undegraded":"2024-09-21T02:34:31.415910+0000","last_fullsized":"2024-09-21T02:34:31.415910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:28.830619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.621093+0000","last_change":"2024-09-21T02:32:41.467719+0000","last_active":"2024-09-21T02:34:59.621093+0000","last_peered":"2024-09-21T02:34:59.621093+0000","last_clean":"2024-09-21T02:34:59.621093+0000","last_became_active":"2024-09-21T02:32:41.467332+0000","last_became_peered":"2024-09-21T02:32:41.467332+0000","last_unstale":"2024-09-21T02:34:59.621093+0000","last_undegraded":"2024-09-21T02:34:59.621093+0000","last_fullsized":"2024-09-21T02:34:59.621093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:06.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411998+0000","last_change":"2024-09-21T02:32:38.428553+0000","last_active":"2024-09-21T02:34:31.411998+0000","last_peered":"2024-09-21T02:34:31.411998+0000","last_clean":"2024-09-21T02:34:31.411998+0000","last_became_active":"2024-09-21T02:32:38.428159+0000","last_became_peered":"2024-09-21T02:32:38.428159+0000","last_unstale":"2024-09-21T02:34:31.411998+0000","last_undegraded":"2024-09-21T02:34:31.411998+0000","last_fullsized":"2024-09-21T02:34:31.411998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:17.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602179+0000","last_change":"2024-09-21T02:32:50.694290+0000","last_active":"2024-09-21T02:34:31.602179+0000","last_peered":"2024-09-21T02:34:31.602179+0000","last_clean":"2024-09-21T02:34:31.602179+0000","last_became_active":"2024-09-21T02:32:50.693794+0000","last_became_peered":"2024-09-21T02:32:50.693794+0000","last_unstale":"2024-09-21T02:34:31.602179+0000","last_undegraded":"2024-09-21T02:34:31.602179+0000","last_fullsized":"2024-09-21T02:34:31.602179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:07.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626360+0000","last_change":"2024-09-21T02:32:41.466802+0000","last_active":"2024-09-21T02:34:59.626360+0000","last_peered":"2024-09-21T02:34:59.626360+0000","last_clean":"2024-09-21T02:34:59.626360+0000","last_became_active":"2024-09-21T02:32:41.465348+0000","last_became_peered":"2024-09-21T02:32:41.465348+0000","last_unstale":"2024-09-21T02:34:59.626360+0000","last_undegraded":"2024-09-21T02:34:59.626360+0000","last_fullsized":"2024-09-21T02:34:59.626360+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:23.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601415+0000","last_change":"2024-09-21T02:32:38.435725+0000","last_active":"2024-09-21T02:34:31.601415+0000","last_peered":"2024-09-21T02:34:31.601415+0000","last_clean":"2024-09-21T02:34:31.601415+0000","last_became_active":"2024-09-21T02:32:38.434688+0000","last_became_peered":"2024-09-21T02:32:38.434688+0000","last_unstale":"2024-09-21T02:34:31.601415+0000","last_undegraded":"2024-09-21T02:34:31.601415+0000","last_fullsized":"2024-09-21T02:34:31.601415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:27.829955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410365+0000","last_change":"2024-09-21T02:33:31.041957+0000","last_active":"2024-09-21T02:34:31.410365+0000","last_peered":"2024-09-21T02:34:31.410365+0000","last_clean":"2024-09-21T02:34:31.410365+0000","last_became_active":"2024-09-21T02:33:31.041160+0000","last_became_peered":"2024-09-21T02:33:31.041160+0000","last_unstale":"2024-09-21T02:34:31.410365+0000","last_undegraded":"2024-09-21T02:34:31.410365+0000","last_fullsized":"2024-09-21T02:34:31.410365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.226199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7,1],"acting":[8,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.627975+0000","last_change":"2024-09-21T02:32:41.474796+0000","last_active":"2024-09-21T02:34:59.627975+0000","last_peered":"2024-09-21T02:34:59.627975+0000","last_clean":"2024-09-21T02:34:59.627975+0000","last_became_active":"2024-09-21T02:32:41.474377+0000","last_became_peered":"2024-09-21T02:32:41.474377+0000","last_unstale":"2024-09-21T02:34:59.627975+0000","last_undegraded":"2024-09-21T02:34:59.627975+0000","last_fullsized":"2024-09-21T02:34:59.627975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.418508+0000","last_change":"2024-09-21T02:34:31.418421+0000","last_active":"2024-09-21T02:34:31.418508+0000","last_peered":"2024-09-21T02:34:31.418508+0000","last_clean":"2024-09-21T02:34:31.418508+0000","last_became_active":"2024-09-21T02:34:31.413206+0000","last_became_peered":"2024-09-21T02:34:31.413206+0000","last_unstale":"2024-09-21T02:34:31.418508+0000","last_undegraded":"2024-09-21T02:34:31.418508+0000","last_fullsized":"2024-09-21T02:34:31.418508+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:33.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410536+0000","last_change":"2024-09-21T02:32:50.685932+0000","last_active":"2024-09-21T02:34:31.410536+0000","last_peered":"2024-09-21T02:34:31.410536+0000","last_clean":"2024-09-21T02:34:31.410536+0000","last_became_active":"2024-09-21T02:32:50.685584+0000","last_became_peered":"2024-09-21T02:32:50.685584+0000","last_unstale":"2024-09-21T02:34:31.410536+0000","last_undegraded":"2024-09-21T02:34:31.410536+0000","last_fullsized":"2024-09-21T02:34:31.410536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:42.118046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628583+0000","last_change":"2024-09-21T02:33:31.041507+0000","last_active":"2024-09-21T02:34:59.628583+0000","last_peered":"2024-09-21T02:34:59.628583+0000","last_clean":"2024-09-21T02:34:59.628583+0000","last_became_active":"2024-09-21T02:33:31.040982+0000","last_became_peered":"2024-09-21T02:33:31.040982+0000","last_unstale":"2024-09-21T02:34:59.628583+0000","last_undegraded":"2024-09-21T02:34:59.628583+0000","last_fullsized":"2024-09-21T02:34:59.628583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:17.608426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410182+0000","last_change":"2024-09-21T02:32:38.512557+0000","last_active":"2024-09-21T02:34:31.410182+0000","last_peered":"2024-09-21T02:34:31.410182+0000","last_clean":"2024-09-21T02:34:31.410182+0000","last_became_active":"2024-09-21T02:32:38.512069+0000","last_became_peered":"2024-09-21T02:32:38.512069+0000","last_unstale":"2024-09-21T02:34:31.410182+0000","last_undegraded":"2024-09-21T02:34:31.410182+0000","last_fullsized":"2024-09-21T02:34:31.410182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:55.038548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601304+0000","last_change":"2024-09-21T02:32:50.698539+0000","last_active":"2024-09-21T02:34:31.601304+0000","last_peered":"2024-09-21T02:34:31.601304+0000","last_clean":"2024-09-21T02:34:31.601304+0000","last_became_active":"2024-09-21T02:32:50.698107+0000","last_became_peered":"2024-09-21T02:32:50.698107+0000","last_unstale":"2024-09-21T02:34:31.601304+0000","last_undegraded":"2024-09-21T02:34:31.601304+0000","last_fullsized":"2024-09-21T02:34:31.601304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:43.141885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629232+0000","last_change":"2024-09-21T02:32:41.468472+0000","last_active":"2024-09-21T02:34:59.629232+0000","last_peered":"2024-09-21T02:34:59.629232+0000","last_clean":"2024-09-21T02:34:59.629232+0000","last_became_active":"2024-09-21T02:32:41.468039+0000","last_became_peered":"2024-09-21T02:32:41.468039+0000","last_unstale":"2024-09-21T02:34:59.629232+0000","last_undegraded":"2024-09-21T02:34:59.629232+0000","last_fullsized":"2024-09-21T02:34:59.629232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:00.501173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410057+0000","last_change":"2024-09-21T02:32:38.431613+0000","last_active":"2024-09-21T02:34:31.410057+0000","last_peered":"2024-09-21T02:34:31.410057+0000","last_clean":"2024-09-21T02:34:31.410057+0000","last_became_active":"2024-09-21T02:32:38.431128+0000","last_became_peered":"2024-09-21T02:32:38.431128+0000","last_unstale":"2024-09-21T02:34:31.410057+0000","last_undegraded":"2024-09-21T02:34:31.410057+0000","last_fullsized":"2024-09-21T02:34:31.410057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:09.400651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408210+0000","last_change":"2024-09-21T02:32:50.691401+0000","last_active":"2024-09-21T02:34:31.408210+0000","last_peered":"2024-09-21T02:34:31.408210+0000","last_clean":"2024-09-21T02:34:31.408210+0000","last_became_active":"2024-09-21T02:32:50.688202+0000","last_became_peered":"2024-09-21T02:32:50.688202+0000","last_unstale":"2024-09-21T02:34:31.408210+0000","last_undegraded":"2024-09-21T02:34:31.408210+0000","last_fullsized":"2024-09-21T02:34:31.408210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:42.516887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633862+0000","last_change":"2024-09-21T02:32:41.475760+0000","last_active":"2024-09-21T02:34:59.633862+0000","last_peered":"2024-09-21T02:34:59.633862+0000","last_clean":"2024-09-21T02:34:59.633862+0000","last_became_active":"2024-09-21T02:32:41.475381+0000","last_became_peered":"2024-09-21T02:32:41.475381+0000","last_unstale":"2024-09-21T02:34:59.633862+0000","last_undegraded":"2024-09-21T02:34:59.633862+0000","last_fullsized":"2024-09-21T02:34:59.633862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.070064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411007+0000","last_change":"2024-09-21T02:32:38.424789+0000","last_active":"2024-09-21T02:34:31.411007+0000","last_peered":"2024-09-21T02:34:31.411007+0000","last_clean":"2024-09-21T02:34:31.411007+0000","last_became_active":"2024-09-21T02:32:38.424275+0000","last_became_peered":"2024-09-21T02:32:38.424275+0000","last_unstale":"2024-09-21T02:34:31.411007+0000","last_undegraded":"2024-09-21T02:34:31.411007+0000","last_fullsized":"2024-09-21T02:34:31.411007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:50.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407352+0000","last_change":"2024-09-21T02:32:50.692496+0000","last_active":"2024-09-21T02:34:31.407352+0000","last_peered":"2024-09-21T02:34:31.407352+0000","last_clean":"2024-09-21T02:34:31.407352+0000","last_became_active":"2024-09-21T02:32:50.692055+0000","last_became_peered":"2024-09-21T02:32:50.692055+0000","last_unstale":"2024-09-21T02:34:31.407352+0000","last_undegraded":"2024-09-21T02:34:31.407352+0000","last_fullsized":"2024-09-21T02:34:31.407352+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:25.433298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635108+0000","last_change":"2024-09-21T02:32:41.475732+0000","last_active":"2024-09-21T02:34:59.635108+0000","last_peered":"2024-09-21T02:34:59.635108+0000","last_clean":"2024-09-21T02:34:59.635108+0000","last_became_active":"2024-09-21T02:32:41.475395+0000","last_became_peered":"2024-09-21T02:32:41.475395+0000","last_unstale":"2024-09-21T02:34:59.635108+0000","last_undegraded":"2024-09-21T02:34:59.635108+0000","last_fullsized":"2024-09-21T02:34:59.635108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:26.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416279+0000","last_change":"2024-09-21T02:32:38.434080+0000","last_active":"2024-09-21T02:34:31.416279+0000","last_peered":"2024-09-21T02:34:31.416279+0000","last_clean":"2024-09-21T02:34:31.416279+0000","last_became_active":"2024-09-21T02:32:38.433625+0000","last_became_peered":"2024-09-21T02:32:38.433625+0000","last_unstale":"2024-09-21T02:34:31.416279+0000","last_undegraded":"2024-09-21T02:34:31.416279+0000","last_fullsized":"2024-09-21T02:34:31.416279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:11.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411576+0000","last_change":"2024-09-21T02:32:50.687555+0000","last_active":"2024-09-21T02:34:31.411576+0000","last_peered":"2024-09-21T02:34:31.411576+0000","last_clean":"2024-09-21T02:34:31.411576+0000","last_became_active":"2024-09-21T02:32:50.686979+0000","last_became_peered":"2024-09-21T02:32:50.686979+0000","last_unstale":"2024-09-21T02:34:31.411576+0000","last_undegraded":"2024-09-21T02:34:31.411576+0000","last_fullsized":"2024-09-21T02:34:31.411576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:01.136515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625187+0000","last_change":"2024-09-21T02:32:41.463688+0000","last_active":"2024-09-21T02:34:59.625187+0000","last_peered":"2024-09-21T02:34:59.625187+0000","last_clean":"2024-09-21T02:34:59.625187+0000","last_became_active":"2024-09-21T02:32:41.463306+0000","last_became_peered":"2024-09-21T02:32:41.463306+0000","last_unstale":"2024-09-21T02:34:59.625187+0000","last_undegraded":"2024-09-21T02:34:59.625187+0000","last_fullsized":"2024-09-21T02:34:59.625187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:46.217029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'37","reported_seq":316,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:35:17.493030+0000","last_change":"2024-09-21T02:34:31.423753+0000","last_active":"2024-09-21T02:35:17.493030+0000","last_peered":"2024-09-21T02:35:17.493030+0000","last_clean":"2024-09-21T02:35:17.493030+0000","last_became_active":"2024-09-21T02:34:31.417307+0000","last_became_peered":"2024-09-21T02:34:31.417307+0000","last_unstale":"2024-09-21T02:35:17.493030+0000","last_undegraded":"2024-09-21T02:35:17.493030+0000","last_fullsized":"2024-09-21T02:35:17.493030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:29.538505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69516,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":219,"num_read_kb":178,"num_write":37,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":69267,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412671+0000","last_change":"2024-09-21T02:33:30.538615+0000","last_active":"2024-09-21T02:34:31.412671+0000","last_peered":"2024-09-21T02:34:31.412671+0000","last_clean":"2024-09-21T02:34:31.412671+0000","last_became_active":"2024-09-21T02:33:30.538046+0000","last_became_peered":"2024-09-21T02:33:30.538046+0000","last_unstale":"2024-09-21T02:34:31.412671+0000","last_undegraded":"2024-09-21T02:34:31.412671+0000","last_fullsized":"2024-09-21T02:34:31.412671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:04.235706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644082+0000","last_change":"2024-09-21T02:32:41.470318+0000","last_active":"2024-09-21T02:34:59.644082+0000","last_peered":"2024-09-21T02:34:59.644082+0000","last_clean":"2024-09-21T02:34:59.644082+0000","last_became_active":"2024-09-21T02:32:41.466804+0000","last_became_peered":"2024-09-21T02:32:41.466804+0000","last_unstale":"2024-09-21T02:34:59.644082+0000","last_undegraded":"2024-09-21T02:34:59.644082+0000","last_fullsized":"2024-09-21T02:34:59.644082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411855+0000","last_change":"2024-09-21T02:32:38.514901+0000","last_active":"2024-09-21T02:34:31.411855+0000","last_peered":"2024-09-21T02:34:31.411855+0000","last_clean":"2024-09-21T02:34:31.411855+0000","last_became_active":"2024-09-21T02:32:38.514497+0000","last_became_peered":"2024-09-21T02:32:38.514497+0000","last_unstale":"2024-09-21T02:34:31.411855+0000","last_undegraded":"2024-09-21T02:34:31.411855+0000","last_fullsized":"2024-09-21T02:34:31.411855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:02.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410240+0000","last_change":"2024-09-21T02:33:31.041566+0000","last_active":"2024-09-21T02:34:31.410240+0000","last_peered":"2024-09-21T02:34:31.410240+0000","last_clean":"2024-09-21T02:34:31.410240+0000","last_became_active":"2024-09-21T02:33:31.041041+0000","last_became_peered":"2024-09-21T02:33:31.041041+0000","last_unstale":"2024-09-21T02:34:31.410240+0000","last_undegraded":"2024-09-21T02:34:31.410240+0000","last_fullsized":"2024-09-21T02:34:31.410240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:00.236406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638081+0000","last_change":"2024-09-21T02:32:41.483502+0000","last_active":"2024-09-21T02:34:59.638081+0000","last_peered":"2024-09-21T02:34:59.638081+0000","last_clean":"2024-09-21T02:34:59.638081+0000","last_became_active":"2024-09-21T02:32:41.483116+0000","last_became_peered":"2024-09-21T02:32:41.483116+0000","last_unstale":"2024-09-21T02:34:59.638081+0000","last_undegraded":"2024-09-21T02:34:59.638081+0000","last_fullsized":"2024-09-21T02:34:59.638081+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:39.146202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412020+0000","last_change":"2024-09-21T02:33:31.041819+0000","last_active":"2024-09-21T02:34:31.412020+0000","last_peered":"2024-09-21T02:34:31.412020+0000","last_clean":"2024-09-21T02:34:31.412020+0000","last_became_active":"2024-09-21T02:33:31.041241+0000","last_became_peered":"2024-09-21T02:33:31.041241+0000","last_unstale":"2024-09-21T02:34:31.412020+0000","last_undegraded":"2024-09-21T02:34:31.412020+0000","last_fullsized":"2024-09-21T02:34:31.412020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:00.241618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407302+0000","last_change":"2024-09-21T02:32:50.692227+0000","last_active":"2024-09-21T02:34:31.407302+0000","last_peered":"2024-09-21T02:34:31.407302+0000","last_clean":"2024-09-21T02:34:31.407302+0000","last_became_active":"2024-09-21T02:32:50.691787+0000","last_became_peered":"2024-09-21T02:32:50.691787+0000","last_unstale":"2024-09-21T02:34:31.407302+0000","last_undegraded":"2024-09-21T02:34:31.407302+0000","last_fullsized":"2024-09-21T02:34:31.407302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:40.086313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644603+0000","last_change":"2024-09-21T02:32:41.476056+0000","last_active":"2024-09-21T02:34:59.644603+0000","last_peered":"2024-09-21T02:34:59.644603+0000","last_clean":"2024-09-21T02:34:59.644603+0000","last_became_active":"2024-09-21T02:32:41.475525+0000","last_became_peered":"2024-09-21T02:32:41.475525+0000","last_unstale":"2024-09-21T02:34:59.644603+0000","last_undegraded":"2024-09-21T02:34:59.644603+0000","last_fullsized":"2024-09-21T02:34:59.644603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:42.074296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413613+0000","last_change":"2024-09-21T02:32:38.430845+0000","last_active":"2024-09-21T02:34:31.413613+0000","last_peered":"2024-09-21T02:34:31.413613+0000","last_clean":"2024-09-21T02:34:31.413613+0000","last_became_active":"2024-09-21T02:32:38.430372+0000","last_became_peered":"2024-09-21T02:32:38.430372+0000","last_unstale":"2024-09-21T02:34:31.413613+0000","last_undegraded":"2024-09-21T02:34:31.413613+0000","last_fullsized":"2024-09-21T02:34:31.413613+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:40.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409266+0000","last_change":"2024-09-21T02:32:50.685481+0000","last_active":"2024-09-21T02:34:31.409266+0000","last_peered":"2024-09-21T02:34:31.409266+0000","last_clean":"2024-09-21T02:34:31.409266+0000","last_became_active":"2024-09-21T02:32:50.685044+0000","last_became_peered":"2024-09-21T02:32:50.685044+0000","last_unstale":"2024-09-21T02:34:31.409266+0000","last_undegraded":"2024-09-21T02:34:31.409266+0000","last_fullsized":"2024-09-21T02:34:31.409266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:33.132966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602323+0000","last_change":"2024-09-21T02:32:50.690447+0000","last_active":"2024-09-21T02:34:31.602323+0000","last_peered":"2024-09-21T02:34:31.602323+0000","last_clean":"2024-09-21T02:34:31.602323+0000","last_became_active":"2024-09-21T02:32:50.690021+0000","last_became_peered":"2024-09-21T02:32:50.690021+0000","last_unstale":"2024-09-21T02:34:31.602323+0000","last_undegraded":"2024-09-21T02:34:31.602323+0000","last_fullsized":"2024-09-21T02:34:31.602323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:44.436690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633674+0000","last_change":"2024-09-21T02:32:41.469186+0000","last_active":"2024-09-21T02:34:59.633674+0000","last_peered":"2024-09-21T02:34:59.633674+0000","last_clean":"2024-09-21T02:34:59.633674+0000","last_became_active":"2024-09-21T02:32:41.468837+0000","last_became_peered":"2024-09-21T02:32:41.468837+0000","last_unstale":"2024-09-21T02:34:59.633674+0000","last_undegraded":"2024-09-21T02:34:59.633674+0000","last_fullsized":"2024-09-21T02:34:59.633674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:02.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411587+0000","last_change":"2024-09-21T02:32:38.426631+0000","last_active":"2024-09-21T02:34:31.411587+0000","last_peered":"2024-09-21T02:34:31.411587+0000","last_clean":"2024-09-21T02:34:31.411587+0000","last_became_active":"2024-09-21T02:32:38.425600+0000","last_became_peered":"2024-09-21T02:32:38.425600+0000","last_unstale":"2024-09-21T02:34:31.411587+0000","last_undegraded":"2024-09-21T02:34:31.411587+0000","last_fullsized":"2024-09-21T02:34:31.411587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.669245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407635+0000","last_change":"2024-09-21T02:32:50.697935+0000","last_active":"2024-09-21T02:34:31.407635+0000","last_peered":"2024-09-21T02:34:31.407635+0000","last_clean":"2024-09-21T02:34:31.407635+0000","last_became_active":"2024-09-21T02:32:50.697537+0000","last_became_peered":"2024-09-21T02:32:50.697537+0000","last_unstale":"2024-09-21T02:34:31.407635+0000","last_undegraded":"2024-09-21T02:34:31.407635+0000","last_fullsized":"2024-09-21T02:34:31.407635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:32.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628002+0000","last_change":"2024-09-21T02:32:41.458640+0000","last_active":"2024-09-21T02:34:59.628002+0000","last_peered":"2024-09-21T02:34:59.628002+0000","last_clean":"2024-09-21T02:34:59.628002+0000","last_became_active":"2024-09-21T02:32:41.458231+0000","last_became_peered":"2024-09-21T02:32:41.458231+0000","last_unstale":"2024-09-21T02:34:59.628002+0000","last_undegraded":"2024-09-21T02:34:59.628002+0000","last_fullsized":"2024-09-21T02:34:59.628002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:26.132979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600867+0000","last_change":"2024-09-21T02:32:38.430888+0000","last_active":"2024-09-21T02:34:31.600867+0000","last_peered":"2024-09-21T02:34:31.600867+0000","last_clean":"2024-09-21T02:34:31.600867+0000","last_became_active":"2024-09-21T02:32:38.430516+0000","last_became_peered":"2024-09-21T02:32:38.430516+0000","last_unstale":"2024-09-21T02:34:31.600867+0000","last_undegraded":"2024-09-21T02:34:31.600867+0000","last_fullsized":"2024-09-21T02:34:31.600867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:54.671763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412943+0000","last_change":"2024-09-21T02:32:38.434012+0000","last_active":"2024-09-21T02:34:31.412943+0000","last_peered":"2024-09-21T02:34:31.412943+0000","last_clean":"2024-09-21T02:34:31.412943+0000","last_became_active":"2024-09-21T02:32:38.433571+0000","last_became_peered":"2024-09-21T02:32:38.433571+0000","last_unstale":"2024-09-21T02:34:31.412943+0000","last_undegraded":"2024-09-21T02:34:31.412943+0000","last_fullsized":"2024-09-21T02:34:31.412943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:59.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635223+0000","last_change":"2024-09-21T02:33:30.650855+0000","last_active":"2024-09-21T02:34:59.635223+0000","last_peered":"2024-09-21T02:34:59.635223+0000","last_clean":"2024-09-21T02:34:59.635223+0000","last_became_active":"2024-09-21T02:33:30.650428+0000","last_became_peered":"2024-09-21T02:33:30.650428+0000","last_unstale":"2024-09-21T02:34:59.635223+0000","last_undegraded":"2024-09-21T02:34:59.635223+0000","last_fullsized":"2024-09-21T02:34:59.635223+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:55.757861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416153+0000","last_change":"2024-09-21T02:32:50.698249+0000","last_active":"2024-09-21T02:34:31.416153+0000","last_peered":"2024-09-21T02:34:31.416153+0000","last_clean":"2024-09-21T02:34:31.416153+0000","last_became_active":"2024-09-21T02:32:50.697768+0000","last_became_peered":"2024-09-21T02:32:50.697768+0000","last_unstale":"2024-09-21T02:34:31.416153+0000","last_undegraded":"2024-09-21T02:34:31.416153+0000","last_fullsized":"2024-09-21T02:34:31.416153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.723420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411368+0000","last_change":"2024-09-21T02:32:38.435733+0000","last_active":"2024-09-21T02:34:31.411368+0000","last_peered":"2024-09-21T02:34:31.411368+0000","last_clean":"2024-09-21T02:34:31.411368+0000","last_became_active":"2024-09-21T02:32:38.435288+0000","last_became_peered":"2024-09-21T02:32:38.435288+0000","last_unstale":"2024-09-21T02:34:31.411368+0000","last_undegraded":"2024-09-21T02:34:31.411368+0000","last_fullsized":"2024-09-21T02:34:31.411368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.430652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.619449+0000","last_change":"2024-09-21T02:32:41.468127+0000","last_active":"2024-09-21T02:34:59.619449+0000","last_peered":"2024-09-21T02:34:59.619449+0000","last_clean":"2024-09-21T02:34:59.619449+0000","last_became_active":"2024-09-21T02:32:41.467730+0000","last_became_peered":"2024-09-21T02:32:41.467730+0000","last_unstale":"2024-09-21T02:34:59.619449+0000","last_undegraded":"2024-09-21T02:34:59.619449+0000","last_fullsized":"2024-09-21T02:34:59.619449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:39.684035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416423+0000","last_change":"2024-09-21T02:32:50.684115+0000","last_active":"2024-09-21T02:34:31.416423+0000","last_peered":"2024-09-21T02:34:31.416423+0000","last_clean":"2024-09-21T02:34:31.416423+0000","last_became_active":"2024-09-21T02:32:50.683627+0000","last_became_peered":"2024-09-21T02:32:50.683627+0000","last_unstale":"2024-09-21T02:34:31.416423+0000","last_undegraded":"2024-09-21T02:34:31.416423+0000","last_fullsized":"2024-09-21T02:34:31.416423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:10.953943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628536+0000","last_change":"2024-09-21T02:32:41.465744+0000","last_active":"2024-09-21T02:34:59.628536+0000","last_peered":"2024-09-21T02:34:59.628536+0000","last_clean":"2024-09-21T02:34:59.628536+0000","last_became_active":"2024-09-21T02:32:41.465392+0000","last_became_peered":"2024-09-21T02:32:41.465392+0000","last_unstale":"2024-09-21T02:34:59.628536+0000","last_undegraded":"2024-09-21T02:34:59.628536+0000","last_fullsized":"2024-09-21T02:34:59.628536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:54.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.623827+0000","last_change":"2024-09-21T02:32:41.470967+0000","last_active":"2024-09-21T02:34:59.623827+0000","last_peered":"2024-09-21T02:34:59.623827+0000","last_clean":"2024-09-21T02:34:59.623827+0000","last_became_active":"2024-09-21T02:32:41.470547+0000","last_became_peered":"2024-09-21T02:32:41.470547+0000","last_unstale":"2024-09-21T02:34:59.623827+0000","last_undegraded":"2024-09-21T02:34:59.623827+0000","last_fullsized":"2024-09-21T02:34:59.623827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:57.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626050+0000","last_change":"2024-09-21T02:32:41.474500+0000","last_active":"2024-09-21T02:34:59.626050+0000","last_peered":"2024-09-21T02:34:59.626050+0000","last_clean":"2024-09-21T02:34:59.626050+0000","last_became_active":"2024-09-21T02:32:41.474117+0000","last_became_peered":"2024-09-21T02:32:41.474117+0000","last_unstale":"2024-09-21T02:34:59.626050+0000","last_undegraded":"2024-09-21T02:34:59.626050+0000","last_fullsized":"2024-09-21T02:34:59.626050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:43.152503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638408+0000","last_change":"2024-09-21T02:32:41.479123+0000","last_active":"2024-09-21T02:34:59.638408+0000","last_peered":"2024-09-21T02:34:59.638408+0000","last_clean":"2024-09-21T02:34:59.638408+0000","last_became_active":"2024-09-21T02:32:41.478543+0000","last_became_peered":"2024-09-21T02:32:41.478543+0000","last_unstale":"2024-09-21T02:34:59.638408+0000","last_undegraded":"2024-09-21T02:34:59.638408+0000","last_fullsized":"2024-09-21T02:34:59.638408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:39.802425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641218+0000","last_change":"2024-09-21T02:32:41.483334+0000","last_active":"2024-09-21T02:34:59.641218+0000","last_peered":"2024-09-21T02:34:59.641218+0000","last_clean":"2024-09-21T02:34:59.641218+0000","last_became_active":"2024-09-21T02:32:41.482999+0000","last_became_peered":"2024-09-21T02:32:41.482999+0000","last_unstale":"2024-09-21T02:34:59.641218+0000","last_undegraded":"2024-09-21T02:34:59.641218+0000","last_fullsized":"2024-09-21T02:34:59.641218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:16.259647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.620849+0000","last_change":"2024-09-21T02:33:30.539417+0000","last_active":"2024-09-21T02:34:59.620849+0000","last_peered":"2024-09-21T02:34:59.620849+0000","last_clean":"2024-09-21T02:34:59.620849+0000","last_became_active":"2024-09-21T02:33:30.538970+0000","last_became_peered":"2024-09-21T02:33:30.538970+0000","last_unstale":"2024-09-21T02:34:59.620849+0000","last_undegraded":"2024-09-21T02:34:59.620849+0000","last_fullsized":"2024-09-21T02:34:59.620849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:09.772513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.623783+0000","last_change":"2024-09-21T02:32:41.469386+0000","last_active":"2024-09-21T02:34:59.623783+0000","last_peered":"2024-09-21T02:34:59.623783+0000","last_clean":"2024-09-21T02:34:59.623783+0000","last_became_active":"2024-09-21T02:32:41.468982+0000","last_became_peered":"2024-09-21T02:32:41.468982+0000","last_unstale":"2024-09-21T02:34:59.623783+0000","last_undegraded":"2024-09-21T02:34:59.623783+0000","last_fullsized":"2024-09-21T02:34:59.623783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.644854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.617299+0000","last_change":"2024-09-21T02:32:41.467365+0000","last_active":"2024-09-21T02:34:59.617299+0000","last_peered":"2024-09-21T02:34:59.617299+0000","last_clean":"2024-09-21T02:34:59.617299+0000","last_became_active":"2024-09-21T02:32:41.466893+0000","last_became_peered":"2024-09-21T02:32:41.466893+0000","last_unstale":"2024-09-21T02:34:59.617299+0000","last_undegraded":"2024-09-21T02:34:59.617299+0000","last_fullsized":"2024-09-21T02:34:59.617299+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.634987+0000","last_change":"2024-09-21T02:32:41.473695+0000","last_active":"2024-09-21T02:34:59.634987+0000","last_peered":"2024-09-21T02:34:59.634987+0000","last_clean":"2024-09-21T02:34:59.634987+0000","last_became_active":"2024-09-21T02:32:41.473035+0000","last_became_peered":"2024-09-21T02:32:41.473035+0000","last_unstale":"2024-09-21T02:34:59.634987+0000","last_undegraded":"2024-09-21T02:34:59.634987+0000","last_fullsized":"2024-09-21T02:34:59.634987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:54.343984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625865+0000","last_change":"2024-09-21T02:32:41.473578+0000","last_active":"2024-09-21T02:34:59.625865+0000","last_peered":"2024-09-21T02:34:59.625865+0000","last_clean":"2024-09-21T02:34:59.625865+0000","last_became_active":"2024-09-21T02:32:41.472983+0000","last_became_peered":"2024-09-21T02:32:41.472983+0000","last_unstale":"2024-09-21T02:34:59.625865+0000","last_undegraded":"2024-09-21T02:34:59.625865+0000","last_fullsized":"2024-09-21T02:34:59.625865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.895809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642194+0000","last_change":"2024-09-21T02:32:41.473751+0000","last_active":"2024-09-21T02:34:59.642194+0000","last_peered":"2024-09-21T02:34:59.642194+0000","last_clean":"2024-09-21T02:34:59.642194+0000","last_became_active":"2024-09-21T02:32:41.473367+0000","last_became_peered":"2024-09-21T02:32:41.473367+0000","last_unstale":"2024-09-21T02:34:59.642194+0000","last_undegraded":"2024-09-21T02:34:59.642194+0000","last_fullsized":"2024-09-21T02:34:59.642194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:04.707745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641726+0000","last_change":"2024-09-21T02:32:41.485375+0000","last_active":"2024-09-21T02:34:59.641726+0000","last_peered":"2024-09-21T02:34:59.641726+0000","last_clean":"2024-09-21T02:34:59.641726+0000","last_became_active":"2024-09-21T02:32:41.484845+0000","last_became_peered":"2024-09-21T02:32:41.484845+0000","last_unstale":"2024-09-21T02:34:59.641726+0000","last_undegraded":"2024-09-21T02:34:59.641726+0000","last_fullsized":"2024-09-21T02:34:59.641726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:58.529747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625775+0000","last_change":"2024-09-21T02:32:41.462925+0000","last_active":"2024-09-21T02:34:59.625775+0000","last_peered":"2024-09-21T02:34:59.625775+0000","last_clean":"2024-09-21T02:34:59.625775+0000","last_became_active":"2024-09-21T02:32:41.462056+0000","last_became_peered":"2024-09-21T02:32:41.462056+0000","last_unstale":"2024-09-21T02:34:59.625775+0000","last_undegraded":"2024-09-21T02:34:59.625775+0000","last_fullsized":"2024-09-21T02:34:59.625775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:05.447554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.624036+0000","last_change":"2024-09-21T02:32:41.475111+0000","last_active":"2024-09-21T02:34:59.624036+0000","last_peered":"2024-09-21T02:34:59.624036+0000","last_clean":"2024-09-21T02:34:59.624036+0000","last_became_active":"2024-09-21T02:32:41.474634+0000","last_became_peered":"2024-09-21T02:32:41.474634+0000","last_unstale":"2024-09-21T02:34:59.624036+0000","last_undegraded":"2024-09-21T02:34:59.624036+0000","last_fullsized":"2024-09-21T02:34:59.624036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:07.750970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.630603+0000","last_change":"2024-09-21T02:32:41.479702+0000","last_active":"2024-09-21T02:34:59.630603+0000","last_peered":"2024-09-21T02:34:59.630603+0000","last_clean":"2024-09-21T02:34:59.630603+0000","last_became_active":"2024-09-21T02:32:41.479378+0000","last_became_peered":"2024-09-21T02:32:41.479378+0000","last_unstale":"2024-09-21T02:34:59.630603+0000","last_undegraded":"2024-09-21T02:34:59.630603+0000","last_fullsized":"2024-09-21T02:34:59.630603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:56.687641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642769+0000","last_change":"2024-09-21T02:32:41.475567+0000","last_active":"2024-09-21T02:34:59.642769+0000","last_peered":"2024-09-21T02:34:59.642769+0000","last_clean":"2024-09-21T02:34:59.642769+0000","last_became_active":"2024-09-21T02:32:41.475207+0000","last_became_peered":"2024-09-21T02:32:41.475207+0000","last_unstale":"2024-09-21T02:34:59.642769+0000","last_undegraded":"2024-09-21T02:34:59.642769+0000","last_fullsized":"2024-09-21T02:34:59.642769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:33.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644970+0000","last_change":"2024-09-21T02:32:41.483518+0000","last_active":"2024-09-21T02:34:59.644970+0000","last_peered":"2024-09-21T02:34:59.644970+0000","last_clean":"2024-09-21T02:34:59.644970+0000","last_became_active":"2024-09-21T02:32:41.483088+0000","last_became_peered":"2024-09-21T02:32:41.483088+0000","last_unstale":"2024-09-21T02:34:59.644970+0000","last_undegraded":"2024-09-21T02:34:59.644970+0000","last_fullsized":"2024-09-21T02:34:59.644970+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:23.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633832+0000","last_change":"2024-09-21T02:32:41.482113+0000","last_active":"2024-09-21T02:34:59.633832+0000","last_peered":"2024-09-21T02:34:59.633832+0000","last_clean":"2024-09-21T02:34:59.633832+0000","last_became_active":"2024-09-21T02:32:41.479123+0000","last_became_peered":"2024-09-21T02:32:41.479123+0000","last_unstale":"2024-09-21T02:34:59.633832+0000","last_undegraded":"2024-09-21T02:34:59.633832+0000","last_fullsized":"2024-09-21T02:34:59.633832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:48.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642077+0000","last_change":"2024-09-21T02:32:41.470429+0000","last_active":"2024-09-21T02:34:59.642077+0000","last_peered":"2024-09-21T02:34:59.642077+0000","last_clean":"2024-09-21T02:34:59.642077+0000","last_became_active":"2024-09-21T02:32:41.469421+0000","last_became_peered":"2024-09-21T02:32:41.469421+0000","last_unstale":"2024-09-21T02:34:59.642077+0000","last_undegraded":"2024-09-21T02:34:59.642077+0000","last_fullsized":"2024-09-21T02:34:59.642077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:00.952030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.634790+0000","last_change":"2024-09-21T02:32:41.470361+0000","last_active":"2024-09-21T02:34:59.634790+0000","last_peered":"2024-09-21T02:34:59.634790+0000","last_clean":"2024-09-21T02:34:59.634790+0000","last_became_active":"2024-09-21T02:32:41.469983+0000","last_became_peered":"2024-09-21T02:32:41.469983+0000","last_unstale":"2024-09-21T02:34:59.634790+0000","last_undegraded":"2024-09-21T02:34:59.634790+0000","last_fullsized":"2024-09-21T02:34:59.634790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:02.703688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.637811+0000","last_change":"2024-09-21T02:32:41.468975+0000","last_active":"2024-09-21T02:34:59.637811+0000","last_peered":"2024-09-21T02:34:59.637811+0000","last_clean":"2024-09-21T02:34:59.637811+0000","last_became_active":"2024-09-21T02:32:41.468612+0000","last_became_peered":"2024-09-21T02:32:41.468612+0000","last_unstale":"2024-09-21T02:34:59.637811+0000","last_undegraded":"2024-09-21T02:34:59.637811+0000","last_fullsized":"2024-09-21T02:34:59.637811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:04.442257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643213+0000","last_change":"2024-09-21T02:32:41.471444+0000","last_active":"2024-09-21T02:34:59.643213+0000","last_peered":"2024-09-21T02:34:59.643213+0000","last_clean":"2024-09-21T02:34:59.643213+0000","last_became_active":"2024-09-21T02:32:41.470437+0000","last_became_peered":"2024-09-21T02:32:41.470437+0000","last_unstale":"2024-09-21T02:34:59.643213+0000","last_undegraded":"2024-09-21T02:34:59.643213+0000","last_fullsized":"2024-09-21T02:34:59.643213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:13.933069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635196+0000","last_change":"2024-09-21T02:32:41.475397+0000","last_active":"2024-09-21T02:34:59.635196+0000","last_peered":"2024-09-21T02:34:59.635196+0000","last_clean":"2024-09-21T02:34:59.635196+0000","last_became_active":"2024-09-21T02:32:41.475034+0000","last_became_peered":"2024-09-21T02:32:41.475034+0000","last_unstale":"2024-09-21T02:34:59.635196+0000","last_undegraded":"2024-09-21T02:34:59.635196+0000","last_fullsized":"2024-09-21T02:34:59.635196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:24.944289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643674+0000","last_change":"2024-09-21T02:32:41.470297+0000","last_active":"2024-09-21T02:34:59.643674+0000","last_peered":"2024-09-21T02:34:59.643674+0000","last_clean":"2024-09-21T02:34:59.643674+0000","last_became_active":"2024-09-21T02:32:41.469843+0000","last_became_peered":"2024-09-21T02:32:41.469843+0000","last_unstale":"2024-09-21T02:34:59.643674+0000","last_undegraded":"2024-09-21T02:34:59.643674+0000","last_fullsized":"2024-09-21T02:34:59.643674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629146+0000","last_change":"2024-09-21T02:33:30.535828+0000","last_active":"2024-09-21T02:34:59.629146+0000","last_peered":"2024-09-21T02:34:59.629146+0000","last_clean":"2024-09-21T02:34:59.629146+0000","last_became_active":"2024-09-21T02:33:30.535576+0000","last_became_peered":"2024-09-21T02:33:30.535576+0000","last_unstale":"2024-09-21T02:34:59.629146+0000","last_undegraded":"2024-09-21T02:34:59.629146+0000","last_fullsized":"2024-09-21T02:34:59.629146+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:05.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.621368+0000","last_change":"2024-09-21T02:32:41.466073+0000","last_active":"2024-09-21T02:34:59.621368+0000","last_peered":"2024-09-21T02:34:59.621368+0000","last_clean":"2024-09-21T02:34:59.621368+0000","last_became_active":"2024-09-21T02:32:41.465664+0000","last_became_peered":"2024-09-21T02:32:41.465664+0000","last_unstale":"2024-09-21T02:34:59.621368+0000","last_undegraded":"2024-09-21T02:34:59.621368+0000","last_fullsized":"2024-09-21T02:34:59.621368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:25.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.636445+0000","last_change":"2024-09-21T02:32:41.471006+0000","last_active":"2024-09-21T02:34:59.636445+0000","last_peered":"2024-09-21T02:34:59.636445+0000","last_clean":"2024-09-21T02:34:59.636445+0000","last_became_active":"2024-09-21T02:32:41.469780+0000","last_became_peered":"2024-09-21T02:32:41.469780+0000","last_unstale":"2024-09-21T02:34:59.636445+0000","last_undegraded":"2024-09-21T02:34:59.636445+0000","last_fullsized":"2024-09-21T02:34:59.636445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:18.604729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.624994+0000","last_change":"2024-09-21T02:32:41.476169+0000","last_active":"2024-09-21T02:34:59.624994+0000","last_peered":"2024-09-21T02:34:59.624994+0000","last_clean":"2024-09-21T02:34:59.624994+0000","last_became_active":"2024-09-21T02:32:41.475754+0000","last_became_peered":"2024-09-21T02:32:41.475754+0000","last_unstale":"2024-09-21T02:34:59.624994+0000","last_undegraded":"2024-09-21T02:34:59.624994+0000","last_fullsized":"2024-09-21T02:34:59.624994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:18.532122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.622188+0000","last_change":"2024-09-21T02:32:41.467078+0000","last_active":"2024-09-21T02:34:59.622188+0000","last_peered":"2024-09-21T02:34:59.622188+0000","last_clean":"2024-09-21T02:34:59.622188+0000","last_became_active":"2024-09-21T02:32:41.466702+0000","last_became_peered":"2024-09-21T02:32:41.466702+0000","last_unstale":"2024-09-21T02:34:59.622188+0000","last_undegraded":"2024-09-21T02:34:59.622188+0000","last_fullsized":"2024-09-21T02:34:59.622188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:43.409390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643197+0000","last_change":"2024-09-21T02:32:41.467476+0000","last_active":"2024-09-21T02:34:59.643197+0000","last_peered":"2024-09-21T02:34:59.643197+0000","last_clean":"2024-09-21T02:34:59.643197+0000","last_became_active":"2024-09-21T02:32:41.466901+0000","last_became_peered":"2024-09-21T02:32:41.466901+0000","last_unstale":"2024-09-21T02:34:59.643197+0000","last_undegraded":"2024-09-21T02:34:59.643197+0000","last_fullsized":"2024-09-21T02:34:59.643197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:46.207507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.639768+0000","last_change":"2024-09-21T02:32:41.486528+0000","last_active":"2024-09-21T02:34:59.639768+0000","last_peered":"2024-09-21T02:34:59.639768+0000","last_clean":"2024-09-21T02:34:59.639768+0000","last_became_active":"2024-09-21T02:32:41.484370+0000","last_became_peered":"2024-09-21T02:32:41.484370+0000","last_unstale":"2024-09-21T02:34:59.639768+0000","last_undegraded":"2024-09-21T02:34:59.639768+0000","last_fullsized":"2024-09-21T02:34:59.639768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:28.978540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641305+0000","last_change":"2024-09-21T02:32:41.474525+0000","last_active":"2024-09-21T02:34:59.641305+0000","last_peered":"2024-09-21T02:34:59.641305+0000","last_clean":"2024-09-21T02:34:59.641305+0000","last_became_active":"2024-09-21T02:32:41.474147+0000","last_became_peered":"2024-09-21T02:32:41.474147+0000","last_unstale":"2024-09-21T02:34:59.641305+0000","last_undegraded":"2024-09-21T02:34:59.641305+0000","last_fullsized":"2024-09-21T02:34:59.641305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:26.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70314,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":224,"num_read_kb":183,"num_write":99,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":69871,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":210942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710766,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":505903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906994,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1161281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070520,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":509977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266750,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":505881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462980,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1601536,"data_stored":1099763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626506,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":501203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822736,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1609728,"data_stored":1095849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986260,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":574837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182491,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":501307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":501237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":570719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738474,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":501293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:35:24.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:35:25.360 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:25.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:25 smithi148 ceph-mon[34626]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T02:35:25.847 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:25 smithi079 ceph-mon[30788]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T02:35:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:25 smithi098 ceph-mon[34832]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T02:35:26.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.016+0000 7f08fa800640 1 -- 172.21.15.79:0/2126253285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 msgr2=0x7f08f4103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:26.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.016+0000 7f08fa800640 1 --2- 172.21.15.79:0/2126253285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 0x7f08f4103dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009900 tx=0x7f08e802a410 comp rx=0 tx=0).stop 2024-09-21T02:35:26.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.017+0000 7f08fa800640 1 -- 172.21.15.79:0/2126253285 shutdown_connections 2024-09-21T02:35:26.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.017+0000 7f08fa800640 1 --2- 172.21.15.79:0/2126253285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4109c40 0x7f08f4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.017+0000 7f08fa800640 1 --2- 172.21.15.79:0/2126253285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08f41092f0 0x7f08f4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.017+0000 7f08fa800640 1 --2- 172.21.15.79:0/2126253285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 0x7f08f4103dc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.017+0000 7f08fa800640 1 -- 172.21.15.79:0/2126253285 >> 172.21.15.79:0/2126253285 conn(0x7f08f40ff440 msgr2=0x7f08f4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:26.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.017+0000 7f08fa800640 1 -- 172.21.15.79:0/2126253285 shutdown_connections 2024-09-21T02:35:26.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.017+0000 7f08fa800640 1 -- 172.21.15.79:0/2126253285 wait complete. 2024-09-21T02:35:26.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 Processor -- start 2024-09-21T02:35:26.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 -- start start 2024-09-21T02:35:26.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 0x7f08f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:26.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f41092f0 0x7f08f4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:26.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08f4109c40 0x7f08f4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:26.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4113900 con 0x7f08f41039b0 2024-09-21T02:35:26.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4113780 con 0x7f08f41092f0 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.018+0000 7f08fa800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4113a80 con 0x7f08f4109c40 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f9400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 0x7f08f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f41092f0 0x7f08f4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08f4109c40 0x7f08f4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f41092f0 0x7f08f4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35822/0 (socket says 172.21.15.79:35822) 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 -- 172.21.15.79:0/2606737724 learned_addr learned my addr 172.21.15.79:0/2606737724 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 -- 172.21.15.79:0/2606737724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08f4109c40 msgr2=0x7f08f4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08f4109c40 0x7f08f4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 -- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 msgr2=0x7f08f4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 0x7f08f4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 -- 172.21.15.79:0/2606737724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f41a85d0 con 0x7f08f41092f0 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f9e00640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08f4109c40 0x7f08f4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:26.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.019+0000 7f08f8a00640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f41092f0 0x7f08f4075c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f08e000e9c0 tx=0x7f08e000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.020+0000 7f08f2000640 1 -- 172.21.15.79:0/2606737724 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e000ccc0 con 0x7f08f41092f0 2024-09-21T02:35:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.020+0000 7f08f2000640 1 -- 172.21.15.79:0/2606737724 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08e00054d0 con 0x7f08f41092f0 2024-09-21T02:35:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.020+0000 7f08f2000640 1 -- 172.21.15.79:0/2606737724 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0010430 con 0x7f08f41092f0 2024-09-21T02:35:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.020+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f41a88c0 con 0x7f08f41092f0 2024-09-21T02:35:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.020+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f41a8db0 con 0x7f08f41092f0 2024-09-21T02:35:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.021+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f4103dc0 con 0x7f08f41092f0 2024-09-21T02:35:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.024+0000 7f08f2000640 1 -- 172.21.15.79:0/2606737724 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f08e0005000 con 0x7f08f41092f0 2024-09-21T02:35:26.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.026+0000 7f08f2000640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f08dc0b6590 0x7f08dc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:26.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.026+0000 7f08f2000640 1 -- 172.21.15.79:0/2606737724 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f08e00e7bd0 con 0x7f08f41092f0 2024-09-21T02:35:26.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.026+0000 7f08f9400640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f08dc0b6590 0x7f08dc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.027+0000 7f08f9400640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f08dc0b6590 0x7f08dc0b8aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f08e8000c00 tx=0x7f08e8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:26.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.027+0000 7f08f2000640 1 -- 172.21.15.79:0/2606737724 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08e0056710 con 0x7f08f41092f0 2024-09-21T02:35:26.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.210+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08f4063800 con 0x7f08dc0b6590 2024-09-21T02:35:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.217+0000 7f08f2000640 1 -- 172.21.15.79:0/2606737724 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340398 (secure 0 0 0) 0x7f08f4063800 con 0x7f08dc0b6590 2024-09-21T02:35:26.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:26.223 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T02:35:26.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f08dc0b6590 msgr2=0x7f08dc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f08dc0b6590 0x7f08dc0b8aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f08e8000c00 tx=0x7f08e8031400 comp rx=0 tx=0).stop 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f41092f0 msgr2=0x7f08f4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f41092f0 0x7f08f4075c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f08e000e9c0 tx=0x7f08e000ee80 comp rx=0 tx=0).stop 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 shutdown_connections 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f08dc0b6590 0x7f08dc0b8aa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08f4109c40 0x7f08f4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f41092f0 0x7f08f4075c50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 --2- 172.21.15.79:0/2606737724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f41039b0 0x7f08f4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 >> 172.21.15.79:0/2606737724 conn(0x7f08f40ff440 msgr2=0x7f08f4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 shutdown_connections 2024-09-21T02:35:26.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:26.224+0000 7f08fa800640 1 -- 172.21.15.79:0/2606737724 wait complete. 2024-09-21T02:35:26.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:26 smithi148 ceph-mon[34626]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:26.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:26 smithi098 ceph-mon[34832]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:26.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:26 smithi079 ceph-mon[30788]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:27.039 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-21T02:35:25.442441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661227,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":311,"num_read_kb":253,"num_write":226,"num_write_kb":2258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3021711,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":677,"ondisk_log_size":677,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387980,"kb_used_data":13772,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553844,"statfs":{"total":1151940427776,"available":1151543136256,"internally_reserved":0,"allocated":14102528,"data_stored":8029872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003729"},"pg_stats":[{"pgid":"2.1f","version":"78'4","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.422675+0000","last_change":"2024-09-21T02:34:31.422073+0000","last_active":"2024-09-21T02:34:31.422675+0000","last_peered":"2024-09-21T02:34:31.422675+0000","last_clean":"2024-09-21T02:34:31.422675+0000","last_became_active":"2024-09-21T02:34:31.412208+0000","last_became_peered":"2024-09-21T02:34:31.412208+0000","last_unstale":"2024-09-21T02:34:31.422675+0000","last_undegraded":"2024-09-21T02:34:31.422675+0000","last_fullsized":"2024-09-21T02:34:31.422675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.165710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628085+0000","last_change":"2024-09-21T02:32:41.473485+0000","last_active":"2024-09-21T02:34:59.628085+0000","last_peered":"2024-09-21T02:34:59.628085+0000","last_clean":"2024-09-21T02:34:59.628085+0000","last_became_active":"2024-09-21T02:32:41.473134+0000","last_became_peered":"2024-09-21T02:32:41.473134+0000","last_unstale":"2024-09-21T02:34:59.628085+0000","last_undegraded":"2024-09-21T02:34:59.628085+0000","last_fullsized":"2024-09-21T02:34:59.628085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415843+0000","last_change":"2024-09-21T02:32:50.687618+0000","last_active":"2024-09-21T02:34:31.415843+0000","last_peered":"2024-09-21T02:34:31.415843+0000","last_clean":"2024-09-21T02:34:31.415843+0000","last_became_active":"2024-09-21T02:32:50.687157+0000","last_became_peered":"2024-09-21T02:32:50.687157+0000","last_unstale":"2024-09-21T02:34:31.415843+0000","last_undegraded":"2024-09-21T02:34:31.415843+0000","last_fullsized":"2024-09-21T02:34:31.415843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:29.247287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409896+0000","last_change":"2024-09-21T02:32:38.512667+0000","last_active":"2024-09-21T02:34:31.409896+0000","last_peered":"2024-09-21T02:34:31.409896+0000","last_clean":"2024-09-21T02:34:31.409896+0000","last_became_active":"2024-09-21T02:32:38.512261+0000","last_became_peered":"2024-09-21T02:32:38.512261+0000","last_unstale":"2024-09-21T02:34:31.409896+0000","last_undegraded":"2024-09-21T02:34:31.409896+0000","last_fullsized":"2024-09-21T02:34:31.409896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:05.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644540+0000","last_change":"2024-09-21T02:32:41.481816+0000","last_active":"2024-09-21T02:34:59.644540+0000","last_peered":"2024-09-21T02:34:59.644540+0000","last_clean":"2024-09-21T02:34:59.644540+0000","last_became_active":"2024-09-21T02:32:41.478295+0000","last_became_peered":"2024-09-21T02:32:41.478295+0000","last_unstale":"2024-09-21T02:34:59.644540+0000","last_undegraded":"2024-09-21T02:34:59.644540+0000","last_fullsized":"2024-09-21T02:34:59.644540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:58.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409553+0000","last_change":"2024-09-21T02:32:50.692598+0000","last_active":"2024-09-21T02:34:31.409553+0000","last_peered":"2024-09-21T02:34:31.409553+0000","last_clean":"2024-09-21T02:34:31.409553+0000","last_became_active":"2024-09-21T02:32:50.692120+0000","last_became_peered":"2024-09-21T02:32:50.692120+0000","last_unstale":"2024-09-21T02:34:31.409553+0000","last_undegraded":"2024-09-21T02:34:31.409553+0000","last_fullsized":"2024-09-21T02:34:31.409553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:57.642195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411124+0000","last_change":"2024-09-21T02:32:38.435292+0000","last_active":"2024-09-21T02:34:31.411124+0000","last_peered":"2024-09-21T02:34:31.411124+0000","last_clean":"2024-09-21T02:34:31.411124+0000","last_became_active":"2024-09-21T02:32:38.434878+0000","last_became_peered":"2024-09-21T02:32:38.434878+0000","last_unstale":"2024-09-21T02:34:31.411124+0000","last_undegraded":"2024-09-21T02:34:31.411124+0000","last_fullsized":"2024-09-21T02:34:31.411124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:56.827844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.645301+0000","last_change":"2024-09-21T02:32:41.467834+0000","last_active":"2024-09-21T02:34:59.645301+0000","last_peered":"2024-09-21T02:34:59.645301+0000","last_clean":"2024-09-21T02:34:59.645301+0000","last_became_active":"2024-09-21T02:32:41.467440+0000","last_became_peered":"2024-09-21T02:32:41.467440+0000","last_unstale":"2024-09-21T02:34:59.645301+0000","last_undegraded":"2024-09-21T02:34:59.645301+0000","last_fullsized":"2024-09-21T02:34:59.645301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:16.857988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409856+0000","last_change":"2024-09-21T02:33:30.539580+0000","last_active":"2024-09-21T02:34:31.409856+0000","last_peered":"2024-09-21T02:34:31.409856+0000","last_clean":"2024-09-21T02:34:31.409856+0000","last_became_active":"2024-09-21T02:33:30.539088+0000","last_became_peered":"2024-09-21T02:33:30.539088+0000","last_unstale":"2024-09-21T02:34:31.409856+0000","last_undegraded":"2024-09-21T02:34:31.409856+0000","last_fullsized":"2024-09-21T02:34:31.409856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:42.437535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410618+0000","last_change":"2024-09-21T02:32:38.431645+0000","last_active":"2024-09-21T02:34:31.410618+0000","last_peered":"2024-09-21T02:34:31.410618+0000","last_clean":"2024-09-21T02:34:31.410618+0000","last_became_active":"2024-09-21T02:32:38.431069+0000","last_became_peered":"2024-09-21T02:32:38.431069+0000","last_unstale":"2024-09-21T02:34:31.410618+0000","last_undegraded":"2024-09-21T02:34:31.410618+0000","last_fullsized":"2024-09-21T02:34:31.410618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:34.893292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629116+0000","last_change":"2024-09-21T02:32:41.470506+0000","last_active":"2024-09-21T02:34:59.629116+0000","last_peered":"2024-09-21T02:34:59.629116+0000","last_clean":"2024-09-21T02:34:59.629116+0000","last_became_active":"2024-09-21T02:32:41.470165+0000","last_became_peered":"2024-09-21T02:32:41.470165+0000","last_unstale":"2024-09-21T02:34:59.629116+0000","last_undegraded":"2024-09-21T02:34:59.629116+0000","last_fullsized":"2024-09-21T02:34:59.629116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409749+0000","last_change":"2024-09-21T02:32:50.681923+0000","last_active":"2024-09-21T02:34:31.409749+0000","last_peered":"2024-09-21T02:34:31.409749+0000","last_clean":"2024-09-21T02:34:31.409749+0000","last_became_active":"2024-09-21T02:32:50.681374+0000","last_became_peered":"2024-09-21T02:32:50.681374+0000","last_unstale":"2024-09-21T02:34:31.409749+0000","last_undegraded":"2024-09-21T02:34:31.409749+0000","last_fullsized":"2024-09-21T02:34:31.409749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:46.060715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642808+0000","last_change":"2024-09-21T02:32:41.470550+0000","last_active":"2024-09-21T02:34:59.642808+0000","last_peered":"2024-09-21T02:34:59.642808+0000","last_clean":"2024-09-21T02:34:59.642808+0000","last_became_active":"2024-09-21T02:32:41.469282+0000","last_became_peered":"2024-09-21T02:32:41.469282+0000","last_unstale":"2024-09-21T02:34:59.642808+0000","last_undegraded":"2024-09-21T02:34:59.642808+0000","last_fullsized":"2024-09-21T02:34:59.642808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:34.619382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410335+0000","last_change":"2024-09-21T02:32:38.435261+0000","last_active":"2024-09-21T02:34:31.410335+0000","last_peered":"2024-09-21T02:34:31.410335+0000","last_clean":"2024-09-21T02:34:31.410335+0000","last_became_active":"2024-09-21T02:32:38.434795+0000","last_became_peered":"2024-09-21T02:32:38.434795+0000","last_unstale":"2024-09-21T02:34:31.410335+0000","last_undegraded":"2024-09-21T02:34:31.410335+0000","last_fullsized":"2024-09-21T02:34:31.410335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:05.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409940+0000","last_change":"2024-09-21T02:32:50.714657+0000","last_active":"2024-09-21T02:34:31.409940+0000","last_peered":"2024-09-21T02:34:31.409940+0000","last_clean":"2024-09-21T02:34:31.409940+0000","last_became_active":"2024-09-21T02:32:50.714077+0000","last_became_peered":"2024-09-21T02:32:50.714077+0000","last_unstale":"2024-09-21T02:34:31.409940+0000","last_undegraded":"2024-09-21T02:34:31.409940+0000","last_fullsized":"2024-09-21T02:34:31.409940+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.812785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638187+0000","last_change":"2024-09-21T02:32:41.473964+0000","last_active":"2024-09-21T02:34:59.638187+0000","last_peered":"2024-09-21T02:34:59.638187+0000","last_clean":"2024-09-21T02:34:59.638187+0000","last_became_active":"2024-09-21T02:32:41.473598+0000","last_became_peered":"2024-09-21T02:32:41.473598+0000","last_unstale":"2024-09-21T02:34:59.638187+0000","last_undegraded":"2024-09-21T02:34:59.638187+0000","last_fullsized":"2024-09-21T02:34:59.638187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415931+0000","last_change":"2024-09-21T02:32:38.435800+0000","last_active":"2024-09-21T02:34:31.415931+0000","last_peered":"2024-09-21T02:34:31.415931+0000","last_clean":"2024-09-21T02:34:31.415931+0000","last_became_active":"2024-09-21T02:32:38.434797+0000","last_became_peered":"2024-09-21T02:32:38.434797+0000","last_unstale":"2024-09-21T02:34:31.415931+0000","last_undegraded":"2024-09-21T02:34:31.415931+0000","last_fullsized":"2024-09-21T02:34:31.415931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:46.540597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410125+0000","last_change":"2024-09-21T02:32:50.693447+0000","last_active":"2024-09-21T02:34:31.410125+0000","last_peered":"2024-09-21T02:34:31.410125+0000","last_clean":"2024-09-21T02:34:31.410125+0000","last_became_active":"2024-09-21T02:32:50.692829+0000","last_became_peered":"2024-09-21T02:32:50.692829+0000","last_unstale":"2024-09-21T02:34:31.410125+0000","last_undegraded":"2024-09-21T02:34:31.410125+0000","last_fullsized":"2024-09-21T02:34:31.410125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:10.958279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.640800+0000","last_change":"2024-09-21T02:32:41.478053+0000","last_active":"2024-09-21T02:34:59.640800+0000","last_peered":"2024-09-21T02:34:59.640800+0000","last_clean":"2024-09-21T02:34:59.640800+0000","last_became_active":"2024-09-21T02:32:41.477631+0000","last_became_peered":"2024-09-21T02:32:41.477631+0000","last_unstale":"2024-09-21T02:34:59.640800+0000","last_undegraded":"2024-09-21T02:34:59.640800+0000","last_fullsized":"2024-09-21T02:34:59.640800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:19.548261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409617+0000","last_change":"2024-09-21T02:32:38.425388+0000","last_active":"2024-09-21T02:34:31.409617+0000","last_peered":"2024-09-21T02:34:31.409617+0000","last_clean":"2024-09-21T02:34:31.409617+0000","last_became_active":"2024-09-21T02:32:38.424975+0000","last_became_peered":"2024-09-21T02:32:38.424975+0000","last_unstale":"2024-09-21T02:34:31.409617+0000","last_undegraded":"2024-09-21T02:34:31.409617+0000","last_fullsized":"2024-09-21T02:34:31.409617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:43.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408187+0000","last_change":"2024-09-21T02:32:50.695406+0000","last_active":"2024-09-21T02:34:31.408187+0000","last_peered":"2024-09-21T02:34:31.408187+0000","last_clean":"2024-09-21T02:34:31.408187+0000","last_became_active":"2024-09-21T02:32:50.694958+0000","last_became_peered":"2024-09-21T02:32:50.694958+0000","last_unstale":"2024-09-21T02:34:31.408187+0000","last_undegraded":"2024-09-21T02:34:31.408187+0000","last_fullsized":"2024-09-21T02:34:31.408187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:49.038587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.586954+0000","last_change":"2024-09-21T02:32:41.463475+0000","last_active":"2024-09-21T02:34:59.586954+0000","last_peered":"2024-09-21T02:34:59.586954+0000","last_clean":"2024-09-21T02:34:59.586954+0000","last_became_active":"2024-09-21T02:32:41.462950+0000","last_became_peered":"2024-09-21T02:32:41.462950+0000","last_unstale":"2024-09-21T02:34:59.586954+0000","last_undegraded":"2024-09-21T02:34:59.586954+0000","last_fullsized":"2024-09-21T02:34:59.586954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:40.871522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415861+0000","last_change":"2024-09-21T02:32:38.512534+0000","last_active":"2024-09-21T02:34:31.415861+0000","last_peered":"2024-09-21T02:34:31.415861+0000","last_clean":"2024-09-21T02:34:31.415861+0000","last_became_active":"2024-09-21T02:32:38.512162+0000","last_became_peered":"2024-09-21T02:32:38.512162+0000","last_unstale":"2024-09-21T02:34:31.415861+0000","last_undegraded":"2024-09-21T02:34:31.415861+0000","last_fullsized":"2024-09-21T02:34:31.415861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:35.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410103+0000","last_change":"2024-09-21T02:32:50.716000+0000","last_active":"2024-09-21T02:34:31.410103+0000","last_peered":"2024-09-21T02:34:31.410103+0000","last_clean":"2024-09-21T02:34:31.410103+0000","last_became_active":"2024-09-21T02:32:50.715371+0000","last_became_peered":"2024-09-21T02:32:50.715371+0000","last_unstale":"2024-09-21T02:34:31.410103+0000","last_undegraded":"2024-09-21T02:34:31.410103+0000","last_fullsized":"2024-09-21T02:34:31.410103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:54.490957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642642+0000","last_change":"2024-09-21T02:32:41.479797+0000","last_active":"2024-09-21T02:34:59.642642+0000","last_peered":"2024-09-21T02:34:59.642642+0000","last_clean":"2024-09-21T02:34:59.642642+0000","last_became_active":"2024-09-21T02:32:41.479400+0000","last_became_peered":"2024-09-21T02:32:41.479400+0000","last_unstale":"2024-09-21T02:34:59.642642+0000","last_undegraded":"2024-09-21T02:34:59.642642+0000","last_fullsized":"2024-09-21T02:34:59.642642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:34.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410512+0000","last_change":"2024-09-21T02:32:38.748844+0000","last_active":"2024-09-21T02:34:31.410512+0000","last_peered":"2024-09-21T02:34:31.410512+0000","last_clean":"2024-09-21T02:34:31.410512+0000","last_became_active":"2024-09-21T02:32:38.748428+0000","last_became_peered":"2024-09-21T02:32:38.748428+0000","last_unstale":"2024-09-21T02:34:31.410512+0000","last_undegraded":"2024-09-21T02:34:31.410512+0000","last_fullsized":"2024-09-21T02:34:31.410512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:01.300290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415969+0000","last_change":"2024-09-21T02:32:50.681667+0000","last_active":"2024-09-21T02:34:31.415969+0000","last_peered":"2024-09-21T02:34:31.415969+0000","last_clean":"2024-09-21T02:34:31.415969+0000","last_became_active":"2024-09-21T02:32:50.681113+0000","last_became_peered":"2024-09-21T02:32:50.681113+0000","last_unstale":"2024-09-21T02:34:31.415969+0000","last_undegraded":"2024-09-21T02:34:31.415969+0000","last_fullsized":"2024-09-21T02:34:31.415969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:20.881199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626269+0000","last_change":"2024-09-21T02:32:41.466320+0000","last_active":"2024-09-21T02:34:59.626269+0000","last_peered":"2024-09-21T02:34:59.626269+0000","last_clean":"2024-09-21T02:34:59.626269+0000","last_became_active":"2024-09-21T02:32:41.462700+0000","last_became_peered":"2024-09-21T02:32:41.462700+0000","last_unstale":"2024-09-21T02:34:59.626269+0000","last_undegraded":"2024-09-21T02:34:59.626269+0000","last_fullsized":"2024-09-21T02:34:59.626269+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:05.324192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:47.474143+0000","last_change":"2024-09-21T02:32:38.432478+0000","last_active":"2024-09-21T02:34:47.474143+0000","last_peered":"2024-09-21T02:34:47.474143+0000","last_clean":"2024-09-21T02:34:47.474143+0000","last_became_active":"2024-09-21T02:32:38.431107+0000","last_became_peered":"2024-09-21T02:32:38.431107+0000","last_unstale":"2024-09-21T02:34:47.474143+0000","last_undegraded":"2024-09-21T02:34:47.474143+0000","last_fullsized":"2024-09-21T02:34:47.474143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:04.629078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408632+0000","last_change":"2024-09-21T02:32:50.715335+0000","last_active":"2024-09-21T02:34:31.408632+0000","last_peered":"2024-09-21T02:34:31.408632+0000","last_clean":"2024-09-21T02:34:31.408632+0000","last_became_active":"2024-09-21T02:32:50.714117+0000","last_became_peered":"2024-09-21T02:32:50.714117+0000","last_unstale":"2024-09-21T02:34:31.408632+0000","last_undegraded":"2024-09-21T02:34:31.408632+0000","last_fullsized":"2024-09-21T02:34:31.408632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:53.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.636091+0000","last_change":"2024-09-21T02:32:41.467613+0000","last_active":"2024-09-21T02:34:59.636091+0000","last_peered":"2024-09-21T02:34:59.636091+0000","last_clean":"2024-09-21T02:34:59.636091+0000","last_became_active":"2024-09-21T02:32:41.467136+0000","last_became_peered":"2024-09-21T02:32:41.467136+0000","last_unstale":"2024-09-21T02:34:59.636091+0000","last_undegraded":"2024-09-21T02:34:59.636091+0000","last_fullsized":"2024-09-21T02:34:59.636091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:16.929257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411240+0000","last_change":"2024-09-21T02:32:38.513591+0000","last_active":"2024-09-21T02:34:31.411240+0000","last_peered":"2024-09-21T02:34:31.411240+0000","last_clean":"2024-09-21T02:34:31.411240+0000","last_became_active":"2024-09-21T02:32:38.513169+0000","last_became_peered":"2024-09-21T02:32:38.513169+0000","last_unstale":"2024-09-21T02:34:31.411240+0000","last_undegraded":"2024-09-21T02:34:31.411240+0000","last_fullsized":"2024-09-21T02:34:31.411240+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:24.038894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407303+0000","last_change":"2024-09-21T02:32:50.680165+0000","last_active":"2024-09-21T02:34:31.407303+0000","last_peered":"2024-09-21T02:34:31.407303+0000","last_clean":"2024-09-21T02:34:31.407303+0000","last_became_active":"2024-09-21T02:32:50.679730+0000","last_became_peered":"2024-09-21T02:32:50.679730+0000","last_unstale":"2024-09-21T02:34:31.407303+0000","last_undegraded":"2024-09-21T02:34:31.407303+0000","last_fullsized":"2024-09-21T02:34:31.407303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:25.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633830+0000","last_change":"2024-09-21T02:32:41.483355+0000","last_active":"2024-09-21T02:34:59.633830+0000","last_peered":"2024-09-21T02:34:59.633830+0000","last_clean":"2024-09-21T02:34:59.633830+0000","last_became_active":"2024-09-21T02:32:41.482786+0000","last_became_peered":"2024-09-21T02:32:41.482786+0000","last_unstale":"2024-09-21T02:34:59.633830+0000","last_undegraded":"2024-09-21T02:34:59.633830+0000","last_fullsized":"2024-09-21T02:34:59.633830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:46.277233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407870+0000","last_change":"2024-09-21T02:32:38.515173+0000","last_active":"2024-09-21T02:34:31.407870+0000","last_peered":"2024-09-21T02:34:31.407870+0000","last_clean":"2024-09-21T02:34:31.407870+0000","last_became_active":"2024-09-21T02:32:38.513341+0000","last_became_peered":"2024-09-21T02:32:38.513341+0000","last_unstale":"2024-09-21T02:34:31.407870+0000","last_undegraded":"2024-09-21T02:34:31.407870+0000","last_fullsized":"2024-09-21T02:34:31.407870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.988203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410834+0000","last_change":"2024-09-21T02:32:50.714389+0000","last_active":"2024-09-21T02:34:31.410834+0000","last_peered":"2024-09-21T02:34:31.410834+0000","last_clean":"2024-09-21T02:34:31.410834+0000","last_became_active":"2024-09-21T02:32:50.713859+0000","last_became_peered":"2024-09-21T02:32:50.713859+0000","last_unstale":"2024-09-21T02:34:31.410834+0000","last_undegraded":"2024-09-21T02:34:31.410834+0000","last_fullsized":"2024-09-21T02:34:31.410834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:41.315205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638243+0000","last_change":"2024-09-21T02:33:30.613550+0000","last_active":"2024-09-21T02:34:59.638243+0000","last_peered":"2024-09-21T02:34:59.638243+0000","last_clean":"2024-09-21T02:34:59.638243+0000","last_became_active":"2024-09-21T02:33:30.613216+0000","last_became_peered":"2024-09-21T02:33:30.613216+0000","last_unstale":"2024-09-21T02:34:59.638243+0000","last_undegraded":"2024-09-21T02:34:59.638243+0000","last_fullsized":"2024-09-21T02:34:59.638243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:11.076824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411976+0000","last_change":"2024-09-21T02:32:38.428428+0000","last_active":"2024-09-21T02:34:31.411976+0000","last_peered":"2024-09-21T02:34:31.411976+0000","last_clean":"2024-09-21T02:34:31.411976+0000","last_became_active":"2024-09-21T02:32:38.428066+0000","last_became_peered":"2024-09-21T02:32:38.428066+0000","last_unstale":"2024-09-21T02:34:31.411976+0000","last_undegraded":"2024-09-21T02:34:31.411976+0000","last_fullsized":"2024-09-21T02:34:31.411976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:45.601916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601270+0000","last_change":"2024-09-21T02:32:50.691139+0000","last_active":"2024-09-21T02:34:31.601270+0000","last_peered":"2024-09-21T02:34:31.601270+0000","last_clean":"2024-09-21T02:34:31.601270+0000","last_became_active":"2024-09-21T02:32:50.690653+0000","last_became_peered":"2024-09-21T02:32:50.690653+0000","last_unstale":"2024-09-21T02:34:31.601270+0000","last_undegraded":"2024-09-21T02:34:31.601270+0000","last_fullsized":"2024-09-21T02:34:31.601270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:43.852916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.620886+0000","last_change":"2024-09-21T02:32:41.466857+0000","last_active":"2024-09-21T02:34:59.620886+0000","last_peered":"2024-09-21T02:34:59.620886+0000","last_clean":"2024-09-21T02:34:59.620886+0000","last_became_active":"2024-09-21T02:32:41.466467+0000","last_became_peered":"2024-09-21T02:32:41.466467+0000","last_unstale":"2024-09-21T02:34:59.620886+0000","last_undegraded":"2024-09-21T02:34:59.620886+0000","last_fullsized":"2024-09-21T02:34:59.620886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:29.369150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600894+0000","last_change":"2024-09-21T02:32:38.513999+0000","last_active":"2024-09-21T02:34:31.600894+0000","last_peered":"2024-09-21T02:34:31.600894+0000","last_clean":"2024-09-21T02:34:31.600894+0000","last_became_active":"2024-09-21T02:32:38.513605+0000","last_became_peered":"2024-09-21T02:32:38.513605+0000","last_unstale":"2024-09-21T02:34:31.600894+0000","last_undegraded":"2024-09-21T02:34:31.600894+0000","last_fullsized":"2024-09-21T02:34:31.600894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:45.616961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601236+0000","last_change":"2024-09-21T02:32:50.714830+0000","last_active":"2024-09-21T02:34:31.601236+0000","last_peered":"2024-09-21T02:34:31.601236+0000","last_clean":"2024-09-21T02:34:31.601236+0000","last_became_active":"2024-09-21T02:32:50.714166+0000","last_became_peered":"2024-09-21T02:32:50.714166+0000","last_unstale":"2024-09-21T02:34:31.601236+0000","last_undegraded":"2024-09-21T02:34:31.601236+0000","last_fullsized":"2024-09-21T02:34:31.601236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:35.418689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.632282+0000","last_change":"2024-09-21T02:32:41.468695+0000","last_active":"2024-09-21T02:34:59.632282+0000","last_peered":"2024-09-21T02:34:59.632282+0000","last_clean":"2024-09-21T02:34:59.632282+0000","last_became_active":"2024-09-21T02:32:41.468349+0000","last_became_peered":"2024-09-21T02:32:41.468349+0000","last_unstale":"2024-09-21T02:34:59.632282+0000","last_undegraded":"2024-09-21T02:34:59.632282+0000","last_fullsized":"2024-09-21T02:34:59.632282+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:51.935336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411151+0000","last_change":"2024-09-21T02:32:38.431187+0000","last_active":"2024-09-21T02:34:31.411151+0000","last_peered":"2024-09-21T02:34:31.411151+0000","last_clean":"2024-09-21T02:34:31.411151+0000","last_became_active":"2024-09-21T02:32:38.430790+0000","last_became_peered":"2024-09-21T02:32:38.430790+0000","last_unstale":"2024-09-21T02:34:31.411151+0000","last_undegraded":"2024-09-21T02:34:31.411151+0000","last_fullsized":"2024-09-21T02:34:31.411151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:05.004479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411407+0000","last_change":"2024-09-21T02:32:50.715728+0000","last_active":"2024-09-21T02:34:31.411407+0000","last_peered":"2024-09-21T02:34:31.411407+0000","last_clean":"2024-09-21T02:34:31.411407+0000","last_became_active":"2024-09-21T02:32:50.715329+0000","last_became_peered":"2024-09-21T02:32:50.715329+0000","last_unstale":"2024-09-21T02:34:31.411407+0000","last_undegraded":"2024-09-21T02:34:31.411407+0000","last_fullsized":"2024-09-21T02:34:31.411407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.790489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642681+0000","last_change":"2024-09-21T02:32:41.474885+0000","last_active":"2024-09-21T02:34:59.642681+0000","last_peered":"2024-09-21T02:34:59.642681+0000","last_clean":"2024-09-21T02:34:59.642681+0000","last_became_active":"2024-09-21T02:32:41.474599+0000","last_became_peered":"2024-09-21T02:32:41.474599+0000","last_unstale":"2024-09-21T02:34:59.642681+0000","last_undegraded":"2024-09-21T02:34:59.642681+0000","last_fullsized":"2024-09-21T02:34:59.642681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:43.006829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410433+0000","last_change":"2024-09-21T02:32:38.431168+0000","last_active":"2024-09-21T02:34:31.410433+0000","last_peered":"2024-09-21T02:34:31.410433+0000","last_clean":"2024-09-21T02:34:31.410433+0000","last_became_active":"2024-09-21T02:32:38.430743+0000","last_became_peered":"2024-09-21T02:32:38.430743+0000","last_unstale":"2024-09-21T02:34:31.410433+0000","last_undegraded":"2024-09-21T02:34:31.410433+0000","last_fullsized":"2024-09-21T02:34:31.410433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:54.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411399+0000","last_change":"2024-09-21T02:31:20.822638+0000","last_active":"2024-09-21T02:34:31.411399+0000","last_peered":"2024-09-21T02:34:31.411399+0000","last_clean":"2024-09-21T02:34:31.411399+0000","last_became_active":"2024-09-21T02:31:20.816679+0000","last_became_peered":"2024-09-21T02:31:20.816679+0000","last_unstale":"2024-09-21T02:34:31.411399+0000","last_undegraded":"2024-09-21T02:34:31.411399+0000","last_fullsized":"2024-09-21T02:34:31.411399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_clean_scrub_stamp":"2024-09-21T02:27:32.360535+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:51.568101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411722+0000","last_change":"2024-09-21T02:32:50.698437+0000","last_active":"2024-09-21T02:34:31.411722+0000","last_peered":"2024-09-21T02:34:31.411722+0000","last_clean":"2024-09-21T02:34:31.411722+0000","last_became_active":"2024-09-21T02:32:50.697814+0000","last_became_peered":"2024-09-21T02:32:50.697814+0000","last_unstale":"2024-09-21T02:34:31.411722+0000","last_undegraded":"2024-09-21T02:34:31.411722+0000","last_fullsized":"2024-09-21T02:34:31.411722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:51.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643644+0000","last_change":"2024-09-21T02:32:41.469539+0000","last_active":"2024-09-21T02:34:59.643644+0000","last_peered":"2024-09-21T02:34:59.643644+0000","last_clean":"2024-09-21T02:34:59.643644+0000","last_became_active":"2024-09-21T02:32:41.469060+0000","last_became_peered":"2024-09-21T02:32:41.469060+0000","last_unstale":"2024-09-21T02:34:59.643644+0000","last_undegraded":"2024-09-21T02:34:59.643644+0000","last_fullsized":"2024-09-21T02:34:59.643644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:36.699360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416542+0000","last_change":"2024-09-21T02:32:38.748487+0000","last_active":"2024-09-21T02:34:31.416542+0000","last_peered":"2024-09-21T02:34:31.416542+0000","last_clean":"2024-09-21T02:34:31.416542+0000","last_became_active":"2024-09-21T02:32:38.747956+0000","last_became_peered":"2024-09-21T02:32:38.747956+0000","last_unstale":"2024-09-21T02:34:31.416542+0000","last_undegraded":"2024-09-21T02:34:31.416542+0000","last_fullsized":"2024-09-21T02:34:31.416542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:15.745119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415910+0000","last_change":"2024-09-21T02:32:50.687412+0000","last_active":"2024-09-21T02:34:31.415910+0000","last_peered":"2024-09-21T02:34:31.415910+0000","last_clean":"2024-09-21T02:34:31.415910+0000","last_became_active":"2024-09-21T02:32:50.686819+0000","last_became_peered":"2024-09-21T02:32:50.686819+0000","last_unstale":"2024-09-21T02:34:31.415910+0000","last_undegraded":"2024-09-21T02:34:31.415910+0000","last_fullsized":"2024-09-21T02:34:31.415910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:28.830619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.621093+0000","last_change":"2024-09-21T02:32:41.467719+0000","last_active":"2024-09-21T02:34:59.621093+0000","last_peered":"2024-09-21T02:34:59.621093+0000","last_clean":"2024-09-21T02:34:59.621093+0000","last_became_active":"2024-09-21T02:32:41.467332+0000","last_became_peered":"2024-09-21T02:32:41.467332+0000","last_unstale":"2024-09-21T02:34:59.621093+0000","last_undegraded":"2024-09-21T02:34:59.621093+0000","last_fullsized":"2024-09-21T02:34:59.621093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:06.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411998+0000","last_change":"2024-09-21T02:32:38.428553+0000","last_active":"2024-09-21T02:34:31.411998+0000","last_peered":"2024-09-21T02:34:31.411998+0000","last_clean":"2024-09-21T02:34:31.411998+0000","last_became_active":"2024-09-21T02:32:38.428159+0000","last_became_peered":"2024-09-21T02:32:38.428159+0000","last_unstale":"2024-09-21T02:34:31.411998+0000","last_undegraded":"2024-09-21T02:34:31.411998+0000","last_fullsized":"2024-09-21T02:34:31.411998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:17.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602179+0000","last_change":"2024-09-21T02:32:50.694290+0000","last_active":"2024-09-21T02:34:31.602179+0000","last_peered":"2024-09-21T02:34:31.602179+0000","last_clean":"2024-09-21T02:34:31.602179+0000","last_became_active":"2024-09-21T02:32:50.693794+0000","last_became_peered":"2024-09-21T02:32:50.693794+0000","last_unstale":"2024-09-21T02:34:31.602179+0000","last_undegraded":"2024-09-21T02:34:31.602179+0000","last_fullsized":"2024-09-21T02:34:31.602179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:07.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626360+0000","last_change":"2024-09-21T02:32:41.466802+0000","last_active":"2024-09-21T02:34:59.626360+0000","last_peered":"2024-09-21T02:34:59.626360+0000","last_clean":"2024-09-21T02:34:59.626360+0000","last_became_active":"2024-09-21T02:32:41.465348+0000","last_became_peered":"2024-09-21T02:32:41.465348+0000","last_unstale":"2024-09-21T02:34:59.626360+0000","last_undegraded":"2024-09-21T02:34:59.626360+0000","last_fullsized":"2024-09-21T02:34:59.626360+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:23.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601415+0000","last_change":"2024-09-21T02:32:38.435725+0000","last_active":"2024-09-21T02:34:31.601415+0000","last_peered":"2024-09-21T02:34:31.601415+0000","last_clean":"2024-09-21T02:34:31.601415+0000","last_became_active":"2024-09-21T02:32:38.434688+0000","last_became_peered":"2024-09-21T02:32:38.434688+0000","last_unstale":"2024-09-21T02:34:31.601415+0000","last_undegraded":"2024-09-21T02:34:31.601415+0000","last_fullsized":"2024-09-21T02:34:31.601415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:27.829955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410365+0000","last_change":"2024-09-21T02:33:31.041957+0000","last_active":"2024-09-21T02:34:31.410365+0000","last_peered":"2024-09-21T02:34:31.410365+0000","last_clean":"2024-09-21T02:34:31.410365+0000","last_became_active":"2024-09-21T02:33:31.041160+0000","last_became_peered":"2024-09-21T02:33:31.041160+0000","last_unstale":"2024-09-21T02:34:31.410365+0000","last_undegraded":"2024-09-21T02:34:31.410365+0000","last_fullsized":"2024-09-21T02:34:31.410365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.226199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7,1],"acting":[8,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.627975+0000","last_change":"2024-09-21T02:32:41.474796+0000","last_active":"2024-09-21T02:34:59.627975+0000","last_peered":"2024-09-21T02:34:59.627975+0000","last_clean":"2024-09-21T02:34:59.627975+0000","last_became_active":"2024-09-21T02:32:41.474377+0000","last_became_peered":"2024-09-21T02:32:41.474377+0000","last_unstale":"2024-09-21T02:34:59.627975+0000","last_undegraded":"2024-09-21T02:34:59.627975+0000","last_fullsized":"2024-09-21T02:34:59.627975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.418508+0000","last_change":"2024-09-21T02:34:31.418421+0000","last_active":"2024-09-21T02:34:31.418508+0000","last_peered":"2024-09-21T02:34:31.418508+0000","last_clean":"2024-09-21T02:34:31.418508+0000","last_became_active":"2024-09-21T02:34:31.413206+0000","last_became_peered":"2024-09-21T02:34:31.413206+0000","last_unstale":"2024-09-21T02:34:31.418508+0000","last_undegraded":"2024-09-21T02:34:31.418508+0000","last_fullsized":"2024-09-21T02:34:31.418508+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:33.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410536+0000","last_change":"2024-09-21T02:32:50.685932+0000","last_active":"2024-09-21T02:34:31.410536+0000","last_peered":"2024-09-21T02:34:31.410536+0000","last_clean":"2024-09-21T02:34:31.410536+0000","last_became_active":"2024-09-21T02:32:50.685584+0000","last_became_peered":"2024-09-21T02:32:50.685584+0000","last_unstale":"2024-09-21T02:34:31.410536+0000","last_undegraded":"2024-09-21T02:34:31.410536+0000","last_fullsized":"2024-09-21T02:34:31.410536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:42.118046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628583+0000","last_change":"2024-09-21T02:33:31.041507+0000","last_active":"2024-09-21T02:34:59.628583+0000","last_peered":"2024-09-21T02:34:59.628583+0000","last_clean":"2024-09-21T02:34:59.628583+0000","last_became_active":"2024-09-21T02:33:31.040982+0000","last_became_peered":"2024-09-21T02:33:31.040982+0000","last_unstale":"2024-09-21T02:34:59.628583+0000","last_undegraded":"2024-09-21T02:34:59.628583+0000","last_fullsized":"2024-09-21T02:34:59.628583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:17.608426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410182+0000","last_change":"2024-09-21T02:32:38.512557+0000","last_active":"2024-09-21T02:34:31.410182+0000","last_peered":"2024-09-21T02:34:31.410182+0000","last_clean":"2024-09-21T02:34:31.410182+0000","last_became_active":"2024-09-21T02:32:38.512069+0000","last_became_peered":"2024-09-21T02:32:38.512069+0000","last_unstale":"2024-09-21T02:34:31.410182+0000","last_undegraded":"2024-09-21T02:34:31.410182+0000","last_fullsized":"2024-09-21T02:34:31.410182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:55.038548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601304+0000","last_change":"2024-09-21T02:32:50.698539+0000","last_active":"2024-09-21T02:34:31.601304+0000","last_peered":"2024-09-21T02:34:31.601304+0000","last_clean":"2024-09-21T02:34:31.601304+0000","last_became_active":"2024-09-21T02:32:50.698107+0000","last_became_peered":"2024-09-21T02:32:50.698107+0000","last_unstale":"2024-09-21T02:34:31.601304+0000","last_undegraded":"2024-09-21T02:34:31.601304+0000","last_fullsized":"2024-09-21T02:34:31.601304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:43.141885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629232+0000","last_change":"2024-09-21T02:32:41.468472+0000","last_active":"2024-09-21T02:34:59.629232+0000","last_peered":"2024-09-21T02:34:59.629232+0000","last_clean":"2024-09-21T02:34:59.629232+0000","last_became_active":"2024-09-21T02:32:41.468039+0000","last_became_peered":"2024-09-21T02:32:41.468039+0000","last_unstale":"2024-09-21T02:34:59.629232+0000","last_undegraded":"2024-09-21T02:34:59.629232+0000","last_fullsized":"2024-09-21T02:34:59.629232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:00.501173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410057+0000","last_change":"2024-09-21T02:32:38.431613+0000","last_active":"2024-09-21T02:34:31.410057+0000","last_peered":"2024-09-21T02:34:31.410057+0000","last_clean":"2024-09-21T02:34:31.410057+0000","last_became_active":"2024-09-21T02:32:38.431128+0000","last_became_peered":"2024-09-21T02:32:38.431128+0000","last_unstale":"2024-09-21T02:34:31.410057+0000","last_undegraded":"2024-09-21T02:34:31.410057+0000","last_fullsized":"2024-09-21T02:34:31.410057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:09.400651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408210+0000","last_change":"2024-09-21T02:32:50.691401+0000","last_active":"2024-09-21T02:34:31.408210+0000","last_peered":"2024-09-21T02:34:31.408210+0000","last_clean":"2024-09-21T02:34:31.408210+0000","last_became_active":"2024-09-21T02:32:50.688202+0000","last_became_peered":"2024-09-21T02:32:50.688202+0000","last_unstale":"2024-09-21T02:34:31.408210+0000","last_undegraded":"2024-09-21T02:34:31.408210+0000","last_fullsized":"2024-09-21T02:34:31.408210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:42.516887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633862+0000","last_change":"2024-09-21T02:32:41.475760+0000","last_active":"2024-09-21T02:34:59.633862+0000","last_peered":"2024-09-21T02:34:59.633862+0000","last_clean":"2024-09-21T02:34:59.633862+0000","last_became_active":"2024-09-21T02:32:41.475381+0000","last_became_peered":"2024-09-21T02:32:41.475381+0000","last_unstale":"2024-09-21T02:34:59.633862+0000","last_undegraded":"2024-09-21T02:34:59.633862+0000","last_fullsized":"2024-09-21T02:34:59.633862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.070064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411007+0000","last_change":"2024-09-21T02:32:38.424789+0000","last_active":"2024-09-21T02:34:31.411007+0000","last_peered":"2024-09-21T02:34:31.411007+0000","last_clean":"2024-09-21T02:34:31.411007+0000","last_became_active":"2024-09-21T02:32:38.424275+0000","last_became_peered":"2024-09-21T02:32:38.424275+0000","last_unstale":"2024-09-21T02:34:31.411007+0000","last_undegraded":"2024-09-21T02:34:31.411007+0000","last_fullsized":"2024-09-21T02:34:31.411007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:50.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407352+0000","last_change":"2024-09-21T02:32:50.692496+0000","last_active":"2024-09-21T02:34:31.407352+0000","last_peered":"2024-09-21T02:34:31.407352+0000","last_clean":"2024-09-21T02:34:31.407352+0000","last_became_active":"2024-09-21T02:32:50.692055+0000","last_became_peered":"2024-09-21T02:32:50.692055+0000","last_unstale":"2024-09-21T02:34:31.407352+0000","last_undegraded":"2024-09-21T02:34:31.407352+0000","last_fullsized":"2024-09-21T02:34:31.407352+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:25.433298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635108+0000","last_change":"2024-09-21T02:32:41.475732+0000","last_active":"2024-09-21T02:34:59.635108+0000","last_peered":"2024-09-21T02:34:59.635108+0000","last_clean":"2024-09-21T02:34:59.635108+0000","last_became_active":"2024-09-21T02:32:41.475395+0000","last_became_peered":"2024-09-21T02:32:41.475395+0000","last_unstale":"2024-09-21T02:34:59.635108+0000","last_undegraded":"2024-09-21T02:34:59.635108+0000","last_fullsized":"2024-09-21T02:34:59.635108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:26.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416279+0000","last_change":"2024-09-21T02:32:38.434080+0000","last_active":"2024-09-21T02:34:31.416279+0000","last_peered":"2024-09-21T02:34:31.416279+0000","last_clean":"2024-09-21T02:34:31.416279+0000","last_became_active":"2024-09-21T02:32:38.433625+0000","last_became_peered":"2024-09-21T02:32:38.433625+0000","last_unstale":"2024-09-21T02:34:31.416279+0000","last_undegraded":"2024-09-21T02:34:31.416279+0000","last_fullsized":"2024-09-21T02:34:31.416279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:11.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411576+0000","last_change":"2024-09-21T02:32:50.687555+0000","last_active":"2024-09-21T02:34:31.411576+0000","last_peered":"2024-09-21T02:34:31.411576+0000","last_clean":"2024-09-21T02:34:31.411576+0000","last_became_active":"2024-09-21T02:32:50.686979+0000","last_became_peered":"2024-09-21T02:32:50.686979+0000","last_unstale":"2024-09-21T02:34:31.411576+0000","last_undegraded":"2024-09-21T02:34:31.411576+0000","last_fullsized":"2024-09-21T02:34:31.411576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:01.136515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625187+0000","last_change":"2024-09-21T02:32:41.463688+0000","last_active":"2024-09-21T02:34:59.625187+0000","last_peered":"2024-09-21T02:34:59.625187+0000","last_clean":"2024-09-21T02:34:59.625187+0000","last_became_active":"2024-09-21T02:32:41.463306+0000","last_became_peered":"2024-09-21T02:32:41.463306+0000","last_unstale":"2024-09-21T02:34:59.625187+0000","last_undegraded":"2024-09-21T02:34:59.625187+0000","last_fullsized":"2024-09-21T02:34:59.625187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:46.217029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":329,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:35:22.500783+0000","last_change":"2024-09-21T02:34:31.423753+0000","last_active":"2024-09-21T02:35:22.500783+0000","last_peered":"2024-09-21T02:35:22.500783+0000","last_clean":"2024-09-21T02:35:22.500783+0000","last_became_active":"2024-09-21T02:34:31.417307+0000","last_became_peered":"2024-09-21T02:34:31.417307+0000","last_unstale":"2024-09-21T02:35:22.500783+0000","last_undegraded":"2024-09-21T02:35:22.500783+0000","last_fullsized":"2024-09-21T02:35:22.500783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:29.538505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69827,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":184,"num_write":39,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":69267,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412671+0000","last_change":"2024-09-21T02:33:30.538615+0000","last_active":"2024-09-21T02:34:31.412671+0000","last_peered":"2024-09-21T02:34:31.412671+0000","last_clean":"2024-09-21T02:34:31.412671+0000","last_became_active":"2024-09-21T02:33:30.538046+0000","last_became_peered":"2024-09-21T02:33:30.538046+0000","last_unstale":"2024-09-21T02:34:31.412671+0000","last_undegraded":"2024-09-21T02:34:31.412671+0000","last_fullsized":"2024-09-21T02:34:31.412671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:04.235706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644082+0000","last_change":"2024-09-21T02:32:41.470318+0000","last_active":"2024-09-21T02:34:59.644082+0000","last_peered":"2024-09-21T02:34:59.644082+0000","last_clean":"2024-09-21T02:34:59.644082+0000","last_became_active":"2024-09-21T02:32:41.466804+0000","last_became_peered":"2024-09-21T02:32:41.466804+0000","last_unstale":"2024-09-21T02:34:59.644082+0000","last_undegraded":"2024-09-21T02:34:59.644082+0000","last_fullsized":"2024-09-21T02:34:59.644082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411855+0000","last_change":"2024-09-21T02:32:38.514901+0000","last_active":"2024-09-21T02:34:31.411855+0000","last_peered":"2024-09-21T02:34:31.411855+0000","last_clean":"2024-09-21T02:34:31.411855+0000","last_became_active":"2024-09-21T02:32:38.514497+0000","last_became_peered":"2024-09-21T02:32:38.514497+0000","last_unstale":"2024-09-21T02:34:31.411855+0000","last_undegraded":"2024-09-21T02:34:31.411855+0000","last_fullsized":"2024-09-21T02:34:31.411855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:02.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410240+0000","last_change":"2024-09-21T02:33:31.041566+0000","last_active":"2024-09-21T02:34:31.410240+0000","last_peered":"2024-09-21T02:34:31.410240+0000","last_clean":"2024-09-21T02:34:31.410240+0000","last_became_active":"2024-09-21T02:33:31.041041+0000","last_became_peered":"2024-09-21T02:33:31.041041+0000","last_unstale":"2024-09-21T02:34:31.410240+0000","last_undegraded":"2024-09-21T02:34:31.410240+0000","last_fullsized":"2024-09-21T02:34:31.410240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:00.236406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638081+0000","last_change":"2024-09-21T02:32:41.483502+0000","last_active":"2024-09-21T02:34:59.638081+0000","last_peered":"2024-09-21T02:34:59.638081+0000","last_clean":"2024-09-21T02:34:59.638081+0000","last_became_active":"2024-09-21T02:32:41.483116+0000","last_became_peered":"2024-09-21T02:32:41.483116+0000","last_unstale":"2024-09-21T02:34:59.638081+0000","last_undegraded":"2024-09-21T02:34:59.638081+0000","last_fullsized":"2024-09-21T02:34:59.638081+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:39.146202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412020+0000","last_change":"2024-09-21T02:33:31.041819+0000","last_active":"2024-09-21T02:34:31.412020+0000","last_peered":"2024-09-21T02:34:31.412020+0000","last_clean":"2024-09-21T02:34:31.412020+0000","last_became_active":"2024-09-21T02:33:31.041241+0000","last_became_peered":"2024-09-21T02:33:31.041241+0000","last_unstale":"2024-09-21T02:34:31.412020+0000","last_undegraded":"2024-09-21T02:34:31.412020+0000","last_fullsized":"2024-09-21T02:34:31.412020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:00.241618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407302+0000","last_change":"2024-09-21T02:32:50.692227+0000","last_active":"2024-09-21T02:34:31.407302+0000","last_peered":"2024-09-21T02:34:31.407302+0000","last_clean":"2024-09-21T02:34:31.407302+0000","last_became_active":"2024-09-21T02:32:50.691787+0000","last_became_peered":"2024-09-21T02:32:50.691787+0000","last_unstale":"2024-09-21T02:34:31.407302+0000","last_undegraded":"2024-09-21T02:34:31.407302+0000","last_fullsized":"2024-09-21T02:34:31.407302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:40.086313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644603+0000","last_change":"2024-09-21T02:32:41.476056+0000","last_active":"2024-09-21T02:34:59.644603+0000","last_peered":"2024-09-21T02:34:59.644603+0000","last_clean":"2024-09-21T02:34:59.644603+0000","last_became_active":"2024-09-21T02:32:41.475525+0000","last_became_peered":"2024-09-21T02:32:41.475525+0000","last_unstale":"2024-09-21T02:34:59.644603+0000","last_undegraded":"2024-09-21T02:34:59.644603+0000","last_fullsized":"2024-09-21T02:34:59.644603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:42.074296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413613+0000","last_change":"2024-09-21T02:32:38.430845+0000","last_active":"2024-09-21T02:34:31.413613+0000","last_peered":"2024-09-21T02:34:31.413613+0000","last_clean":"2024-09-21T02:34:31.413613+0000","last_became_active":"2024-09-21T02:32:38.430372+0000","last_became_peered":"2024-09-21T02:32:38.430372+0000","last_unstale":"2024-09-21T02:34:31.413613+0000","last_undegraded":"2024-09-21T02:34:31.413613+0000","last_fullsized":"2024-09-21T02:34:31.413613+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:40.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409266+0000","last_change":"2024-09-21T02:32:50.685481+0000","last_active":"2024-09-21T02:34:31.409266+0000","last_peered":"2024-09-21T02:34:31.409266+0000","last_clean":"2024-09-21T02:34:31.409266+0000","last_became_active":"2024-09-21T02:32:50.685044+0000","last_became_peered":"2024-09-21T02:32:50.685044+0000","last_unstale":"2024-09-21T02:34:31.409266+0000","last_undegraded":"2024-09-21T02:34:31.409266+0000","last_fullsized":"2024-09-21T02:34:31.409266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:33.132966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602323+0000","last_change":"2024-09-21T02:32:50.690447+0000","last_active":"2024-09-21T02:34:31.602323+0000","last_peered":"2024-09-21T02:34:31.602323+0000","last_clean":"2024-09-21T02:34:31.602323+0000","last_became_active":"2024-09-21T02:32:50.690021+0000","last_became_peered":"2024-09-21T02:32:50.690021+0000","last_unstale":"2024-09-21T02:34:31.602323+0000","last_undegraded":"2024-09-21T02:34:31.602323+0000","last_fullsized":"2024-09-21T02:34:31.602323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:44.436690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633674+0000","last_change":"2024-09-21T02:32:41.469186+0000","last_active":"2024-09-21T02:34:59.633674+0000","last_peered":"2024-09-21T02:34:59.633674+0000","last_clean":"2024-09-21T02:34:59.633674+0000","last_became_active":"2024-09-21T02:32:41.468837+0000","last_became_peered":"2024-09-21T02:32:41.468837+0000","last_unstale":"2024-09-21T02:34:59.633674+0000","last_undegraded":"2024-09-21T02:34:59.633674+0000","last_fullsized":"2024-09-21T02:34:59.633674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:02.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411587+0000","last_change":"2024-09-21T02:32:38.426631+0000","last_active":"2024-09-21T02:34:31.411587+0000","last_peered":"2024-09-21T02:34:31.411587+0000","last_clean":"2024-09-21T02:34:31.411587+0000","last_became_active":"2024-09-21T02:32:38.425600+0000","last_became_peered":"2024-09-21T02:32:38.425600+0000","last_unstale":"2024-09-21T02:34:31.411587+0000","last_undegraded":"2024-09-21T02:34:31.411587+0000","last_fullsized":"2024-09-21T02:34:31.411587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.669245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407635+0000","last_change":"2024-09-21T02:32:50.697935+0000","last_active":"2024-09-21T02:34:31.407635+0000","last_peered":"2024-09-21T02:34:31.407635+0000","last_clean":"2024-09-21T02:34:31.407635+0000","last_became_active":"2024-09-21T02:32:50.697537+0000","last_became_peered":"2024-09-21T02:32:50.697537+0000","last_unstale":"2024-09-21T02:34:31.407635+0000","last_undegraded":"2024-09-21T02:34:31.407635+0000","last_fullsized":"2024-09-21T02:34:31.407635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:32.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628002+0000","last_change":"2024-09-21T02:32:41.458640+0000","last_active":"2024-09-21T02:34:59.628002+0000","last_peered":"2024-09-21T02:34:59.628002+0000","last_clean":"2024-09-21T02:34:59.628002+0000","last_became_active":"2024-09-21T02:32:41.458231+0000","last_became_peered":"2024-09-21T02:32:41.458231+0000","last_unstale":"2024-09-21T02:34:59.628002+0000","last_undegraded":"2024-09-21T02:34:59.628002+0000","last_fullsized":"2024-09-21T02:34:59.628002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:26.132979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600867+0000","last_change":"2024-09-21T02:32:38.430888+0000","last_active":"2024-09-21T02:34:31.600867+0000","last_peered":"2024-09-21T02:34:31.600867+0000","last_clean":"2024-09-21T02:34:31.600867+0000","last_became_active":"2024-09-21T02:32:38.430516+0000","last_became_peered":"2024-09-21T02:32:38.430516+0000","last_unstale":"2024-09-21T02:34:31.600867+0000","last_undegraded":"2024-09-21T02:34:31.600867+0000","last_fullsized":"2024-09-21T02:34:31.600867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:54.671763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412943+0000","last_change":"2024-09-21T02:32:38.434012+0000","last_active":"2024-09-21T02:34:31.412943+0000","last_peered":"2024-09-21T02:34:31.412943+0000","last_clean":"2024-09-21T02:34:31.412943+0000","last_became_active":"2024-09-21T02:32:38.433571+0000","last_became_peered":"2024-09-21T02:32:38.433571+0000","last_unstale":"2024-09-21T02:34:31.412943+0000","last_undegraded":"2024-09-21T02:34:31.412943+0000","last_fullsized":"2024-09-21T02:34:31.412943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:59.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635223+0000","last_change":"2024-09-21T02:33:30.650855+0000","last_active":"2024-09-21T02:34:59.635223+0000","last_peered":"2024-09-21T02:34:59.635223+0000","last_clean":"2024-09-21T02:34:59.635223+0000","last_became_active":"2024-09-21T02:33:30.650428+0000","last_became_peered":"2024-09-21T02:33:30.650428+0000","last_unstale":"2024-09-21T02:34:59.635223+0000","last_undegraded":"2024-09-21T02:34:59.635223+0000","last_fullsized":"2024-09-21T02:34:59.635223+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:55.757861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416153+0000","last_change":"2024-09-21T02:32:50.698249+0000","last_active":"2024-09-21T02:34:31.416153+0000","last_peered":"2024-09-21T02:34:31.416153+0000","last_clean":"2024-09-21T02:34:31.416153+0000","last_became_active":"2024-09-21T02:32:50.697768+0000","last_became_peered":"2024-09-21T02:32:50.697768+0000","last_unstale":"2024-09-21T02:34:31.416153+0000","last_undegraded":"2024-09-21T02:34:31.416153+0000","last_fullsized":"2024-09-21T02:34:31.416153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.723420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411368+0000","last_change":"2024-09-21T02:32:38.435733+0000","last_active":"2024-09-21T02:34:31.411368+0000","last_peered":"2024-09-21T02:34:31.411368+0000","last_clean":"2024-09-21T02:34:31.411368+0000","last_became_active":"2024-09-21T02:32:38.435288+0000","last_became_peered":"2024-09-21T02:32:38.435288+0000","last_unstale":"2024-09-21T02:34:31.411368+0000","last_undegraded":"2024-09-21T02:34:31.411368+0000","last_fullsized":"2024-09-21T02:34:31.411368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.430652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.619449+0000","last_change":"2024-09-21T02:32:41.468127+0000","last_active":"2024-09-21T02:34:59.619449+0000","last_peered":"2024-09-21T02:34:59.619449+0000","last_clean":"2024-09-21T02:34:59.619449+0000","last_became_active":"2024-09-21T02:32:41.467730+0000","last_became_peered":"2024-09-21T02:32:41.467730+0000","last_unstale":"2024-09-21T02:34:59.619449+0000","last_undegraded":"2024-09-21T02:34:59.619449+0000","last_fullsized":"2024-09-21T02:34:59.619449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:39.684035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416423+0000","last_change":"2024-09-21T02:32:50.684115+0000","last_active":"2024-09-21T02:34:31.416423+0000","last_peered":"2024-09-21T02:34:31.416423+0000","last_clean":"2024-09-21T02:34:31.416423+0000","last_became_active":"2024-09-21T02:32:50.683627+0000","last_became_peered":"2024-09-21T02:32:50.683627+0000","last_unstale":"2024-09-21T02:34:31.416423+0000","last_undegraded":"2024-09-21T02:34:31.416423+0000","last_fullsized":"2024-09-21T02:34:31.416423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:10.953943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628536+0000","last_change":"2024-09-21T02:32:41.465744+0000","last_active":"2024-09-21T02:34:59.628536+0000","last_peered":"2024-09-21T02:34:59.628536+0000","last_clean":"2024-09-21T02:34:59.628536+0000","last_became_active":"2024-09-21T02:32:41.465392+0000","last_became_peered":"2024-09-21T02:32:41.465392+0000","last_unstale":"2024-09-21T02:34:59.628536+0000","last_undegraded":"2024-09-21T02:34:59.628536+0000","last_fullsized":"2024-09-21T02:34:59.628536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:54.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.623827+0000","last_change":"2024-09-21T02:32:41.470967+0000","last_active":"2024-09-21T02:34:59.623827+0000","last_peered":"2024-09-21T02:34:59.623827+0000","last_clean":"2024-09-21T02:34:59.623827+0000","last_became_active":"2024-09-21T02:32:41.470547+0000","last_became_peered":"2024-09-21T02:32:41.470547+0000","last_unstale":"2024-09-21T02:34:59.623827+0000","last_undegraded":"2024-09-21T02:34:59.623827+0000","last_fullsized":"2024-09-21T02:34:59.623827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:57.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626050+0000","last_change":"2024-09-21T02:32:41.474500+0000","last_active":"2024-09-21T02:34:59.626050+0000","last_peered":"2024-09-21T02:34:59.626050+0000","last_clean":"2024-09-21T02:34:59.626050+0000","last_became_active":"2024-09-21T02:32:41.474117+0000","last_became_peered":"2024-09-21T02:32:41.474117+0000","last_unstale":"2024-09-21T02:34:59.626050+0000","last_undegraded":"2024-09-21T02:34:59.626050+0000","last_fullsized":"2024-09-21T02:34:59.626050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:43.152503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638408+0000","last_change":"2024-09-21T02:32:41.479123+0000","last_active":"2024-09-21T02:34:59.638408+0000","last_peered":"2024-09-21T02:34:59.638408+0000","last_clean":"2024-09-21T02:34:59.638408+0000","last_became_active":"2024-09-21T02:32:41.478543+0000","last_became_peered":"2024-09-21T02:32:41.478543+0000","last_unstale":"2024-09-21T02:34:59.638408+0000","last_undegraded":"2024-09-21T02:34:59.638408+0000","last_fullsized":"2024-09-21T02:34:59.638408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:39.802425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641218+0000","last_change":"2024-09-21T02:32:41.483334+0000","last_active":"2024-09-21T02:34:59.641218+0000","last_peered":"2024-09-21T02:34:59.641218+0000","last_clean":"2024-09-21T02:34:59.641218+0000","last_became_active":"2024-09-21T02:32:41.482999+0000","last_became_peered":"2024-09-21T02:32:41.482999+0000","last_unstale":"2024-09-21T02:34:59.641218+0000","last_undegraded":"2024-09-21T02:34:59.641218+0000","last_fullsized":"2024-09-21T02:34:59.641218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:16.259647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.620849+0000","last_change":"2024-09-21T02:33:30.539417+0000","last_active":"2024-09-21T02:34:59.620849+0000","last_peered":"2024-09-21T02:34:59.620849+0000","last_clean":"2024-09-21T02:34:59.620849+0000","last_became_active":"2024-09-21T02:33:30.538970+0000","last_became_peered":"2024-09-21T02:33:30.538970+0000","last_unstale":"2024-09-21T02:34:59.620849+0000","last_undegraded":"2024-09-21T02:34:59.620849+0000","last_fullsized":"2024-09-21T02:34:59.620849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:09.772513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.623783+0000","last_change":"2024-09-21T02:32:41.469386+0000","last_active":"2024-09-21T02:34:59.623783+0000","last_peered":"2024-09-21T02:34:59.623783+0000","last_clean":"2024-09-21T02:34:59.623783+0000","last_became_active":"2024-09-21T02:32:41.468982+0000","last_became_peered":"2024-09-21T02:32:41.468982+0000","last_unstale":"2024-09-21T02:34:59.623783+0000","last_undegraded":"2024-09-21T02:34:59.623783+0000","last_fullsized":"2024-09-21T02:34:59.623783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.644854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.617299+0000","last_change":"2024-09-21T02:32:41.467365+0000","last_active":"2024-09-21T02:34:59.617299+0000","last_peered":"2024-09-21T02:34:59.617299+0000","last_clean":"2024-09-21T02:34:59.617299+0000","last_became_active":"2024-09-21T02:32:41.466893+0000","last_became_peered":"2024-09-21T02:32:41.466893+0000","last_unstale":"2024-09-21T02:34:59.617299+0000","last_undegraded":"2024-09-21T02:34:59.617299+0000","last_fullsized":"2024-09-21T02:34:59.617299+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.634987+0000","last_change":"2024-09-21T02:32:41.473695+0000","last_active":"2024-09-21T02:34:59.634987+0000","last_peered":"2024-09-21T02:34:59.634987+0000","last_clean":"2024-09-21T02:34:59.634987+0000","last_became_active":"2024-09-21T02:32:41.473035+0000","last_became_peered":"2024-09-21T02:32:41.473035+0000","last_unstale":"2024-09-21T02:34:59.634987+0000","last_undegraded":"2024-09-21T02:34:59.634987+0000","last_fullsized":"2024-09-21T02:34:59.634987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:54.343984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625865+0000","last_change":"2024-09-21T02:32:41.473578+0000","last_active":"2024-09-21T02:34:59.625865+0000","last_peered":"2024-09-21T02:34:59.625865+0000","last_clean":"2024-09-21T02:34:59.625865+0000","last_became_active":"2024-09-21T02:32:41.472983+0000","last_became_peered":"2024-09-21T02:32:41.472983+0000","last_unstale":"2024-09-21T02:34:59.625865+0000","last_undegraded":"2024-09-21T02:34:59.625865+0000","last_fullsized":"2024-09-21T02:34:59.625865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.895809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642194+0000","last_change":"2024-09-21T02:32:41.473751+0000","last_active":"2024-09-21T02:34:59.642194+0000","last_peered":"2024-09-21T02:34:59.642194+0000","last_clean":"2024-09-21T02:34:59.642194+0000","last_became_active":"2024-09-21T02:32:41.473367+0000","last_became_peered":"2024-09-21T02:32:41.473367+0000","last_unstale":"2024-09-21T02:34:59.642194+0000","last_undegraded":"2024-09-21T02:34:59.642194+0000","last_fullsized":"2024-09-21T02:34:59.642194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:04.707745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641726+0000","last_change":"2024-09-21T02:32:41.485375+0000","last_active":"2024-09-21T02:34:59.641726+0000","last_peered":"2024-09-21T02:34:59.641726+0000","last_clean":"2024-09-21T02:34:59.641726+0000","last_became_active":"2024-09-21T02:32:41.484845+0000","last_became_peered":"2024-09-21T02:32:41.484845+0000","last_unstale":"2024-09-21T02:34:59.641726+0000","last_undegraded":"2024-09-21T02:34:59.641726+0000","last_fullsized":"2024-09-21T02:34:59.641726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:58.529747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625775+0000","last_change":"2024-09-21T02:32:41.462925+0000","last_active":"2024-09-21T02:34:59.625775+0000","last_peered":"2024-09-21T02:34:59.625775+0000","last_clean":"2024-09-21T02:34:59.625775+0000","last_became_active":"2024-09-21T02:32:41.462056+0000","last_became_peered":"2024-09-21T02:32:41.462056+0000","last_unstale":"2024-09-21T02:34:59.625775+0000","last_undegraded":"2024-09-21T02:34:59.625775+0000","last_fullsized":"2024-09-21T02:34:59.625775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:05.447554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.624036+0000","last_change":"2024-09-21T02:32:41.475111+0000","last_active":"2024-09-21T02:34:59.624036+0000","last_peered":"2024-09-21T02:34:59.624036+0000","last_clean":"2024-09-21T02:34:59.624036+0000","last_became_active":"2024-09-21T02:32:41.474634+0000","last_became_peered":"2024-09-21T02:32:41.474634+0000","last_unstale":"2024-09-21T02:34:59.624036+0000","last_undegraded":"2024-09-21T02:34:59.624036+0000","last_fullsized":"2024-09-21T02:34:59.624036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:07.750970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.630603+0000","last_change":"2024-09-21T02:32:41.479702+0000","last_active":"2024-09-21T02:34:59.630603+0000","last_peered":"2024-09-21T02:34:59.630603+0000","last_clean":"2024-09-21T02:34:59.630603+0000","last_became_active":"2024-09-21T02:32:41.479378+0000","last_became_peered":"2024-09-21T02:32:41.479378+0000","last_unstale":"2024-09-21T02:34:59.630603+0000","last_undegraded":"2024-09-21T02:34:59.630603+0000","last_fullsized":"2024-09-21T02:34:59.630603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:56.687641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642769+0000","last_change":"2024-09-21T02:32:41.475567+0000","last_active":"2024-09-21T02:34:59.642769+0000","last_peered":"2024-09-21T02:34:59.642769+0000","last_clean":"2024-09-21T02:34:59.642769+0000","last_became_active":"2024-09-21T02:32:41.475207+0000","last_became_peered":"2024-09-21T02:32:41.475207+0000","last_unstale":"2024-09-21T02:34:59.642769+0000","last_undegraded":"2024-09-21T02:34:59.642769+0000","last_fullsized":"2024-09-21T02:34:59.642769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:33.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644970+0000","last_change":"2024-09-21T02:32:41.483518+0000","last_active":"2024-09-21T02:34:59.644970+0000","last_peered":"2024-09-21T02:34:59.644970+0000","last_clean":"2024-09-21T02:34:59.644970+0000","last_became_active":"2024-09-21T02:32:41.483088+0000","last_became_peered":"2024-09-21T02:32:41.483088+0000","last_unstale":"2024-09-21T02:34:59.644970+0000","last_undegraded":"2024-09-21T02:34:59.644970+0000","last_fullsized":"2024-09-21T02:34:59.644970+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:23.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633832+0000","last_change":"2024-09-21T02:32:41.482113+0000","last_active":"2024-09-21T02:34:59.633832+0000","last_peered":"2024-09-21T02:34:59.633832+0000","last_clean":"2024-09-21T02:34:59.633832+0000","last_became_active":"2024-09-21T02:32:41.479123+0000","last_became_peered":"2024-09-21T02:32:41.479123+0000","last_unstale":"2024-09-21T02:34:59.633832+0000","last_undegraded":"2024-09-21T02:34:59.633832+0000","last_fullsized":"2024-09-21T02:34:59.633832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:48.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642077+0000","last_change":"2024-09-21T02:32:41.470429+0000","last_active":"2024-09-21T02:34:59.642077+0000","last_peered":"2024-09-21T02:34:59.642077+0000","last_clean":"2024-09-21T02:34:59.642077+0000","last_became_active":"2024-09-21T02:32:41.469421+0000","last_became_peered":"2024-09-21T02:32:41.469421+0000","last_unstale":"2024-09-21T02:34:59.642077+0000","last_undegraded":"2024-09-21T02:34:59.642077+0000","last_fullsized":"2024-09-21T02:34:59.642077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:00.952030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.634790+0000","last_change":"2024-09-21T02:32:41.470361+0000","last_active":"2024-09-21T02:34:59.634790+0000","last_peered":"2024-09-21T02:34:59.634790+0000","last_clean":"2024-09-21T02:34:59.634790+0000","last_became_active":"2024-09-21T02:32:41.469983+0000","last_became_peered":"2024-09-21T02:32:41.469983+0000","last_unstale":"2024-09-21T02:34:59.634790+0000","last_undegraded":"2024-09-21T02:34:59.634790+0000","last_fullsized":"2024-09-21T02:34:59.634790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:02.703688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.637811+0000","last_change":"2024-09-21T02:32:41.468975+0000","last_active":"2024-09-21T02:34:59.637811+0000","last_peered":"2024-09-21T02:34:59.637811+0000","last_clean":"2024-09-21T02:34:59.637811+0000","last_became_active":"2024-09-21T02:32:41.468612+0000","last_became_peered":"2024-09-21T02:32:41.468612+0000","last_unstale":"2024-09-21T02:34:59.637811+0000","last_undegraded":"2024-09-21T02:34:59.637811+0000","last_fullsized":"2024-09-21T02:34:59.637811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:04.442257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643213+0000","last_change":"2024-09-21T02:32:41.471444+0000","last_active":"2024-09-21T02:34:59.643213+0000","last_peered":"2024-09-21T02:34:59.643213+0000","last_clean":"2024-09-21T02:34:59.643213+0000","last_became_active":"2024-09-21T02:32:41.470437+0000","last_became_peered":"2024-09-21T02:32:41.470437+0000","last_unstale":"2024-09-21T02:34:59.643213+0000","last_undegraded":"2024-09-21T02:34:59.643213+0000","last_fullsized":"2024-09-21T02:34:59.643213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:13.933069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635196+0000","last_change":"2024-09-21T02:32:41.475397+0000","last_active":"2024-09-21T02:34:59.635196+0000","last_peered":"2024-09-21T02:34:59.635196+0000","last_clean":"2024-09-21T02:34:59.635196+0000","last_became_active":"2024-09-21T02:32:41.475034+0000","last_became_peered":"2024-09-21T02:32:41.475034+0000","last_unstale":"2024-09-21T02:34:59.635196+0000","last_undegraded":"2024-09-21T02:34:59.635196+0000","last_fullsized":"2024-09-21T02:34:59.635196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:24.944289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643674+0000","last_change":"2024-09-21T02:32:41.470297+0000","last_active":"2024-09-21T02:34:59.643674+0000","last_peered":"2024-09-21T02:34:59.643674+0000","last_clean":"2024-09-21T02:34:59.643674+0000","last_became_active":"2024-09-21T02:32:41.469843+0000","last_became_peered":"2024-09-21T02:32:41.469843+0000","last_unstale":"2024-09-21T02:34:59.643674+0000","last_undegraded":"2024-09-21T02:34:59.643674+0000","last_fullsized":"2024-09-21T02:34:59.643674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629146+0000","last_change":"2024-09-21T02:33:30.535828+0000","last_active":"2024-09-21T02:34:59.629146+0000","last_peered":"2024-09-21T02:34:59.629146+0000","last_clean":"2024-09-21T02:34:59.629146+0000","last_became_active":"2024-09-21T02:33:30.535576+0000","last_became_peered":"2024-09-21T02:33:30.535576+0000","last_unstale":"2024-09-21T02:34:59.629146+0000","last_undegraded":"2024-09-21T02:34:59.629146+0000","last_fullsized":"2024-09-21T02:34:59.629146+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:05.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.621368+0000","last_change":"2024-09-21T02:32:41.466073+0000","last_active":"2024-09-21T02:34:59.621368+0000","last_peered":"2024-09-21T02:34:59.621368+0000","last_clean":"2024-09-21T02:34:59.621368+0000","last_became_active":"2024-09-21T02:32:41.465664+0000","last_became_peered":"2024-09-21T02:32:41.465664+0000","last_unstale":"2024-09-21T02:34:59.621368+0000","last_undegraded":"2024-09-21T02:34:59.621368+0000","last_fullsized":"2024-09-21T02:34:59.621368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:25.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.636445+0000","last_change":"2024-09-21T02:32:41.471006+0000","last_active":"2024-09-21T02:34:59.636445+0000","last_peered":"2024-09-21T02:34:59.636445+0000","last_clean":"2024-09-21T02:34:59.636445+0000","last_became_active":"2024-09-21T02:32:41.469780+0000","last_became_peered":"2024-09-21T02:32:41.469780+0000","last_unstale":"2024-09-21T02:34:59.636445+0000","last_undegraded":"2024-09-21T02:34:59.636445+0000","last_fullsized":"2024-09-21T02:34:59.636445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:18.604729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.624994+0000","last_change":"2024-09-21T02:32:41.476169+0000","last_active":"2024-09-21T02:34:59.624994+0000","last_peered":"2024-09-21T02:34:59.624994+0000","last_clean":"2024-09-21T02:34:59.624994+0000","last_became_active":"2024-09-21T02:32:41.475754+0000","last_became_peered":"2024-09-21T02:32:41.475754+0000","last_unstale":"2024-09-21T02:34:59.624994+0000","last_undegraded":"2024-09-21T02:34:59.624994+0000","last_fullsized":"2024-09-21T02:34:59.624994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:18.532122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.622188+0000","last_change":"2024-09-21T02:32:41.467078+0000","last_active":"2024-09-21T02:34:59.622188+0000","last_peered":"2024-09-21T02:34:59.622188+0000","last_clean":"2024-09-21T02:34:59.622188+0000","last_became_active":"2024-09-21T02:32:41.466702+0000","last_became_peered":"2024-09-21T02:32:41.466702+0000","last_unstale":"2024-09-21T02:34:59.622188+0000","last_undegraded":"2024-09-21T02:34:59.622188+0000","last_fullsized":"2024-09-21T02:34:59.622188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:43.409390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643197+0000","last_change":"2024-09-21T02:32:41.467476+0000","last_active":"2024-09-21T02:34:59.643197+0000","last_peered":"2024-09-21T02:34:59.643197+0000","last_clean":"2024-09-21T02:34:59.643197+0000","last_became_active":"2024-09-21T02:32:41.466901+0000","last_became_peered":"2024-09-21T02:32:41.466901+0000","last_unstale":"2024-09-21T02:34:59.643197+0000","last_undegraded":"2024-09-21T02:34:59.643197+0000","last_fullsized":"2024-09-21T02:34:59.643197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:46.207507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.639768+0000","last_change":"2024-09-21T02:32:41.486528+0000","last_active":"2024-09-21T02:34:59.639768+0000","last_peered":"2024-09-21T02:34:59.639768+0000","last_clean":"2024-09-21T02:34:59.639768+0000","last_became_active":"2024-09-21T02:32:41.484370+0000","last_became_peered":"2024-09-21T02:32:41.484370+0000","last_unstale":"2024-09-21T02:34:59.639768+0000","last_undegraded":"2024-09-21T02:34:59.639768+0000","last_fullsized":"2024-09-21T02:34:59.639768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:28.978540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641305+0000","last_change":"2024-09-21T02:32:41.474525+0000","last_active":"2024-09-21T02:34:59.641305+0000","last_peered":"2024-09-21T02:34:59.641305+0000","last_clean":"2024-09-21T02:34:59.641305+0000","last_became_active":"2024-09-21T02:32:41.474147+0000","last_became_peered":"2024-09-21T02:32:41.474147+0000","last_unstale":"2024-09-21T02:34:59.641305+0000","last_undegraded":"2024-09-21T02:34:59.641305+0000","last_fullsized":"2024-09-21T02:34:59.641305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:26.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70625,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":235,"num_read_kb":189,"num_write":101,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":69871,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":211564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710766,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":505903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906995,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1161592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070520,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":509977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266751,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":505881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462981,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1601536,"data_stored":1099763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626506,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":501203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822736,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1609728,"data_stored":1095849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986260,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":574837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182491,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":501307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":501237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":571030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":501293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:35:27.044 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:35:27.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:35:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:27.801 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:27 smithi079 ceph-mon[30788]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T02:35:27.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:27 smithi148 ceph-mon[34626]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T02:35:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:27 smithi098 ceph-mon[34832]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T02:35:28.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 -- 172.21.15.79:0/671508205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef3810b4f0 msgr2=0x7fef3810b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 --2- 172.21.15.79:0/671508205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef3810b4f0 0x7fef3810b900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef20009900 tx=0x7fef2002a410 comp rx=0 tx=0).stop 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 -- 172.21.15.79:0/671508205 shutdown_connections 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 --2- 172.21.15.79:0/671508205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef3810be40 0x7fef38112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 --2- 172.21.15.79:0/671508205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef3810b4f0 0x7fef3810b900 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 --2- 172.21.15.79:0/671508205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef38105bb0 0x7fef38105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 -- 172.21.15.79:0/671508205 >> 172.21.15.79:0/671508205 conn(0x7fef38101680 msgr2=0x7fef38103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 -- 172.21.15.79:0/671508205 shutdown_connections 2024-09-21T02:35:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.095+0000 7fef3ce00640 1 -- 172.21.15.79:0/671508205 wait complete. 2024-09-21T02:35:28.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 Processor -- start 2024-09-21T02:35:28.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 -- start start 2024-09-21T02:35:28.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef38105bb0 0x7fef3819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef3810b4f0 0x7fef3819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef3810be40 0x7fef381a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef38115b00 con 0x7fef38105bb0 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fef38115980 con 0x7fef3810be40 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.096+0000 7fef3ce00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fef38115c80 con 0x7fef3810b4f0 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef38105bb0 0x7fef3819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef38105bb0 0x7fef3819c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56752/0 (socket says 172.21.15.79:56752) 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 -- 172.21.15.79:0/1755797267 learned_addr learned my addr 172.21.15.79:0/1755797267 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef2ea00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef3810b4f0 0x7fef3819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37e00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef3810be40 0x7fef381a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 -- 172.21.15.79:0/1755797267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef3810b4f0 msgr2=0x7fef3819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef3810b4f0 0x7fef3819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 -- 172.21.15.79:0/1755797267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef3810be40 msgr2=0x7fef381a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef3810be40 0x7fef381a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.097+0000 7fef37400640 1 -- 172.21.15.79:0/1755797267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef381a24c0 con 0x7fef38105bb0 2024-09-21T02:35:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.098+0000 7fef37400640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef38105bb0 0x7fef3819c550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef2800d950 tx=0x7fef2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.098+0000 7fef34c00640 1 -- 172.21.15.79:0/1755797267 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28017030 con 0x7fef38105bb0 2024-09-21T02:35:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.098+0000 7fef34c00640 1 -- 172.21.15.79:0/1755797267 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef28004020 con 0x7fef38105bb0 2024-09-21T02:35:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.098+0000 7fef34c00640 1 -- 172.21.15.79:0/1755797267 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280047a0 con 0x7fef38105bb0 2024-09-21T02:35:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.098+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef381a27b0 con 0x7fef38105bb0 2024-09-21T02:35:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.098+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef381a8f10 con 0x7fef38105bb0 2024-09-21T02:35:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.099+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef38105fc0 con 0x7fef38105bb0 2024-09-21T02:35:28.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.102+0000 7fef34c00640 1 -- 172.21.15.79:0/1755797267 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fef28009a30 con 0x7fef38105bb0 2024-09-21T02:35:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.103+0000 7fef34c00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fef1c0b6510 0x7fef1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.103+0000 7fef34c00640 1 -- 172.21.15.79:0/1755797267 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fef280e77a0 con 0x7fef38105bb0 2024-09-21T02:35:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.103+0000 7fef2ea00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fef1c0b6510 0x7fef1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:28.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.104+0000 7fef2ea00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fef1c0b6510 0x7fef1c0b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef20009230 tx=0x7fef20031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:28.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.105+0000 7fef34c00640 1 -- 172.21.15.79:0/1755797267 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef280adc20 con 0x7fef38105bb0 2024-09-21T02:35:28.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.293+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 --> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef38063800 con 0x7fef1c0b6510 2024-09-21T02:35:28.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.299+0000 7fef34c00640 1 -- 172.21.15.79:0/1755797267 <== mgr.14152 v2:172.21.15.79:6800/863078239 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340398 (secure 0 0 0) 0x7fef38063800 con 0x7fef1c0b6510 2024-09-21T02:35:28.304 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:28.306 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T02:35:28.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fef1c0b6510 msgr2=0x7fef1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:28.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fef1c0b6510 0x7fef1c0b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef20009230 tx=0x7fef20031400 comp rx=0 tx=0).stop 2024-09-21T02:35:28.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef38105bb0 msgr2=0x7fef3819c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:28.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef38105bb0 0x7fef3819c550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef2800d950 tx=0x7fef2800de10 comp rx=0 tx=0).stop 2024-09-21T02:35:28.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 shutdown_connections 2024-09-21T02:35:28.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fef1c0b6510 0x7fef1c0b8a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef3810be40 0x7fef381a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef3810b4f0 0x7fef3819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 --2- 172.21.15.79:0/1755797267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef38105bb0 0x7fef3819c550 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:28.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 >> 172.21.15.79:0/1755797267 conn(0x7fef38101680 msgr2=0x7fef38103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:28.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 shutdown_connections 2024-09-21T02:35:28.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:28.304+0000 7fef3ce00640 1 -- 172.21.15.79:0/1755797267 wait complete. 2024-09-21T02:35:28.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:28 smithi079 ceph-mon[30788]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:28.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:28 smithi148 ceph-mon[34626]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:28.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:28 smithi098 ceph-mon[34832]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:35:29.158 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-09-21T02:35:27.443229+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661227,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":311,"num_read_kb":253,"num_write":226,"num_write_kb":2258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":3021711,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":677,"ondisk_log_size":677,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387980,"kb_used_data":13772,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553844,"statfs":{"total":1151940427776,"available":1151543136256,"internally_reserved":0,"allocated":14102528,"data_stored":8030183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003942"},"pg_stats":[{"pgid":"2.1f","version":"78'4","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.422675+0000","last_change":"2024-09-21T02:34:31.422073+0000","last_active":"2024-09-21T02:34:31.422675+0000","last_peered":"2024-09-21T02:34:31.422675+0000","last_clean":"2024-09-21T02:34:31.422675+0000","last_became_active":"2024-09-21T02:34:31.412208+0000","last_became_peered":"2024-09-21T02:34:31.412208+0000","last_unstale":"2024-09-21T02:34:31.422675+0000","last_undegraded":"2024-09-21T02:34:31.422675+0000","last_fullsized":"2024-09-21T02:34:31.422675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:05.165710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628085+0000","last_change":"2024-09-21T02:32:41.473485+0000","last_active":"2024-09-21T02:34:59.628085+0000","last_peered":"2024-09-21T02:34:59.628085+0000","last_clean":"2024-09-21T02:34:59.628085+0000","last_became_active":"2024-09-21T02:32:41.473134+0000","last_became_peered":"2024-09-21T02:32:41.473134+0000","last_unstale":"2024-09-21T02:34:59.628085+0000","last_undegraded":"2024-09-21T02:34:59.628085+0000","last_fullsized":"2024-09-21T02:34:59.628085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415843+0000","last_change":"2024-09-21T02:32:50.687618+0000","last_active":"2024-09-21T02:34:31.415843+0000","last_peered":"2024-09-21T02:34:31.415843+0000","last_clean":"2024-09-21T02:34:31.415843+0000","last_became_active":"2024-09-21T02:32:50.687157+0000","last_became_peered":"2024-09-21T02:32:50.687157+0000","last_unstale":"2024-09-21T02:34:31.415843+0000","last_undegraded":"2024-09-21T02:34:31.415843+0000","last_fullsized":"2024-09-21T02:34:31.415843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:29.247287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409896+0000","last_change":"2024-09-21T02:32:38.512667+0000","last_active":"2024-09-21T02:34:31.409896+0000","last_peered":"2024-09-21T02:34:31.409896+0000","last_clean":"2024-09-21T02:34:31.409896+0000","last_became_active":"2024-09-21T02:32:38.512261+0000","last_became_peered":"2024-09-21T02:32:38.512261+0000","last_unstale":"2024-09-21T02:34:31.409896+0000","last_undegraded":"2024-09-21T02:34:31.409896+0000","last_fullsized":"2024-09-21T02:34:31.409896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:05.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644540+0000","last_change":"2024-09-21T02:32:41.481816+0000","last_active":"2024-09-21T02:34:59.644540+0000","last_peered":"2024-09-21T02:34:59.644540+0000","last_clean":"2024-09-21T02:34:59.644540+0000","last_became_active":"2024-09-21T02:32:41.478295+0000","last_became_peered":"2024-09-21T02:32:41.478295+0000","last_unstale":"2024-09-21T02:34:59.644540+0000","last_undegraded":"2024-09-21T02:34:59.644540+0000","last_fullsized":"2024-09-21T02:34:59.644540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:58.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409553+0000","last_change":"2024-09-21T02:32:50.692598+0000","last_active":"2024-09-21T02:34:31.409553+0000","last_peered":"2024-09-21T02:34:31.409553+0000","last_clean":"2024-09-21T02:34:31.409553+0000","last_became_active":"2024-09-21T02:32:50.692120+0000","last_became_peered":"2024-09-21T02:32:50.692120+0000","last_unstale":"2024-09-21T02:34:31.409553+0000","last_undegraded":"2024-09-21T02:34:31.409553+0000","last_fullsized":"2024-09-21T02:34:31.409553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:57.642195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411124+0000","last_change":"2024-09-21T02:32:38.435292+0000","last_active":"2024-09-21T02:34:31.411124+0000","last_peered":"2024-09-21T02:34:31.411124+0000","last_clean":"2024-09-21T02:34:31.411124+0000","last_became_active":"2024-09-21T02:32:38.434878+0000","last_became_peered":"2024-09-21T02:32:38.434878+0000","last_unstale":"2024-09-21T02:34:31.411124+0000","last_undegraded":"2024-09-21T02:34:31.411124+0000","last_fullsized":"2024-09-21T02:34:31.411124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:56.827844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.645301+0000","last_change":"2024-09-21T02:32:41.467834+0000","last_active":"2024-09-21T02:34:59.645301+0000","last_peered":"2024-09-21T02:34:59.645301+0000","last_clean":"2024-09-21T02:34:59.645301+0000","last_became_active":"2024-09-21T02:32:41.467440+0000","last_became_peered":"2024-09-21T02:32:41.467440+0000","last_unstale":"2024-09-21T02:34:59.645301+0000","last_undegraded":"2024-09-21T02:34:59.645301+0000","last_fullsized":"2024-09-21T02:34:59.645301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:16.857988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409856+0000","last_change":"2024-09-21T02:33:30.539580+0000","last_active":"2024-09-21T02:34:31.409856+0000","last_peered":"2024-09-21T02:34:31.409856+0000","last_clean":"2024-09-21T02:34:31.409856+0000","last_became_active":"2024-09-21T02:33:30.539088+0000","last_became_peered":"2024-09-21T02:33:30.539088+0000","last_unstale":"2024-09-21T02:34:31.409856+0000","last_undegraded":"2024-09-21T02:34:31.409856+0000","last_fullsized":"2024-09-21T02:34:31.409856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:42.437535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410618+0000","last_change":"2024-09-21T02:32:38.431645+0000","last_active":"2024-09-21T02:34:31.410618+0000","last_peered":"2024-09-21T02:34:31.410618+0000","last_clean":"2024-09-21T02:34:31.410618+0000","last_became_active":"2024-09-21T02:32:38.431069+0000","last_became_peered":"2024-09-21T02:32:38.431069+0000","last_unstale":"2024-09-21T02:34:31.410618+0000","last_undegraded":"2024-09-21T02:34:31.410618+0000","last_fullsized":"2024-09-21T02:34:31.410618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:34.893292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629116+0000","last_change":"2024-09-21T02:32:41.470506+0000","last_active":"2024-09-21T02:34:59.629116+0000","last_peered":"2024-09-21T02:34:59.629116+0000","last_clean":"2024-09-21T02:34:59.629116+0000","last_became_active":"2024-09-21T02:32:41.470165+0000","last_became_peered":"2024-09-21T02:32:41.470165+0000","last_unstale":"2024-09-21T02:34:59.629116+0000","last_undegraded":"2024-09-21T02:34:59.629116+0000","last_fullsized":"2024-09-21T02:34:59.629116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:08.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409749+0000","last_change":"2024-09-21T02:32:50.681923+0000","last_active":"2024-09-21T02:34:31.409749+0000","last_peered":"2024-09-21T02:34:31.409749+0000","last_clean":"2024-09-21T02:34:31.409749+0000","last_became_active":"2024-09-21T02:32:50.681374+0000","last_became_peered":"2024-09-21T02:32:50.681374+0000","last_unstale":"2024-09-21T02:34:31.409749+0000","last_undegraded":"2024-09-21T02:34:31.409749+0000","last_fullsized":"2024-09-21T02:34:31.409749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:46.060715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642808+0000","last_change":"2024-09-21T02:32:41.470550+0000","last_active":"2024-09-21T02:34:59.642808+0000","last_peered":"2024-09-21T02:34:59.642808+0000","last_clean":"2024-09-21T02:34:59.642808+0000","last_became_active":"2024-09-21T02:32:41.469282+0000","last_became_peered":"2024-09-21T02:32:41.469282+0000","last_unstale":"2024-09-21T02:34:59.642808+0000","last_undegraded":"2024-09-21T02:34:59.642808+0000","last_fullsized":"2024-09-21T02:34:59.642808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:34.619382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410335+0000","last_change":"2024-09-21T02:32:38.435261+0000","last_active":"2024-09-21T02:34:31.410335+0000","last_peered":"2024-09-21T02:34:31.410335+0000","last_clean":"2024-09-21T02:34:31.410335+0000","last_became_active":"2024-09-21T02:32:38.434795+0000","last_became_peered":"2024-09-21T02:32:38.434795+0000","last_unstale":"2024-09-21T02:34:31.410335+0000","last_undegraded":"2024-09-21T02:34:31.410335+0000","last_fullsized":"2024-09-21T02:34:31.410335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:38:05.231944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409940+0000","last_change":"2024-09-21T02:32:50.714657+0000","last_active":"2024-09-21T02:34:31.409940+0000","last_peered":"2024-09-21T02:34:31.409940+0000","last_clean":"2024-09-21T02:34:31.409940+0000","last_became_active":"2024-09-21T02:32:50.714077+0000","last_became_peered":"2024-09-21T02:32:50.714077+0000","last_unstale":"2024-09-21T02:34:31.409940+0000","last_undegraded":"2024-09-21T02:34:31.409940+0000","last_fullsized":"2024-09-21T02:34:31.409940+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.812785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638187+0000","last_change":"2024-09-21T02:32:41.473964+0000","last_active":"2024-09-21T02:34:59.638187+0000","last_peered":"2024-09-21T02:34:59.638187+0000","last_clean":"2024-09-21T02:34:59.638187+0000","last_became_active":"2024-09-21T02:32:41.473598+0000","last_became_peered":"2024-09-21T02:32:41.473598+0000","last_unstale":"2024-09-21T02:34:59.638187+0000","last_undegraded":"2024-09-21T02:34:59.638187+0000","last_fullsized":"2024-09-21T02:34:59.638187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415931+0000","last_change":"2024-09-21T02:32:38.435800+0000","last_active":"2024-09-21T02:34:31.415931+0000","last_peered":"2024-09-21T02:34:31.415931+0000","last_clean":"2024-09-21T02:34:31.415931+0000","last_became_active":"2024-09-21T02:32:38.434797+0000","last_became_peered":"2024-09-21T02:32:38.434797+0000","last_unstale":"2024-09-21T02:34:31.415931+0000","last_undegraded":"2024-09-21T02:34:31.415931+0000","last_fullsized":"2024-09-21T02:34:31.415931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:46.540597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410125+0000","last_change":"2024-09-21T02:32:50.693447+0000","last_active":"2024-09-21T02:34:31.410125+0000","last_peered":"2024-09-21T02:34:31.410125+0000","last_clean":"2024-09-21T02:34:31.410125+0000","last_became_active":"2024-09-21T02:32:50.692829+0000","last_became_peered":"2024-09-21T02:32:50.692829+0000","last_unstale":"2024-09-21T02:34:31.410125+0000","last_undegraded":"2024-09-21T02:34:31.410125+0000","last_fullsized":"2024-09-21T02:34:31.410125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:10.958279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.640800+0000","last_change":"2024-09-21T02:32:41.478053+0000","last_active":"2024-09-21T02:34:59.640800+0000","last_peered":"2024-09-21T02:34:59.640800+0000","last_clean":"2024-09-21T02:34:59.640800+0000","last_became_active":"2024-09-21T02:32:41.477631+0000","last_became_peered":"2024-09-21T02:32:41.477631+0000","last_unstale":"2024-09-21T02:34:59.640800+0000","last_undegraded":"2024-09-21T02:34:59.640800+0000","last_fullsized":"2024-09-21T02:34:59.640800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:19.548261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409617+0000","last_change":"2024-09-21T02:32:38.425388+0000","last_active":"2024-09-21T02:34:31.409617+0000","last_peered":"2024-09-21T02:34:31.409617+0000","last_clean":"2024-09-21T02:34:31.409617+0000","last_became_active":"2024-09-21T02:32:38.424975+0000","last_became_peered":"2024-09-21T02:32:38.424975+0000","last_unstale":"2024-09-21T02:34:31.409617+0000","last_undegraded":"2024-09-21T02:34:31.409617+0000","last_fullsized":"2024-09-21T02:34:31.409617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:43.227634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408187+0000","last_change":"2024-09-21T02:32:50.695406+0000","last_active":"2024-09-21T02:34:31.408187+0000","last_peered":"2024-09-21T02:34:31.408187+0000","last_clean":"2024-09-21T02:34:31.408187+0000","last_became_active":"2024-09-21T02:32:50.694958+0000","last_became_peered":"2024-09-21T02:32:50.694958+0000","last_unstale":"2024-09-21T02:34:31.408187+0000","last_undegraded":"2024-09-21T02:34:31.408187+0000","last_fullsized":"2024-09-21T02:34:31.408187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:49.038587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.586954+0000","last_change":"2024-09-21T02:32:41.463475+0000","last_active":"2024-09-21T02:34:59.586954+0000","last_peered":"2024-09-21T02:34:59.586954+0000","last_clean":"2024-09-21T02:34:59.586954+0000","last_became_active":"2024-09-21T02:32:41.462950+0000","last_became_peered":"2024-09-21T02:32:41.462950+0000","last_unstale":"2024-09-21T02:34:59.586954+0000","last_undegraded":"2024-09-21T02:34:59.586954+0000","last_fullsized":"2024-09-21T02:34:59.586954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:40.871522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415861+0000","last_change":"2024-09-21T02:32:38.512534+0000","last_active":"2024-09-21T02:34:31.415861+0000","last_peered":"2024-09-21T02:34:31.415861+0000","last_clean":"2024-09-21T02:34:31.415861+0000","last_became_active":"2024-09-21T02:32:38.512162+0000","last_became_peered":"2024-09-21T02:32:38.512162+0000","last_unstale":"2024-09-21T02:34:31.415861+0000","last_undegraded":"2024-09-21T02:34:31.415861+0000","last_fullsized":"2024-09-21T02:34:31.415861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:35.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410103+0000","last_change":"2024-09-21T02:32:50.716000+0000","last_active":"2024-09-21T02:34:31.410103+0000","last_peered":"2024-09-21T02:34:31.410103+0000","last_clean":"2024-09-21T02:34:31.410103+0000","last_became_active":"2024-09-21T02:32:50.715371+0000","last_became_peered":"2024-09-21T02:32:50.715371+0000","last_unstale":"2024-09-21T02:34:31.410103+0000","last_undegraded":"2024-09-21T02:34:31.410103+0000","last_fullsized":"2024-09-21T02:34:31.410103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:54.490957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642642+0000","last_change":"2024-09-21T02:32:41.479797+0000","last_active":"2024-09-21T02:34:59.642642+0000","last_peered":"2024-09-21T02:34:59.642642+0000","last_clean":"2024-09-21T02:34:59.642642+0000","last_became_active":"2024-09-21T02:32:41.479400+0000","last_became_peered":"2024-09-21T02:32:41.479400+0000","last_unstale":"2024-09-21T02:34:59.642642+0000","last_undegraded":"2024-09-21T02:34:59.642642+0000","last_fullsized":"2024-09-21T02:34:59.642642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:34.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410512+0000","last_change":"2024-09-21T02:32:38.748844+0000","last_active":"2024-09-21T02:34:31.410512+0000","last_peered":"2024-09-21T02:34:31.410512+0000","last_clean":"2024-09-21T02:34:31.410512+0000","last_became_active":"2024-09-21T02:32:38.748428+0000","last_became_peered":"2024-09-21T02:32:38.748428+0000","last_unstale":"2024-09-21T02:34:31.410512+0000","last_undegraded":"2024-09-21T02:34:31.410512+0000","last_fullsized":"2024-09-21T02:34:31.410512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:01.300290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415969+0000","last_change":"2024-09-21T02:32:50.681667+0000","last_active":"2024-09-21T02:34:31.415969+0000","last_peered":"2024-09-21T02:34:31.415969+0000","last_clean":"2024-09-21T02:34:31.415969+0000","last_became_active":"2024-09-21T02:32:50.681113+0000","last_became_peered":"2024-09-21T02:32:50.681113+0000","last_unstale":"2024-09-21T02:34:31.415969+0000","last_undegraded":"2024-09-21T02:34:31.415969+0000","last_fullsized":"2024-09-21T02:34:31.415969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:20.881199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626269+0000","last_change":"2024-09-21T02:32:41.466320+0000","last_active":"2024-09-21T02:34:59.626269+0000","last_peered":"2024-09-21T02:34:59.626269+0000","last_clean":"2024-09-21T02:34:59.626269+0000","last_became_active":"2024-09-21T02:32:41.462700+0000","last_became_peered":"2024-09-21T02:32:41.462700+0000","last_unstale":"2024-09-21T02:34:59.626269+0000","last_undegraded":"2024-09-21T02:34:59.626269+0000","last_fullsized":"2024-09-21T02:34:59.626269+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:05.324192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:47.474143+0000","last_change":"2024-09-21T02:32:38.432478+0000","last_active":"2024-09-21T02:34:47.474143+0000","last_peered":"2024-09-21T02:34:47.474143+0000","last_clean":"2024-09-21T02:34:47.474143+0000","last_became_active":"2024-09-21T02:32:38.431107+0000","last_became_peered":"2024-09-21T02:32:38.431107+0000","last_unstale":"2024-09-21T02:34:47.474143+0000","last_undegraded":"2024-09-21T02:34:47.474143+0000","last_fullsized":"2024-09-21T02:34:47.474143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:04.629078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408632+0000","last_change":"2024-09-21T02:32:50.715335+0000","last_active":"2024-09-21T02:34:31.408632+0000","last_peered":"2024-09-21T02:34:31.408632+0000","last_clean":"2024-09-21T02:34:31.408632+0000","last_became_active":"2024-09-21T02:32:50.714117+0000","last_became_peered":"2024-09-21T02:32:50.714117+0000","last_unstale":"2024-09-21T02:34:31.408632+0000","last_undegraded":"2024-09-21T02:34:31.408632+0000","last_fullsized":"2024-09-21T02:34:31.408632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:53.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.636091+0000","last_change":"2024-09-21T02:32:41.467613+0000","last_active":"2024-09-21T02:34:59.636091+0000","last_peered":"2024-09-21T02:34:59.636091+0000","last_clean":"2024-09-21T02:34:59.636091+0000","last_became_active":"2024-09-21T02:32:41.467136+0000","last_became_peered":"2024-09-21T02:32:41.467136+0000","last_unstale":"2024-09-21T02:34:59.636091+0000","last_undegraded":"2024-09-21T02:34:59.636091+0000","last_fullsized":"2024-09-21T02:34:59.636091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:16.929257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411240+0000","last_change":"2024-09-21T02:32:38.513591+0000","last_active":"2024-09-21T02:34:31.411240+0000","last_peered":"2024-09-21T02:34:31.411240+0000","last_clean":"2024-09-21T02:34:31.411240+0000","last_became_active":"2024-09-21T02:32:38.513169+0000","last_became_peered":"2024-09-21T02:32:38.513169+0000","last_unstale":"2024-09-21T02:34:31.411240+0000","last_undegraded":"2024-09-21T02:34:31.411240+0000","last_fullsized":"2024-09-21T02:34:31.411240+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:24.038894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407303+0000","last_change":"2024-09-21T02:32:50.680165+0000","last_active":"2024-09-21T02:34:31.407303+0000","last_peered":"2024-09-21T02:34:31.407303+0000","last_clean":"2024-09-21T02:34:31.407303+0000","last_became_active":"2024-09-21T02:32:50.679730+0000","last_became_peered":"2024-09-21T02:32:50.679730+0000","last_unstale":"2024-09-21T02:34:31.407303+0000","last_undegraded":"2024-09-21T02:34:31.407303+0000","last_fullsized":"2024-09-21T02:34:31.407303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:25.739615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633830+0000","last_change":"2024-09-21T02:32:41.483355+0000","last_active":"2024-09-21T02:34:59.633830+0000","last_peered":"2024-09-21T02:34:59.633830+0000","last_clean":"2024-09-21T02:34:59.633830+0000","last_became_active":"2024-09-21T02:32:41.482786+0000","last_became_peered":"2024-09-21T02:32:41.482786+0000","last_unstale":"2024-09-21T02:34:59.633830+0000","last_undegraded":"2024-09-21T02:34:59.633830+0000","last_fullsized":"2024-09-21T02:34:59.633830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:46.277233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407870+0000","last_change":"2024-09-21T02:32:38.515173+0000","last_active":"2024-09-21T02:34:31.407870+0000","last_peered":"2024-09-21T02:34:31.407870+0000","last_clean":"2024-09-21T02:34:31.407870+0000","last_became_active":"2024-09-21T02:32:38.513341+0000","last_became_peered":"2024-09-21T02:32:38.513341+0000","last_unstale":"2024-09-21T02:34:31.407870+0000","last_undegraded":"2024-09-21T02:34:31.407870+0000","last_fullsized":"2024-09-21T02:34:31.407870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.988203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410834+0000","last_change":"2024-09-21T02:32:50.714389+0000","last_active":"2024-09-21T02:34:31.410834+0000","last_peered":"2024-09-21T02:34:31.410834+0000","last_clean":"2024-09-21T02:34:31.410834+0000","last_became_active":"2024-09-21T02:32:50.713859+0000","last_became_peered":"2024-09-21T02:32:50.713859+0000","last_unstale":"2024-09-21T02:34:31.410834+0000","last_undegraded":"2024-09-21T02:34:31.410834+0000","last_fullsized":"2024-09-21T02:34:31.410834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:41.315205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638243+0000","last_change":"2024-09-21T02:33:30.613550+0000","last_active":"2024-09-21T02:34:59.638243+0000","last_peered":"2024-09-21T02:34:59.638243+0000","last_clean":"2024-09-21T02:34:59.638243+0000","last_became_active":"2024-09-21T02:33:30.613216+0000","last_became_peered":"2024-09-21T02:33:30.613216+0000","last_unstale":"2024-09-21T02:34:59.638243+0000","last_undegraded":"2024-09-21T02:34:59.638243+0000","last_fullsized":"2024-09-21T02:34:59.638243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:11.076824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411976+0000","last_change":"2024-09-21T02:32:38.428428+0000","last_active":"2024-09-21T02:34:31.411976+0000","last_peered":"2024-09-21T02:34:31.411976+0000","last_clean":"2024-09-21T02:34:31.411976+0000","last_became_active":"2024-09-21T02:32:38.428066+0000","last_became_peered":"2024-09-21T02:32:38.428066+0000","last_unstale":"2024-09-21T02:34:31.411976+0000","last_undegraded":"2024-09-21T02:34:31.411976+0000","last_fullsized":"2024-09-21T02:34:31.411976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:45.601916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601270+0000","last_change":"2024-09-21T02:32:50.691139+0000","last_active":"2024-09-21T02:34:31.601270+0000","last_peered":"2024-09-21T02:34:31.601270+0000","last_clean":"2024-09-21T02:34:31.601270+0000","last_became_active":"2024-09-21T02:32:50.690653+0000","last_became_peered":"2024-09-21T02:32:50.690653+0000","last_unstale":"2024-09-21T02:34:31.601270+0000","last_undegraded":"2024-09-21T02:34:31.601270+0000","last_fullsized":"2024-09-21T02:34:31.601270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:43.852916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.620886+0000","last_change":"2024-09-21T02:32:41.466857+0000","last_active":"2024-09-21T02:34:59.620886+0000","last_peered":"2024-09-21T02:34:59.620886+0000","last_clean":"2024-09-21T02:34:59.620886+0000","last_became_active":"2024-09-21T02:32:41.466467+0000","last_became_peered":"2024-09-21T02:32:41.466467+0000","last_unstale":"2024-09-21T02:34:59.620886+0000","last_undegraded":"2024-09-21T02:34:59.620886+0000","last_fullsized":"2024-09-21T02:34:59.620886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:29.369150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600894+0000","last_change":"2024-09-21T02:32:38.513999+0000","last_active":"2024-09-21T02:34:31.600894+0000","last_peered":"2024-09-21T02:34:31.600894+0000","last_clean":"2024-09-21T02:34:31.600894+0000","last_became_active":"2024-09-21T02:32:38.513605+0000","last_became_peered":"2024-09-21T02:32:38.513605+0000","last_unstale":"2024-09-21T02:34:31.600894+0000","last_undegraded":"2024-09-21T02:34:31.600894+0000","last_fullsized":"2024-09-21T02:34:31.600894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:45.616961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601236+0000","last_change":"2024-09-21T02:32:50.714830+0000","last_active":"2024-09-21T02:34:31.601236+0000","last_peered":"2024-09-21T02:34:31.601236+0000","last_clean":"2024-09-21T02:34:31.601236+0000","last_became_active":"2024-09-21T02:32:50.714166+0000","last_became_peered":"2024-09-21T02:32:50.714166+0000","last_unstale":"2024-09-21T02:34:31.601236+0000","last_undegraded":"2024-09-21T02:34:31.601236+0000","last_fullsized":"2024-09-21T02:34:31.601236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:35.418689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.632282+0000","last_change":"2024-09-21T02:32:41.468695+0000","last_active":"2024-09-21T02:34:59.632282+0000","last_peered":"2024-09-21T02:34:59.632282+0000","last_clean":"2024-09-21T02:34:59.632282+0000","last_became_active":"2024-09-21T02:32:41.468349+0000","last_became_peered":"2024-09-21T02:32:41.468349+0000","last_unstale":"2024-09-21T02:34:59.632282+0000","last_undegraded":"2024-09-21T02:34:59.632282+0000","last_fullsized":"2024-09-21T02:34:59.632282+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:51.935336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411151+0000","last_change":"2024-09-21T02:32:38.431187+0000","last_active":"2024-09-21T02:34:31.411151+0000","last_peered":"2024-09-21T02:34:31.411151+0000","last_clean":"2024-09-21T02:34:31.411151+0000","last_became_active":"2024-09-21T02:32:38.430790+0000","last_became_peered":"2024-09-21T02:32:38.430790+0000","last_unstale":"2024-09-21T02:34:31.411151+0000","last_undegraded":"2024-09-21T02:34:31.411151+0000","last_fullsized":"2024-09-21T02:34:31.411151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:05.004479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411407+0000","last_change":"2024-09-21T02:32:50.715728+0000","last_active":"2024-09-21T02:34:31.411407+0000","last_peered":"2024-09-21T02:34:31.411407+0000","last_clean":"2024-09-21T02:34:31.411407+0000","last_became_active":"2024-09-21T02:32:50.715329+0000","last_became_peered":"2024-09-21T02:32:50.715329+0000","last_unstale":"2024-09-21T02:34:31.411407+0000","last_undegraded":"2024-09-21T02:34:31.411407+0000","last_fullsized":"2024-09-21T02:34:31.411407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.790489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642681+0000","last_change":"2024-09-21T02:32:41.474885+0000","last_active":"2024-09-21T02:34:59.642681+0000","last_peered":"2024-09-21T02:34:59.642681+0000","last_clean":"2024-09-21T02:34:59.642681+0000","last_became_active":"2024-09-21T02:32:41.474599+0000","last_became_peered":"2024-09-21T02:32:41.474599+0000","last_unstale":"2024-09-21T02:34:59.642681+0000","last_undegraded":"2024-09-21T02:34:59.642681+0000","last_fullsized":"2024-09-21T02:34:59.642681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:43.006829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410433+0000","last_change":"2024-09-21T02:32:38.431168+0000","last_active":"2024-09-21T02:34:31.410433+0000","last_peered":"2024-09-21T02:34:31.410433+0000","last_clean":"2024-09-21T02:34:31.410433+0000","last_became_active":"2024-09-21T02:32:38.430743+0000","last_became_peered":"2024-09-21T02:32:38.430743+0000","last_unstale":"2024-09-21T02:34:31.410433+0000","last_undegraded":"2024-09-21T02:34:31.410433+0000","last_fullsized":"2024-09-21T02:34:31.410433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:54.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411399+0000","last_change":"2024-09-21T02:31:20.822638+0000","last_active":"2024-09-21T02:34:31.411399+0000","last_peered":"2024-09-21T02:34:31.411399+0000","last_clean":"2024-09-21T02:34:31.411399+0000","last_became_active":"2024-09-21T02:31:20.816679+0000","last_became_peered":"2024-09-21T02:31:20.816679+0000","last_unstale":"2024-09-21T02:34:31.411399+0000","last_undegraded":"2024-09-21T02:34:31.411399+0000","last_fullsized":"2024-09-21T02:34:31.411399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:27:32.360535+0000","last_clean_scrub_stamp":"2024-09-21T02:27:32.360535+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:51.568101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411722+0000","last_change":"2024-09-21T02:32:50.698437+0000","last_active":"2024-09-21T02:34:31.411722+0000","last_peered":"2024-09-21T02:34:31.411722+0000","last_clean":"2024-09-21T02:34:31.411722+0000","last_became_active":"2024-09-21T02:32:50.697814+0000","last_became_peered":"2024-09-21T02:32:50.697814+0000","last_unstale":"2024-09-21T02:34:31.411722+0000","last_undegraded":"2024-09-21T02:34:31.411722+0000","last_fullsized":"2024-09-21T02:34:31.411722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:51.685203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643644+0000","last_change":"2024-09-21T02:32:41.469539+0000","last_active":"2024-09-21T02:34:59.643644+0000","last_peered":"2024-09-21T02:34:59.643644+0000","last_clean":"2024-09-21T02:34:59.643644+0000","last_became_active":"2024-09-21T02:32:41.469060+0000","last_became_peered":"2024-09-21T02:32:41.469060+0000","last_unstale":"2024-09-21T02:34:59.643644+0000","last_undegraded":"2024-09-21T02:34:59.643644+0000","last_fullsized":"2024-09-21T02:34:59.643644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:36.699360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416542+0000","last_change":"2024-09-21T02:32:38.748487+0000","last_active":"2024-09-21T02:34:31.416542+0000","last_peered":"2024-09-21T02:34:31.416542+0000","last_clean":"2024-09-21T02:34:31.416542+0000","last_became_active":"2024-09-21T02:32:38.747956+0000","last_became_peered":"2024-09-21T02:32:38.747956+0000","last_unstale":"2024-09-21T02:34:31.416542+0000","last_undegraded":"2024-09-21T02:34:31.416542+0000","last_fullsized":"2024-09-21T02:34:31.416542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:15.745119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.415910+0000","last_change":"2024-09-21T02:32:50.687412+0000","last_active":"2024-09-21T02:34:31.415910+0000","last_peered":"2024-09-21T02:34:31.415910+0000","last_clean":"2024-09-21T02:34:31.415910+0000","last_became_active":"2024-09-21T02:32:50.686819+0000","last_became_peered":"2024-09-21T02:32:50.686819+0000","last_unstale":"2024-09-21T02:34:31.415910+0000","last_undegraded":"2024-09-21T02:34:31.415910+0000","last_fullsized":"2024-09-21T02:34:31.415910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:28.830619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.621093+0000","last_change":"2024-09-21T02:32:41.467719+0000","last_active":"2024-09-21T02:34:59.621093+0000","last_peered":"2024-09-21T02:34:59.621093+0000","last_clean":"2024-09-21T02:34:59.621093+0000","last_became_active":"2024-09-21T02:32:41.467332+0000","last_became_peered":"2024-09-21T02:32:41.467332+0000","last_unstale":"2024-09-21T02:34:59.621093+0000","last_undegraded":"2024-09-21T02:34:59.621093+0000","last_fullsized":"2024-09-21T02:34:59.621093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:06.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411998+0000","last_change":"2024-09-21T02:32:38.428553+0000","last_active":"2024-09-21T02:34:31.411998+0000","last_peered":"2024-09-21T02:34:31.411998+0000","last_clean":"2024-09-21T02:34:31.411998+0000","last_became_active":"2024-09-21T02:32:38.428159+0000","last_became_peered":"2024-09-21T02:32:38.428159+0000","last_unstale":"2024-09-21T02:34:31.411998+0000","last_undegraded":"2024-09-21T02:34:31.411998+0000","last_fullsized":"2024-09-21T02:34:31.411998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:17.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602179+0000","last_change":"2024-09-21T02:32:50.694290+0000","last_active":"2024-09-21T02:34:31.602179+0000","last_peered":"2024-09-21T02:34:31.602179+0000","last_clean":"2024-09-21T02:34:31.602179+0000","last_became_active":"2024-09-21T02:32:50.693794+0000","last_became_peered":"2024-09-21T02:32:50.693794+0000","last_unstale":"2024-09-21T02:34:31.602179+0000","last_undegraded":"2024-09-21T02:34:31.602179+0000","last_fullsized":"2024-09-21T02:34:31.602179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:07.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626360+0000","last_change":"2024-09-21T02:32:41.466802+0000","last_active":"2024-09-21T02:34:59.626360+0000","last_peered":"2024-09-21T02:34:59.626360+0000","last_clean":"2024-09-21T02:34:59.626360+0000","last_became_active":"2024-09-21T02:32:41.465348+0000","last_became_peered":"2024-09-21T02:32:41.465348+0000","last_unstale":"2024-09-21T02:34:59.626360+0000","last_undegraded":"2024-09-21T02:34:59.626360+0000","last_fullsized":"2024-09-21T02:34:59.626360+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:23.881469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601415+0000","last_change":"2024-09-21T02:32:38.435725+0000","last_active":"2024-09-21T02:34:31.601415+0000","last_peered":"2024-09-21T02:34:31.601415+0000","last_clean":"2024-09-21T02:34:31.601415+0000","last_became_active":"2024-09-21T02:32:38.434688+0000","last_became_peered":"2024-09-21T02:32:38.434688+0000","last_unstale":"2024-09-21T02:34:31.601415+0000","last_undegraded":"2024-09-21T02:34:31.601415+0000","last_fullsized":"2024-09-21T02:34:31.601415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:27.829955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410365+0000","last_change":"2024-09-21T02:33:31.041957+0000","last_active":"2024-09-21T02:34:31.410365+0000","last_peered":"2024-09-21T02:34:31.410365+0000","last_clean":"2024-09-21T02:34:31.410365+0000","last_became_active":"2024-09-21T02:33:31.041160+0000","last_became_peered":"2024-09-21T02:33:31.041160+0000","last_unstale":"2024-09-21T02:34:31.410365+0000","last_undegraded":"2024-09-21T02:34:31.410365+0000","last_fullsized":"2024-09-21T02:34:31.410365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:06.226199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7,1],"acting":[8,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.627975+0000","last_change":"2024-09-21T02:32:41.474796+0000","last_active":"2024-09-21T02:34:59.627975+0000","last_peered":"2024-09-21T02:34:59.627975+0000","last_clean":"2024-09-21T02:34:59.627975+0000","last_became_active":"2024-09-21T02:32:41.474377+0000","last_became_peered":"2024-09-21T02:32:41.474377+0000","last_unstale":"2024-09-21T02:34:59.627975+0000","last_undegraded":"2024-09-21T02:34:59.627975+0000","last_fullsized":"2024-09-21T02:34:59.627975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.754372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.418508+0000","last_change":"2024-09-21T02:34:31.418421+0000","last_active":"2024-09-21T02:34:31.418508+0000","last_peered":"2024-09-21T02:34:31.418508+0000","last_clean":"2024-09-21T02:34:31.418508+0000","last_became_active":"2024-09-21T02:34:31.413206+0000","last_became_peered":"2024-09-21T02:34:31.413206+0000","last_unstale":"2024-09-21T02:34:31.418508+0000","last_undegraded":"2024-09-21T02:34:31.418508+0000","last_fullsized":"2024-09-21T02:34:31.418508+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:33.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410536+0000","last_change":"2024-09-21T02:32:50.685932+0000","last_active":"2024-09-21T02:34:31.410536+0000","last_peered":"2024-09-21T02:34:31.410536+0000","last_clean":"2024-09-21T02:34:31.410536+0000","last_became_active":"2024-09-21T02:32:50.685584+0000","last_became_peered":"2024-09-21T02:32:50.685584+0000","last_unstale":"2024-09-21T02:34:31.410536+0000","last_undegraded":"2024-09-21T02:34:31.410536+0000","last_fullsized":"2024-09-21T02:34:31.410536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:42.118046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628583+0000","last_change":"2024-09-21T02:33:31.041507+0000","last_active":"2024-09-21T02:34:59.628583+0000","last_peered":"2024-09-21T02:34:59.628583+0000","last_clean":"2024-09-21T02:34:59.628583+0000","last_became_active":"2024-09-21T02:33:31.040982+0000","last_became_peered":"2024-09-21T02:33:31.040982+0000","last_unstale":"2024-09-21T02:34:59.628583+0000","last_undegraded":"2024-09-21T02:34:59.628583+0000","last_fullsized":"2024-09-21T02:34:59.628583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:17.608426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410182+0000","last_change":"2024-09-21T02:32:38.512557+0000","last_active":"2024-09-21T02:34:31.410182+0000","last_peered":"2024-09-21T02:34:31.410182+0000","last_clean":"2024-09-21T02:34:31.410182+0000","last_became_active":"2024-09-21T02:32:38.512069+0000","last_became_peered":"2024-09-21T02:32:38.512069+0000","last_unstale":"2024-09-21T02:34:31.410182+0000","last_undegraded":"2024-09-21T02:34:31.410182+0000","last_fullsized":"2024-09-21T02:34:31.410182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:34:55.038548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.601304+0000","last_change":"2024-09-21T02:32:50.698539+0000","last_active":"2024-09-21T02:34:31.601304+0000","last_peered":"2024-09-21T02:34:31.601304+0000","last_clean":"2024-09-21T02:34:31.601304+0000","last_became_active":"2024-09-21T02:32:50.698107+0000","last_became_peered":"2024-09-21T02:32:50.698107+0000","last_unstale":"2024-09-21T02:34:31.601304+0000","last_undegraded":"2024-09-21T02:34:31.601304+0000","last_fullsized":"2024-09-21T02:34:31.601304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:43.141885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629232+0000","last_change":"2024-09-21T02:32:41.468472+0000","last_active":"2024-09-21T02:34:59.629232+0000","last_peered":"2024-09-21T02:34:59.629232+0000","last_clean":"2024-09-21T02:34:59.629232+0000","last_became_active":"2024-09-21T02:32:41.468039+0000","last_became_peered":"2024-09-21T02:32:41.468039+0000","last_unstale":"2024-09-21T02:34:59.629232+0000","last_undegraded":"2024-09-21T02:34:59.629232+0000","last_fullsized":"2024-09-21T02:34:59.629232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:00.501173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410057+0000","last_change":"2024-09-21T02:32:38.431613+0000","last_active":"2024-09-21T02:34:31.410057+0000","last_peered":"2024-09-21T02:34:31.410057+0000","last_clean":"2024-09-21T02:34:31.410057+0000","last_became_active":"2024-09-21T02:32:38.431128+0000","last_became_peered":"2024-09-21T02:32:38.431128+0000","last_unstale":"2024-09-21T02:34:31.410057+0000","last_undegraded":"2024-09-21T02:34:31.410057+0000","last_fullsized":"2024-09-21T02:34:31.410057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:09.400651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.408210+0000","last_change":"2024-09-21T02:32:50.691401+0000","last_active":"2024-09-21T02:34:31.408210+0000","last_peered":"2024-09-21T02:34:31.408210+0000","last_clean":"2024-09-21T02:34:31.408210+0000","last_became_active":"2024-09-21T02:32:50.688202+0000","last_became_peered":"2024-09-21T02:32:50.688202+0000","last_unstale":"2024-09-21T02:34:31.408210+0000","last_undegraded":"2024-09-21T02:34:31.408210+0000","last_fullsized":"2024-09-21T02:34:31.408210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:42.516887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633862+0000","last_change":"2024-09-21T02:32:41.475760+0000","last_active":"2024-09-21T02:34:59.633862+0000","last_peered":"2024-09-21T02:34:59.633862+0000","last_clean":"2024-09-21T02:34:59.633862+0000","last_became_active":"2024-09-21T02:32:41.475381+0000","last_became_peered":"2024-09-21T02:32:41.475381+0000","last_unstale":"2024-09-21T02:34:59.633862+0000","last_undegraded":"2024-09-21T02:34:59.633862+0000","last_fullsized":"2024-09-21T02:34:59.633862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:13.070064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411007+0000","last_change":"2024-09-21T02:32:38.424789+0000","last_active":"2024-09-21T02:34:31.411007+0000","last_peered":"2024-09-21T02:34:31.411007+0000","last_clean":"2024-09-21T02:34:31.411007+0000","last_became_active":"2024-09-21T02:32:38.424275+0000","last_became_peered":"2024-09-21T02:32:38.424275+0000","last_unstale":"2024-09-21T02:34:31.411007+0000","last_undegraded":"2024-09-21T02:34:31.411007+0000","last_fullsized":"2024-09-21T02:34:31.411007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:50.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407352+0000","last_change":"2024-09-21T02:32:50.692496+0000","last_active":"2024-09-21T02:34:31.407352+0000","last_peered":"2024-09-21T02:34:31.407352+0000","last_clean":"2024-09-21T02:34:31.407352+0000","last_became_active":"2024-09-21T02:32:50.692055+0000","last_became_peered":"2024-09-21T02:32:50.692055+0000","last_unstale":"2024-09-21T02:34:31.407352+0000","last_undegraded":"2024-09-21T02:34:31.407352+0000","last_fullsized":"2024-09-21T02:34:31.407352+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:25.433298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635108+0000","last_change":"2024-09-21T02:32:41.475732+0000","last_active":"2024-09-21T02:34:59.635108+0000","last_peered":"2024-09-21T02:34:59.635108+0000","last_clean":"2024-09-21T02:34:59.635108+0000","last_became_active":"2024-09-21T02:32:41.475395+0000","last_became_peered":"2024-09-21T02:32:41.475395+0000","last_unstale":"2024-09-21T02:34:59.635108+0000","last_undegraded":"2024-09-21T02:34:59.635108+0000","last_fullsized":"2024-09-21T02:34:59.635108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:26.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416279+0000","last_change":"2024-09-21T02:32:38.434080+0000","last_active":"2024-09-21T02:34:31.416279+0000","last_peered":"2024-09-21T02:34:31.416279+0000","last_clean":"2024-09-21T02:34:31.416279+0000","last_became_active":"2024-09-21T02:32:38.433625+0000","last_became_peered":"2024-09-21T02:32:38.433625+0000","last_unstale":"2024-09-21T02:34:31.416279+0000","last_undegraded":"2024-09-21T02:34:31.416279+0000","last_fullsized":"2024-09-21T02:34:31.416279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:11.837223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411576+0000","last_change":"2024-09-21T02:32:50.687555+0000","last_active":"2024-09-21T02:34:31.411576+0000","last_peered":"2024-09-21T02:34:31.411576+0000","last_clean":"2024-09-21T02:34:31.411576+0000","last_became_active":"2024-09-21T02:32:50.686979+0000","last_became_peered":"2024-09-21T02:32:50.686979+0000","last_unstale":"2024-09-21T02:34:31.411576+0000","last_undegraded":"2024-09-21T02:34:31.411576+0000","last_fullsized":"2024-09-21T02:34:31.411576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:01.136515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625187+0000","last_change":"2024-09-21T02:32:41.463688+0000","last_active":"2024-09-21T02:34:59.625187+0000","last_peered":"2024-09-21T02:34:59.625187+0000","last_clean":"2024-09-21T02:34:59.625187+0000","last_became_active":"2024-09-21T02:32:41.463306+0000","last_became_peered":"2024-09-21T02:32:41.463306+0000","last_unstale":"2024-09-21T02:34:59.625187+0000","last_undegraded":"2024-09-21T02:34:59.625187+0000","last_fullsized":"2024-09-21T02:34:59.625187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:46.217029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":329,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:35:22.500783+0000","last_change":"2024-09-21T02:34:31.423753+0000","last_active":"2024-09-21T02:35:22.500783+0000","last_peered":"2024-09-21T02:35:22.500783+0000","last_clean":"2024-09-21T02:35:22.500783+0000","last_became_active":"2024-09-21T02:34:31.417307+0000","last_became_peered":"2024-09-21T02:34:31.417307+0000","last_unstale":"2024-09-21T02:35:22.500783+0000","last_undegraded":"2024-09-21T02:35:22.500783+0000","last_fullsized":"2024-09-21T02:35:22.500783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:29.538505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69827,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":184,"num_write":39,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":69267,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412671+0000","last_change":"2024-09-21T02:33:30.538615+0000","last_active":"2024-09-21T02:34:31.412671+0000","last_peered":"2024-09-21T02:34:31.412671+0000","last_clean":"2024-09-21T02:34:31.412671+0000","last_became_active":"2024-09-21T02:33:30.538046+0000","last_became_peered":"2024-09-21T02:33:30.538046+0000","last_unstale":"2024-09-21T02:34:31.412671+0000","last_undegraded":"2024-09-21T02:34:31.412671+0000","last_fullsized":"2024-09-21T02:34:31.412671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:04.235706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644082+0000","last_change":"2024-09-21T02:32:41.470318+0000","last_active":"2024-09-21T02:34:59.644082+0000","last_peered":"2024-09-21T02:34:59.644082+0000","last_clean":"2024-09-21T02:34:59.644082+0000","last_became_active":"2024-09-21T02:32:41.466804+0000","last_became_peered":"2024-09-21T02:32:41.466804+0000","last_unstale":"2024-09-21T02:34:59.644082+0000","last_undegraded":"2024-09-21T02:34:59.644082+0000","last_fullsized":"2024-09-21T02:34:59.644082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:02.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411855+0000","last_change":"2024-09-21T02:32:38.514901+0000","last_active":"2024-09-21T02:34:31.411855+0000","last_peered":"2024-09-21T02:34:31.411855+0000","last_clean":"2024-09-21T02:34:31.411855+0000","last_became_active":"2024-09-21T02:32:38.514497+0000","last_became_peered":"2024-09-21T02:32:38.514497+0000","last_unstale":"2024-09-21T02:34:31.411855+0000","last_undegraded":"2024-09-21T02:34:31.411855+0000","last_fullsized":"2024-09-21T02:34:31.411855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:02.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.410240+0000","last_change":"2024-09-21T02:33:31.041566+0000","last_active":"2024-09-21T02:34:31.410240+0000","last_peered":"2024-09-21T02:34:31.410240+0000","last_clean":"2024-09-21T02:34:31.410240+0000","last_became_active":"2024-09-21T02:33:31.041041+0000","last_became_peered":"2024-09-21T02:33:31.041041+0000","last_unstale":"2024-09-21T02:34:31.410240+0000","last_undegraded":"2024-09-21T02:34:31.410240+0000","last_fullsized":"2024-09-21T02:34:31.410240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:51:00.236406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638081+0000","last_change":"2024-09-21T02:32:41.483502+0000","last_active":"2024-09-21T02:34:59.638081+0000","last_peered":"2024-09-21T02:34:59.638081+0000","last_clean":"2024-09-21T02:34:59.638081+0000","last_became_active":"2024-09-21T02:32:41.483116+0000","last_became_peered":"2024-09-21T02:32:41.483116+0000","last_unstale":"2024-09-21T02:34:59.638081+0000","last_undegraded":"2024-09-21T02:34:59.638081+0000","last_fullsized":"2024-09-21T02:34:59.638081+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:39.146202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412020+0000","last_change":"2024-09-21T02:33:31.041819+0000","last_active":"2024-09-21T02:34:31.412020+0000","last_peered":"2024-09-21T02:34:31.412020+0000","last_clean":"2024-09-21T02:34:31.412020+0000","last_became_active":"2024-09-21T02:33:31.041241+0000","last_became_peered":"2024-09-21T02:33:31.041241+0000","last_unstale":"2024-09-21T02:34:31.412020+0000","last_undegraded":"2024-09-21T02:34:31.412020+0000","last_fullsized":"2024-09-21T02:34:31.412020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:00.241618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407302+0000","last_change":"2024-09-21T02:32:50.692227+0000","last_active":"2024-09-21T02:34:31.407302+0000","last_peered":"2024-09-21T02:34:31.407302+0000","last_clean":"2024-09-21T02:34:31.407302+0000","last_became_active":"2024-09-21T02:32:50.691787+0000","last_became_peered":"2024-09-21T02:32:50.691787+0000","last_unstale":"2024-09-21T02:34:31.407302+0000","last_undegraded":"2024-09-21T02:34:31.407302+0000","last_fullsized":"2024-09-21T02:34:31.407302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:40.086313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644603+0000","last_change":"2024-09-21T02:32:41.476056+0000","last_active":"2024-09-21T02:34:59.644603+0000","last_peered":"2024-09-21T02:34:59.644603+0000","last_clean":"2024-09-21T02:34:59.644603+0000","last_became_active":"2024-09-21T02:32:41.475525+0000","last_became_peered":"2024-09-21T02:32:41.475525+0000","last_unstale":"2024-09-21T02:34:59.644603+0000","last_undegraded":"2024-09-21T02:34:59.644603+0000","last_fullsized":"2024-09-21T02:34:59.644603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:42.074296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.413613+0000","last_change":"2024-09-21T02:32:38.430845+0000","last_active":"2024-09-21T02:34:31.413613+0000","last_peered":"2024-09-21T02:34:31.413613+0000","last_clean":"2024-09-21T02:34:31.413613+0000","last_became_active":"2024-09-21T02:32:38.430372+0000","last_became_peered":"2024-09-21T02:32:38.430372+0000","last_unstale":"2024-09-21T02:34:31.413613+0000","last_undegraded":"2024-09-21T02:34:31.413613+0000","last_fullsized":"2024-09-21T02:34:31.413613+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:40.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.409266+0000","last_change":"2024-09-21T02:32:50.685481+0000","last_active":"2024-09-21T02:34:31.409266+0000","last_peered":"2024-09-21T02:34:31.409266+0000","last_clean":"2024-09-21T02:34:31.409266+0000","last_became_active":"2024-09-21T02:32:50.685044+0000","last_became_peered":"2024-09-21T02:32:50.685044+0000","last_unstale":"2024-09-21T02:34:31.409266+0000","last_undegraded":"2024-09-21T02:34:31.409266+0000","last_fullsized":"2024-09-21T02:34:31.409266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:33.132966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.602323+0000","last_change":"2024-09-21T02:32:50.690447+0000","last_active":"2024-09-21T02:34:31.602323+0000","last_peered":"2024-09-21T02:34:31.602323+0000","last_clean":"2024-09-21T02:34:31.602323+0000","last_became_active":"2024-09-21T02:32:50.690021+0000","last_became_peered":"2024-09-21T02:32:50.690021+0000","last_unstale":"2024-09-21T02:34:31.602323+0000","last_undegraded":"2024-09-21T02:34:31.602323+0000","last_fullsized":"2024-09-21T02:34:31.602323+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:44.436690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633674+0000","last_change":"2024-09-21T02:32:41.469186+0000","last_active":"2024-09-21T02:34:59.633674+0000","last_peered":"2024-09-21T02:34:59.633674+0000","last_clean":"2024-09-21T02:34:59.633674+0000","last_became_active":"2024-09-21T02:32:41.468837+0000","last_became_peered":"2024-09-21T02:32:41.468837+0000","last_unstale":"2024-09-21T02:34:59.633674+0000","last_undegraded":"2024-09-21T02:34:59.633674+0000","last_fullsized":"2024-09-21T02:34:59.633674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:02.993758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411587+0000","last_change":"2024-09-21T02:32:38.426631+0000","last_active":"2024-09-21T02:34:31.411587+0000","last_peered":"2024-09-21T02:34:31.411587+0000","last_clean":"2024-09-21T02:34:31.411587+0000","last_became_active":"2024-09-21T02:32:38.425600+0000","last_became_peered":"2024-09-21T02:32:38.425600+0000","last_unstale":"2024-09-21T02:34:31.411587+0000","last_undegraded":"2024-09-21T02:34:31.411587+0000","last_fullsized":"2024-09-21T02:34:31.411587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.669245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.407635+0000","last_change":"2024-09-21T02:32:50.697935+0000","last_active":"2024-09-21T02:34:31.407635+0000","last_peered":"2024-09-21T02:34:31.407635+0000","last_clean":"2024-09-21T02:34:31.407635+0000","last_became_active":"2024-09-21T02:32:50.697537+0000","last_became_peered":"2024-09-21T02:32:50.697537+0000","last_unstale":"2024-09-21T02:34:31.407635+0000","last_undegraded":"2024-09-21T02:34:31.407635+0000","last_fullsized":"2024-09-21T02:34:31.407635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:32.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628002+0000","last_change":"2024-09-21T02:32:41.458640+0000","last_active":"2024-09-21T02:34:59.628002+0000","last_peered":"2024-09-21T02:34:59.628002+0000","last_clean":"2024-09-21T02:34:59.628002+0000","last_became_active":"2024-09-21T02:32:41.458231+0000","last_became_peered":"2024-09-21T02:32:41.458231+0000","last_unstale":"2024-09-21T02:34:59.628002+0000","last_undegraded":"2024-09-21T02:34:59.628002+0000","last_fullsized":"2024-09-21T02:34:59.628002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:26.132979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.600867+0000","last_change":"2024-09-21T02:32:38.430888+0000","last_active":"2024-09-21T02:34:31.600867+0000","last_peered":"2024-09-21T02:34:31.600867+0000","last_clean":"2024-09-21T02:34:31.600867+0000","last_became_active":"2024-09-21T02:32:38.430516+0000","last_became_peered":"2024-09-21T02:32:38.430516+0000","last_unstale":"2024-09-21T02:34:31.600867+0000","last_undegraded":"2024-09-21T02:34:31.600867+0000","last_fullsized":"2024-09-21T02:34:31.600867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:54.671763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.412943+0000","last_change":"2024-09-21T02:32:38.434012+0000","last_active":"2024-09-21T02:34:31.412943+0000","last_peered":"2024-09-21T02:34:31.412943+0000","last_clean":"2024-09-21T02:34:31.412943+0000","last_became_active":"2024-09-21T02:32:38.433571+0000","last_became_peered":"2024-09-21T02:32:38.433571+0000","last_unstale":"2024-09-21T02:34:31.412943+0000","last_undegraded":"2024-09-21T02:34:31.412943+0000","last_fullsized":"2024-09-21T02:34:31.412943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:59.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635223+0000","last_change":"2024-09-21T02:33:30.650855+0000","last_active":"2024-09-21T02:34:59.635223+0000","last_peered":"2024-09-21T02:34:59.635223+0000","last_clean":"2024-09-21T02:34:59.635223+0000","last_became_active":"2024-09-21T02:33:30.650428+0000","last_became_peered":"2024-09-21T02:33:30.650428+0000","last_unstale":"2024-09-21T02:34:59.635223+0000","last_undegraded":"2024-09-21T02:34:59.635223+0000","last_fullsized":"2024-09-21T02:34:59.635223+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:55.757861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416153+0000","last_change":"2024-09-21T02:32:50.698249+0000","last_active":"2024-09-21T02:34:31.416153+0000","last_peered":"2024-09-21T02:34:31.416153+0000","last_clean":"2024-09-21T02:34:31.416153+0000","last_became_active":"2024-09-21T02:32:50.697768+0000","last_became_peered":"2024-09-21T02:32:50.697768+0000","last_unstale":"2024-09-21T02:34:31.416153+0000","last_undegraded":"2024-09-21T02:34:31.416153+0000","last_fullsized":"2024-09-21T02:34:31.416153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.723420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.411368+0000","last_change":"2024-09-21T02:32:38.435733+0000","last_active":"2024-09-21T02:34:31.411368+0000","last_peered":"2024-09-21T02:34:31.411368+0000","last_clean":"2024-09-21T02:34:31.411368+0000","last_became_active":"2024-09-21T02:32:38.435288+0000","last_became_peered":"2024-09-21T02:32:38.435288+0000","last_unstale":"2024-09-21T02:34:31.411368+0000","last_undegraded":"2024-09-21T02:34:31.411368+0000","last_fullsized":"2024-09-21T02:34:31.411368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:37.400309+0000","last_clean_scrub_stamp":"2024-09-21T02:32:37.400309+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:15.430652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.619449+0000","last_change":"2024-09-21T02:32:41.468127+0000","last_active":"2024-09-21T02:34:59.619449+0000","last_peered":"2024-09-21T02:34:59.619449+0000","last_clean":"2024-09-21T02:34:59.619449+0000","last_became_active":"2024-09-21T02:32:41.467730+0000","last_became_peered":"2024-09-21T02:32:41.467730+0000","last_unstale":"2024-09-21T02:34:59.619449+0000","last_undegraded":"2024-09-21T02:34:59.619449+0000","last_fullsized":"2024-09-21T02:34:59.619449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:39.684035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:31.416423+0000","last_change":"2024-09-21T02:32:50.684115+0000","last_active":"2024-09-21T02:34:31.416423+0000","last_peered":"2024-09-21T02:34:31.416423+0000","last_clean":"2024-09-21T02:34:31.416423+0000","last_became_active":"2024-09-21T02:32:50.683627+0000","last_became_peered":"2024-09-21T02:32:50.683627+0000","last_unstale":"2024-09-21T02:34:31.416423+0000","last_undegraded":"2024-09-21T02:34:31.416423+0000","last_fullsized":"2024-09-21T02:34:31.416423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:49.661994+0000","last_clean_scrub_stamp":"2024-09-21T02:32:49.661994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:10.953943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.628536+0000","last_change":"2024-09-21T02:32:41.465744+0000","last_active":"2024-09-21T02:34:59.628536+0000","last_peered":"2024-09-21T02:34:59.628536+0000","last_clean":"2024-09-21T02:34:59.628536+0000","last_became_active":"2024-09-21T02:32:41.465392+0000","last_became_peered":"2024-09-21T02:32:41.465392+0000","last_unstale":"2024-09-21T02:34:59.628536+0000","last_undegraded":"2024-09-21T02:34:59.628536+0000","last_fullsized":"2024-09-21T02:34:59.628536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:54.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.623827+0000","last_change":"2024-09-21T02:32:41.470967+0000","last_active":"2024-09-21T02:34:59.623827+0000","last_peered":"2024-09-21T02:34:59.623827+0000","last_clean":"2024-09-21T02:34:59.623827+0000","last_became_active":"2024-09-21T02:32:41.470547+0000","last_became_peered":"2024-09-21T02:32:41.470547+0000","last_unstale":"2024-09-21T02:34:59.623827+0000","last_undegraded":"2024-09-21T02:34:59.623827+0000","last_fullsized":"2024-09-21T02:34:59.623827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:57.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.626050+0000","last_change":"2024-09-21T02:32:41.474500+0000","last_active":"2024-09-21T02:34:59.626050+0000","last_peered":"2024-09-21T02:34:59.626050+0000","last_clean":"2024-09-21T02:34:59.626050+0000","last_became_active":"2024-09-21T02:32:41.474117+0000","last_became_peered":"2024-09-21T02:32:41.474117+0000","last_unstale":"2024-09-21T02:34:59.626050+0000","last_undegraded":"2024-09-21T02:34:59.626050+0000","last_fullsized":"2024-09-21T02:34:59.626050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:43.152503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.638408+0000","last_change":"2024-09-21T02:32:41.479123+0000","last_active":"2024-09-21T02:34:59.638408+0000","last_peered":"2024-09-21T02:34:59.638408+0000","last_clean":"2024-09-21T02:34:59.638408+0000","last_became_active":"2024-09-21T02:32:41.478543+0000","last_became_peered":"2024-09-21T02:32:41.478543+0000","last_unstale":"2024-09-21T02:34:59.638408+0000","last_undegraded":"2024-09-21T02:34:59.638408+0000","last_fullsized":"2024-09-21T02:34:59.638408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:39.802425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641218+0000","last_change":"2024-09-21T02:32:41.483334+0000","last_active":"2024-09-21T02:34:59.641218+0000","last_peered":"2024-09-21T02:34:59.641218+0000","last_clean":"2024-09-21T02:34:59.641218+0000","last_became_active":"2024-09-21T02:32:41.482999+0000","last_became_peered":"2024-09-21T02:32:41.482999+0000","last_unstale":"2024-09-21T02:34:59.641218+0000","last_undegraded":"2024-09-21T02:34:59.641218+0000","last_fullsized":"2024-09-21T02:34:59.641218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:16.259647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.620849+0000","last_change":"2024-09-21T02:33:30.539417+0000","last_active":"2024-09-21T02:34:59.620849+0000","last_peered":"2024-09-21T02:34:59.620849+0000","last_clean":"2024-09-21T02:34:59.620849+0000","last_became_active":"2024-09-21T02:33:30.538970+0000","last_became_peered":"2024-09-21T02:33:30.538970+0000","last_unstale":"2024-09-21T02:34:59.620849+0000","last_undegraded":"2024-09-21T02:34:59.620849+0000","last_fullsized":"2024-09-21T02:34:59.620849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:09.772513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.623783+0000","last_change":"2024-09-21T02:32:41.469386+0000","last_active":"2024-09-21T02:34:59.623783+0000","last_peered":"2024-09-21T02:34:59.623783+0000","last_clean":"2024-09-21T02:34:59.623783+0000","last_became_active":"2024-09-21T02:32:41.468982+0000","last_became_peered":"2024-09-21T02:32:41.468982+0000","last_unstale":"2024-09-21T02:34:59.623783+0000","last_undegraded":"2024-09-21T02:34:59.623783+0000","last_fullsized":"2024-09-21T02:34:59.623783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.644854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.617299+0000","last_change":"2024-09-21T02:32:41.467365+0000","last_active":"2024-09-21T02:34:59.617299+0000","last_peered":"2024-09-21T02:34:59.617299+0000","last_clean":"2024-09-21T02:34:59.617299+0000","last_became_active":"2024-09-21T02:32:41.466893+0000","last_became_peered":"2024-09-21T02:32:41.466893+0000","last_unstale":"2024-09-21T02:34:59.617299+0000","last_undegraded":"2024-09-21T02:34:59.617299+0000","last_fullsized":"2024-09-21T02:34:59.617299+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.634987+0000","last_change":"2024-09-21T02:32:41.473695+0000","last_active":"2024-09-21T02:34:59.634987+0000","last_peered":"2024-09-21T02:34:59.634987+0000","last_clean":"2024-09-21T02:34:59.634987+0000","last_became_active":"2024-09-21T02:32:41.473035+0000","last_became_peered":"2024-09-21T02:32:41.473035+0000","last_unstale":"2024-09-21T02:34:59.634987+0000","last_undegraded":"2024-09-21T02:34:59.634987+0000","last_fullsized":"2024-09-21T02:34:59.634987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:54.343984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625865+0000","last_change":"2024-09-21T02:32:41.473578+0000","last_active":"2024-09-21T02:34:59.625865+0000","last_peered":"2024-09-21T02:34:59.625865+0000","last_clean":"2024-09-21T02:34:59.625865+0000","last_became_active":"2024-09-21T02:32:41.472983+0000","last_became_peered":"2024-09-21T02:32:41.472983+0000","last_unstale":"2024-09-21T02:34:59.625865+0000","last_undegraded":"2024-09-21T02:34:59.625865+0000","last_fullsized":"2024-09-21T02:34:59.625865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.895809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642194+0000","last_change":"2024-09-21T02:32:41.473751+0000","last_active":"2024-09-21T02:34:59.642194+0000","last_peered":"2024-09-21T02:34:59.642194+0000","last_clean":"2024-09-21T02:34:59.642194+0000","last_became_active":"2024-09-21T02:32:41.473367+0000","last_became_peered":"2024-09-21T02:32:41.473367+0000","last_unstale":"2024-09-21T02:34:59.642194+0000","last_undegraded":"2024-09-21T02:34:59.642194+0000","last_fullsized":"2024-09-21T02:34:59.642194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:04.707745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641726+0000","last_change":"2024-09-21T02:32:41.485375+0000","last_active":"2024-09-21T02:34:59.641726+0000","last_peered":"2024-09-21T02:34:59.641726+0000","last_clean":"2024-09-21T02:34:59.641726+0000","last_became_active":"2024-09-21T02:32:41.484845+0000","last_became_peered":"2024-09-21T02:32:41.484845+0000","last_unstale":"2024-09-21T02:34:59.641726+0000","last_undegraded":"2024-09-21T02:34:59.641726+0000","last_fullsized":"2024-09-21T02:34:59.641726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:58.529747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.625775+0000","last_change":"2024-09-21T02:32:41.462925+0000","last_active":"2024-09-21T02:34:59.625775+0000","last_peered":"2024-09-21T02:34:59.625775+0000","last_clean":"2024-09-21T02:34:59.625775+0000","last_became_active":"2024-09-21T02:32:41.462056+0000","last_became_peered":"2024-09-21T02:32:41.462056+0000","last_unstale":"2024-09-21T02:34:59.625775+0000","last_undegraded":"2024-09-21T02:34:59.625775+0000","last_fullsized":"2024-09-21T02:34:59.625775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:05.447554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.624036+0000","last_change":"2024-09-21T02:32:41.475111+0000","last_active":"2024-09-21T02:34:59.624036+0000","last_peered":"2024-09-21T02:34:59.624036+0000","last_clean":"2024-09-21T02:34:59.624036+0000","last_became_active":"2024-09-21T02:32:41.474634+0000","last_became_peered":"2024-09-21T02:32:41.474634+0000","last_unstale":"2024-09-21T02:34:59.624036+0000","last_undegraded":"2024-09-21T02:34:59.624036+0000","last_fullsized":"2024-09-21T02:34:59.624036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:07.750970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.630603+0000","last_change":"2024-09-21T02:32:41.479702+0000","last_active":"2024-09-21T02:34:59.630603+0000","last_peered":"2024-09-21T02:34:59.630603+0000","last_clean":"2024-09-21T02:34:59.630603+0000","last_became_active":"2024-09-21T02:32:41.479378+0000","last_became_peered":"2024-09-21T02:32:41.479378+0000","last_unstale":"2024-09-21T02:34:59.630603+0000","last_undegraded":"2024-09-21T02:34:59.630603+0000","last_fullsized":"2024-09-21T02:34:59.630603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:56.687641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642769+0000","last_change":"2024-09-21T02:32:41.475567+0000","last_active":"2024-09-21T02:34:59.642769+0000","last_peered":"2024-09-21T02:34:59.642769+0000","last_clean":"2024-09-21T02:34:59.642769+0000","last_became_active":"2024-09-21T02:32:41.475207+0000","last_became_peered":"2024-09-21T02:32:41.475207+0000","last_unstale":"2024-09-21T02:34:59.642769+0000","last_undegraded":"2024-09-21T02:34:59.642769+0000","last_fullsized":"2024-09-21T02:34:59.642769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:33.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.644970+0000","last_change":"2024-09-21T02:32:41.483518+0000","last_active":"2024-09-21T02:34:59.644970+0000","last_peered":"2024-09-21T02:34:59.644970+0000","last_clean":"2024-09-21T02:34:59.644970+0000","last_became_active":"2024-09-21T02:32:41.483088+0000","last_became_peered":"2024-09-21T02:32:41.483088+0000","last_unstale":"2024-09-21T02:34:59.644970+0000","last_undegraded":"2024-09-21T02:34:59.644970+0000","last_fullsized":"2024-09-21T02:34:59.644970+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:23.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.633832+0000","last_change":"2024-09-21T02:32:41.482113+0000","last_active":"2024-09-21T02:34:59.633832+0000","last_peered":"2024-09-21T02:34:59.633832+0000","last_clean":"2024-09-21T02:34:59.633832+0000","last_became_active":"2024-09-21T02:32:41.479123+0000","last_became_peered":"2024-09-21T02:32:41.479123+0000","last_unstale":"2024-09-21T02:34:59.633832+0000","last_undegraded":"2024-09-21T02:34:59.633832+0000","last_fullsized":"2024-09-21T02:34:59.633832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:48.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.642077+0000","last_change":"2024-09-21T02:32:41.470429+0000","last_active":"2024-09-21T02:34:59.642077+0000","last_peered":"2024-09-21T02:34:59.642077+0000","last_clean":"2024-09-21T02:34:59.642077+0000","last_became_active":"2024-09-21T02:32:41.469421+0000","last_became_peered":"2024-09-21T02:32:41.469421+0000","last_unstale":"2024-09-21T02:34:59.642077+0000","last_undegraded":"2024-09-21T02:34:59.642077+0000","last_fullsized":"2024-09-21T02:34:59.642077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:00.952030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.634790+0000","last_change":"2024-09-21T02:32:41.470361+0000","last_active":"2024-09-21T02:34:59.634790+0000","last_peered":"2024-09-21T02:34:59.634790+0000","last_clean":"2024-09-21T02:34:59.634790+0000","last_became_active":"2024-09-21T02:32:41.469983+0000","last_became_peered":"2024-09-21T02:32:41.469983+0000","last_unstale":"2024-09-21T02:34:59.634790+0000","last_undegraded":"2024-09-21T02:34:59.634790+0000","last_fullsized":"2024-09-21T02:34:59.634790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:02.703688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.637811+0000","last_change":"2024-09-21T02:32:41.468975+0000","last_active":"2024-09-21T02:34:59.637811+0000","last_peered":"2024-09-21T02:34:59.637811+0000","last_clean":"2024-09-21T02:34:59.637811+0000","last_became_active":"2024-09-21T02:32:41.468612+0000","last_became_peered":"2024-09-21T02:32:41.468612+0000","last_unstale":"2024-09-21T02:34:59.637811+0000","last_undegraded":"2024-09-21T02:34:59.637811+0000","last_fullsized":"2024-09-21T02:34:59.637811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:04.442257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643213+0000","last_change":"2024-09-21T02:32:41.471444+0000","last_active":"2024-09-21T02:34:59.643213+0000","last_peered":"2024-09-21T02:34:59.643213+0000","last_clean":"2024-09-21T02:34:59.643213+0000","last_became_active":"2024-09-21T02:32:41.470437+0000","last_became_peered":"2024-09-21T02:32:41.470437+0000","last_unstale":"2024-09-21T02:34:59.643213+0000","last_undegraded":"2024-09-21T02:34:59.643213+0000","last_fullsized":"2024-09-21T02:34:59.643213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:13.933069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.635196+0000","last_change":"2024-09-21T02:32:41.475397+0000","last_active":"2024-09-21T02:34:59.635196+0000","last_peered":"2024-09-21T02:34:59.635196+0000","last_clean":"2024-09-21T02:34:59.635196+0000","last_became_active":"2024-09-21T02:32:41.475034+0000","last_became_peered":"2024-09-21T02:32:41.475034+0000","last_unstale":"2024-09-21T02:34:59.635196+0000","last_undegraded":"2024-09-21T02:34:59.635196+0000","last_fullsized":"2024-09-21T02:34:59.635196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:24.944289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643674+0000","last_change":"2024-09-21T02:32:41.470297+0000","last_active":"2024-09-21T02:34:59.643674+0000","last_peered":"2024-09-21T02:34:59.643674+0000","last_clean":"2024-09-21T02:34:59.643674+0000","last_became_active":"2024-09-21T02:32:41.469843+0000","last_became_peered":"2024-09-21T02:32:41.469843+0000","last_unstale":"2024-09-21T02:34:59.643674+0000","last_undegraded":"2024-09-21T02:34:59.643674+0000","last_fullsized":"2024-09-21T02:34:59.643674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.986115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.629146+0000","last_change":"2024-09-21T02:33:30.535828+0000","last_active":"2024-09-21T02:34:59.629146+0000","last_peered":"2024-09-21T02:34:59.629146+0000","last_clean":"2024-09-21T02:34:59.629146+0000","last_became_active":"2024-09-21T02:33:30.535576+0000","last_became_peered":"2024-09-21T02:33:30.535576+0000","last_unstale":"2024-09-21T02:34:59.629146+0000","last_undegraded":"2024-09-21T02:34:59.629146+0000","last_fullsized":"2024-09-21T02:34:59.629146+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:05.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.621368+0000","last_change":"2024-09-21T02:32:41.466073+0000","last_active":"2024-09-21T02:34:59.621368+0000","last_peered":"2024-09-21T02:34:59.621368+0000","last_clean":"2024-09-21T02:34:59.621368+0000","last_became_active":"2024-09-21T02:32:41.465664+0000","last_became_peered":"2024-09-21T02:32:41.465664+0000","last_unstale":"2024-09-21T02:34:59.621368+0000","last_undegraded":"2024-09-21T02:34:59.621368+0000","last_fullsized":"2024-09-21T02:34:59.621368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:25.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.636445+0000","last_change":"2024-09-21T02:32:41.471006+0000","last_active":"2024-09-21T02:34:59.636445+0000","last_peered":"2024-09-21T02:34:59.636445+0000","last_clean":"2024-09-21T02:34:59.636445+0000","last_became_active":"2024-09-21T02:32:41.469780+0000","last_became_peered":"2024-09-21T02:32:41.469780+0000","last_unstale":"2024-09-21T02:34:59.636445+0000","last_undegraded":"2024-09-21T02:34:59.636445+0000","last_fullsized":"2024-09-21T02:34:59.636445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:18.604729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.624994+0000","last_change":"2024-09-21T02:32:41.476169+0000","last_active":"2024-09-21T02:34:59.624994+0000","last_peered":"2024-09-21T02:34:59.624994+0000","last_clean":"2024-09-21T02:34:59.624994+0000","last_became_active":"2024-09-21T02:32:41.475754+0000","last_became_peered":"2024-09-21T02:32:41.475754+0000","last_unstale":"2024-09-21T02:34:59.624994+0000","last_undegraded":"2024-09-21T02:34:59.624994+0000","last_fullsized":"2024-09-21T02:34:59.624994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:18.532122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.622188+0000","last_change":"2024-09-21T02:32:41.467078+0000","last_active":"2024-09-21T02:34:59.622188+0000","last_peered":"2024-09-21T02:34:59.622188+0000","last_clean":"2024-09-21T02:34:59.622188+0000","last_became_active":"2024-09-21T02:32:41.466702+0000","last_became_peered":"2024-09-21T02:32:41.466702+0000","last_unstale":"2024-09-21T02:34:59.622188+0000","last_undegraded":"2024-09-21T02:34:59.622188+0000","last_fullsized":"2024-09-21T02:34:59.622188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:43.409390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.643197+0000","last_change":"2024-09-21T02:32:41.467476+0000","last_active":"2024-09-21T02:34:59.643197+0000","last_peered":"2024-09-21T02:34:59.643197+0000","last_clean":"2024-09-21T02:34:59.643197+0000","last_became_active":"2024-09-21T02:32:41.466901+0000","last_became_peered":"2024-09-21T02:32:41.466901+0000","last_unstale":"2024-09-21T02:34:59.643197+0000","last_undegraded":"2024-09-21T02:34:59.643197+0000","last_fullsized":"2024-09-21T02:34:59.643197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:46.207507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.639768+0000","last_change":"2024-09-21T02:32:41.486528+0000","last_active":"2024-09-21T02:34:59.639768+0000","last_peered":"2024-09-21T02:34:59.639768+0000","last_clean":"2024-09-21T02:34:59.639768+0000","last_became_active":"2024-09-21T02:32:41.484370+0000","last_became_peered":"2024-09-21T02:32:41.484370+0000","last_unstale":"2024-09-21T02:34:59.639768+0000","last_undegraded":"2024-09-21T02:34:59.639768+0000","last_fullsized":"2024-09-21T02:34:59.639768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:28.978540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:34:59.641305+0000","last_change":"2024-09-21T02:32:41.474525+0000","last_active":"2024-09-21T02:34:59.641305+0000","last_peered":"2024-09-21T02:34:59.641305+0000","last_clean":"2024-09-21T02:34:59.641305+0000","last_became_active":"2024-09-21T02:32:41.474147+0000","last_became_peered":"2024-09-21T02:32:41.474147+0000","last_unstale":"2024-09-21T02:34:59.641305+0000","last_undegraded":"2024-09-21T02:34:59.641305+0000","last_fullsized":"2024-09-21T02:34:59.641305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:32:40.430894+0000","last_clean_scrub_stamp":"2024-09-21T02:32:40.430894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:26.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70625,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":235,"num_read_kb":189,"num_write":101,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":69871,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":217318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710767,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":505903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906995,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1161592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070520,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":509977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266751,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":505881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462981,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1601536,"data_stored":1099763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626507,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":501203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822737,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1609728,"data_stored":1095849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986261,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":575148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182491,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":501307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":501237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":571030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":501293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":75292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:35:29.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:35:29.541 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:29 smithi148 ceph-mon[34626]: pgmap v408: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T02:35:29.869 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:29 smithi079 ceph-mon[30788]: pgmap v408: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T02:35:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:29 smithi098 ceph-mon[34832]: pgmap v408: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T02:35:30.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 -- 172.21.15.79:0/1567044067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810b6c0 msgr2=0x7ff0e810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 --2- 172.21.15.79:0/1567044067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810b6c0 0x7ff0e810bad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009900 tx=0x7ff0d402a410 comp rx=0 tx=0).stop 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 -- 172.21.15.79:0/1567044067 shutdown_connections 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 --2- 172.21.15.79:0/1567044067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e810c010 0x7ff0e8112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 --2- 172.21.15.79:0/1567044067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810b6c0 0x7ff0e810bad0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 --2- 172.21.15.79:0/1567044067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0e8105d80 0x7ff0e8106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 -- 172.21.15.79:0/1567044067 >> 172.21.15.79:0/1567044067 conn(0x7ff0e8101810 msgr2=0x7ff0e8103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 -- 172.21.15.79:0/1567044067 shutdown_connections 2024-09-21T02:35:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.184+0000 7ff0f0000640 1 -- 172.21.15.79:0/1567044067 wait complete. 2024-09-21T02:35:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.185+0000 7ff0f0000640 1 Processor -- start 2024-09-21T02:35:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0f0000640 1 -- start start 2024-09-21T02:35:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0f0000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8105d80 0x7ff0e819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0f0000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0e810b6c0 0x7ff0e819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0f0000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810c010 0x7ff0e81a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0f0000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e8115d20 con 0x7ff0e810c010 2024-09-21T02:35:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0f0000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e8115ba0 con 0x7ff0e8105d80 2024-09-21T02:35:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0f0000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e8115ea0 con 0x7ff0e810b6c0 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0ee000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810c010 0x7ff0e81a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0ee000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810c010 0x7ff0e81a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56776/0 (socket says 172.21.15.79:56776) 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0ee000640 1 -- 172.21.15.79:0/324372766 learned_addr learned my addr 172.21.15.79:0/324372766 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0ecc00640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0e810b6c0 0x7ff0e819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.186+0000 7ff0ed600640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8105d80 0x7ff0e819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0ee000640 1 -- 172.21.15.79:0/324372766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0e810b6c0 msgr2=0x7ff0e819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0ee000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0e810b6c0 0x7ff0e819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0ee000640 1 -- 172.21.15.79:0/324372766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8105d80 msgr2=0x7ff0e819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0ee000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8105d80 0x7ff0e819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0ee000640 1 -- 172.21.15.79:0/324372766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e81a2640 con 0x7ff0e810c010 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0ed600640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8105d80 0x7ff0e819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0ee000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810c010 0x7ff0e81a1f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000eb10 tx=0x7ff0e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0e6000640 1 -- 172.21.15.79:0/324372766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0004b20 con 0x7ff0e810c010 2024-09-21T02:35:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0e6000640 1 -- 172.21.15.79:0/324372766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0e0004cc0 con 0x7ff0e810c010 2024-09-21T02:35:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.187+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e81a2930 con 0x7ff0e810c010 2024-09-21T02:35:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.188+0000 7ff0e6000640 1 -- 172.21.15.79:0/324372766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0010670 con 0x7ff0e810c010 2024-09-21T02:35:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.188+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e81a9090 con 0x7ff0e810c010 2024-09-21T02:35:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.189+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e8106190 con 0x7ff0e810c010 2024-09-21T02:35:30.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.191+0000 7ff0e6000640 1 -- 172.21.15.79:0/324372766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff0e0005020 con 0x7ff0e810c010 2024-09-21T02:35:30.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.192+0000 7ff0e6000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0d00b6510 0x7ff0d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:30.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.193+0000 7ff0e6000640 1 -- 172.21.15.79:0/324372766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff0e00e7cc0 con 0x7ff0e810c010 2024-09-21T02:35:30.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.193+0000 7ff0ed600640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0d00b6510 0x7ff0d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:30.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.193+0000 7ff0ed600640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0d00b6510 0x7ff0d00b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009fc0 tx=0x7ff0dc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:30.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.196+0000 7ff0e6000640 1 -- 172.21.15.79:0/324372766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0e00ee080 con 0x7ff0e810c010 2024-09-21T02:35:30.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.422+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0e810d850 con 0x7ff0e810c010 2024-09-21T02:35:30.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.423+0000 7ff0e6000640 1 -- 172.21.15.79:0/324372766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7ff0e00ae140 con 0x7ff0e810c010 2024-09-21T02:35:30.425 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:30.425 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:35:30.425 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:35:30.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0d00b6510 msgr2=0x7ff0d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:30.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0d00b6510 0x7ff0d00b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009fc0 tx=0x7ff0dc005f90 comp rx=0 tx=0).stop 2024-09-21T02:35:30.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810c010 msgr2=0x7ff0e81a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:30.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810c010 0x7ff0e81a1f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000eb10 tx=0x7ff0e000c2d0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 shutdown_connections 2024-09-21T02:35:30.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff0d00b6510 0x7ff0d00b8a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e810c010 0x7ff0e81a1f10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0e810b6c0 0x7ff0e819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 --2- 172.21.15.79:0/324372766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e8105d80 0x7ff0e819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:30.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.426+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 >> 172.21.15.79:0/324372766 conn(0x7ff0e8101810 msgr2=0x7ff0e8103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:30.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.427+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 shutdown_connections 2024-09-21T02:35:30.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:30.427+0000 7ff0f0000640 1 -- 172.21.15.79:0/324372766 wait complete. 2024-09-21T02:35:30.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:30 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/324372766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:30.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:30 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/324372766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:30.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:30 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/324372766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:31.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:35:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:31 smithi148 ceph-mon[34626]: pgmap v409: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T02:35:31.849 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:31 smithi098 ceph-mon[34832]: pgmap v409: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T02:35:31.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:31 smithi079 ceph-mon[30788]: pgmap v409: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 -- 172.21.15.79:0/1720942374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 msgr2=0x7f3878103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 --2- 172.21.15.79:0/1720942374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f3878103dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3868009900 tx=0x7f386802a410 comp rx=0 tx=0).stop 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 -- 172.21.15.79:0/1720942374 shutdown_connections 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 --2- 172.21.15.79:0/1720942374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3878109c40 0x7f3878110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 --2- 172.21.15.79:0/1720942374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38781092f0 0x7f3878109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 --2- 172.21.15.79:0/1720942374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f3878103dc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 -- 172.21.15.79:0/1720942374 >> 172.21.15.79:0/1720942374 conn(0x7f38780ff440 msgr2=0x7f3878101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 -- 172.21.15.79:0/1720942374 shutdown_connections 2024-09-21T02:35:32.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.503+0000 7f387d800640 1 -- 172.21.15.79:0/1720942374 wait complete. 2024-09-21T02:35:32.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.504+0000 7f387d800640 1 Processor -- start 2024-09-21T02:35:32.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.504+0000 7f387d800640 1 -- start start 2024-09-21T02:35:32.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f387d800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f387819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:32.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f387d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38781092f0 0x7f387819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:32.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f387d800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3878109c40 0x7f387819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:32.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f387d800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3878113900 con 0x7f38781039b0 2024-09-21T02:35:32.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f387d800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3878113780 con 0x7f3878109c40 2024-09-21T02:35:32.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f387d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3878113a80 con 0x7f38781092f0 2024-09-21T02:35:32.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f3877e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f387819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f3877e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f387819a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56800/0 (socket says 172.21.15.79:56800) 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f3877e00640 1 -- 172.21.15.79:0/445235136 learned_addr learned my addr 172.21.15.79:0/445235136 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f3877400640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38781092f0 0x7f387819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.505+0000 7f387ce00640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3878109c40 0x7f387819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3877e00640 1 -- 172.21.15.79:0/445235136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38781092f0 msgr2=0x7f387819a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3877e00640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38781092f0 0x7f387819a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3877e00640 1 -- 172.21.15.79:0/445235136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3878109c40 msgr2=0x7f387819fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3877e00640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3878109c40 0x7f387819fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3877e00640 1 -- 172.21.15.79:0/445235136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38781a02a0 con 0x7f38781039b0 2024-09-21T02:35:32.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f387ce00640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3878109c40 0x7f387819fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:35:32.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3877e00640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f387819a330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3868005940 tx=0x7f3868004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:32.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3874c00640 1 -- 172.21.15.79:0/445235136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386803f030 con 0x7f38781039b0 2024-09-21T02:35:32.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3874c00640 1 -- 172.21.15.79:0/445235136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3868003aa0 con 0x7f38781039b0 2024-09-21T02:35:32.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f3874c00640 1 -- 172.21.15.79:0/445235136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868035070 con 0x7f38781039b0 2024-09-21T02:35:32.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.506+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38781a0530 con 0x7f38781039b0 2024-09-21T02:35:32.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.507+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38781a6cf0 con 0x7f38781039b0 2024-09-21T02:35:32.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.508+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3878103dc0 con 0x7f38781039b0 2024-09-21T02:35:32.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.510+0000 7f3874c00640 1 -- 172.21.15.79:0/445235136 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3868042030 con 0x7f38781039b0 2024-09-21T02:35:32.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.511+0000 7f3874c00640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f385c0b6510 0x7f385c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:32.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.512+0000 7f3874c00640 1 -- 172.21.15.79:0/445235136 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3868107ba0 con 0x7f38781039b0 2024-09-21T02:35:32.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.512+0000 7f3877400640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f385c0b6510 0x7f385c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:32.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.513+0000 7f3877400640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f385c0b6510 0x7f385c0b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3878108ef0 tx=0x7f3864005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.516+0000 7f3874c00640 1 -- 172.21.15.79:0/445235136 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f386810c070 con 0x7f38781039b0 2024-09-21T02:35:32.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.745+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f387819b460 con 0x7f38781039b0 2024-09-21T02:35:32.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.746+0000 7f3874c00640 1 -- 172.21.15.79:0/445235136 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f38680ce020 con 0x7f38781039b0 2024-09-21T02:35:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:32.748 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:35:32.749 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f385c0b6510 msgr2=0x7f385c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f385c0b6510 0x7f385c0b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3878108ef0 tx=0x7f3864005f90 comp rx=0 tx=0).stop 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 msgr2=0x7f387819a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f387819a330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3868005940 tx=0x7f3868004270 comp rx=0 tx=0).stop 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 shutdown_connections 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f385c0b6510 0x7f385c0b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3878109c40 0x7f387819fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38781092f0 0x7f387819a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 --2- 172.21.15.79:0/445235136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38781039b0 0x7f387819a330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:32.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 >> 172.21.15.79:0/445235136 conn(0x7f38780ff440 msgr2=0x7f3878101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:32.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 shutdown_connections 2024-09-21T02:35:32.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:32.750+0000 7f387d800640 1 -- 172.21.15.79:0/445235136 wait complete. 2024-09-21T02:35:33.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:32 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/445235136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:33.140 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:32 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/445235136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:33.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:32 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/445235136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:33.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:35:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:34.450 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:34 smithi079 ceph-mon[30788]: pgmap v410: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T02:35:34.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:34 smithi098 ceph-mon[34832]: pgmap v410: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T02:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.715+0000 7f9137e00640 1 -- 172.21.15.79:0/1391211014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 msgr2=0x7f9138112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.715+0000 7f9137e00640 1 --2- 172.21.15.79:0/1391211014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f9138112350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9130009ca0 tx=0x7f913002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.716+0000 7f9137e00640 1 -- 172.21.15.79:0/1391211014 shutdown_connections 2024-09-21T02:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.716+0000 7f9137e00640 1 --2- 172.21.15.79:0/1391211014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f9138112350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.716+0000 7f9137e00640 1 --2- 172.21.15.79:0/1391211014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9138076100 0x7f913810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.716+0000 7f9137e00640 1 --2- 172.21.15.79:0/1391211014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91380757b0 0x7f9138075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.716+0000 7f9137e00640 1 -- 172.21.15.79:0/1391211014 >> 172.21.15.79:0/1391211014 conn(0x7f91380ff440 msgr2=0x7f9138101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.716+0000 7f9137e00640 1 -- 172.21.15.79:0/1391211014 shutdown_connections 2024-09-21T02:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.716+0000 7f9137e00640 1 -- 172.21.15.79:0/1391211014 wait complete. 2024-09-21T02:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 Processor -- start 2024-09-21T02:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 -- start start 2024-09-21T02:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91380757b0 0x7f913819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9138076100 0x7f913819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f91381a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9138115b10 con 0x7f913810ff10 2024-09-21T02:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9138115990 con 0x7f9138076100 2024-09-21T02:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.717+0000 7f9137e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9138115c90 con 0x7f91380757b0 2024-09-21T02:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9137400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f91381a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9137400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f91381a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57874/0 (socket says 172.21.15.79:57874) 2024-09-21T02:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9137400640 1 -- 172.21.15.79:0/2021033264 learned_addr learned my addr 172.21.15.79:0/2021033264 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136000640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9138076100 0x7f913819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136a00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91380757b0 0x7f913819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136000640 1 -- 172.21.15.79:0/2021033264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91380757b0 msgr2=0x7f913819c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136000640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91380757b0 0x7f913819c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136000640 1 -- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 msgr2=0x7f91381a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136000640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f91381a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136000640 1 -- 172.21.15.79:0/2021033264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91381a23f0 con 0x7f9138076100 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9137400640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f91381a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.718+0000 7f9136000640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9138076100 0x7f913819ca20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f912400d6a0 tx=0x7f912400db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.719+0000 7f912f400640 1 -- 172.21.15.79:0/2021033264 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124017070 con 0x7f9138076100 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.719+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91381a26e0 con 0x7f9138076100 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.719+0000 7f912f400640 1 -- 172.21.15.79:0/2021033264 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9124009cd0 con 0x7f9138076100 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.719+0000 7f912f400640 1 -- 172.21.15.79:0/2021033264 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124003b60 con 0x7f9138076100 2024-09-21T02:35:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.719+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91381a8e40 con 0x7f9138076100 2024-09-21T02:35:34.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.720+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9138075bc0 con 0x7f9138076100 2024-09-21T02:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.723+0000 7f912f400640 1 -- 172.21.15.79:0/2021033264 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f91240042b0 con 0x7f9138076100 2024-09-21T02:35:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.724+0000 7f912f400640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f911c0b6590 0x7f911c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.724+0000 7f912f400640 1 -- 172.21.15.79:0/2021033264 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f91240e7370 con 0x7f9138076100 2024-09-21T02:35:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.724+0000 7f9136a00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f911c0b6590 0x7f911c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.725+0000 7f9136a00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f911c0b6590 0x7f911c0b8aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9128005fd0 tx=0x7f912800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.726+0000 7f912f400640 1 -- 172.21.15.79:0/2021033264 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91240b1c50 con 0x7f9138076100 2024-09-21T02:35:34.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:34 smithi148 ceph-mon[34626]: pgmap v410: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T02:35:34.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.913+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91381a9070 con 0x7f9138076100 2024-09-21T02:35:34.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.915+0000 7f912f400640 1 -- 172.21.15.79:0/2021033264 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24834 (secure 0 0 0) 0x7f91240b6b90 con 0x7f9138076100 2024-09-21T02:35:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:34.917 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:34:31.402384+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f911c0b6590 msgr2=0x7f911c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f911c0b6590 0x7f911c0b8aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9128005fd0 tx=0x7f912800b390 comp rx=0 tx=0).stop 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9138076100 msgr2=0x7f913819ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9138076100 0x7f913819ca20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f912400d6a0 tx=0x7f912400db60 comp rx=0 tx=0).stop 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 shutdown_connections 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f911c0b6590 0x7f911c0b8aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f913810ff10 0x7f91381a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9138076100 0x7f913819ca20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 --2- 172.21.15.79:0/2021033264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91380757b0 0x7f913819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.917+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 >> 172.21.15.79:0/2021033264 conn(0x7f91380ff440 msgr2=0x7f9138109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.918+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 shutdown_connections 2024-09-21T02:35:34.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:34.918+0000 7f9137e00640 1 -- 172.21.15.79:0/2021033264 wait complete. 2024-09-21T02:35:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:35 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2021033264' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:35:35.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:35 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2021033264' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:35:35.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T02:35:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:35 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2021033264' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:35:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 -- 172.21.15.79:0/2954005959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 msgr2=0x7ff63010ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 --2- 172.21.15.79:0/2954005959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63010ba70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009ca0 tx=0x7ff62c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 -- 172.21.15.79:0/2954005959 shutdown_connections 2024-09-21T02:35:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 --2- 172.21.15.79:0/2954005959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63010ba70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 --2- 172.21.15.79:0/2954005959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff630104730 0x7ff630104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 --2- 172.21.15.79:0/2954005959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6301036b0 0x7ff630103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 -- 172.21.15.79:0/2954005959 >> 172.21.15.79:0/2954005959 conn(0x7ff6300feff0 msgr2=0x7ff6301014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 -- 172.21.15.79:0/2954005959 shutdown_connections 2024-09-21T02:35:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.050+0000 7ff638800640 1 -- 172.21.15.79:0/2954005959 wait complete. 2024-09-21T02:35:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.051+0000 7ff638800640 1 Processor -- start 2024-09-21T02:35:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.052+0000 7ff638800640 1 -- start start 2024-09-21T02:35:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.052+0000 7ff638800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6301036b0 0x7ff630199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.052+0000 7ff638800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff630104730 0x7ff63019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.052+0000 7ff638800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63019b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.052+0000 7ff638800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff63010f350 con 0x7ff6301050d0 2024-09-21T02:35:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.052+0000 7ff638800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff63010f1d0 con 0x7ff630104730 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.052+0000 7ff638800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff63010f4d0 con 0x7ff6301036b0 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63019b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63019b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57894/0 (socket says 172.21.15.79:57894) 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 -- 172.21.15.79:0/2468376007 learned_addr learned my addr 172.21.15.79:0/2468376007 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff635400640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff630104730 0x7ff63019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff635e00640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6301036b0 0x7ff630199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 -- 172.21.15.79:0/2468376007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6301036b0 msgr2=0x7ff630199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6301036b0 0x7ff630199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 -- 172.21.15.79:0/2468376007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff630104730 msgr2=0x7ff63019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff630104730 0x7ff63019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 -- 172.21.15.79:0/2468376007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63019b930 con 0x7ff6301050d0 2024-09-21T02:35:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff635400640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff630104730 0x7ff63019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.053+0000 7ff636800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63019b110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009430 tx=0x7ff62c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.054+0000 7ff62aa00640 1 -- 172.21.15.79:0/2468376007 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c003b70 con 0x7ff6301050d0 2024-09-21T02:35:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.054+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63019bbc0 con 0x7ff6301050d0 2024-09-21T02:35:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.054+0000 7ff62aa00640 1 -- 172.21.15.79:0/2468376007 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff62c003d10 con 0x7ff6301050d0 2024-09-21T02:35:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.054+0000 7ff62aa00640 1 -- 172.21.15.79:0/2468376007 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c02fb40 con 0x7ff6301050d0 2024-09-21T02:35:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.054+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6301a2310 con 0x7ff6301050d0 2024-09-21T02:35:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.057+0000 7ff63f878740 1 Processor -- start 2024-09-21T02:35:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.059+0000 7ff62aa00640 1 -- 172.21.15.79:0/2468376007 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff62c004610 con 0x7ff6301050d0 2024-09-21T02:35:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.059+0000 7ff63f878740 1 -- start start 2024-09-21T02:35:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff63f878740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fc90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff63f878740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539bf92f0 0x556539fc9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff63f878740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff63f878740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556539f3c6b0 con 0x556539c014d0 2024-09-21T02:35:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff63f878740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556539f2bae0 con 0x556539c221b0 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff63f878740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556539f2f8f0 con 0x556539bf92f0 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fc90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fc90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37130/0 (socket says 172.21.15.79:37130) 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 -- 172.21.15.79:0/2433260200 learned_addr learned my addr 172.21.15.79:0/2433260200 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635e00640 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539bf92f0 0x556539fc9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 -- 172.21.15.79:0/2433260200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539bf92f0 msgr2=0x556539fc9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539bf92f0 0x556539fc9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 -- 172.21.15.79:0/2433260200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 msgr2=0x556539fca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.060+0000 7ff635400640 1 -- 172.21.15.79:0/2433260200 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556539ef8780 con 0x556539c221b0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.061+0000 7ff635400640 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fc90d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6200118b0 tx=0x7ff620009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27742c7b5a587852 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.061+0000 7ff62aa00640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6180b6510 0x7ff6180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.061+0000 7ff61f000640 1 -- 172.21.15.79:0/2433260200 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62000f8c0 con 0x556539c221b0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.061+0000 7ff61f000640 1 -- 172.21.15.79:0/2433260200 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff62001e420 con 0x556539c221b0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.061+0000 7ff61f000640 1 -- 172.21.15.79:0/2433260200 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62000e620 con 0x556539c221b0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.061+0000 7ff62aa00640 1 -- 172.21.15.79:0/2468376007 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff62c108880 con 0x7ff6301050d0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.061+0000 7ff635e00640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6180b6510 0x7ff6180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 -- 172.21.15.79:0/2433260200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 msgr2=0x556539fc90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fc90d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6200118b0 tx=0x7ff620009f90 comp rx=0 tx=0).stop 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff635e00640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6180b6510 0x7ff6180b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff624009da0 tx=0x7ff624005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 -- 172.21.15.79:0/2433260200 shutdown_connections 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539bf92f0 0x556539fc9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 --2- 172.21.15.79:0/2433260200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fc90d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 -- 172.21.15.79:0/2433260200 >> 172.21.15.79:0/2433260200 conn(0x556539c16300 msgr2=0x556539fc4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 -- 172.21.15.79:0/2433260200 shutdown_connections 2024-09-21T02:35:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.062+0000 7ff63f878740 1 -- 172.21.15.79:0/2433260200 wait complete. 2024-09-21T02:35:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 -- start start 2024-09-21T02:35:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 Processor -- start 2024-09-21T02:35:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fd6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fd72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c221b0 0x556539fd7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556539e63ab0 con 0x556539c014d0 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556539ed2570 con 0x556539bf92f0 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.063+0000 7ff63f878740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556539fcadb0 con 0x556539c221b0 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff63f878740 10 client.0 _ll_register_callbacks cb 0x556539ee1100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fd6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fd72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fd6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37146/0 (socket says 172.21.15.79:37146) 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 -- 172.21.15.79:0/1823853070 learned_addr learned my addr 172.21.15.79:0/1823853070 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff636800640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c221b0 0x556539fd7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 -- 172.21.15.79:0/1823853070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c221b0 msgr2=0x556539fd7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c221b0 0x556539fd7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 -- 172.21.15.79:0/1823853070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 msgr2=0x556539fd72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fd72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635e00640 1 -- 172.21.15.79:0/1823853070 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556539c8d790 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff636800640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c221b0 0x556539fd7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.064+0000 7ff635400640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fd72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff635e00640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fd6c30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff62401ea00 tx=0x7ff624004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba192e0aadefca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff613400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff613400640 1 -- 172.21.15.79:0/1823853070 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62402e060 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff62001e420 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff613400640 1 -- 172.21.15.79:0/1823853070 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff624018030 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff613400640 1 -- 172.21.15.79:0/1823853070 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff624035050 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff63f878740 10 client.25283 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.065+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556539d06620 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff613400640 1 -- 172.21.15.79:0/1823853070 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff62001e420 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff613400640 1 -- 172.21.15.79:0/1823853070 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff62400f500 con 0x556539bf92f0 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff63f878740 10 client.25283 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff63f878740 10 client.25283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff63f878740 20 client.25283 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff63f878740 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539be0d80 0x556539fe43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff63f878740 4 client.25283 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:35:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556539f3e600 con 0x556539be0d80 2024-09-21T02:35:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.066+0000 7ff635400640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539be0d80 0x556539fe43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.067+0000 7ff613400640 10 client.25283 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.067+0000 7ff635400640 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539be0d80 0x556539fe43d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42fdf77753374a6 server_cookie=9b451900bdc7281a in_seq=0 out_seq=0 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff613400640 1 -- 172.21.15.79:0/1823853070 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556539f3e600 con 0x556539be0d80 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff613400640 10 client.25283 handle_command_reply: tid=0 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 client.25283 shutdown 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 msgr2=0x556539fd6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fd6c30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff62401ea00 tx=0x7ff624004730 comp rx=0 tx=0).stop 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 shutdown_connections 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539be0d80 0x556539fe43d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c221b0 0x556539fd7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c014d0 0x556539fd72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff613400640 0 client.25283 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 --2- 172.21.15.79:0/1823853070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fd6c30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 >> 172.21.15.79:0/1823853070 conn(0x556539c16300 msgr2=0x556539fc30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 shutdown_connections 2024-09-21T02:35:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 1 -- 172.21.15.79:0/1823853070 wait complete. 2024-09-21T02:35:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.068+0000 7ff63f878740 20 client.25283 trim_cache size 0 max 16384 2024-09-21T02:35:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 Processor -- start 2024-09-21T02:35:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 -- start start 2024-09-21T02:35:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539bf92f0 0x556539fca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fd51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fd5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301a8530 con 0x556539bf92f0 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301aadb0 con 0x556539c221b0 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff63f878740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301a8ba0 con 0x556539c014d0 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff635e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539bf92f0 0x556539fca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff635e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539bf92f0 0x556539fca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57920/0 (socket says 172.21.15.79:57920) 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.084+0000 7ff635e00640 1 -- 172.21.15.79:0/702086557 learned_addr learned my addr 172.21.15.79:0/702086557 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff635400640 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fd51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff636800640 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fd5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff635e00640 1 -- 172.21.15.79:0/702086557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 msgr2=0x556539fd51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff635e00640 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fd51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff635e00640 1 -- 172.21.15.79:0/702086557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 msgr2=0x556539fd5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff635e00640 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fd5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff635e00640 1 -- 172.21.15.79:0/702086557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556539fd81d0 con 0x556539bf92f0 2024-09-21T02:35:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff635e00640 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539bf92f0 0x556539fca030 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff624005c20 tx=0x7ff62400fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b24fa6ae4f8f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff61e600640 1 -- 172.21.15.79:0/702086557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62402e030 con 0x556539bf92f0 2024-09-21T02:35:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.085+0000 7ff61e600640 1 -- 172.21.15.79:0/702086557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff624004030 con 0x556539bf92f0 2024-09-21T02:35:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff61e600640 1 -- 172.21.15.79:0/702086557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6240055e0 con 0x556539bf92f0 2024-09-21T02:35:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff63f878740 1 -- 172.21.15.79:0/702086557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539bf92f0 msgr2=0x556539fca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff63f878740 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539bf92f0 0x556539fca030 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff624005c20 tx=0x7ff62400fcd0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff63f878740 1 -- 172.21.15.79:0/702086557 shutdown_connections 2024-09-21T02:35:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff63f878740 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539c221b0 0x556539fd5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff63f878740 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fd51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff63f878740 1 --2- 172.21.15.79:0/702086557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539bf92f0 0x556539fca030 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.086+0000 7ff63f878740 1 -- 172.21.15.79:0/702086557 >> 172.21.15.79:0/702086557 conn(0x556539c16300 msgr2=0x556539fd5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.087+0000 7ff63f878740 1 -- 172.21.15.79:0/702086557 shutdown_connections 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.087+0000 7ff63f878740 1 -- 172.21.15.79:0/702086557 wait complete. 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.087+0000 7ff63f878740 1 -- start start 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.087+0000 7ff63f878740 1 Processor -- start 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff63f878740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fdbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff63f878740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fdc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff63f878740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c221b0 0x556539fdd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff63f878740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301a9270 con 0x556539c221b0 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff63f878740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301aa6e0 con 0x556539bf92f0 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff63f878740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301a9940 con 0x556539c014d0 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff63f878740 10 client.0 _ll_register_callbacks cb 0x7ff62401e890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff636800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c221b0 0x556539fdd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fdbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fdc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff636800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c221b0 0x556539fdd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57922/0 (socket says 172.21.15.79:57922) 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff636800640 1 -- 172.21.15.79:0/3290615072 learned_addr learned my addr 172.21.15.79:0/3290615072 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635e00640 1 -- 172.21.15.79:0/3290615072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 msgr2=0x556539fdc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635e00640 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fdc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635e00640 1 -- 172.21.15.79:0/3290615072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c221b0 msgr2=0x556539fdd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635e00640 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c221b0 0x556539fdd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635e00640 1 -- 172.21.15.79:0/3290615072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556539fdd7b0 con 0x556539bf92f0 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff636800640 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c221b0 0x556539fdd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.088+0000 7ff635400640 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fdc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff635e00640 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fdbe90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff62400f8d0 tx=0x7ff6240050a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43ad7b415662bae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff613400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:35:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff613400640 1 -- 172.21.15.79:0/3290615072 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62402e050 con 0x556539bf92f0 2024-09-21T02:35:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff624004030 con 0x556539bf92f0 2024-09-21T02:35:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff613400640 1 -- 172.21.15.79:0/3290615072 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff6240052e0 con 0x556539bf92f0 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff613400640 1 -- 172.21.15.79:0/3290615072 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff62404c050 con 0x556539bf92f0 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff63f878740 10 client.25289 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.089+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556539fdeaa0 con 0x556539bf92f0 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff613400640 1 -- 172.21.15.79:0/3290615072 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff624004030 con 0x556539bf92f0 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff613400640 1 -- 172.21.15.79:0/3290615072 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff62403a480 con 0x556539bf92f0 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff63f878740 10 client.25289 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff63f878740 10 client.25289 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff63f878740 20 client.25289 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff63f878740 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539bb61c0 0x55653a050ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff63f878740 4 client.25289 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:35:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556539fca710 con 0x556539bb61c0 2024-09-21T02:35:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.090+0000 7ff635400640 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539bb61c0 0x55653a050ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.091+0000 7ff635400640 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539bb61c0 0x55653a050ea0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d151c37558ab07aa server_cookie=91eb5c061e220cf4 in_seq=0 out_seq=0 2024-09-21T02:35:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.091+0000 7ff613400640 10 client.25289 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff613400640 1 -- 172.21.15.79:0/3290615072 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556539fca710 con 0x556539bb61c0 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff613400640 10 client.25289 handle_command_reply: tid=0 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 client.25289 shutdown 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 msgr2=0x556539fdbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fdbe90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff62400f8d0 tx=0x7ff6240050a0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 shutdown_connections 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556539bb61c0 0x55653a050ea0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556539c221b0 0x556539fdd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556539c014d0 0x556539fdc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 --2- 172.21.15.79:0/3290615072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556539bf92f0 0x556539fdbe90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff613400640 0 client.25289 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 >> 172.21.15.79:0/3290615072 conn(0x556539c16300 msgr2=0x556539fd5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.103+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 shutdown_connections 2024-09-21T02:35:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff63f878740 1 -- 172.21.15.79:0/3290615072 wait complete. 2024-09-21T02:35:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff63f878740 20 client.25289 trim_cache size 0 max 16384 2024-09-21T02:35:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:35:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:35:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:35:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6180b6510 msgr2=0x7ff6180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6180b6510 0x7ff6180b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff624009da0 tx=0x7ff624005f90 comp rx=0 tx=0).stop 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 msgr2=0x7ff63019b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63019b110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009430 tx=0x7ff62c0316f0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 shutdown_connections 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6180b6510 0x7ff6180b8a20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6301050d0 0x7ff63019b110 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff630104730 0x7ff63019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 --2- 172.21.15.79:0/2468376007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6301036b0 0x7ff630199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.104+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 >> 172.21.15.79:0/2468376007 conn(0x7ff6300feff0 msgr2=0x7ff630107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.105+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 shutdown_connections 2024-09-21T02:35:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:36.105+0000 7ff638800640 1 -- 172.21.15.79:0/2468376007 wait complete. 2024-09-21T02:35:36.180 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:36.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:36 smithi098 ceph-mon[34832]: pgmap v411: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T02:35:36.662 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:36 smithi079 ceph-mon[30788]: pgmap v411: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T02:35:36.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:36 smithi148 ceph-mon[34626]: pgmap v411: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T02:35:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:37 smithi079 ceph-mon[30788]: pgmap v412: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T02:35:37.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:37 smithi148 ceph-mon[34626]: pgmap v412: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T02:35:37.814 INFO:teuthology.orchestra.run.smithi079.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T02:35:37.814 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T02:35:37.814 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T02:35:37.815 DEBUG:tasks.quiescer:Yielding 2024-09-21T02:35:37.815 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T02:35:37.825 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T02:35:37.826 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:35:37.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-21T02:35:37.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:35:37.904 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:37 smithi098 ceph-mon[34832]: pgmap v412: 129 pgs: 129 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T02:35:37.930 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-21T02:35:37.930 INFO:teuthology.orchestra.run.smithi079.stdout:0@56d10306-77c0-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/269a1161-9dbe-40e4-b6ca-6cedc21ad806 1.1T 380M 1.1T 1% /tmp/cephfs 2024-09-21T02:35:37.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-21T02:35:38.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-21T02:35:38.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-21T02:35:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:38.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 -- 172.21.15.79:0/1389713036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5241092f0 msgr2=0x7fa524109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 --2- 172.21.15.79:0/1389713036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5241092f0 0x7fa524109700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009900 tx=0x7fa50c02a410 comp rx=0 tx=0).stop 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 -- 172.21.15.79:0/1389713036 shutdown_connections 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 --2- 172.21.15.79:0/1389713036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa524109c40 0x7fa524110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 --2- 172.21.15.79:0/1389713036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5241092f0 0x7fa524109700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 --2- 172.21.15.79:0/1389713036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5241039b0 0x7fa524103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 -- 172.21.15.79:0/1389713036 >> 172.21.15.79:0/1389713036 conn(0x7fa5240ff440 msgr2=0x7fa524101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 -- 172.21.15.79:0/1389713036 shutdown_connections 2024-09-21T02:35:38.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.856+0000 7fa523e00640 1 -- 172.21.15.79:0/1389713036 wait complete. 2024-09-21T02:35:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.857+0000 7fa523e00640 1 Processor -- start 2024-09-21T02:35:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.857+0000 7fa523e00640 1 -- start start 2024-09-21T02:35:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5241039b0 0x7fa52419c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5241092f0 0x7fa52419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa524109c40 0x7fa5241a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa524113950 con 0x7fa524109c40 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa5241137d0 con 0x7fa5241039b0 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa524113ad0 con 0x7fa5241092f0 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa524109c40 0x7fa5241a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa522a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5241039b0 0x7fa52419c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa522a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5241039b0 0x7fa52419c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37200/0 (socket says 172.21.15.79:37200) 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa523400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa524109c40 0x7fa5241a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57948/0 (socket says 172.21.15.79:57948) 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa522a00640 1 -- 172.21.15.79:0/29547808 learned_addr learned my addr 172.21.15.79:0/29547808 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.858+0000 7fa51a000640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5241092f0 0x7fa52419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:38.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa522a00640 1 -- 172.21.15.79:0/29547808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5241092f0 msgr2=0x7fa52419cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:38.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa522a00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5241092f0 0x7fa52419cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa522a00640 1 -- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa524109c40 msgr2=0x7fa5241a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:38.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa522a00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa524109c40 0x7fa5241a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa522a00640 1 -- 172.21.15.79:0/29547808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5241a24d0 con 0x7fa5241039b0 2024-09-21T02:35:38.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa522a00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5241039b0 0x7fa52419c560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa51400eb90 tx=0x7fa51400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:38.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa51be00640 1 -- 172.21.15.79:0/29547808 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514004d20 con 0x7fa5241039b0 2024-09-21T02:35:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.859+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5241a27c0 con 0x7fa5241039b0 2024-09-21T02:35:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.860+0000 7fa51be00640 1 -- 172.21.15.79:0/29547808 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa51400ee90 con 0x7fa5241039b0 2024-09-21T02:35:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.860+0000 7fa51be00640 1 -- 172.21.15.79:0/29547808 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514010670 con 0x7fa5241039b0 2024-09-21T02:35:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.860+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5241a8f20 con 0x7fa5241039b0 2024-09-21T02:35:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.861+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa524103dc0 con 0x7fa5241039b0 2024-09-21T02:35:38.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.863+0000 7fa51be00640 1 -- 172.21.15.79:0/29547808 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa514010950 con 0x7fa5241039b0 2024-09-21T02:35:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.865+0000 7fa51be00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa5080b6590 0x7fa5080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.865+0000 7fa51be00640 1 -- 172.21.15.79:0/29547808 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa5140e7fe0 con 0x7fa5241039b0 2024-09-21T02:35:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.865+0000 7fa51a000640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa5080b6590 0x7fa5080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.866+0000 7fa51a000640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa5080b6590 0x7fa5080b8aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa50c02aa00 tx=0x7fa50c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:38.867+0000 7fa51be00640 1 -- 172.21.15.79:0/29547808 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5140ae460 con 0x7fa5241039b0 2024-09-21T02:35:39.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.098+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa52419d690 con 0x7fa5241039b0 2024-09-21T02:35:39.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.099+0000 7fa51be00640 1 -- 172.21.15.79:0/29547808 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fa5140b2840 con 0x7fa5241039b0 2024-09-21T02:35:39.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:39.101 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:35:39.101 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:35:39.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa5080b6590 msgr2=0x7fa5080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa5080b6590 0x7fa5080b8aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa50c02aa00 tx=0x7fa50c005a20 comp rx=0 tx=0).stop 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5241039b0 msgr2=0x7fa52419c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5241039b0 0x7fa52419c560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa51400eb90 tx=0x7fa51400c6a0 comp rx=0 tx=0).stop 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 shutdown_connections 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa5080b6590 0x7fa5080b8aa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa524109c40 0x7fa5241a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5241092f0 0x7fa52419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 --2- 172.21.15.79:0/29547808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa5241039b0 0x7fa52419c560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 >> 172.21.15.79:0/29547808 conn(0x7fa5240ff440 msgr2=0x7fa524106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.102+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 shutdown_connections 2024-09-21T02:35:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:39.103+0000 7fa523e00640 1 -- 172.21.15.79:0/29547808 wait complete. 2024-09-21T02:35:39.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:39 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/29547808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:39.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:39 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/29547808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:39 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/29547808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:35:40.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:40 smithi079 ceph-mon[30788]: pgmap v413: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T02:35:40.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:40 smithi148 ceph-mon[34626]: pgmap v413: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T02:35:40.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:32:42.479233+0000', 'modified': '2024-09-21T02:33:34.630634+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24668': {'gid': 24668, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6837/2031151027', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 2031151027}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 2031151027}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.98:6839/413408652', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 413408652}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 413408652}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24704]} 2024-09-21T02:35:40.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T02:35:40.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:35:40.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:40 smithi098 ceph-mon[34832]: pgmap v413: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T02:35:40.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-21T02:35:40.881 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-21T02:35:40.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-21T02:35:40.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T02:35:41.002 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:41.055 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/: 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 .. 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 data 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data: 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:41.056 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 .. 2024-09-21T02:35:41.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-21T02:35:41.200 INFO:teuthology.orchestra.run.smithi079.stdout:[Service] 2024-09-21T02:35:41.201 INFO:teuthology.orchestra.run.smithi079.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-21T02:35:41.201 INFO:teuthology.orchestra.run.smithi079.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-21T02:35:41.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-21T02:35:41.409 INFO:teuthology.orchestra.run.smithi079.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-21T02:35:41.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:41 smithi079 ceph-mon[30788]: pgmap v414: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T02:35:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 -- 172.21.15.79:0/1428225639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 msgr2=0x7f97a0112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 --2- 172.21.15.79:0/1428225639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 0x7f97a0112680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9798009ca0 tx=0x7f979802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 -- 172.21.15.79:0/1428225639 shutdown_connections 2024-09-21T02:35:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 --2- 172.21.15.79:0/1428225639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 0x7f97a0112680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 --2- 172.21.15.79:0/1428225639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 0x7f97a010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 --2- 172.21.15.79:0/1428225639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a0105bc0 0x7f97a0105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 -- 172.21.15.79:0/1428225639 >> 172.21.15.79:0/1428225639 conn(0x7f97a0101630 msgr2=0x7f97a0103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 -- 172.21.15.79:0/1428225639 shutdown_connections 2024-09-21T02:35:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.717+0000 7f97a5800640 1 -- 172.21.15.79:0/1428225639 wait complete. 2024-09-21T02:35:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.718+0000 7f97a5800640 1 Processor -- start 2024-09-21T02:35:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.718+0000 7f97a5800640 1 -- start start 2024-09-21T02:35:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a5800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a0105bc0 0x7f97a019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a5800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 0x7f97a019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a5800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 0x7f97a01a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a5800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0115b60 con 0x7f97a010b500 2024-09-21T02:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a5800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01159e0 con 0x7f97a010be50 2024-09-21T02:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a5800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0115ce0 con 0x7f97a0105bc0 2024-09-21T02:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f9797e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 0x7f97a019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f979fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a0105bc0 0x7f97a019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f9797e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 0x7f97a019ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57968/0 (socket says 172.21.15.79:57968) 2024-09-21T02:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f9797e00640 1 -- 172.21.15.79:0/3463014032 learned_addr learned my addr 172.21.15.79:0/3463014032 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a4e00640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 0x7f97a01a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a4e00640 1 -- 172.21.15.79:0/3463014032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a0105bc0 msgr2=0x7f97a019c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.719+0000 7f97a4e00640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a0105bc0 0x7f97a019c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f97a4e00640 1 -- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 msgr2=0x7f97a019ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f97a4e00640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 0x7f97a019ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f97a4e00640 1 -- 172.21.15.79:0/3463014032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a01a2400 con 0x7f97a010be50 2024-09-21T02:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f9797e00640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 0x7f97a019ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f97a4e00640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 0x7f97a01a1cd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9798005e30 tx=0x7f97980317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f979d600640 1 -- 172.21.15.79:0/3463014032 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798003b70 con 0x7f97a010be50 2024-09-21T02:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a01a2690 con 0x7f97a010be50 2024-09-21T02:35:41.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f979d600640 1 -- 172.21.15.79:0/3463014032 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9798003d10 con 0x7f97a010be50 2024-09-21T02:35:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f979d600640 1 -- 172.21.15.79:0/3463014032 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979802f970 con 0x7f97a010be50 2024-09-21T02:35:41.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.720+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a01a8e50 con 0x7f97a010be50 2024-09-21T02:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.724+0000 7f97ad9f4740 1 Processor -- start 2024-09-21T02:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.724+0000 7f979d600640 1 -- 172.21.15.79:0/3463014032 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f979802fb10 con 0x7f97a010be50 2024-09-21T02:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.724+0000 7f97ad9f4740 1 -- start start 2024-09-21T02:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a915f60 0x55569acbc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a8ed0a0 0x55569acbcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acbd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55569ac33d50 con 0x55569a8f5280 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55569ac23180 con 0x55569a8ed0a0 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55569ac26f90 con 0x55569a915f60 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f979fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a8ed0a0 0x55569acbcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f979fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a8ed0a0 0x55569acbcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37226/0 (socket says 172.21.15.79:37226) 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f979fe00640 1 -- 172.21.15.79:0/2388640633 learned_addr learned my addr 172.21.15.79:0/2388640633 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f9797e00640 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acbd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.725+0000 7f9797e00640 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a915f60 0x55569acbc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979fe00640 1 -- 172.21.15.79:0/2388640633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a915f60 msgr2=0x55569acbc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979fe00640 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a915f60 0x55569acbc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979fe00640 1 -- 172.21.15.79:0/2388640633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 msgr2=0x55569acbd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979fe00640 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acbd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979fe00640 1 -- 172.21.15.79:0/2388640633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55569abeda70 con 0x55569a8ed0a0 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979fe00640 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a8ed0a0 0x55569acbcbb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d20 tx=0x7f9790011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac60443916bfa17b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979d600640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97840b6510 0x7f97840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f9795600640 1 -- 172.21.15.79:0/2388640633 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979001e070 con 0x55569a8ed0a0 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f979d600640 1 -- 172.21.15.79:0/3463014032 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f97981086a0 con 0x7f97a010be50 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f9795600640 1 -- 172.21.15.79:0/2388640633 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9790019ae0 con 0x55569a8ed0a0 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f9795600640 1 -- 172.21.15.79:0/2388640633 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979000ea50 con 0x55569a8ed0a0 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.726+0000 7f9797e00640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97840b6510 0x7f97840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.727+0000 7f97ad9f4740 1 -- 172.21.15.79:0/2388640633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a8ed0a0 msgr2=0x55569acbcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.727+0000 7f9797e00640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97840b6510 0x7f97840b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f97a0104f50 tx=0x7f9788005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.727+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a8ed0a0 0x55569acbcbb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d20 tx=0x7f9790011810 comp rx=0 tx=0).stop 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 -- 172.21.15.79:0/2388640633 shutdown_connections 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acbd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a8ed0a0 0x55569acbcbb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/2388640633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a915f60 0x55569acbc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 -- 172.21.15.79:0/2388640633 >> 172.21.15.79:0/2388640633 conn(0x55569a90a350 msgr2=0x55569acba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 -- 172.21.15.79:0/2388640633 shutdown_connections 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 -- 172.21.15.79:0/2388640633 wait complete. 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.728+0000 7f97ad9f4740 1 -- start start 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 1 Processor -- start 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569acc8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acc87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acd4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55569aa845f0 con 0x55569a8ed0a0 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55569abbe460 con 0x55569a915f60 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55569accae50 con 0x55569a8f5280 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97ad9f4740 10 client.0 _ll_register_callbacks cb 0x55569abce210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f979fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569acc8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97a4e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acd4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f9797e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acc87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97a4e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acd4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37234/0 (socket says 172.21.15.79:37234) 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f979fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569acc8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57974/0 (socket says 172.21.15.79:57974) 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.729+0000 7f97a4e00640 1 -- 172.21.15.79:0/1802376920 learned_addr learned my addr 172.21.15.79:0/1802376920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f97a4e00640 1 -- 172.21.15.79:0/1802376920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 msgr2=0x55569acc87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f97a4e00640 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acc87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f97a4e00640 1 -- 172.21.15.79:0/1802376920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 msgr2=0x55569acc8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f97a4e00640 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569acc8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f97a4e00640 1 -- 172.21.15.79:0/1802376920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55569a981540 con 0x55569a915f60 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f97a4e00640 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acd4140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97980ce3b0 tx=0x7f97980ce1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccdcac5aa3ff8449 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f978e000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:35:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f978e000640 1 -- 172.21.15.79:0/1802376920 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97980cdf30 con 0x55569a915f60 2024-09-21T02:35:41.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f978e000640 1 -- 172.21.15.79:0/1802376920 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f97980d79b0 con 0x55569a915f60 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.730+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55569abc0a70 con 0x55569a915f60 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f978e000640 1 -- 172.21.15.79:0/1802376920 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f97980e9050 con 0x55569a915f60 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 10 client.25307 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55569abdb6f0 con 0x55569a915f60 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f978e000640 1 -- 172.21.15.79:0/1802376920 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55569abc0a70 con 0x55569a915f60 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f978e000640 1 -- 172.21.15.79:0/1802376920 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9798108070 con 0x55569a915f60 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 10 client.25307 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 10 client.25307 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 20 client.25307 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8d48e0 0x55569acda820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 4 client.25307 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:35:41.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.731+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55569ac35ca0 con 0x55569a8d48e0 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.732+0000 7f979fe00640 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8d48e0 0x55569acda820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.732+0000 7f979fe00640 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8d48e0 0x55569acda820 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77ff90967709240 server_cookie=1b63ce9dfd94f16b in_seq=0 out_seq=0 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.732+0000 7f978e000640 10 client.25307 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f978e000640 1 -- 172.21.15.79:0/1802376920 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55569ac35ca0 con 0x55569a8d48e0 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f978e000640 10 client.25307 handle_command_reply: tid=0 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 client.25307 shutdown 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 msgr2=0x55569acd4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acd4140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97980ce3b0 tx=0x7f97980ce1f0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 shutdown_connections 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8d48e0 0x55569acda820 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acd4140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acc87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1802376920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569acc8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 >> 172.21.15.79:0/1802376920 conn(0x55569a90a350 msgr2=0x55569acbf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:41.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.733+0000 7f978e000640 0 client.25307 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.734+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 shutdown_connections 2024-09-21T02:35:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.734+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1802376920 wait complete. 2024-09-21T02:35:41.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.734+0000 7f97ad9f4740 20 client.25307 trim_cache size 0 max 16384 2024-09-21T02:35:41.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.757+0000 7f97ad9f4740 1 Processor -- start 2024-09-21T02:35:41.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.757+0000 7f97ad9f4740 1 -- start start 2024-09-21T02:35:41.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.757+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8ed0a0 0x55569acc3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.757+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acc36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.757+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acc68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55569acd8b60 con 0x55569a8f5280 2024-09-21T02:35:41.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55569acd9230 con 0x55569a915f60 2024-09-21T02:35:41.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55569acd9900 con 0x55569a8ed0a0 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f9797e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acc36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f9797e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acc36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57988/0 (socket says 172.21.15.79:57988) 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f9797e00640 1 -- 172.21.15.79:0/1753684415 learned_addr learned my addr 172.21.15.79:0/1753684415 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97a4e00640 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acc68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f979fe00640 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8ed0a0 0x55569acc3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97a4e00640 1 -- 172.21.15.79:0/1753684415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8ed0a0 msgr2=0x55569acc3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97a4e00640 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8ed0a0 0x55569acc3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97a4e00640 1 -- 172.21.15.79:0/1753684415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 msgr2=0x55569acc36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97a4e00640 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acc36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f97a4e00640 1 -- 172.21.15.79:0/1753684415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55569accad30 con 0x55569a915f60 2024-09-21T02:35:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.758+0000 7f9797e00640 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acc36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.759+0000 7f97a4e00640 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acc68d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9798004af0 tx=0x7f979802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60483bce4b7d5e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.759+0000 7f9794c00640 1 -- 172.21.15.79:0/1753684415 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97980ed070 con 0x55569a915f60 2024-09-21T02:35:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.759+0000 7f9794c00640 1 -- 172.21.15.79:0/1753684415 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9798036040 con 0x55569a915f60 2024-09-21T02:35:41.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.759+0000 7f9794c00640 1 -- 172.21.15.79:0/1753684415 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97980d7e80 con 0x55569a915f60 2024-09-21T02:35:41.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1753684415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 msgr2=0x55569acc68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acc68d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9798004af0 tx=0x7f979802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1753684415 shutdown_connections 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acc68d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8f5280 0x55569acc36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/1753684415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8ed0a0 0x55569acc3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1753684415 >> 172.21.15.79:0/1753684415 conn(0x55569a90a350 msgr2=0x55569acd8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1753684415 shutdown_connections 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 -- 172.21.15.79:0/1753684415 wait complete. 2024-09-21T02:35:41.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.760+0000 7f97ad9f4740 1 -- start start 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 1 Processor -- start 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569ace33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acdd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acdd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55569acda6a0 con 0x55569a8ed0a0 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55569acd9fd0 con 0x55569a915f60 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55569acdad70 con 0x55569a8f5280 2024-09-21T02:35:41.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f97ad9f4740 10 client.0 _ll_register_callbacks cb 0x7f97980cab40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.761+0000 7f979fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569ace33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569ace33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57990/0 (socket says 172.21.15.79:57990) 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 -- 172.21.15.79:0/3964273829 learned_addr learned my addr 172.21.15.79:0/3964273829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f9797e00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acdd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f97a4e00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acdd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 -- 172.21.15.79:0/3964273829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 msgr2=0x55569acdd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acdd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 -- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 msgr2=0x55569acdd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acdd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 -- 172.21.15.79:0/3964273829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55569acdde10 con 0x55569a8ed0a0 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f97a4e00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acdd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f979fe00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569ace33f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d20 tx=0x7f9790011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc17305edc90989 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.762+0000 7f978e000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.763+0000 7f978e000640 1 -- 172.21.15.79:0/3964273829 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979001e040 con 0x55569a8ed0a0 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.763+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9798036040 con 0x55569a8ed0a0 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.763+0000 7f978e000640 1 -- 172.21.15.79:0/3964273829 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f97900052c0 con 0x55569a8ed0a0 2024-09-21T02:35:41.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.763+0000 7f978e000640 1 -- 172.21.15.79:0/3964273829 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9790005c50 con 0x55569a8ed0a0 2024-09-21T02:35:41.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.763+0000 7f97ad9f4740 10 client.15303 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:41.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.763+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55569ad45d50 con 0x55569a8ed0a0 2024-09-21T02:35:41.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.763+0000 7f978e000640 1 -- 172.21.15.79:0/3964273829 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9798036040 con 0x55569a8ed0a0 2024-09-21T02:35:41.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f978e000640 1 -- 172.21.15.79:0/3964273829 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f979000e660 con 0x55569a8ed0a0 2024-09-21T02:35:41.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f97ad9f4740 10 client.15303 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:41.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f97ad9f4740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:35:41.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f97ad9f4740 20 client.15303 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:41.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8a9c90 0x55569ad49340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:41.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f97ad9f4740 4 client.15303 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "status"}) -- 0x55569ac31750 con 0x55569a8a9c90 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.764+0000 7f9797e00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8a9c90 0x55569ad49340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.765+0000 7f978e000640 10 client.15303 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.765+0000 7f9797e00640 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8a9c90 0x55569ad49340 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7fd3491e11b45d5 server_cookie=3e6c4afdf5ae6ac0 in_seq=0 out_seq=0 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.765+0000 7f978e000640 1 -- 172.21.15.79:0/3964273829 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55569ac31750 con 0x55569a8a9c90 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.765+0000 7f978e000640 10 client.15303 handle_command_reply: tid=0 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 client.15303 shutdown 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 msgr2=0x55569ace33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569ace33f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d20 tx=0x7f9790011e30 comp rx=0 tx=0).stop 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 shutdown_connections 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55569a8a9c90 0x55569ad49340 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55569a915f60 0x55569acdd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55569a8f5280 0x55569acdd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 --2- 172.21.15.79:0/3964273829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55569a8ed0a0 0x55569ace33f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f978e000640 0 client.15303 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 >> 172.21.15.79:0/3964273829 conn(0x55569a90a350 msgr2=0x55569acc3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 shutdown_connections 2024-09-21T02:35:41.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 1 -- 172.21.15.79:0/3964273829 wait complete. 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.766+0000 7f97ad9f4740 20 client.15303 trim_cache size 0 max 16384 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "56d10306-77c0-11ef-baf5-efdc52797490", 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24704, 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-09-21T02:35:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-09-21T02:35:41.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 178.29737554299999, 2024-09-21T02:35:41.775 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 21, 2024-09-21T02:35:41.775 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 88, 2024-09-21T02:35:41.775 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:35:41.775 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 192.26899796199999 2024-09-21T02:35:41.775 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:35:41.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97840b6510 msgr2=0x7f97840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97840b6510 0x7f97840b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f97a0104f50 tx=0x7f9788005f90 comp rx=0 tx=0).stop 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 msgr2=0x7f97a01a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 0x7f97a01a1cd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9798005e30 tx=0x7f97980317c0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 shutdown_connections 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f97840b6510 0x7f97840b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97a010be50 0x7f97a01a1cd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a010b500 0x7f97a019ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 --2- 172.21.15.79:0/3463014032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a0105bc0 0x7f97a019c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 >> 172.21.15.79:0/3463014032 conn(0x7f97a0101630 msgr2=0x7f97a0108a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 shutdown_connections 2024-09-21T02:35:41.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:41.767+0000 7f97a5800640 1 -- 172.21.15.79:0/3463014032 wait complete. 2024-09-21T02:35:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:41 smithi148 ceph-mon[34626]: pgmap v414: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T02:35:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:41 smithi098 ceph-mon[34832]: pgmap v414: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T02:35:42.672 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T02:35:43.793 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:43 smithi079 ceph-mon[30788]: pgmap v415: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-21T02:35:43.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:43 smithi148 ceph-mon[34626]: pgmap v415: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-21T02:35:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:43 smithi098 ceph-mon[34832]: pgmap v415: 129 pgs: 129 active+clean; 659 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-21T02:35:45.426 INFO:teuthology.orchestra.run.smithi079.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-21T02:35:45.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T02:35:45.530 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/: 2024-09-21T02:35:45.530 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.530 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 .. 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 data 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data: 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:total 35 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 . 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 .. 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 base 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 21 02:35 global 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 log 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_commit_ts 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_dynshmem 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 21 02:35 pg_hba.conf 2024-09-21T02:35:45.531 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 21 02:35 pg_ident.conf 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 pg_logical 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 pg_multixact 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_notify 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_replslot 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_serial 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_snapshots 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_stat 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_stat_tmp 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 pg_subtrans 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_tblspc 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_twophase 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 pg_wal 2024-09-21T02:35:45.532 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 pg_xact 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 21 02:35 postgresql.auto.conf 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 21 02:35 postgresql.conf 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base: 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 . 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 1 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 13493 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 13494 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-21T02:35:45.533 INFO:teuthology.orchestra.run.smithi079.stdout:total 7777 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 . 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 .. 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 112 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 113 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 1247 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1247_fsm 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1247_vm 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 02:35 1249 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1249_fsm 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1249_vm 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 02:35 1255 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1255_fsm 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1255_vm 2024-09-21T02:35:45.534 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 02:35 1259 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1259_fsm 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1259_vm 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 02:35 13344 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13344_fsm 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13344_vm 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13346 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13348 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13349_fsm 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349_vm 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13351 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13353 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13354_fsm 2024-09-21T02:35:45.535 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354_vm 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13356 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13358 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13359_fsm 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359_vm 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13361 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13363 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1417 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1418 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 174 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 175 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2187 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2224 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2328 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2336 2024-09-21T02:35:45.536 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2337 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2579 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2600 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2600_fsm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2600_vm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2601_fsm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601_vm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2602 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2602_fsm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2602_vm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2603 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2603_fsm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2603_vm 2024-09-21T02:35:45.537 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2604 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2605 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2605_fsm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2605_vm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2606_fsm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606_vm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2607 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2607_fsm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2607_vm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 02:35 2608 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2608_fsm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2608_vm 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 02:35 2609 2024-09-21T02:35:45.538 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2609_fsm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2609_vm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2610 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2610_fsm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2610_vm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2611 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2612_fsm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612_vm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2613 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2615_fsm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615_vm 2024-09-21T02:35:45.539 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2616 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2616_fsm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2616_vm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 02:35 2617 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2617_fsm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2617_vm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 02:35 2618 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2618_fsm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2618_vm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 02:35 2619 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2619_fsm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2619_vm 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2620 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2650 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2651 2024-09-21T02:35:45.540 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2652 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2653 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2654 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2655 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2656 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2657 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 02:35 2658 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 2659 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2660 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2661 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2662 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2663 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2664 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2665 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2666 2024-09-21T02:35:45.541 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2667 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2668 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2669 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2670 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 02:35 2673 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 02:35 2674 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 02:35 2675 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2678 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2679 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2680 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2681 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2682 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2683 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2684 2024-09-21T02:35:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2685 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2686 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2687 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2688 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2689 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 02:35 2690 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 02:35 2691 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2692 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2693 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2696 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2699 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2701 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2702 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2703 2024-09-21T02:35:45.543 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2704 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2753 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2753_fsm 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2753_vm 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2754 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2755 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2756 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2757 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2830 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2831 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2832 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2833 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2834 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2835 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2836 2024-09-21T02:35:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2837 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 02:35 2838 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2838_fsm 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2838_vm 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2839 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840_fsm 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2840_vm 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2841 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2995 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2996 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3079_fsm 2024-09-21T02:35:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079_vm 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3080 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3081 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3085 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3118 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3119 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 02:35 3164 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3256 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3257 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3258 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3350 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3351 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3379 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3380 2024-09-21T02:35:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3381 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3394 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3394_fsm 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3394_vm 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3395 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3429 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3430 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3431 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3433 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3439 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3440 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3455 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 02:35 3456 2024-09-21T02:35:45.547 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3456_fsm 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3456_vm 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3466 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3467 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3468 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3501 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3502 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3503 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3534 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3541_fsm 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541_vm 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3542 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3574 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3575 2024-09-21T02:35:45.548 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3576 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3596 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3597 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3598 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3599 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3600_fsm 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600_vm 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3601_fsm 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601_vm 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3602_fsm 2024-09-21T02:35:45.549 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602_vm 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603_fsm 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3603_vm 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3604 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3605 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3606 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3607 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3608 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 3609 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3712 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3764_fsm 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764_vm 2024-09-21T02:35:45.550 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3766 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3767 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3997 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4143 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4144 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4145 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4146 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4147 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4148 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4149 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4150 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4151 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4152 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4153 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4154 2024-09-21T02:35:45.551 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4155 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4156 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4157 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4158 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4159 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4160 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4161 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4162 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4163 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4164 2024-09-21T02:35:45.552 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4165 2024-09-21T02:35:45.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4166 2024-09-21T02:35:45.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4167 2024-09-21T02:35:45.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4168 2024-09-21T02:35:45.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4169 2024-09-21T02:35:45.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4170 2024-09-21T02:35:45.553 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4171 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4172 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4173 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4174 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 5002 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 548 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 549 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6102 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6104 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6106 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6110 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6111 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6112 2024-09-21T02:35:45.554 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6113 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6117 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 826 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 827 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 828 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:total 7777 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 . 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 .. 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 112 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 113 2024-09-21T02:35:45.555 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 1247 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1247_fsm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1247_vm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 02:35 1249 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1249_fsm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1249_vm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 02:35 1255 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1255_fsm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1255_vm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 02:35 1259 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1259_fsm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1259_vm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 02:35 13344 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13344_fsm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13344_vm 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13346 2024-09-21T02:35:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13348 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13349_fsm 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349_vm 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13351 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13353 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13354_fsm 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354_vm 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13356 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13358 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13359_fsm 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359_vm 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13361 2024-09-21T02:35:45.557 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13363 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1417 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1418 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 174 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 175 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2187 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2224 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2328 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2336 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2337 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2579 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2600 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2600_fsm 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2600_vm 2024-09-21T02:35:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2601_fsm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601_vm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2602 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2602_fsm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2602_vm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2603 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2603_fsm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2603_vm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2604 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2605 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2605_fsm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2605_vm 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606 2024-09-21T02:35:45.559 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2606_fsm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606_vm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2607 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2607_fsm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2607_vm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 02:35 2608 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2608_fsm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2608_vm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 02:35 2609 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2609_fsm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2609_vm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2610 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2610_fsm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2610_vm 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2611 2024-09-21T02:35:45.560 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2612_fsm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612_vm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2613 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2615_fsm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615_vm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2616 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2616_fsm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2616_vm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 02:35 2617 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2617_fsm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2617_vm 2024-09-21T02:35:45.561 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 02:35 2618 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2618_fsm 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2618_vm 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 02:35 2619 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2619_fsm 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2619_vm 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2620 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2650 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2651 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2652 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2653 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2654 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2655 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2656 2024-09-21T02:35:45.562 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2657 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 02:35 2658 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 2659 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2660 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2661 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2662 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2663 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2664 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2665 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2666 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2667 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2668 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2669 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2670 2024-09-21T02:35:45.563 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 02:35 2673 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 02:35 2674 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 02:35 2675 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2678 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2679 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2680 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2681 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2682 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2683 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2684 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2685 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2686 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2687 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2688 2024-09-21T02:35:45.564 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2689 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 02:35 2690 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 02:35 2691 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2692 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2693 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2696 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2699 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2701 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2702 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2703 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2704 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2753 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2753_fsm 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2753_vm 2024-09-21T02:35:45.565 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2754 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2755 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2756 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2757 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2830 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2831 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2832 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2833 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2834 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2835 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2836 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2837 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 02:35 2838 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2838_fsm 2024-09-21T02:35:45.566 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2838_vm 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2839 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840_fsm 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2840_vm 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2841 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2995 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2996 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3079_fsm 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079_vm 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3080 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3081 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3085 2024-09-21T02:35:45.567 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3118 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3119 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 02:35 3164 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3256 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3257 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3258 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3350 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3351 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3379 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3380 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3381 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3394 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3394_fsm 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3394_vm 2024-09-21T02:35:45.568 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3395 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3429 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3430 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3431 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3433 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3439 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3440 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3455 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 02:35 3456 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3456_fsm 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3456_vm 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3466 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3467 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3468 2024-09-21T02:35:45.569 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3501 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3502 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3503 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3534 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3541_fsm 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541_vm 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3542 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3574 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3575 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3576 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3596 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3597 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3598 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3599 2024-09-21T02:35:45.570 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3600_fsm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600_vm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3601_fsm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601_vm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3602_fsm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602_vm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603_fsm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3603_vm 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3604 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3605 2024-09-21T02:35:45.571 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3606 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3607 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3608 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 3609 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3712 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3764_fsm 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764_vm 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3766 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3767 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3997 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4143 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4144 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4145 2024-09-21T02:35:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4146 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4147 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4148 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4149 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4150 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4151 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4152 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4153 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4154 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4155 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4156 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4157 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4158 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4159 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4160 2024-09-21T02:35:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4161 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4162 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4163 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4164 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4165 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4166 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4167 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4168 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4169 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4170 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4171 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4172 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4173 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4174 2024-09-21T02:35:45.574 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 5002 2024-09-21T02:35:45.575 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 548 2024-09-21T02:35:45.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 549 2024-09-21T02:35:45.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6102 2024-09-21T02:35:45.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6104 2024-09-21T02:35:45.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6106 2024-09-21T02:35:45.576 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6110 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6111 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6112 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6113 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6117 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 826 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 827 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 828 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:total 7777 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 . 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 .. 2024-09-21T02:35:45.577 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 112 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 113 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 1247 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1247_fsm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1247_vm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 02:35 1249 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1249_fsm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1249_vm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 02:35 1255 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1255_fsm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1255_vm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 02:35 1259 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1259_fsm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1259_vm 2024-09-21T02:35:45.578 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 02:35 13344 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13344_fsm 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13344_vm 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13346 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13348 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13349_fsm 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349_vm 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13351 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13353 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13354_fsm 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354_vm 2024-09-21T02:35:45.579 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13356 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13358 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13359_fsm 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359_vm 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13361 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13363 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1417 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1418 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 174 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 175 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2187 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2224 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2328 2024-09-21T02:35:45.580 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2336 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2337 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2579 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2600 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2600_fsm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2600_vm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2601_fsm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601_vm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2602 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2602_fsm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2602_vm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2603 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2603_fsm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2603_vm 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2604 2024-09-21T02:35:45.581 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2605 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2605_fsm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2605_vm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2606_fsm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606_vm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2607 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2607_fsm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2607_vm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 02:35 2608 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2608_fsm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2608_vm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 02:35 2609 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2609_fsm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2609_vm 2024-09-21T02:35:45.582 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2610 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2610_fsm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2610_vm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2611 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2612_fsm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612_vm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2613 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2615_fsm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615_vm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2616 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2616_fsm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2616_vm 2024-09-21T02:35:45.583 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 02:35 2617 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2617_fsm 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2617_vm 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 02:35 2618 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2618_fsm 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2618_vm 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 02:35 2619 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2619_fsm 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2619_vm 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2620 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2650 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2651 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2652 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2653 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2654 2024-09-21T02:35:45.584 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2655 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2656 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2657 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 02:35 2658 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 2659 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2660 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2661 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2662 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2663 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2664 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2665 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2666 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2667 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2668 2024-09-21T02:35:45.585 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2669 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2670 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 02:35 2673 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 02:35 2674 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 02:35 2675 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2678 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2679 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2680 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2681 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2682 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2683 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2684 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2685 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2686 2024-09-21T02:35:45.586 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2687 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2688 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2689 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 02:35 2690 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 02:35 2691 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2692 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2693 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2696 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2699 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2701 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2702 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2703 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2704 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2753 2024-09-21T02:35:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2753_fsm 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2753_vm 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2754 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2755 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2756 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2757 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2830 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2831 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2832 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2833 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2834 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2835 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2836 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2837 2024-09-21T02:35:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 02:35 2838 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2838_fsm 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2838_vm 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2839 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840_fsm 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2840_vm 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2841 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2995 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2996 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3079_fsm 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079_vm 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3080 2024-09-21T02:35:45.589 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3081 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3085 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3118 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3119 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 02:35 3164 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3256 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3257 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3258 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3350 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3351 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3379 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3380 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3381 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3394 2024-09-21T02:35:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3394_fsm 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3394_vm 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3395 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3429 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3430 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3431 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3433 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3439 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3440 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3455 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 02:35 3456 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3456_fsm 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3456_vm 2024-09-21T02:35:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3466 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3467 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3468 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3501 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3502 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3503 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3534 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3541_fsm 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541_vm 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3542 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3574 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3575 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3576 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3596 2024-09-21T02:35:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3597 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3598 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3599 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3600_fsm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600_vm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3601_fsm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601_vm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3602_fsm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602_vm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603_fsm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3603_vm 2024-09-21T02:35:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3604 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3605 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3606 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3607 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3608 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 3609 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3712 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3764_fsm 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764_vm 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3766 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3767 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3997 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4143 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4144 2024-09-21T02:35:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4145 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4146 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4147 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4148 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4149 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4150 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4151 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4152 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4153 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4154 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4155 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4156 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4157 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4158 2024-09-21T02:35:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4159 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4160 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4161 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4162 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4163 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4164 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4165 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4166 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4167 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4168 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4169 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4170 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4171 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4172 2024-09-21T02:35:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4173 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4174 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 5002 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 548 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 549 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6102 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6104 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6106 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6110 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6111 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6112 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6113 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6117 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 826 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 827 2024-09-21T02:35:45.597 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 828 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/global: 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:total 537 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 21 02:35 . 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1213 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1213_fsm 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1213_vm 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1214 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1214_fsm 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1214_vm 2024-09-21T02:35:45.598 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 1232 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 1233 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1260 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1260_fsm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1260_vm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1261 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1261_fsm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1261_vm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1262 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1262_fsm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1262_vm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2396 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2396_fsm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2396_vm 2024-09-21T02:35:45.599 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2397 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2671 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2672 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2676 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2677 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2694 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2695 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2697 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2698 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2846 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2847 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2964 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2965 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2966 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2967 2024-09-21T02:35:45.600 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3592 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3593 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4060 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4061 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4175 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4176 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4177 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4178 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4181 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4182 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4183 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4184 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4185 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4186 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6000 2024-09-21T02:35:45.601 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6001 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6002 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6100 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6114 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6115 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 pg_control 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/log: 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.602 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:total 1 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 . 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.603 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 mappings 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 02:35 replorigin_checkpoint 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 snapshots 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 .. 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 .. 2024-09-21T02:35:45.604 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 . 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 members 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 offsets 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:total 8 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 .. 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 0000 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.605 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:total 8 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 .. 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 0000 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.606 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.607 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:total 8 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 0000 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.608 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:total 16384 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 . 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:35 000000010000000000000001 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 archive_status 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 .. 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:total 8 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 21 02:35 .. 2024-09-21T02:35:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 0000 2024-09-21T02:35:45.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-21T02:35:45.679 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:45 smithi079 ceph-mon[30788]: pgmap v416: 129 pgs: 129 active+clean; 13 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 18 op/s 2024-09-21T02:35:45.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:45 smithi148 ceph-mon[34626]: pgmap v416: 129 pgs: 129 active+clean; 13 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 18 op/s 2024-09-21T02:35:45.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-21T02:35:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:45 smithi098 ceph-mon[34832]: pgmap v416: 129 pgs: 129 active+clean; 13 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 18 op/s 2024-09-21T02:35:45.927 INFO:teuthology.orchestra.run.smithi079.stderr:dropping old tables... 2024-09-21T02:35:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-21T02:35:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-21T02:35:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-21T02:35:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-21T02:35:45.929 INFO:teuthology.orchestra.run.smithi079.stderr:creating tables... 2024-09-21T02:35:45.945 INFO:teuthology.orchestra.run.smithi079.stderr:generating data (client-side)... 2024-09-21T02:35:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.12 s, remaining 3.58 s) 2024-09-21T02:35:46.366 INFO:teuthology.orchestra.run.smithi079.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.40 s, remaining 5.95 s) 2024-09-21T02:35:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.65 s, remaining 6.24 s) 2024-09-21T02:35:46.781 INFO:teuthology.orchestra.run.smithi079.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.81 s, remaining 5.68 s) 2024-09-21T02:35:46.978 INFO:teuthology.orchestra.run.smithi079.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.01 s, remaining 5.45 s) 2024-09-21T02:35:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.18 s, remaining 5.09 s) 2024-09-21T02:35:47.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:47 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:47.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:47 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.45 s, remaining 5.19 s) 2024-09-21T02:35:47.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:47 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:47.704 INFO:teuthology.orchestra.run.smithi079.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.73 s, remaining 5.20 s) 2024-09-21T02:35:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.89 s, remaining 4.82 s) 2024-09-21T02:35:48.135 INFO:teuthology.orchestra.run.smithi079.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.17 s, remaining 4.76 s) 2024-09-21T02:35:48.472 INFO:teuthology.orchestra.run.smithi079.stderr:1100000 of 3200000 tuples (34%) done (elapsed 2.50 s, remaining 4.78 s) 2024-09-21T02:35:48.559 INFO:teuthology.orchestra.run.smithi079.stderr:1200000 of 3200000 tuples (37%) done (elapsed 2.59 s, remaining 4.32 s) 2024-09-21T02:35:48.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: pgmap v417: 129 pgs: 129 active+clean; 36 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.3 MiB/s wr, 60 op/s 2024-09-21T02:35:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:48.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: pgmap v417: 129 pgs: 129 active+clean; 36 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.3 MiB/s wr, 60 op/s 2024-09-21T02:35:48.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:48.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:48.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: pgmap v417: 129 pgs: 129 active+clean; 36 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.3 MiB/s wr, 60 op/s 2024-09-21T02:35:48.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:48.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:48.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:35:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:1300000 of 3200000 tuples (40%) done (elapsed 2.85 s, remaining 4.17 s) 2024-09-21T02:35:49.125 INFO:teuthology.orchestra.run.smithi079.stderr:1400000 of 3200000 tuples (43%) done (elapsed 3.16 s, remaining 4.06 s) 2024-09-21T02:35:49.278 INFO:teuthology.orchestra.run.smithi079.stderr:1500000 of 3200000 tuples (46%) done (elapsed 3.31 s, remaining 3.75 s) 2024-09-21T02:35:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.341+0000 7f9903200640 1 -- 172.21.15.79:0/117969652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 msgr2=0x7f99041038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.341+0000 7f9903200640 1 --2- 172.21.15.79:0/117969652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 0x7f99041038d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009900 tx=0x7f98f402a410 comp rx=0 tx=0).stop 2024-09-21T02:35:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.342+0000 7f9903200640 1 -- 172.21.15.79:0/117969652 shutdown_connections 2024-09-21T02:35:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.342+0000 7f9903200640 1 --2- 172.21.15.79:0/117969652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9904103e60 0x7f990410a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.342+0000 7f9903200640 1 --2- 172.21.15.79:0/117969652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 0x7f99041038d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.342+0000 7f9903200640 1 --2- 172.21.15.79:0/117969652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904102440 0x7f99041028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.342+0000 7f9903200640 1 -- 172.21.15.79:0/117969652 >> 172.21.15.79:0/117969652 conn(0x7f99040fdd80 msgr2=0x7f9904100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.342+0000 7f9903200640 1 -- 172.21.15.79:0/117969652 shutdown_connections 2024-09-21T02:35:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.342+0000 7f9903200640 1 -- 172.21.15.79:0/117969652 wait complete. 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 Processor -- start 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 -- start start 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9904102440 0x7f9904199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 0x7f990419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904103e60 0x7f990419afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f990410f1c0 con 0x7f99041034c0 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f990410f040 con 0x7f9904102440 2024-09-21T02:35:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.343+0000 7f9903200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f990410f340 con 0x7f9904103e60 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904103e60 0x7f990419afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9901400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 0x7f990419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904103e60 0x7f990419afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50066/0 (socket says 172.21.15.79:50066) 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 -- 172.21.15.79:0/853593199 learned_addr learned my addr 172.21.15.79:0/853593199 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9901e00640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9904102440 0x7f9904199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 -- 172.21.15.79:0/853593199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9904102440 msgr2=0x7f9904199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9904102440 0x7f9904199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 -- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 msgr2=0x7f990419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 0x7f990419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 -- 172.21.15.79:0/853593199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990419b7c0 con 0x7f9904103e60 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9901400640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 0x7f990419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.344+0000 7f9902800640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904103e60 0x7f990419afa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00eb10 tx=0x7f98fc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.345+0000 7f98faa00640 1 -- 172.21.15.79:0/853593199 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc004b20 con 0x7f9904103e60 2024-09-21T02:35:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.345+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990419bab0 con 0x7f9904103e60 2024-09-21T02:35:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.345+0000 7f98faa00640 1 -- 172.21.15.79:0/853593199 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98fc004cc0 con 0x7f9904103e60 2024-09-21T02:35:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.345+0000 7f98faa00640 1 -- 172.21.15.79:0/853593199 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc010670 con 0x7f9904103e60 2024-09-21T02:35:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.345+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990410b330 con 0x7f9904103e60 2024-09-21T02:35:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.348+0000 7f991009f740 1 Processor -- start 2024-09-21T02:35:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f98faa00640 1 -- 172.21.15.79:0/853593199 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f98fc005020 con 0x7f9904103e60 2024-09-21T02:35:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f991009f740 1 -- start start 2024-09-21T02:35:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f991009f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4869bd1b0 0x55f486d642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f991009f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d64920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f991009f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f48699c4d0 0x55f486d65470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f991009f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f486cd76b0 con 0x55f48699c4d0 2024-09-21T02:35:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f991009f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f486cc6ae0 con 0x55f4869942f0 2024-09-21T02:35:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.349+0000 7f991009f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f486cca8f0 con 0x55f4869bd1b0 2024-09-21T02:35:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d64920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d64920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:42310/0 (socket says 172.21.15.79:42310) 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 -- 172.21.15.79:0/1859833009 learned_addr learned my addr 172.21.15.79:0/1859833009 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901400640 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f48699c4d0 0x55f486d65470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 -- 172.21.15.79:0/1859833009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4869bd1b0 msgr2=0x55f486d642b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4869bd1b0 0x55f486d642b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 -- 172.21.15.79:0/1859833009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f48699c4d0 msgr2=0x55f486d65470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f48699c4d0 0x55f486d65470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.350+0000 7f9901e00640 1 -- 172.21.15.79:0/1859833009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f486c93780 con 0x55f4869942f0 2024-09-21T02:35:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.351+0000 7f9901e00640 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d64920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98f000bd50 tx=0x7f98f00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b54c8e36950329a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.351+0000 7f98faa00640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e80ba920 0x7f98e80bce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.351+0000 7f98ef400640 1 -- 172.21.15.79:0/1859833009 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0005220 con 0x55f4869942f0 2024-09-21T02:35:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.351+0000 7f98faa00640 1 -- 172.21.15.79:0/853593199 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f98fc0e7c40 con 0x7f9904103e60 2024-09-21T02:35:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.351+0000 7f9901400640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e80ba920 0x7f98e80bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.351+0000 7f98ef400640 1 -- 172.21.15.79:0/1859833009 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98f000be40 con 0x55f4869942f0 2024-09-21T02:35:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.351+0000 7f98ef400640 1 -- 172.21.15.79:0/1859833009 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00117c0 con 0x55f4869942f0 2024-09-21T02:35:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 -- 172.21.15.79:0/1859833009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 msgr2=0x55f486d64920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f9901400640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e80ba920 0x7f98e80bce30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98f4004770 tx=0x7f98f40314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d64920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98f000bd50 tx=0x7f98f00107a0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 -- 172.21.15.79:0/1859833009 shutdown_connections 2024-09-21T02:35:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f48699c4d0 0x55f486d65470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d64920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 --2- 172.21.15.79:0/1859833009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4869bd1b0 0x55f486d642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 -- 172.21.15.79:0/1859833009 >> 172.21.15.79:0/1859833009 conn(0x55f4869b1300 msgr2=0x55f486d5fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 -- 172.21.15.79:0/1859833009 shutdown_connections 2024-09-21T02:35:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.353+0000 7f991009f740 1 -- 172.21.15.79:0/1859833009 wait complete. 2024-09-21T02:35:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.354+0000 7f991009f740 1 -- start start 2024-09-21T02:35:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.354+0000 7f991009f740 1 Processor -- start 2024-09-21T02:35:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f991009f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f991009f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d6e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f991009f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d6ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f991009f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f486bfeab0 con 0x55f4869942f0 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f991009f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f486c6d570 con 0x55f4869bd1b0 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f991009f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f486d65f90 con 0x55f48699c4d0 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f991009f740 10 client.0 _ll_register_callbacks cb 0x55f486c7c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f9901e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f9901e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46524/0 (socket says 172.21.15.79:46524) 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.355+0000 7f9901e00640 1 -- 172.21.15.79:0/3613666487 learned_addr learned my addr 172.21.15.79:0/3613666487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9901400640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d6e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9902800640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d6ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9901e00640 1 -- 172.21.15.79:0/3613666487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 msgr2=0x55f486d6e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9901e00640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d6e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9901e00640 1 -- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 msgr2=0x55f486d6ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9901e00640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d6ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9901e00640 1 -- 172.21.15.79:0/3613666487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f486a28790 con 0x55f4869942f0 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9902800640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d6ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:35:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.356+0000 7f9901400640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d6e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.357+0000 7f9901e00640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6d9a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f98f0005d00 tx=0x7f98f00118b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82351b0bd03304ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.357+0000 7f98e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.358+0000 7f98e3e00640 1 -- 172.21.15.79:0/3613666487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f002a060 con 0x55f4869942f0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.358+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f486cd9600 con 0x55f4869942f0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.358+0000 7f98e3e00640 1 -- 172.21.15.79:0/3613666487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f98f0025460 con 0x55f4869942f0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.359+0000 7f98e3e00640 1 -- 172.21.15.79:0/3613666487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f98f0031050 con 0x55f4869942f0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.359+0000 7f991009f740 10 client.15315 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.359+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f486aa1620 con 0x55f4869942f0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.359+0000 7f98e3e00640 1 -- 172.21.15.79:0/3613666487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f486cd9600 con 0x55f4869942f0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.359+0000 7f98e3e00640 1 -- 172.21.15.79:0/3613666487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f98f0023360 con 0x55f4869942f0 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.359+0000 7f991009f740 10 client.15315 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.359+0000 7f991009f740 10 client.15315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:35:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.360+0000 7f991009f740 20 client.15315 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.360+0000 7f991009f740 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f48697bd80 0x55f486d7adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.360+0000 7f991009f740 4 client.15315 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:35:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.360+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f486cd50b0 con 0x55f48697bd80 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.360+0000 7f9901400640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f48697bd80 0x55f486d7adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.361+0000 7f9901400640 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f48697bd80 0x55f486d7adc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebac492dc9433387 server_cookie=f0e382890d939fd4 in_seq=0 out_seq=0 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.361+0000 7f98e3e00640 10 client.15315 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.361+0000 7f98e3e00640 1 -- 172.21.15.79:0/3613666487 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f486cd50b0 con 0x55f48697bd80 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.361+0000 7f98e3e00640 10 client.15315 handle_command_reply: tid=0 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 client.15315 shutdown 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 msgr2=0x55f486d6d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6d9a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f98f0005d00 tx=0x7f98f00118b0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 shutdown_connections 2024-09-21T02:35:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f48697bd80 0x55f486d7adc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d6ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d6e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 --2- 172.21.15.79:0/3613666487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6d9a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 >> 172.21.15.79:0/3613666487 conn(0x55f4869b1300 msgr2=0x55f486d5e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f98e3e00640 0 client.15315 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 shutdown_connections 2024-09-21T02:35:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.362+0000 7f991009f740 1 -- 172.21.15.79:0/3613666487 wait complete. 2024-09-21T02:35:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.363+0000 7f991009f740 20 client.15315 trim_cache size 0 max 16384 2024-09-21T02:35:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 Processor -- start 2024-09-21T02:35:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 -- start start 2024-09-21T02:35:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d75ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d63ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99041a8370 con 0x55f4869942f0 2024-09-21T02:35:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99041aabf0 con 0x55f4869bd1b0 2024-09-21T02:35:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.383+0000 7f991009f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99041a89e0 con 0x55f48699c4d0 2024-09-21T02:35:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d63ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d63ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:42320/0 (socket says 172.21.15.79:42320) 2024-09-21T02:35:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9901400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d75ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 -- 172.21.15.79:0/4183755314 learned_addr learned my addr 172.21.15.79:0/4183755314 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9901e00640 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 -- 172.21.15.79:0/4183755314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 msgr2=0x55f486d75ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d75ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 -- 172.21.15.79:0/4183755314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 msgr2=0x55f486d6c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9902800640 1 -- 172.21.15.79:0/4183755314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f486d6ef40 con 0x55f4869bd1b0 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.384+0000 7f9901e00640 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.385+0000 7f9902800640 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d63ea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00cf20 tx=0x7f98fc0ad790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=662ac106e9241211 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.385+0000 7f98eea00640 1 -- 172.21.15.79:0/4183755314 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0a9130 con 0x55f4869bd1b0 2024-09-21T02:35:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.385+0000 7f98eea00640 1 -- 172.21.15.79:0/4183755314 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98fc0ad4d0 con 0x55f4869bd1b0 2024-09-21T02:35:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.385+0000 7f98eea00640 1 -- 172.21.15.79:0/4183755314 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0b6f50 con 0x55f4869bd1b0 2024-09-21T02:35:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 -- 172.21.15.79:0/4183755314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 msgr2=0x55f486d63ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d63ea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00cf20 tx=0x7f98fc0ad790 comp rx=0 tx=0).stop 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 -- 172.21.15.79:0/4183755314 shutdown_connections 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869bd1b0 0x55f486d63ea0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d75ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 --2- 172.21.15.79:0/4183755314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869942f0 0x55f486d6c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 -- 172.21.15.79:0/4183755314 >> 172.21.15.79:0/4183755314 conn(0x55f4869b1300 msgr2=0x55f486d6bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 -- 172.21.15.79:0/4183755314 shutdown_connections 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 -- 172.21.15.79:0/4183755314 wait complete. 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 -- start start 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.386+0000 7f991009f740 1 Processor -- start 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f991009f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d72480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f991009f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d72b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f991009f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869bd1b0 0x55f486d736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f991009f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99041a90b0 con 0x55f4869bd1b0 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f991009f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99041aa520 con 0x55f4869942f0 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f991009f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99041a9780 con 0x55f48699c4d0 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f991009f740 10 client.0 _ll_register_callbacks cb 0x7f98f000bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d72480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d72b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d72480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:42332/0 (socket says 172.21.15.79:42332) 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901e00640 1 -- 172.21.15.79:0/4290094923 learned_addr learned my addr 172.21.15.79:0/4290094923 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9902800640 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869bd1b0 0x55f486d736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901e00640 1 -- 172.21.15.79:0/4290094923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 msgr2=0x55f486d72b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901e00640 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d72b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901e00640 1 -- 172.21.15.79:0/4290094923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869bd1b0 msgr2=0x55f486d736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.387+0000 7f9901e00640 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869bd1b0 0x55f486d736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f9901e00640 1 -- 172.21.15.79:0/4290094923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f486d73e10 con 0x55f4869942f0 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f9901e00640 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d72480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f98f0023760 tx=0x7f98f00119a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7978209795a32f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f98e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f98e3e00640 1 -- 172.21.15.79:0/4290094923 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f002a070 con 0x55f4869942f0 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98fc0ad4d0 con 0x55f4869942f0 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f98e3e00640 1 -- 172.21.15.79:0/4290094923 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f98f0011440 con 0x55f4869942f0 2024-09-21T02:35:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f98e3e00640 1 -- 172.21.15.79:0/4290094923 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f98f0043050 con 0x55f4869942f0 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f991009f740 10 client.25328 fetch_fsmap learned FSMap version 21 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f486d75130 con 0x55f4869942f0 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.388+0000 7f98e3e00640 1 -- 172.21.15.79:0/4290094923 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98fc0ad4d0 con 0x55f4869942f0 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f98e3e00640 1 -- 172.21.15.79:0/4290094923 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f98f0025a10 con 0x55f4869942f0 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f991009f740 10 client.25328 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f991009f740 10 client.25328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f991009f740 20 client.25328 populate_metadata read hostname 'smithi079' 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f991009f740 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4869511c0 0x55f486de7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f991009f740 4 client.25328 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f486cd24e0 con 0x55f4869511c0 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f9901400640 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4869511c0 0x55f486de7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f98e3e00640 10 client.25328 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.389+0000 7f9901400640 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4869511c0 0x55f486de7720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d08069b5fb5d7a8 server_cookie=217ed30f94aa96a3 in_seq=0 out_seq=0 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f98e3e00640 1 -- 172.21.15.79:0/4290094923 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f486cd24e0 con 0x55f4869511c0 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f98e3e00640 10 client.25328 handle_command_reply: tid=0 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 client.25328 shutdown 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 msgr2=0x55f486d72480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d72480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f98f0023760 tx=0x7f98f00119a0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 shutdown_connections 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4869511c0 0x55f486de7720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4869bd1b0 0x55f486d736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48699c4d0 0x55f486d72b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 --2- 172.21.15.79:0/4290094923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4869942f0 0x55f486d72480 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f98e3e00640 0 client.25328 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 >> 172.21.15.79:0/4290094923 conn(0x55f4869b1300 msgr2=0x55f486d68340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 shutdown_connections 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.801+0000 7f991009f740 1 -- 172.21.15.79:0/4290094923 wait complete. 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f991009f740 20 client.25328 trim_cache size 0 max 16384 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:35:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:35:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:35:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e80ba920 msgr2=0x7f98e80bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e80ba920 0x7f98e80bce30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98f4004770 tx=0x7f98f40314a0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904103e60 msgr2=0x7f990419afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904103e60 0x7f990419afa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00eb10 tx=0x7f98fc00c2d0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 shutdown_connections 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f98e80ba920 0x7f98e80bce30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904103e60 0x7f990419afa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99041034c0 0x7f990419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 --2- 172.21.15.79:0/853593199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9904102440 0x7f9904199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 >> 172.21.15.79:0/853593199 conn(0x7f99040fdd80 msgr2=0x7f99041067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 shutdown_connections 2024-09-21T02:35:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:35:49.802+0000 7f9903200640 1 -- 172.21.15.79:0/853593199 wait complete. 2024-09-21T02:35:49.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:49 smithi148 ceph-mon[34626]: pgmap v418: 129 pgs: 129 active+clean; 80 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 10 MiB/s wr, 126 op/s 2024-09-21T02:35:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:1600000 of 3200000 tuples (50%) done (elapsed 3.92 s, remaining 3.92 s) 2024-09-21T02:35:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:49 smithi098 ceph-mon[34832]: pgmap v418: 129 pgs: 129 active+clean; 80 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 10 MiB/s wr, 126 op/s 2024-09-21T02:35:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:49 smithi079 ceph-mon[30788]: pgmap v418: 129 pgs: 129 active+clean; 80 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 10 MiB/s wr, 126 op/s 2024-09-21T02:35:50.058 INFO:teuthology.orchestra.run.smithi079.stderr:1700000 of 3200000 tuples (53%) done (elapsed 4.09 s, remaining 3.61 s) 2024-09-21T02:35:50.315 INFO:teuthology.orchestra.run.smithi079.stderr:1800000 of 3200000 tuples (56%) done (elapsed 4.35 s, remaining 3.38 s) 2024-09-21T02:35:50.594 INFO:teuthology.orchestra.run.smithi079.stderr:1900000 of 3200000 tuples (59%) done (elapsed 4.62 s, remaining 3.16 s) 2024-09-21T02:35:50.899 INFO:teuthology.orchestra.run.smithi079.stderr:2000000 of 3200000 tuples (62%) done (elapsed 4.93 s, remaining 2.96 s) 2024-09-21T02:35:50.980 INFO:teuthology.orchestra.run.smithi079.stderr:2100000 of 3200000 tuples (65%) done (elapsed 5.01 s, remaining 2.62 s) 2024-09-21T02:35:51.251 INFO:teuthology.orchestra.run.smithi079.stderr:2200000 of 3200000 tuples (68%) done (elapsed 5.28 s, remaining 2.40 s) 2024-09-21T02:35:51.390 INFO:teuthology.orchestra.run.smithi079.stderr:2300000 of 3200000 tuples (71%) done (elapsed 5.42 s, remaining 2.12 s) 2024-09-21T02:35:51.652 INFO:teuthology.orchestra.run.smithi079.stderr:2400000 of 3200000 tuples (75%) done (elapsed 5.68 s, remaining 1.89 s) 2024-09-21T02:35:51.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:51 smithi148 ceph-mon[34626]: pgmap v419: 129 pgs: 129 active+clean; 180 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 27 MiB/s wr, 276 op/s 2024-09-21T02:35:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:51 smithi098 ceph-mon[34832]: pgmap v419: 129 pgs: 129 active+clean; 180 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 27 MiB/s wr, 276 op/s 2024-09-21T02:35:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2500000 of 3200000 tuples (78%) done (elapsed 5.95 s, remaining 1.67 s) 2024-09-21T02:35:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:51 smithi079 ceph-mon[30788]: pgmap v419: 129 pgs: 129 active+clean; 180 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 27 MiB/s wr, 276 op/s 2024-09-21T02:35:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2600000 of 3200000 tuples (81%) done (elapsed 6.11 s, remaining 1.41 s) 2024-09-21T02:35:52.295 INFO:teuthology.orchestra.run.smithi079.stderr:2700000 of 3200000 tuples (84%) done (elapsed 6.32 s, remaining 1.17 s) 2024-09-21T02:35:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2800000 of 3200000 tuples (87%) done (elapsed 6.47 s, remaining 0.92 s) 2024-09-21T02:35:52.722 INFO:teuthology.orchestra.run.smithi079.stderr:2900000 of 3200000 tuples (90%) done (elapsed 6.75 s, remaining 0.70 s) 2024-09-21T02:35:52.974 INFO:teuthology.orchestra.run.smithi079.stderr:3000000 of 3200000 tuples (93%) done (elapsed 7.00 s, remaining 0.47 s) 2024-09-21T02:35:53.139 INFO:teuthology.orchestra.run.smithi079.stderr:3100000 of 3200000 tuples (96%) done (elapsed 7.17 s, remaining 0.23 s) 2024-09-21T02:35:53.332 INFO:teuthology.orchestra.run.smithi079.stderr:3200000 of 3200000 tuples (100%) done (elapsed 7.36 s, remaining 0.00 s) 2024-09-21T02:35:53.413 INFO:teuthology.orchestra.run.smithi079.stderr:vacuuming... 2024-09-21T02:35:53.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:53 smithi148 ceph-mon[34626]: pgmap v420: 129 pgs: 129 active+clean; 252 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 39 MiB/s wr, 370 op/s 2024-09-21T02:35:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:53 smithi098 ceph-mon[34832]: pgmap v420: 129 pgs: 129 active+clean; 252 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 39 MiB/s wr, 370 op/s 2024-09-21T02:35:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:53 smithi079 ceph-mon[30788]: pgmap v420: 129 pgs: 129 active+clean; 252 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 39 MiB/s wr, 370 op/s 2024-09-21T02:35:54.379 INFO:teuthology.orchestra.run.smithi079.stderr:creating primary keys... 2024-09-21T02:35:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:55 smithi148 ceph-mon[34626]: pgmap v421: 129 pgs: 129 active+clean; 296 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 46 MiB/s wr, 397 op/s 2024-09-21T02:35:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:55 smithi098 ceph-mon[34832]: pgmap v421: 129 pgs: 129 active+clean; 296 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 46 MiB/s wr, 397 op/s 2024-09-21T02:35:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:55 smithi079 ceph-mon[30788]: pgmap v421: 129 pgs: 129 active+clean; 296 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 46 MiB/s wr, 397 op/s 2024-09-21T02:35:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:done in 10.45 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 7.47 s, vacuum 0.97 s, primary keys 1.99 s). 2024-09-21T02:35:56.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-21T02:35:56.492 INFO:teuthology.orchestra.run.smithi079.stderr:starting vacuum...end. 2024-09-21T02:35:57.672 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T02:35:57.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:35:57.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:57 smithi148 ceph-mon[34626]: pgmap v422: 129 pgs: 129 active+clean; 392 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 61 MiB/s wr, 399 op/s 2024-09-21T02:35:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:57 smithi098 ceph-mon[34832]: pgmap v422: 129 pgs: 129 active+clean; 392 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 61 MiB/s wr, 399 op/s 2024-09-21T02:35:57.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:57 smithi079 ceph-mon[30788]: pgmap v422: 129 pgs: 129 active+clean; 392 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 61 MiB/s wr, 399 op/s 2024-09-21T02:35:58.334 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:35:59.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 -- 172.21.15.79:0/3702798255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 msgr2=0x7f32641076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:59.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 --2- 172.21.15.79:0/3702798255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 0x7f32641076a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3250009860 tx=0x7f325002a340 comp rx=0 tx=0).stop 2024-09-21T02:35:59.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 -- 172.21.15.79:0/3702798255 shutdown_connections 2024-09-21T02:35:59.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 --2- 172.21.15.79:0/3702798255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3264107be0 0x7f3264108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 --2- 172.21.15.79:0/3702798255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 0x7f32641076a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 --2- 172.21.15.79:0/3702798255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264101b60 0x7f3264101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 -- 172.21.15.79:0/3702798255 >> 172.21.15.79:0/3702798255 conn(0x7f3264077800 msgr2=0x7f3264077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 -- 172.21.15.79:0/3702798255 shutdown_connections 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.141+0000 7f3269400640 1 -- 172.21.15.79:0/3702798255 wait complete. 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.142+0000 7f3269400640 1 Processor -- start 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.143+0000 7f3269400640 1 -- start start 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.143+0000 7f3269400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3264101b60 0x7f3264117a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:59.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.143+0000 7f3269400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 0x7f3264111d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.143+0000 7f3269400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264107be0 0x7f32641123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.143+0000 7f3269400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f326410a130 con 0x7f3264107290 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.143+0000 7f3269400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3264109fb0 con 0x7f3264107be0 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.143+0000 7f3269400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f326410a2b0 con 0x7f3264101b60 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264107be0 0x7f32641123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264107be0 0x7f32641123c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37718/0 (socket says 172.21.15.79:37718) 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 -- 172.21.15.79:0/41752131 learned_addr learned my addr 172.21.15.79:0/41752131 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3261e00640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 0x7f3264111d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3262800640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3264101b60 0x7f3264117a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 -- 172.21.15.79:0/41752131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3264101b60 msgr2=0x7f3264117a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3264101b60 0x7f3264117a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 -- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 msgr2=0x7f3264111d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 0x7f3264111d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 -- 172.21.15.79:0/41752131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3264112b50 con 0x7f3264107be0 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.144+0000 7f3263200640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264107be0 0x7f32641123c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f325c009fd0 tx=0x7f325c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.145+0000 7f325b400640 1 -- 172.21.15.79:0/41752131 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c017070 con 0x7f3264107be0 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.145+0000 7f325b400640 1 -- 172.21.15.79:0/41752131 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f325c003e20 con 0x7f3264107be0 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.145+0000 7f325b400640 1 -- 172.21.15.79:0/41752131 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c010460 con 0x7f3264107be0 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.145+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32641b56a0 con 0x7f3264107be0 2024-09-21T02:35:59.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.145+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32641b5aa0 con 0x7f3264107be0 2024-09-21T02:35:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.148+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32641076a0 con 0x7f3264107be0 2024-09-21T02:35:59.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.149+0000 7f325b400640 1 -- 172.21.15.79:0/41752131 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f325c003970 con 0x7f3264107be0 2024-09-21T02:35:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.151+0000 7f325b400640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32480b6550 0x7f32480b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.152+0000 7f325b400640 1 -- 172.21.15.79:0/41752131 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f325c0e73b0 con 0x7f3264107be0 2024-09-21T02:35:59.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.152+0000 7f3262800640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32480b6550 0x7f32480b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:59.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.153+0000 7f3262800640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32480b6550 0x7f32480b8a60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f32641177c0 tx=0x7f325400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:59.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.155+0000 7f325b400640 1 -- 172.21.15.79:0/41752131 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f325c0ad890 con 0x7f3264107be0 2024-09-21T02:35:59.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.577+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32641b5dc0 con 0x7f3264107be0 2024-09-21T02:35:59.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.578+0000 7f325b400640 1 -- 172.21.15.79:0/41752131 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f325c0b1c70 con 0x7f3264107be0 2024-09-21T02:35:59.579 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:35:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:35:59.581 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:35:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32480b6550 msgr2=0x7f32480b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32480b6550 0x7f32480b8a60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f32641177c0 tx=0x7f325400a300 comp rx=0 tx=0).stop 2024-09-21T02:35:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264107be0 msgr2=0x7f32641123c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:59.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264107be0 0x7f32641123c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f325c009fd0 tx=0x7f325c00b260 comp rx=0 tx=0).stop 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 shutdown_connections 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32480b6550 0x7f32480b8a60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3264107be0 0x7f32641123c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3264107290 0x7f3264111d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 --2- 172.21.15.79:0/41752131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3264101b60 0x7f3264117a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 >> 172.21.15.79:0/41752131 conn(0x7f3264077800 msgr2=0x7f32641008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.582+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 shutdown_connections 2024-09-21T02:35:59.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:35:59.583+0000 7f3269400640 1 -- 172.21.15.79:0/41752131 wait complete. 2024-09-21T02:35:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:35:59 smithi148 ceph-mon[34626]: pgmap v423: 129 pgs: 129 active+clean; 424 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 62 MiB/s wr, 359 op/s 2024-09-21T02:35:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:35:59 smithi098 ceph-mon[34832]: pgmap v423: 129 pgs: 129 active+clean; 424 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 62 MiB/s wr, 359 op/s 2024-09-21T02:35:59.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:35:59 smithi079 ceph-mon[30788]: pgmap v423: 129 pgs: 129 active+clean; 424 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 62 MiB/s wr, 359 op/s 2024-09-21T02:36:00.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:00 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/41752131' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:00.886 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:00 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/41752131' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:00 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/41752131' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:00.984 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T02:36:00.984 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T02:36:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 5.0 s, 2336.5 tps, lat 40.096 ms stddev 46.814 2024-09-21T02:36:01.676 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:36:01.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:01 smithi148 ceph-mon[34626]: pgmap v424: 129 pgs: 129 active+clean; 549 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 66 MiB/s wr, 361 op/s 2024-09-21T02:36:01.847 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:01 smithi079 ceph-mon[30788]: pgmap v424: 129 pgs: 129 active+clean; 549 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 66 MiB/s wr, 361 op/s 2024-09-21T02:36:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:01 smithi098 ceph-mon[34832]: pgmap v424: 129 pgs: 129 active+clean; 549 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 66 MiB/s wr, 361 op/s 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.565+0000 7f9091400640 1 -- 172.21.15.79:0/2029314430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10ad10 msgr2=0x7f908c1183c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.565+0000 7f9091400640 1 --2- 172.21.15.79:0/2029314430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10ad10 0x7f908c1183c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9078009900 tx=0x7f907802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.566+0000 7f9091400640 1 -- 172.21.15.79:0/2029314430 shutdown_connections 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.566+0000 7f9091400640 1 --2- 172.21.15.79:0/2029314430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f908c118900 0x7f908c11ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.566+0000 7f9091400640 1 --2- 172.21.15.79:0/2029314430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10ad10 0x7f908c1183c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.566+0000 7f9091400640 1 --2- 172.21.15.79:0/2029314430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10a3c0 0x7f908c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.566+0000 7f9091400640 1 -- 172.21.15.79:0/2029314430 >> 172.21.15.79:0/2029314430 conn(0x7f908c06ee90 msgr2=0x7f908c06f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.566+0000 7f9091400640 1 -- 172.21.15.79:0/2029314430 shutdown_connections 2024-09-21T02:36:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.567+0000 7f9091400640 1 -- 172.21.15.79:0/2029314430 wait complete. 2024-09-21T02:36:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 Processor -- start 2024-09-21T02:36:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 -- start start 2024-09-21T02:36:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10a3c0 0x7f908c115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10ad10 0x7f908c115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f908c118900 0x7f908c1162b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f908c11e310 con 0x7f908c10a3c0 2024-09-21T02:36:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f908c11e190 con 0x7f908c118900 2024-09-21T02:36:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.568+0000 7f9091400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f908c11e490 con 0x7f908c10ad10 2024-09-21T02:36:02.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10ad10 0x7f908c115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10ad10 0x7f908c115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42546/0 (socket says 172.21.15.79:42546) 2024-09-21T02:36:02.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 -- 172.21.15.79:0/3110338519 learned_addr learned my addr 172.21.15.79:0/3110338519 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:02.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908be00640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10a3c0 0x7f908c115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 -- 172.21.15.79:0/3110338519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f908c118900 msgr2=0x7f908c1162b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f908c118900 0x7f908c1162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 -- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10a3c0 msgr2=0x7f908c115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10a3c0 0x7f908c115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908b400640 1 -- 172.21.15.79:0/3110338519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c1a3910 con 0x7f908c10ad10 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.569+0000 7f908be00640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10a3c0 0x7f908c115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.570+0000 7f908b400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10ad10 0x7f908c115d70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9078031440 tx=0x7f9078003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.570+0000 7f9088c00640 1 -- 172.21.15.79:0/3110338519 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907803f070 con 0x7f908c10ad10 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.570+0000 7f9088c00640 1 -- 172.21.15.79:0/3110338519 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9078031b50 con 0x7f908c10ad10 2024-09-21T02:36:02.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.570+0000 7f9088c00640 1 -- 172.21.15.79:0/3110338519 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078035030 con 0x7f908c10ad10 2024-09-21T02:36:02.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.571+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c1a3ba0 con 0x7f908c10ad10 2024-09-21T02:36:02.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.571+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c1a4030 con 0x7f908c10ad10 2024-09-21T02:36:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.578+0000 7f90995cd740 1 Processor -- start 2024-09-21T02:36:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.578+0000 7f9088c00640 1 -- 172.21.15.79:0/3110338519 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9078042070 con 0x7f908c10ad10 2024-09-21T02:36:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.578+0000 7f90995cd740 1 -- start start 2024-09-21T02:36:02.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.579+0000 7f90995cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x564131024510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.579+0000 7f90995cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c53980 0x564131024a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.579+0000 7f90995cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c5bb60 0x564131024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.579+0000 7f90995cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564130f99ca0 con 0x564130c5bb60 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.579+0000 7f90995cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564130f890d0 con 0x564130c53980 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.579+0000 7f90995cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564130f8cee0 con 0x564130c7c840 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.579+0000 7f9090a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x564131024510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.580+0000 7f9090a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x564131024510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42550/0 (socket says 172.21.15.79:42550) 2024-09-21T02:36:02.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.580+0000 7f9090a00640 1 -- 172.21.15.79:0/31855463 learned_addr learned my addr 172.21.15.79:0/31855463 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:02.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.580+0000 7f9090a00640 1 -- 172.21.15.79:0/31855463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c53980 msgr2=0x564131024a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:36:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.580+0000 7f9090a00640 1 --2- 172.21.15.79:0/31855463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c53980 0x564131024a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.580+0000 7f9090a00640 1 -- 172.21.15.79:0/31855463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c5bb60 msgr2=0x564131024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.580+0000 7f9090a00640 1 --2- 172.21.15.79:0/31855463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c5bb60 0x564131024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.580+0000 7f9090a00640 1 -- 172.21.15.79:0/31855463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564130f3b400 con 0x564130c7c840 2024-09-21T02:36:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.581+0000 7f9088c00640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90700b65d0 0x7f90700b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.581+0000 7f9090a00640 1 --2- 172.21.15.79:0/31855463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x564131024510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9084009ea0 tx=0x7f9084009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bf4d98360179607 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.582+0000 7f9081200640 1 -- 172.21.15.79:0/31855463 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084004d20 con 0x564130c7c840 2024-09-21T02:36:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.582+0000 7f9088c00640 1 -- 172.21.15.79:0/3110338519 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9078107cd0 con 0x7f908c10ad10 2024-09-21T02:36:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.582+0000 7f9081200640 1 -- 172.21.15.79:0/31855463 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f908400ee60 con 0x564130c7c840 2024-09-21T02:36:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.582+0000 7f9081200640 1 -- 172.21.15.79:0/31855463 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084010890 con 0x564130c7c840 2024-09-21T02:36:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.583+0000 7f908be00640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90700b65d0 0x7f90700b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 -- 172.21.15.79:0/31855463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 msgr2=0x564131024510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 --2- 172.21.15.79:0/31855463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x564131024510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9084009ea0 tx=0x7f9084009f90 comp rx=0 tx=0).stop 2024-09-21T02:36:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f908be00640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90700b65d0 0x7f90700b8ae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x564131023190 tx=0x7f907c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 -- 172.21.15.79:0/31855463 shutdown_connections 2024-09-21T02:36:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 --2- 172.21.15.79:0/31855463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c5bb60 0x564131024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 --2- 172.21.15.79:0/31855463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c53980 0x564131024a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 --2- 172.21.15.79:0/31855463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x564131024510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 -- 172.21.15.79:0/31855463 >> 172.21.15.79:0/31855463 conn(0x564130c70990 msgr2=0x564131022400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 -- 172.21.15.79:0/31855463 shutdown_connections 2024-09-21T02:36:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.584+0000 7f90995cd740 1 -- 172.21.15.79:0/31855463 wait complete. 2024-09-21T02:36:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.585+0000 7f90995cd740 1 -- start start 2024-09-21T02:36:02.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.585+0000 7f90995cd740 1 Processor -- start 2024-09-21T02:36:02.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f90995cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c53980 0x56413102fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f90995cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x5641310301a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f90995cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c7c840 0x56413103c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f90995cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564130dea7a0 con 0x564130c7c840 2024-09-21T02:36:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f90995cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564130f2ea10 con 0x564130c5bb60 2024-09-21T02:36:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f90995cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564131032cf0 con 0x564130c53980 2024-09-21T02:36:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f90995cd740 10 client.0 _ll_register_callbacks cb 0x564130f3ebe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f908b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x5641310301a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f908b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x5641310301a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37750/0 (socket says 172.21.15.79:37750) 2024-09-21T02:36:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.586+0000 7f908b400640 1 -- 172.21.15.79:0/4021327027 learned_addr learned my addr 172.21.15.79:0/4021327027 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f908be00640 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c53980 0x56413102fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f908b400640 1 -- 172.21.15.79:0/4021327027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c53980 msgr2=0x56413102fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f908b400640 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c53980 0x56413102fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f908b400640 1 -- 172.21.15.79:0/4021327027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c7c840 msgr2=0x56413103c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f908b400640 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c7c840 0x56413103c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f908b400640 1 -- 172.21.15.79:0/4021327027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564130cf6b90 con 0x564130c5bb60 2024-09-21T02:36:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f908b400640 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x5641310301a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9078006010 tx=0x7f90780ce8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb61e69923569cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f9075600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f9075600640 1 -- 172.21.15.79:0/4021327027 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078049070 con 0x564130c5bb60 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.587+0000 7f9075600640 1 -- 172.21.15.79:0/4021327027 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f90780316a0 con 0x564130c5bb60 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.588+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f908400ee60 con 0x564130c5bb60 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.588+0000 7f9075600640 1 -- 172.21.15.79:0/4021327027 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f90780ca270 con 0x564130c5bb60 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.588+0000 7f90995cd740 10 client.25337 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.588+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56413103eac0 con 0x564130c5bb60 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.588+0000 7f9075600640 1 -- 172.21.15.79:0/4021327027 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f908400ee60 con 0x564130c5bb60 2024-09-21T02:36:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f9075600640 1 -- 172.21.15.79:0/4021327027 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f90780b8030 con 0x564130c5bb60 2024-09-21T02:36:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f90995cd740 10 client.25337 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f90995cd740 10 client.25337 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:36:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f90995cd740 20 client.25337 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f90995cd740 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c3b1c0 0x564131041fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f90995cd740 4 client.25337 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:02.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564130f9bbf0 con 0x564130c3b1c0 2024-09-21T02:36:02.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.590+0000 7f908be00640 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c3b1c0 0x564131041fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.592+0000 7f9075600640 10 client.25337 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.592+0000 7f908be00640 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c3b1c0 0x564131041fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69ecb338be236cba server_cookie=46aadd5ddcac665 in_seq=0 out_seq=0 2024-09-21T02:36:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.594+0000 7f9075600640 1 -- 172.21.15.79:0/4021327027 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564130f9bbf0 con 0x564130c3b1c0 2024-09-21T02:36:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.594+0000 7f9075600640 10 client.25337 handle_command_reply: tid=0 2024-09-21T02:36:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.594+0000 7f90995cd740 1 client.25337 shutdown 2024-09-21T02:36:02.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 msgr2=0x5641310301a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:02.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x5641310301a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9078006010 tx=0x7f90780ce8e0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 shutdown_connections 2024-09-21T02:36:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c3b1c0 0x564131041fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c7c840 0x56413103c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x5641310301a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 --2- 172.21.15.79:0/4021327027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c53980 0x56413102fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f9075600640 0 client.25337 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.596+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 >> 172.21.15.79:0/4021327027 conn(0x564130c70990 msgr2=0x5641310276a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.597+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 shutdown_connections 2024-09-21T02:36:02.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.597+0000 7f90995cd740 1 -- 172.21.15.79:0/4021327027 wait complete. 2024-09-21T02:36:02.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.597+0000 7f90995cd740 20 client.25337 trim_cache size 0 max 16384 2024-09-21T02:36:02.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.631+0000 7f90995cd740 1 Processor -- start 2024-09-21T02:36:02.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f90995cd740 1 -- start start 2024-09-21T02:36:02.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f90995cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131031b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f90995cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c5bb60 0x564131024ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f90995cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c7c840 0x564131047790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f90995cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f906c00dbe0 con 0x564130c53980 2024-09-21T02:36:02.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f90995cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f906c010460 con 0x564130c7c840 2024-09-21T02:36:02.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f90995cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f906c00e250 con 0x564130c5bb60 2024-09-21T02:36:02.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.632+0000 7f9090a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c7c840 0x564131047790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f9090a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c7c840 0x564131047790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37760/0 (socket says 172.21.15.79:37760) 2024-09-21T02:36:02.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f9090a00640 1 -- 172.21.15.79:0/1762367286 learned_addr learned my addr 172.21.15.79:0/1762367286 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:02.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f9090a00640 1 -- 172.21.15.79:0/1762367286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c5bb60 msgr2=0x564131024ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:02.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f908be00640 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131031b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f908b400640 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c5bb60 0x564131024ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f9090a00640 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c5bb60 0x564131024ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f9090a00640 1 -- 172.21.15.79:0/1762367286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 msgr2=0x564131031b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f9090a00640 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131031b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f9090a00640 1 -- 172.21.15.79:0/1762367286 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413101dbf0 con 0x564130c7c840 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f908be00640 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131031b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.633+0000 7f908b400640 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c5bb60 0x564131024ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.634+0000 7f9090a00640 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c7c840 0x564131047790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9084009560 tx=0x7f908400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d6d117d118130b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.634+0000 7f9077e00640 1 -- 172.21.15.79:0/1762367286 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908401d040 con 0x564130c7c840 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.634+0000 7f9077e00640 1 -- 172.21.15.79:0/1762367286 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9084004de0 con 0x564130c7c840 2024-09-21T02:36:02.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.634+0000 7f9077e00640 1 -- 172.21.15.79:0/1762367286 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90840188d0 con 0x564130c7c840 2024-09-21T02:36:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 -- 172.21.15.79:0/1762367286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c7c840 msgr2=0x564131047790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c7c840 0x564131047790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9084009560 tx=0x7f908400ee60 comp rx=0 tx=0).stop 2024-09-21T02:36:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 -- 172.21.15.79:0/1762367286 shutdown_connections 2024-09-21T02:36:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c7c840 0x564131047790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c5bb60 0x564131024ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 --2- 172.21.15.79:0/1762367286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131031b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 -- 172.21.15.79:0/1762367286 >> 172.21.15.79:0/1762367286 conn(0x564130c70990 msgr2=0x564131025bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:02.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 -- 172.21.15.79:0/1762367286 shutdown_connections 2024-09-21T02:36:02.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.636+0000 7f90995cd740 1 -- 172.21.15.79:0/1762367286 wait complete. 2024-09-21T02:36:02.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.637+0000 7f90995cd740 1 -- start start 2024-09-21T02:36:02.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.638+0000 7f90995cd740 1 Processor -- start 2024-09-21T02:36:02.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.639+0000 7f90995cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131038730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.639+0000 7f90995cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x564131036c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f908be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131038730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f908be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131038730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41878/0 (socket says 172.21.15.79:41878) 2024-09-21T02:36:02.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f908be00640 1 -- 172.21.15.79:0/3163022657 learned_addr learned my addr 172.21.15.79:0/3163022657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:02.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f90995cd740 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x5641310371a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f906c00e920 con 0x564130c53980 2024-09-21T02:36:02.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f9090a00640 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x5641310371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f906c00fd90 con 0x564130c5bb60 2024-09-21T02:36:02.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f906c00eff0 con 0x564130c7c840 2024-09-21T02:36:02.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f90995cd740 10 client.0 _ll_register_callbacks cb 0x7f9078005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:02.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.640+0000 7f908b400640 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x564131036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.641+0000 7f9090a00640 1 -- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 msgr2=0x564131036c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:02.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.641+0000 7f9090a00640 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x564131036c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.641+0000 7f9090a00640 1 -- 172.21.15.79:0/3163022657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 msgr2=0x564131038730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:02.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.641+0000 7f9090a00640 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131038730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:02.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.641+0000 7f9090a00640 1 -- 172.21.15.79:0/3163022657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641310378e0 con 0x564130c7c840 2024-09-21T02:36:02.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.642+0000 7f9090a00640 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x5641310371a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9084009560 tx=0x7f9084018ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca96cf73bbc3722e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:02.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.643+0000 7f9075600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:36:02.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.643+0000 7f9075600640 1 -- 172.21.15.79:0/3163022657 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084018e30 con 0x564130c7c840 2024-09-21T02:36:02.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.643+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9084004de0 con 0x564130c7c840 2024-09-21T02:36:02.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.643+0000 7f9075600640 1 -- 172.21.15.79:0/3163022657 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9084004be0 con 0x564130c7c840 2024-09-21T02:36:02.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.644+0000 7f9075600640 1 -- 172.21.15.79:0/3163022657 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9084018e30 con 0x564130c7c840 2024-09-21T02:36:02.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.644+0000 7f90995cd740 10 client.25333 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:02.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.644+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5641310ad720 con 0x564130c7c840 2024-09-21T02:36:02.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.644+0000 7f9075600640 1 -- 172.21.15.79:0/3163022657 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9084004de0 con 0x564130c7c840 2024-09-21T02:36:02.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.645+0000 7f9075600640 1 -- 172.21.15.79:0/3163022657 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f908402b470 con 0x564130c7c840 2024-09-21T02:36:02.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.645+0000 7f90995cd740 10 client.25333 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:02.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.645+0000 7f90995cd740 10 client.25333 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:36:02.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.645+0000 7f90995cd740 20 client.25333 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:02.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.645+0000 7f90995cd740 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c10570 0x5641310afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:02.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.645+0000 7f90995cd740 4 client.25333 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T02:36:02.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.645+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x564130f976a0 con 0x564130c10570 2024-09-21T02:36:02.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.646+0000 7f908be00640 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c10570 0x5641310afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:02.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.648+0000 7f908be00640 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c10570 0x5641310afdf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01fb76b640a6d8c server_cookie=32897b4075d05948 in_seq=0 out_seq=0 2024-09-21T02:36:02.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:02.648+0000 7f9075600640 10 client.25333 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 -- 172.21.15.79:0/915089943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f01034e0 msgr2=0x7ff9f0103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 --2- 172.21.15.79:0/915089943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f01034e0 0x7ff9f0103950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009900 tx=0x7ff9e402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 -- 172.21.15.79:0/915089943 shutdown_connections 2024-09-21T02:36:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 --2- 172.21.15.79:0/915089943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 0x7ff9f010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 --2- 172.21.15.79:0/915089943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f0104560 0x7ff9f0104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 --2- 172.21.15.79:0/915089943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f01034e0 0x7ff9f0103950 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 -- 172.21.15.79:0/915089943 >> 172.21.15.79:0/915089943 conn(0x7ff9f00fee20 msgr2=0x7ff9f01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.056+0000 7ff9f7000640 1 -- 172.21.15.79:0/915089943 shutdown_connections 2024-09-21T02:36:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.057+0000 7ff9f7000640 1 -- 172.21.15.79:0/915089943 wait complete. 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 Processor -- start 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 -- start start 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f01034e0 0x7ff9f0199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f0104560 0x7ff9f019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 0x7ff9f019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010f100 con 0x7ff9f01034e0 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010ef80 con 0x7ff9f0104f00 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f7000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f010f280 con 0x7ff9f0104560 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.058+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f0104560 0x7ff9f019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 0x7ff9f019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 0x7ff9f019af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37788/0 (socket says 172.21.15.79:37788) 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f0104560 0x7ff9f019a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42592/0 (socket says 172.21.15.79:42592) 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 -- 172.21.15.79:0/3617044629 learned_addr learned my addr 172.21.15.79:0/3617044629 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f01034e0 0x7ff9f0199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 -- 172.21.15.79:0/3617044629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f0104560 msgr2=0x7ff9f019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f0104560 0x7ff9f019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 -- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f01034e0 msgr2=0x7ff9f0199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f01034e0 0x7ff9f0199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 -- 172.21.15.79:0/3617044629 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f019b780 con 0x7ff9f0104f00 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.059+0000 7ff9f6600640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 0x7ff9f019af60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800eb10 tx=0x7ff9e800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.060+0000 7ff9ee000640 1 -- 172.21.15.79:0/3617044629 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8004b20 con 0x7ff9f0104f00 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.060+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f019ba70 con 0x7ff9f0104f00 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.060+0000 7ff9ee000640 1 -- 172.21.15.79:0/3617044629 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e8004cc0 con 0x7ff9f0104f00 2024-09-21T02:36:03.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.060+0000 7ff9ee000640 1 -- 172.21.15.79:0/3617044629 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8010670 con 0x7ff9f0104f00 2024-09-21T02:36:03.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.060+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f01a2160 con 0x7ff9f0104f00 2024-09-21T02:36:03.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.063+0000 7ff9ff7bd740 1 Processor -- start 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.064+0000 7ff9ee000640 1 -- 172.21.15.79:0/3617044629 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff9e8005020 con 0x7ff9f0104f00 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.064+0000 7ff9ff7bd740 1 -- start start 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94bb31b0 0x55ce94f5a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b924d0 0x55ce94f5b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce94ecd6b0 con 0x55ce94b924d0 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce94ebcae0 con 0x55ce94bb31b0 2024-09-21T02:36:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ce94ec08f0 con 0x55ce94b8a2f0 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b924d0 0x55ce94f5b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b924d0 0x55ce94f5b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41916/0 (socket says 172.21.15.79:41916) 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9f5200640 1 -- 172.21.15.79:0/127042046 learned_addr learned my addr 172.21.15.79:0/127042046 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9f5200640 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94bb31b0 0x55ce94f5a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.065+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9f5200640 1 -- 172.21.15.79:0/127042046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 msgr2=0x55ce94f5a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9f5200640 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9f5200640 1 -- 172.21.15.79:0/127042046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94bb31b0 msgr2=0x55ce94f5a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9f5200640 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94bb31b0 0x55ce94f5a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9f5200640 1 -- 172.21.15.79:0/127042046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce94e89780 con 0x55ce94b924d0 2024-09-21T02:36:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9f5200640 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b924d0 0x55ce94f5b470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc011850 tx=0x7ff9dc0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9bbff20c3ef4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9e2a00640 1 -- 172.21.15.79:0/127042046 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc004030 con 0x55ce94b924d0 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9e2a00640 1 -- 172.21.15.79:0/127042046 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9dc00f7c0 con 0x55ce94b924d0 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9e2a00640 1 -- 172.21.15.79:0/127042046 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc003850 con 0x55ce94b924d0 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.066+0000 7ff9ee000640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff9d80b6510 0x7ff9d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ee000640 1 -- 172.21.15.79:0/3617044629 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff9e80e7cc0 con 0x7ff9f0104f00 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff9d80b6510 0x7ff9d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/127042046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b924d0 msgr2=0x55ce94f5b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b924d0 0x55ce94f5b470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc011850 tx=0x7ff9dc0097f0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/127042046 shutdown_connections 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b924d0 0x55ce94f5b470 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/127042046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94bb31b0 0x55ce94f5a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/127042046 >> 172.21.15.79:0/127042046 conn(0x55ce94ba7300 msgr2=0x55ce94f55d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.067+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/127042046 shutdown_connections 2024-09-21T02:36:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.068+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/127042046 wait complete. 2024-09-21T02:36:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.068+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff9d80b6510 0x7ff9d80b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4000c00 tx=0x7ff9e4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.068+0000 7ff9ff7bd740 1 -- start start 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.068+0000 7ff9ff7bd740 1 Processor -- start 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b8a2f0 0x55ce94f63970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b924d0 0x55ce94f64030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f64ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ce94df4ab0 con 0x55ce94bb31b0 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce94e63570 con 0x55ce94b8a2f0 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ce94f5bf90 con 0x55ce94b924d0 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9ff7bd740 10 client.0 _ll_register_callbacks cb 0x55ce94e72100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b8a2f0 0x55ce94f63970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b924d0 0x55ce94f64030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b924d0 0x55ce94f64030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42610/0 (socket says 172.21.15.79:42610) 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b8a2f0 0x55ce94f63970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37816/0 (socket says 172.21.15.79:37816) 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5200640 1 -- 172.21.15.79:0/3315914500 learned_addr learned my addr 172.21.15.79:0/3315914500 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f6600640 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f64ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5200640 1 -- 172.21.15.79:0/3315914500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b8a2f0 msgr2=0x55ce94f63970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b8a2f0 0x55ce94f63970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5200640 1 -- 172.21.15.79:0/3315914500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 msgr2=0x55ce94f64ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.069+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f64ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9f5200640 1 -- 172.21.15.79:0/3315914500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce94c1e790 con 0x55ce94b924d0 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b924d0 0x55ce94f64030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00fe40 tx=0x7ff9dc00fe70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36e6813fd2faabc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9d7400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9d7400640 1 -- 172.21.15.79:0/3315914500 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc028440 con 0x55ce94b924d0 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9dc00f7c0 con 0x55ce94b924d0 2024-09-21T02:36:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9d7400640 1 -- 172.21.15.79:0/3315914500 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff9dc01f3f0 con 0x55ce94b924d0 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9d7400640 1 -- 172.21.15.79:0/3315914500 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc01f5f0 con 0x55ce94b924d0 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9ff7bd740 10 client.25345 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.070+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ce94c97620 con 0x55ce94b924d0 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9d7400640 1 -- 172.21.15.79:0/3315914500 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9dc00f7c0 con 0x55ce94b924d0 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9d7400640 1 -- 172.21.15.79:0/3315914500 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff9dc026070 con 0x55ce94b924d0 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9ff7bd740 10 client.25345 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9ff7bd740 10 client.25345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9ff7bd740 20 client.25345 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b71d80 0x55ce94f70eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9ff7bd740 4 client.25345 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce94ecf600 con 0x55ce94b71d80 2024-09-21T02:36:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.071+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b71d80 0x55ce94f70eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.072+0000 7ff9d7400640 10 client.25345 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.072+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b71d80 0x55ce94f70eb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b6da3cc68a5a8f server_cookie=3fe0ad0eef817828 in_seq=0 out_seq=0 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9d7400640 1 -- 172.21.15.79:0/3315914500 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce94ecf600 con 0x55ce94b71d80 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9d7400640 10 client.25345 handle_command_reply: tid=0 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 client.25345 shutdown 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b924d0 msgr2=0x55ce94f64030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b924d0 0x55ce94f64030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00fe40 tx=0x7ff9dc00fe70 comp rx=0 tx=0).stop 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 shutdown_connections 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b71d80 0x55ce94f70eb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f64ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b924d0 0x55ce94f64030 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9d7400640 0 client.25345 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3315914500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b8a2f0 0x55ce94f63970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 >> 172.21.15.79:0/3315914500 conn(0x55ce94ba7300 msgr2=0x55ce94f54360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 shutdown_connections 2024-09-21T02:36:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3315914500 wait complete. 2024-09-21T02:36:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.075+0000 7ff9ff7bd740 20 client.25345 trim_cache size 0 max 16384 2024-09-21T02:36:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.090+0000 7ff9ff7bd740 1 Processor -- start 2024-09-21T02:36:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9ff7bd740 1 -- start start 2024-09-21T02:36:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94f55370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01aa440 con 0x55ce94bb31b0 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01accc0 con 0x55ce94b924d0 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01aaab0 con 0x55ce94b8a2f0 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94f55370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94f55370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37828/0 (socket says 172.21.15.79:37828) 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 -- 172.21.15.79:0/3934241510 learned_addr learned my addr 172.21.15.79:0/3934241510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42622/0 (socket says 172.21.15.79:42622) 2024-09-21T02:36:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f6600640 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 -- 172.21.15.79:0/3934241510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 msgr2=0x55ce94f5ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 -- 172.21.15.79:0/3934241510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 msgr2=0x55ce94f558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.091+0000 7ff9f5200640 1 -- 172.21.15.79:0/3934241510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce94f636f0 con 0x55ce94b924d0 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.092+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94f55370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009560 tx=0x7ff9dc011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a473b7f6c0bcabd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.092+0000 7ff9e2000640 1 -- 172.21.15.79:0/3934241510 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc009a20 con 0x55ce94b924d0 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.092+0000 7ff9e2000640 1 -- 172.21.15.79:0/3934241510 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9dc009bc0 con 0x55ce94b924d0 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.092+0000 7ff9e2000640 1 -- 172.21.15.79:0/3934241510 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc01f9f0 con 0x55ce94b924d0 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3934241510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 msgr2=0x55ce94f55370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94f55370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009560 tx=0x7ff9dc011720 comp rx=0 tx=0).stop 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3934241510 shutdown_connections 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94bb31b0 0x55ce94f558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94f55370 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3934241510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94b8a2f0 0x55ce94f5ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3934241510 >> 172.21.15.79:0/3934241510 conn(0x55ce94ba7300 msgr2=0x55ce94f61ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3934241510 shutdown_connections 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3934241510 wait complete. 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.093+0000 7ff9ff7bd740 1 -- start start 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 1 Processor -- start 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b8a2f0 0x55ce94fd6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94fd75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94bb31b0 0x55ce94fd8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ab180 con 0x55ce94b8a2f0 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ac5f0 con 0x55ce94b924d0 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01ab850 con 0x55ce94bb31b0 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9ff7bd740 10 client.0 _ll_register_callbacks cb 0x7ff9dc009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94fd75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9f6600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94bb31b0 0x55ce94fd8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9f5c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b8a2f0 0x55ce94fd6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9f5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94fd75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37844/0 (socket says 172.21.15.79:37844) 2024-09-21T02:36:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.094+0000 7ff9f5200640 1 -- 172.21.15.79:0/3103039784 learned_addr learned my addr 172.21.15.79:0/3103039784 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9f5200640 1 -- 172.21.15.79:0/3103039784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94bb31b0 msgr2=0x55ce94fd8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94bb31b0 0x55ce94fd8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9f5200640 1 -- 172.21.15.79:0/3103039784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b8a2f0 msgr2=0x55ce94fd6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b8a2f0 0x55ce94fd6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9f5200640 1 -- 172.21.15.79:0/3103039784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce94fd8880 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9f5200640 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94fd75b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00fe40 tx=0x7ff9dc00fe70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ad0908c3a64cab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9d7400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9d7400640 1 -- 172.21.15.79:0/3103039784 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc009a20 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9d7400640 1 -- 172.21.15.79:0/3103039784 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff9dc011260 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9dc009bc0 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9d7400640 1 -- 172.21.15.79:0/3103039784 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc046050 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9ff7bd740 10 client.25361 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.095+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ce94fdfbb0 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9d7400640 1 -- 172.21.15.79:0/3103039784 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9dc009bc0 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9d7400640 1 -- 172.21.15.79:0/3103039784 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff9dc041030 con 0x55ce94b924d0 2024-09-21T02:36:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9ff7bd740 10 client.25361 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9ff7bd740 10 client.25361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9ff7bd740 20 client.25361 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b471c0 0x55ce94fe2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9ff7bd740 4 client.25361 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce94ecb0b0 con 0x55ce94b471c0 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.096+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b471c0 0x55ce94fe2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.097+0000 7ff9f5c00640 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b471c0 0x55ce94fe2400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1044e66df60218a server_cookie=8de67da276ecd592 in_seq=0 out_seq=0 2024-09-21T02:36:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.097+0000 7ff9d7400640 10 client.25361 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9d7400640 1 -- 172.21.15.79:0/3103039784 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce94ecb0b0 con 0x55ce94b471c0 2024-09-21T02:36:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9d7400640 10 client.25361 handle_command_reply: tid=0 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 client.25361 shutdown 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 msgr2=0x55ce94fd75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94fd75b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00fe40 tx=0x7ff9dc00fe70 comp rx=0 tx=0).stop 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 shutdown_connections 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ce94b471c0 0x55ce94fe2400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce94bb31b0 0x55ce94fd8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce94b924d0 0x55ce94fd75b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9d7400640 0 client.25361 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 --2- 172.21.15.79:0/3103039784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ce94b8a2f0 0x55ce94fd6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 >> 172.21.15.79:0/3103039784 conn(0x55ce94ba7300 msgr2=0x55ce94f5ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 shutdown_connections 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 1 -- 172.21.15.79:0/3103039784 wait complete. 2024-09-21T02:36:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.260+0000 7ff9ff7bd740 20 client.25361 trim_cache size 0 max 16384 2024-09-21T02:36:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:36:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:36:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:36:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff9d80b6510 msgr2=0x7ff9d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff9d80b6510 0x7ff9d80b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4000c00 tx=0x7ff9e4031400 comp rx=0 tx=0).stop 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 msgr2=0x7ff9f019af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 0x7ff9f019af60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800eb10 tx=0x7ff9e800c2d0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 shutdown_connections 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff9d80b6510 0x7ff9d80b8a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9f0104f00 0x7ff9f019af60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9f0104560 0x7ff9f019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 --2- 172.21.15.79:0/3617044629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9f01034e0 0x7ff9f0199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 >> 172.21.15.79:0/3617044629 conn(0x7ff9f00fee20 msgr2=0x7ff9f0107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 shutdown_connections 2024-09-21T02:36:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:03.261+0000 7ff9f7000640 1 -- 172.21.15.79:0/3617044629 wait complete. 2024-09-21T02:36:03.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:03 smithi079 ceph-mon[30788]: pgmap v425: 129 pgs: 129 active+clean; 705 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 50 MiB/s wr, 270 op/s 2024-09-21T02:36:03.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:03 smithi148 ceph-mon[34626]: pgmap v425: 129 pgs: 129 active+clean; 705 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 50 MiB/s wr, 270 op/s 2024-09-21T02:36:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:03 smithi098 ceph-mon[34832]: pgmap v425: 129 pgs: 129 active+clean; 705 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 50 MiB/s wr, 270 op/s 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f9075600640 1 -- 172.21.15.79:0/3163022657 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564130f976a0 con 0x564130c10570 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f9075600640 10 client.25333 handle_command_reply: tid=0 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 client.25333 shutdown 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 msgr2=0x5641310371a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x5641310371a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9084009560 tx=0x7f9084018ab0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 shutdown_connections 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564130c10570 0x5641310afdf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564130c7c840 0x5641310371a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564130c5bb60 0x564131036c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 --2- 172.21.15.79:0/3163022657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564130c53980 0x564131038730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f9075600640 0 client.25333 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.958+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 >> 172.21.15.79:0/3163022657 conn(0x564130c70990 msgr2=0x564131031ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.959+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 shutdown_connections 2024-09-21T02:36:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.959+0000 7f90995cd740 1 -- 172.21.15.79:0/3163022657 wait complete. 2024-09-21T02:36:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.959+0000 7f90995cd740 20 client.25333 trim_cache size 0 max 16384 2024-09-21T02:36:03.961 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:36:03.961 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 2, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "3ecc97db": { 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 2, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 134.5, 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:36:03.962 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:03.963 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90700b65d0 msgr2=0x7f90700b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90700b65d0 0x7f90700b8ae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x564131023190 tx=0x7f907c005f90 comp rx=0 tx=0).stop 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10ad10 msgr2=0x7f908c115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10ad10 0x7f908c115d70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9078031440 tx=0x7f9078003b20 comp rx=0 tx=0).stop 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 shutdown_connections 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90700b65d0 0x7f90700b8ae0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f908c118900 0x7f908c1162b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f908c10ad10 0x7f908c115d70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 --2- 172.21.15.79:0/3110338519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f908c10a3c0 0x7f908c115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 >> 172.21.15.79:0/3110338519 conn(0x7f908c06ee90 msgr2=0x7f908c118e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 shutdown_connections 2024-09-21T02:36:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:03.960+0000 7f9091400640 1 -- 172.21.15.79:0/3110338519 wait complete. 2024-09-21T02:36:04.744 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3ecc97db', quiesce took 7.1 seconds. Will release after: 7.4 2024-09-21T02:36:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:05 smithi148 ceph-mon[34626]: pgmap v426: 129 pgs: 129 active+clean; 839 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 221 op/s 2024-09-21T02:36:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:05 smithi098 ceph-mon[34832]: pgmap v426: 129 pgs: 129 active+clean; 839 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 221 op/s 2024-09-21T02:36:05.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:05 smithi079 ceph-mon[30788]: pgmap v426: 129 pgs: 129 active+clean; 839 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 221 op/s 2024-09-21T02:36:06.496 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 10.0 s, 323.6 tps, lat 76.680 ms stddev 79.224 2024-09-21T02:36:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:07 smithi148 ceph-mon[34626]: pgmap v427: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 32 MiB/s wr, 306 op/s 2024-09-21T02:36:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:07 smithi098 ceph-mon[34832]: pgmap v427: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 32 MiB/s wr, 306 op/s 2024-09-21T02:36:07.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:07 smithi079 ceph-mon[30788]: pgmap v427: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 32 MiB/s wr, 306 op/s 2024-09-21T02:36:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:09 smithi148 ceph-mon[34626]: pgmap v428: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 16 MiB/s wr, 298 op/s 2024-09-21T02:36:09.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:09 smithi098 ceph-mon[34832]: pgmap v428: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 16 MiB/s wr, 298 op/s 2024-09-21T02:36:09.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:09 smithi079 ceph-mon[30788]: pgmap v428: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 16 MiB/s wr, 298 op/s 2024-09-21T02:36:11.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 15.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:36:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:11 smithi148 ceph-mon[34626]: pgmap v429: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 12 MiB/s wr, 296 op/s 2024-09-21T02:36:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:11 smithi098 ceph-mon[34832]: pgmap v429: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 12 MiB/s wr, 296 op/s 2024-09-21T02:36:11.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:11 smithi079 ceph-mon[30788]: pgmap v429: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 12 MiB/s wr, 296 op/s 2024-09-21T02:36:12.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:36:12.529 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:36:13.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.141+0000 7f485e800640 1 -- 172.21.15.79:0/2090770681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 msgr2=0x7f4858103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.141+0000 7f485e800640 1 --2- 172.21.15.79:0/2090770681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f4858103dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f484c009900 tx=0x7f484c02a410 comp rx=0 tx=0).stop 2024-09-21T02:36:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.142+0000 7f485e800640 1 -- 172.21.15.79:0/2090770681 shutdown_connections 2024-09-21T02:36:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.142+0000 7f485e800640 1 --2- 172.21.15.79:0/2090770681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4858109c40 0x7f4858110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.142+0000 7f485e800640 1 --2- 172.21.15.79:0/2090770681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48581092f0 0x7f4858109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.142+0000 7f485e800640 1 --2- 172.21.15.79:0/2090770681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f4858103dc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.142+0000 7f485e800640 1 -- 172.21.15.79:0/2090770681 >> 172.21.15.79:0/2090770681 conn(0x7f48580ff440 msgr2=0x7f4858101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.142+0000 7f485e800640 1 -- 172.21.15.79:0/2090770681 shutdown_connections 2024-09-21T02:36:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.142+0000 7f485e800640 1 -- 172.21.15.79:0/2090770681 wait complete. 2024-09-21T02:36:13.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 Processor -- start 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 -- start start 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f485819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48581092f0 0x7f485819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4858109c40 0x7f48581a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4858113950 con 0x7f48581039b0 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48581137d0 con 0x7f4858109c40 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.143+0000 7f485e800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4858113ad0 con 0x7f48581092f0 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f485819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f485819c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35944/0 (socket says 172.21.15.79:35944) 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 -- 172.21.15.79:0/3787510008 learned_addr learned my addr 172.21.15.79:0/3787510008 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485ca00640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48581092f0 0x7f485819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485de00640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4858109c40 0x7f48581a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:13.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 -- 172.21.15.79:0/3787510008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48581092f0 msgr2=0x7f485819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48581092f0 0x7f485819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 -- 172.21.15.79:0/3787510008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4858109c40 msgr2=0x7f48581a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4858109c40 0x7f48581a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 -- 172.21.15.79:0/3787510008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48581a2510 con 0x7f48581039b0 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485de00640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4858109c40 0x7f48581a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.144+0000 7f485d400640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f485819c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f484c005ab0 tx=0x7f484c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.145+0000 7f4856000640 1 -- 172.21.15.79:0/3787510008 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c03f070 con 0x7f48581039b0 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.145+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48581a27a0 con 0x7f48581039b0 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.145+0000 7f4856000640 1 -- 172.21.15.79:0/3787510008 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c031b60 con 0x7f48581039b0 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.145+0000 7f4856000640 1 -- 172.21.15.79:0/3787510008 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c035030 con 0x7f48581039b0 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.145+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48581a8f60 con 0x7f48581039b0 2024-09-21T02:36:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.146+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4858104c30 con 0x7f48581039b0 2024-09-21T02:36:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.148+0000 7f4856000640 1 -- 172.21.15.79:0/3787510008 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f484c042070 con 0x7f48581039b0 2024-09-21T02:36:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.150+0000 7f4856000640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48400b6590 0x7f48400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.150+0000 7f4856000640 1 -- 172.21.15.79:0/3787510008 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f484c108380 con 0x7f48581039b0 2024-09-21T02:36:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.150+0000 7f485ca00640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48400b6590 0x7f48400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:13.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.151+0000 7f485ca00640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48400b6590 0x7f48400b8aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48440095f0 tx=0x7f4844005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.152+0000 7f4856000640 1 -- 172.21.15.79:0/3787510008 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f484c0d2be0 con 0x7f48581039b0 2024-09-21T02:36:13.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.407+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4858103dc0 con 0x7f48581039b0 2024-09-21T02:36:13.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.408+0000 7f4856000640 1 -- 172.21.15.79:0/3787510008 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f4858103dc0 con 0x7f48581039b0 2024-09-21T02:36:13.410 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:36:13.410 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:36:13.410 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.410+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48400b6590 msgr2=0x7f48400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.410+0000 7f485e800640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48400b6590 0x7f48400b8aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48440095f0 tx=0x7f4844005f90 comp rx=0 tx=0).stop 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 msgr2=0x7f485819c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f485819c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f484c005ab0 tx=0x7f484c003c10 comp rx=0 tx=0).stop 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 shutdown_connections 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48400b6590 0x7f48400b8aa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4858109c40 0x7f48581a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48581092f0 0x7f485819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 --2- 172.21.15.79:0/3787510008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48581039b0 0x7f485819c5a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:13.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 >> 172.21.15.79:0/3787510008 conn(0x7f48580ff440 msgr2=0x7f48581089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:13.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 shutdown_connections 2024-09-21T02:36:13.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:13.411+0000 7f485e800640 1 -- 172.21.15.79:0/3787510008 wait complete. 2024-09-21T02:36:13.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:13 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3787510008' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:13.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:13 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3787510008' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:13 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3787510008' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:14.196 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 3ecc97db --release --await' 2024-09-21T02:36:14.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 3ecc97db --release --await 2024-09-21T02:36:14.682 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:36:14.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:14 smithi079 ceph-mon[30788]: pgmap v430: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-09-21T02:36:14.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:14 smithi148 ceph-mon[34626]: pgmap v430: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-09-21T02:36:14.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:14 smithi098 ceph-mon[34832]: pgmap v430: 129 pgs: 129 active+clean; 880 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-09-21T02:36:15.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 -- 172.21.15.79:0/1098379528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681092f0 msgr2=0x7f0168109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 --2- 172.21.15.79:0/1098379528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681092f0 0x7f0168109700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0150009900 tx=0x7f015002a410 comp rx=0 tx=0).stop 2024-09-21T02:36:15.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 -- 172.21.15.79:0/1098379528 shutdown_connections 2024-09-21T02:36:15.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 --2- 172.21.15.79:0/1098379528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0168109c40 0x7f0168110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 --2- 172.21.15.79:0/1098379528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681092f0 0x7f0168109700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 --2- 172.21.15.79:0/1098379528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01681039b0 0x7f0168103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 -- 172.21.15.79:0/1098379528 >> 172.21.15.79:0/1098379528 conn(0x7f01680ff440 msgr2=0x7f0168101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:15.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 -- 172.21.15.79:0/1098379528 shutdown_connections 2024-09-21T02:36:15.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.299+0000 7f0167200640 1 -- 172.21.15.79:0/1098379528 wait complete. 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 Processor -- start 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 -- start start 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681039b0 0x7f016819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01681092f0 0x7f016819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0168109c40 0x7f016819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0168113900 con 0x7f01681039b0 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0168113780 con 0x7f01681092f0 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0167200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0168113a80 con 0x7f0168109c40 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.301+0000 7f0165e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681039b0 0x7f016819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681039b0 0x7f016819a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48080/0 (socket says 172.21.15.79:48080) 2024-09-21T02:36:15.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 -- 172.21.15.79:0/652622541 learned_addr learned my addr 172.21.15.79:0/652622541 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:15.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f015fe00640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01681092f0 0x7f016819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0166800640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0168109c40 0x7f016819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 -- 172.21.15.79:0/652622541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0168109c40 msgr2=0x7f016819fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0168109c40 0x7f016819fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 -- 172.21.15.79:0/652622541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01681092f0 msgr2=0x7f016819a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01681092f0 0x7f016819a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 -- 172.21.15.79:0/652622541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01681a02c0 con 0x7f01681039b0 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.302+0000 7f0165e00640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681039b0 0x7f016819a350 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f015800e9f0 tx=0x7f015800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.303+0000 7f015ea00640 1 -- 172.21.15.79:0/652622541 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015800ccc0 con 0x7f01681039b0 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.303+0000 7f015ea00640 1 -- 172.21.15.79:0/652622541 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01580108e0 con 0x7f01681039b0 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.303+0000 7f015ea00640 1 -- 172.21.15.79:0/652622541 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158018880 con 0x7f01681039b0 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.303+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01681a05b0 con 0x7f01681039b0 2024-09-21T02:36:15.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.303+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01681a6d10 con 0x7f01681039b0 2024-09-21T02:36:15.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.306+0000 7f0173e62740 1 Processor -- start 2024-09-21T02:36:15.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.306+0000 7f0173e62740 1 -- start start 2024-09-21T02:36:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0173e62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0173e62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac57880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0173e62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0173e62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56510abce290 con 0x56510a887660 2024-09-21T02:36:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0173e62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56510abbd6c0 con 0x56510a8b0520 2024-09-21T02:36:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0173e62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56510abc14d0 con 0x56510a88f840 2024-09-21T02:36:15.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f015ea00640 1 -- 172.21.15.79:0/652622541 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f0158010430 con 0x7f01681039b0 2024-09-21T02:36:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0165e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac57880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0166800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0166800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57990/0 (socket says 172.21.15.79:57990) 2024-09-21T02:36:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f0166800640 1 -- 172.21.15.79:0/3897946457 learned_addr learned my addr 172.21.15.79:0/3897946457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.307+0000 7f015fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.308+0000 7f0165e00640 1 -- 172.21.15.79:0/3897946457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 msgr2=0x56510ac57dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.308+0000 7f0165e00640 1 --2- 172.21.15.79:0/3897946457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.308+0000 7f0165e00640 1 -- 172.21.15.79:0/3897946457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 msgr2=0x56510ac57340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.308+0000 7f0165e00640 1 --2- 172.21.15.79:0/3897946457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.308+0000 7f0165e00640 1 -- 172.21.15.79:0/3897946457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510ab4a460 con 0x56510a887660 2024-09-21T02:36:15.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.308+0000 7f0165e00640 1 --2- 172.21.15.79:0/3897946457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac57880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f01580e50d0 tx=0x7f01580ef650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0aa27b6c3b8bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.309+0000 7f0157400640 1 -- 172.21.15.79:0/3897946457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580f6070 con 0x56510a887660 2024-09-21T02:36:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.309+0000 7f0157400640 1 -- 172.21.15.79:0/3897946457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01580efe50 con 0x56510a887660 2024-09-21T02:36:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.309+0000 7f0157400640 1 -- 172.21.15.79:0/3897946457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580e7e60 con 0x56510a887660 2024-09-21T02:36:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.309+0000 7f015ea00640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f014c0b6590 0x7f014c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.309+0000 7f015ea00640 1 -- 172.21.15.79:0/652622541 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f01580e7a70 con 0x7f01681039b0 2024-09-21T02:36:15.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.309+0000 7f0166800640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f014c0b6590 0x7f014c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 -- 172.21.15.79:0/3897946457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 msgr2=0x56510ac57880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 --2- 172.21.15.79:0/3897946457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac57880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f01580e50d0 tx=0x7f01580ef650 comp rx=0 tx=0).stop 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 -- 172.21.15.79:0/3897946457 shutdown_connections 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 --2- 172.21.15.79:0/3897946457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 --2- 172.21.15.79:0/3897946457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac57880 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 --2- 172.21.15.79:0/3897946457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 -- 172.21.15.79:0/3897946457 >> 172.21.15.79:0/3897946457 conn(0x56510a8a4910 msgr2=0x56510ac55230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0166800640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f014c0b6590 0x7f014c0b8aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0160012680 tx=0x7f0160009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.310+0000 7f0173e62740 1 -- 172.21.15.79:0/3897946457 shutdown_connections 2024-09-21T02:36:15.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.311+0000 7f0173e62740 1 -- 172.21.15.79:0/3897946457 wait complete. 2024-09-21T02:36:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.311+0000 7f0173e62740 1 -- start start 2024-09-21T02:36:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.311+0000 7f0173e62740 1 Processor -- start 2024-09-21T02:36:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0173e62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a887660 0x56510ac67300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0173e62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac67840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0173e62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a8b0520 0x56510ac73180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0173e62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56510aa1ebb0 con 0x56510a8b0520 2024-09-21T02:36:15.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0173e62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56510ab586c0 con 0x56510a887660 2024-09-21T02:36:15.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0173e62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56510ac69e50 con 0x56510a88f840 2024-09-21T02:36:15.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0173e62740 10 client.0 _ll_register_callbacks cb 0x56510ab73490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0165e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a887660 0x56510ac67300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f015fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac67840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0165e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a887660 0x56510ac67300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58004/0 (socket says 172.21.15.79:58004) 2024-09-21T02:36:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0165e00640 1 -- 172.21.15.79:0/491375804 learned_addr learned my addr 172.21.15.79:0/491375804 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.312+0000 7f0166800640 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a8b0520 0x56510ac73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0165e00640 1 -- 172.21.15.79:0/491375804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 msgr2=0x56510ac67840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0165e00640 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac67840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0165e00640 1 -- 172.21.15.79:0/491375804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a8b0520 msgr2=0x56510ac73180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0165e00640 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a8b0520 0x56510ac73180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0165e00640 1 -- 172.21.15.79:0/491375804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510a91bb00 con 0x56510a887660 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f015fe00640 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac67840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0165e00640 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a887660 0x56510ac67300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01580ad4f0 tx=0x7f01580e5100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ba80218d7ad728 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f014be00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f014be00640 1 -- 172.21.15.79:0/491375804 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580f6030 con 0x56510a887660 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f014be00640 1 -- 172.21.15.79:0/491375804 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f01580b6d80 con 0x56510a887660 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01580efe50 con 0x56510a887660 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f014be00640 1 -- 172.21.15.79:0/491375804 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01580d2070 con 0x56510a887660 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0173e62740 10 client.25379 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.313+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56510a992960 con 0x56510a887660 2024-09-21T02:36:15.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f014be00640 1 -- 172.21.15.79:0/491375804 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01580efe50 con 0x56510a887660 2024-09-21T02:36:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f014be00640 1 -- 172.21.15.79:0/491375804 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01580f1040 con 0x56510a887660 2024-09-21T02:36:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f0173e62740 10 client.25379 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f0173e62740 10 client.25379 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:36:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f0173e62740 20 client.25379 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f0173e62740 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a86eea0 0x56510ac79030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f0173e62740 4 client.25379 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:15.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.314+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56510abd01e0 con 0x56510a86eea0 2024-09-21T02:36:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.315+0000 7f015fe00640 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a86eea0 0x56510ac79030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.315+0000 7f015fe00640 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a86eea0 0x56510ac79030 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbc51bcea43a96d server_cookie=875b9dbf0236ac99 in_seq=0 out_seq=0 2024-09-21T02:36:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.315+0000 7f014be00640 10 client.25379 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f014be00640 1 -- 172.21.15.79:0/491375804 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56510abd01e0 con 0x56510a86eea0 2024-09-21T02:36:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f014be00640 10 client.25379 handle_command_reply: tid=0 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 client.25379 shutdown 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a887660 msgr2=0x56510ac67300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a887660 0x56510ac67300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01580ad4f0 tx=0x7f01580e5100 comp rx=0 tx=0).stop 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 shutdown_connections 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a86eea0 0x56510ac79030 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a8b0520 0x56510ac73180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac67840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 --2- 172.21.15.79:0/491375804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a887660 0x56510ac67300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 >> 172.21.15.79:0/491375804 conn(0x56510a8a4910 msgr2=0x56510ac5a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f014be00640 0 client.25379 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 shutdown_connections 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.316+0000 7f0173e62740 1 -- 172.21.15.79:0/491375804 wait complete. 2024-09-21T02:36:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.317+0000 7f0173e62740 20 client.25379 trim_cache size 0 max 16384 2024-09-21T02:36:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.334+0000 7f0173e62740 1 Processor -- start 2024-09-21T02:36:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.334+0000 7f0173e62740 1 -- start start 2024-09-21T02:36:15.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0173e62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0173e62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0173e62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0173e62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f01681ac8f0 con 0x56510a887660 2024-09-21T02:36:15.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0173e62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f01681af150 con 0x56510a8b0520 2024-09-21T02:36:15.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0173e62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01681acf40 con 0x56510a88f840 2024-09-21T02:36:15.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0165e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0165e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48104/0 (socket says 172.21.15.79:48104) 2024-09-21T02:36:15.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0165e00640 1 -- 172.21.15.79:0/357838568 learned_addr learned my addr 172.21.15.79:0/357838568 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:15.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0166800640 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f015fe00640 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0165e00640 1 -- 172.21.15.79:0/357838568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 msgr2=0x56510ac57230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0165e00640 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0165e00640 1 -- 172.21.15.79:0/357838568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 msgr2=0x56510ac57770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.335+0000 7f0165e00640 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.336+0000 7f0165e00640 1 -- 172.21.15.79:0/357838568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510ac58170 con 0x56510a887660 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.336+0000 7f0165e00640 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac672e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f01580ad640 tx=0x7f01580ef650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57df591cb16b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.336+0000 7f0156a00640 1 -- 172.21.15.79:0/357838568 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580e7e60 con 0x56510a887660 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.336+0000 7f0156a00640 1 -- 172.21.15.79:0/357838568 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01580ed040 con 0x56510a887660 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.336+0000 7f0156a00640 1 -- 172.21.15.79:0/357838568 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580ed2e0 con 0x56510a887660 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 -- 172.21.15.79:0/357838568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 msgr2=0x56510ac672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac672e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f01580ad640 tx=0x7f01580ef650 comp rx=0 tx=0).stop 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 -- 172.21.15.79:0/357838568 shutdown_connections 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac57770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a88f840 0x56510ac57230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 --2- 172.21.15.79:0/357838568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a887660 0x56510ac672e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 -- 172.21.15.79:0/357838568 >> 172.21.15.79:0/357838568 conn(0x56510a8a4910 msgr2=0x56510ac4fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 -- 172.21.15.79:0/357838568 shutdown_connections 2024-09-21T02:36:15.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.337+0000 7f0173e62740 1 -- 172.21.15.79:0/357838568 wait complete. 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 -- start start 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 Processor -- start 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a887660 0x56510ac7ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a88f840 0x56510ac79f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac7a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f01681ad610 con 0x56510a88f840 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f01681aea80 con 0x56510a8b0520 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01681adce0 con 0x56510a887660 2024-09-21T02:36:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.338+0000 7f0173e62740 10 client.0 _ll_register_callbacks cb 0x7f0160009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f015fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a88f840 0x56510ac79f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0166800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac7a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0165e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a887660 0x56510ac7ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f015fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a88f840 0x56510ac79f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48110/0 (socket says 172.21.15.79:48110) 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f015fe00640 1 -- 172.21.15.79:0/1957208203 learned_addr learned my addr 172.21.15.79:0/1957208203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0165e00640 1 -- 172.21.15.79:0/1957208203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 msgr2=0x56510ac7a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0165e00640 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac7a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0165e00640 1 -- 172.21.15.79:0/1957208203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a88f840 msgr2=0x56510ac79f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0165e00640 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a88f840 0x56510ac79f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0165e00640 1 -- 172.21.15.79:0/1957208203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510ace27b0 con 0x56510a887660 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f0165e00640 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a887660 0x56510ac7ca30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f01580ad4f0 tx=0x7f01580acf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77d5f4ae200f8776 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.339+0000 7f014be00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:36:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f014be00640 1 -- 172.21.15.79:0/1957208203 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580f6070 con 0x56510a887660 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f014be00640 1 -- 172.21.15.79:0/1957208203 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f01580ed780 con 0x56510a887660 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01580ed040 con 0x56510a887660 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f014be00640 1 -- 172.21.15.79:0/1957208203 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01580c8050 con 0x56510a887660 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f0173e62740 10 client.25375 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56510ace3920 con 0x56510a887660 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f014be00640 1 -- 172.21.15.79:0/1957208203 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01580ed040 con 0x56510a887660 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f014be00640 1 -- 172.21.15.79:0/1957208203 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01580f1070 con 0x56510a887660 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f0173e62740 10 client.25375 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f0173e62740 10 client.25375 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.340+0000 7f0173e62740 20 client.25375 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.341+0000 7f0173e62740 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a844250 0x56510ace5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.341+0000 7f0173e62740 4 client.25375 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3ecc97db", "release": true, "await": true}] 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.341+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3ecc97db", "release": true, "await": true}) -- 0x56510abcbc90 con 0x56510a844250 2024-09-21T02:36:15.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.341+0000 7f015fe00640 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a844250 0x56510ace5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:15.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.341+0000 7f015fe00640 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a844250 0x56510ace5c50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bdc1b52ef9d2649 server_cookie=26f7d9f4182d87cd in_seq=0 out_seq=0 2024-09-21T02:36:15.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.341+0000 7f014be00640 10 client.25375 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:15.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.386+0000 7f014be00640 1 -- 172.21.15.79:0/1957208203 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56510abcbc90 con 0x56510a844250 2024-09-21T02:36:15.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.386+0000 7f014be00640 10 client.25375 handle_command_reply: tid=0 2024-09-21T02:36:15.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.386+0000 7f0173e62740 1 client.25375 shutdown 2024-09-21T02:36:15.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.387+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a887660 msgr2=0x56510ac7ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.387+0000 7f0173e62740 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a887660 0x56510ac7ca30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f01580ad4f0 tx=0x7f01580acf60 comp rx=0 tx=0).stop 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 shutdown_connections 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f0173e62740 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56510a844250 0x56510ace5c50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f0173e62740 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56510a8b0520 0x56510ac7a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f0173e62740 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510a88f840 0x56510ac79f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f0173e62740 1 --2- 172.21.15.79:0/1957208203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56510a887660 0x56510ac7ca30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 >> 172.21.15.79:0/1957208203 conn(0x56510a8a4910 msgr2=0x56510ac4fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f014be00640 0 client.25375 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.388+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 shutdown_connections 2024-09-21T02:36:15.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.390+0000 7f0173e62740 1 -- 172.21.15.79:0/1957208203 wait complete. 2024-09-21T02:36:15.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.390+0000 7f0173e62740 20 client.25375 trim_cache size 0 max 16384 2024-09-21T02:36:15.392 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:36:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:36:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:36:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 4, 2024-09-21T02:36:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "3ecc97db": { 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 4, 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 134.5, 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:36:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:36:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:15.394 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:36:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.394+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f014c0b6590 msgr2=0x7f014c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.394+0000 7f0167200640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f014c0b6590 0x7f014c0b8aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0160012680 tx=0x7f0160009500 comp rx=0 tx=0).stop 2024-09-21T02:36:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.394+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681039b0 msgr2=0x7f016819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.394+0000 7f0167200640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681039b0 0x7f016819a350 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f015800e9f0 tx=0x7f015800edf0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.395+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 shutdown_connections 2024-09-21T02:36:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.395+0000 7f0167200640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f014c0b6590 0x7f014c0b8aa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.395+0000 7f0167200640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0168109c40 0x7f016819fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.395+0000 7f0167200640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01681092f0 0x7f016819a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.395+0000 7f0167200640 1 --2- 172.21.15.79:0/652622541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01681039b0 0x7f016819a350 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.395+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 >> 172.21.15.79:0/652622541 conn(0x7f01680ff440 msgr2=0x7f0168101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.396+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 shutdown_connections 2024-09-21T02:36:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:15.396+0000 7f0167200640 1 -- 172.21.15.79:0/652622541 wait complete. 2024-09-21T02:36:16.436 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3ecc97db', total seconds elapsed: 18.8 2024-09-21T02:36:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 20.0 s, 400.4 tps, lat 690.154 ms stddev 2807.583 2024-09-21T02:36:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 -- 172.21.15.79:0/1703363696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa810b630 msgr2=0x7f1aa810dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 --2- 172.21.15.79:0/1703363696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa810b630 0x7f1aa810dae0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009be0 tx=0x7f1aa002a6c0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 -- 172.21.15.79:0/1703363696 shutdown_connections 2024-09-21T02:36:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 --2- 172.21.15.79:0/1703363696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa810b630 0x7f1aa810dae0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 --2- 172.21.15.79:0/1703363696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa8075cf0 0x7f1aa8076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 --2- 172.21.15.79:0/1703363696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aa80770f0 0x7f1aa80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 -- 172.21.15.79:0/1703363696 >> 172.21.15.79:0/1703363696 conn(0x7f1aa80fefe0 msgr2=0x7f1aa8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 -- 172.21.15.79:0/1703363696 shutdown_connections 2024-09-21T02:36:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.564+0000 7f1aafa00640 1 -- 172.21.15.79:0/1703363696 wait complete. 2024-09-21T02:36:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.565+0000 7f1aafa00640 1 Processor -- start 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.565+0000 7f1aafa00640 1 -- start start 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aafa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aa8075cf0 0x7f1aa81035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aafa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa80770f0 0x7f1aa8103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aafa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa810b630 0x7f1aa81047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aafa00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa81114c0 con 0x7f1aa8075cf0 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aafa00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8111340 con 0x7f1aa80770f0 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aafa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8111640 con 0x7f1aa810b630 2024-09-21T02:36:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aa7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa80770f0 0x7f1aa8103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aa7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa80770f0 0x7f1aa8103c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58034/0 (socket says 172.21.15.79:58034) 2024-09-21T02:36:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aa7e00640 1 -- 172.21.15.79:0/3650996991 learned_addr learned my addr 172.21.15.79:0/3650996991 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.566+0000 7f1aad000640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aa8075cf0 0x7f1aa81035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.567+0000 7f1aada00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa810b630 0x7f1aa81047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.567+0000 7f1aa7e00640 1 -- 172.21.15.79:0/3650996991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa810b630 msgr2=0x7f1aa81047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.567+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa810b630 0x7f1aa81047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.567+0000 7f1aa7e00640 1 -- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aa8075cf0 msgr2=0x7f1aa81035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.567+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aa8075cf0 0x7f1aa81035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.567+0000 7f1aa7e00640 1 -- 172.21.15.79:0/3650996991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8105000 con 0x7f1aa80770f0 2024-09-21T02:36:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.568+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa80770f0 0x7f1aa8103c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400e9f0 tx=0x7f1a9400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.568+0000 7f1aa5600640 1 -- 172.21.15.79:0/3650996991 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400cd80 con 0x7f1aa80770f0 2024-09-21T02:36:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.568+0000 7f1aa5600640 1 -- 172.21.15.79:0/3650996991 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a940108e0 con 0x7f1aa80770f0 2024-09-21T02:36:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.568+0000 7f1aa5600640 1 -- 172.21.15.79:0/3650996991 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94018980 con 0x7f1aa80770f0 2024-09-21T02:36:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.568+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa81052f0 con 0x7f1aa80770f0 2024-09-21T02:36:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.569+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa81059b0 con 0x7f1aa80770f0 2024-09-21T02:36:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.578+0000 7f1aa5600640 1 -- 172.21.15.79:0/3650996991 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1a94010430 con 0x7f1aa80770f0 2024-09-21T02:36:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.580+0000 7f1aa5600640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1a900b6590 0x7f1a900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.581+0000 7f1aad000640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1a900b6590 0x7f1a900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.581+0000 7f1ab6a04740 1 Processor -- start 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.582+0000 7f1ab6a04740 1 -- start start 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.582+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.582+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc72740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.582+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc73290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.582+0000 7f1aa7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc72740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.582+0000 7f1aa7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc72740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34404/0 (socket says 172.21.15.79:34404) 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.583+0000 7f1aa7e00640 1 -- 172.21.15.79:0/1244108312 learned_addr learned my addr 172.21.15.79:0/1244108312 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.583+0000 7f1aada00640 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc73290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.583+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55806cbe56b0 con 0x55806c8aa4d0 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.583+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55806cbd4ae0 con 0x55806c8cb1b0 2024-09-21T02:36:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.583+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55806cbd88f0 con 0x55806c8a22f0 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aa5600640 1 -- 172.21.15.79:0/3650996991 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1a940e5230 con 0x7f1aa80770f0 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aa7e00640 1 -- 172.21.15.79:0/1244108312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 msgr2=0x55806cc720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aad000640 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aa7e00640 1 -- 172.21.15.79:0/1244108312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 msgr2=0x55806cc73290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc73290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aa7e00640 1 -- 172.21.15.79:0/1244108312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806cba1780 con 0x55806c8a22f0 2024-09-21T02:36:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.584+0000 7f1aad000640 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:36:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.585+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc72740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a940aa2e0 tx=0x7f1a940b66a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=296fe271bb38371c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.586+0000 7f1aad000640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1a900b6590 0x7f1a900b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c005fd0 tx=0x7f1a9c015850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.586+0000 7f1a9a000640 1 -- 172.21.15.79:0/1244108312 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940a9fa0 con 0x55806c8a22f0 2024-09-21T02:36:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.586+0000 7f1a9a000640 1 -- 172.21.15.79:0/1244108312 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a94010720 con 0x55806c8a22f0 2024-09-21T02:36:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.587+0000 7f1a9a000640 1 -- 172.21.15.79:0/1244108312 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940aa140 con 0x55806c8a22f0 2024-09-21T02:36:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 msgr2=0x55806cc72740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc72740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a940aa2e0 tx=0x7f1a940b66a0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 shutdown_connections 2024-09-21T02:36:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc73290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc72740 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1244108312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 >> 172.21.15.79:0/1244108312 conn(0x55806c8bf300 msgr2=0x55806cc6db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.589+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 shutdown_connections 2024-09-21T02:36:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.590+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1244108312 wait complete. 2024-09-21T02:36:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.591+0000 7f1ab6a04740 1 -- start start 2024-09-21T02:36:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.591+0000 7f1ab6a04740 1 Processor -- start 2024-09-21T02:36:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.592+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc8c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.592+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc8cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.592+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc8da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.592+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55806cb0cab0 con 0x55806c8aa4d0 2024-09-21T02:36:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.592+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55806cb7b570 con 0x55806c8cb1b0 2024-09-21T02:36:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.592+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55806cc73dc0 con 0x55806c8a22f0 2024-09-21T02:36:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.592+0000 7f1ab6a04740 10 client.0 _ll_register_callbacks cb 0x55806cb8a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aada00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc8da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aad000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc8c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aada00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc8da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58050/0 (socket says 172.21.15.79:58050) 2024-09-21T02:36:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aad000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc8c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34418/0 (socket says 172.21.15.79:34418) 2024-09-21T02:36:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aada00640 1 -- 172.21.15.79:0/860382860 learned_addr learned my addr 172.21.15.79:0/860382860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc8cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aad000640 1 -- 172.21.15.79:0/860382860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 msgr2=0x55806cc8da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aad000640 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc8da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aad000640 1 -- 172.21.15.79:0/860382860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 msgr2=0x55806cc8cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aad000640 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc8cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aad000640 1 -- 172.21.15.79:0/860382860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55806c936790 con 0x55806c8a22f0 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.593+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc8cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.594+0000 7f1aad000640 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc8c7e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c012820 tx=0x7f1a9c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccbd93d63176a05c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.594+0000 7f1a8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.594+0000 7f1a8ea00640 1 -- 172.21.15.79:0/860382860 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c011ae0 con 0x55806c8a22f0 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.594+0000 7f1a8ea00640 1 -- 172.21.15.79:0/860382860 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1a9c011c80 con 0x55806c8a22f0 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.595+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55806cbe7600 con 0x55806c8a22f0 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.595+0000 7f1a8ea00640 1 -- 172.21.15.79:0/860382860 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1a9c028400 con 0x55806c8a22f0 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.595+0000 7f1ab6a04740 10 client.25387 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.595+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55806c9af620 con 0x55806c8a22f0 2024-09-21T02:36:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1a8ea00640 1 -- 172.21.15.79:0/860382860 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55806cbe7600 con 0x55806c8a22f0 2024-09-21T02:36:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1a8ea00640 1 -- 172.21.15.79:0/860382860 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1a9c01f040 con 0x55806c8a22f0 2024-09-21T02:36:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1ab6a04740 10 client.25387 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1ab6a04740 10 client.25387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1ab6a04740 20 client.25387 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c889d80 0x55806cc9a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1ab6a04740 4 client.25387 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55806cbe30b0 con 0x55806c889d80 2024-09-21T02:36:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.596+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c889d80 0x55806cc9a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.597+0000 7f1a8ea00640 10 client.25387 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.597+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c889d80 0x55806cc9a070 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b24c0cb6749a3e2 server_cookie=9a1d2b18f97ea9da in_seq=0 out_seq=0 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.598+0000 7f1a8ea00640 1 -- 172.21.15.79:0/860382860 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55806cbe30b0 con 0x55806c889d80 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.598+0000 7f1a8ea00640 10 client.25387 handle_command_reply: tid=0 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.598+0000 7f1ab6a04740 1 client.25387 shutdown 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 msgr2=0x55806cc8c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc8c7e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c012820 tx=0x7f1a9c004730 comp rx=0 tx=0).stop 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 shutdown_connections 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c889d80 0x55806cc9a070 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8cb1b0 0x55806cc8da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8aa4d0 0x55806cc8cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/860382860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc8c7e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 >> 172.21.15.79:0/860382860 conn(0x55806c8bf300 msgr2=0x55806cc73140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1a8ea00640 0 client.25387 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 shutdown_connections 2024-09-21T02:36:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 1 -- 172.21.15.79:0/860382860 wait complete. 2024-09-21T02:36:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.599+0000 7f1ab6a04740 20 client.25387 trim_cache size 0 max 16384 2024-09-21T02:36:16.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 Processor -- start 2024-09-21T02:36:16.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 -- start start 2024-09-21T02:36:16.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8a22f0 0x55806cc71db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8cb1b0 0x55806cc6d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8073520 con 0x55806c8a22f0 2024-09-21T02:36:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa819c4a0 con 0x55806c8aa4d0 2024-09-21T02:36:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.633+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8073b90 con 0x55806c8cb1b0 2024-09-21T02:36:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.634+0000 7f1aada00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8cb1b0 0x55806cc6d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.634+0000 7f1aada00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8cb1b0 0x55806cc6d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34424/0 (socket says 172.21.15.79:34424) 2024-09-21T02:36:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.634+0000 7f1aada00640 1 -- 172.21.15.79:0/1946079570 learned_addr learned my addr 172.21.15.79:0/1946079570 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:16.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.634+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.634+0000 7f1aad000640 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8a22f0 0x55806cc71db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1aada00640 1 -- 172.21.15.79:0/1946079570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 msgr2=0x55806cc687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1aada00640 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1aada00640 1 -- 172.21.15.79:0/1946079570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8a22f0 msgr2=0x55806cc71db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1aada00640 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8a22f0 0x55806cc71db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1aada00640 1 -- 172.21.15.79:0/1946079570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806cc799e0 con 0x55806c8cb1b0 2024-09-21T02:36:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1aad000640 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8a22f0 0x55806cc71db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:36:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1aada00640 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8cb1b0 0x55806cc6d4a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0034040 tx=0x7f1aa00093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724d21818272b16c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.635+0000 7f1a99600640 1 -- 172.21.15.79:0/1946079570 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0036040 con 0x55806c8cb1b0 2024-09-21T02:36:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.636+0000 7f1a99600640 1 -- 172.21.15.79:0/1946079570 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aa0003e20 con 0x55806c8cb1b0 2024-09-21T02:36:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.636+0000 7f1a99600640 1 -- 172.21.15.79:0/1946079570 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0036040 con 0x55806c8cb1b0 2024-09-21T02:36:16.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.637+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1946079570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8cb1b0 msgr2=0x55806cc6d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.637+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8cb1b0 0x55806cc6d4a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0034040 tx=0x7f1aa00093e0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.637+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1946079570 shutdown_connections 2024-09-21T02:36:16.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.637+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8cb1b0 0x55806cc6d4a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.637+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.637+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/1946079570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8a22f0 0x55806cc71db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.637+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1946079570 >> 172.21.15.79:0/1946079570 conn(0x55806c8bf300 msgr2=0x55806cc72f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:16.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.638+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1946079570 shutdown_connections 2024-09-21T02:36:16.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.638+0000 7f1ab6a04740 1 -- 172.21.15.79:0/1946079570 wait complete. 2024-09-21T02:36:16.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.639+0000 7f1ab6a04740 1 -- start start 2024-09-21T02:36:16.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.639+0000 7f1ab6a04740 1 Processor -- start 2024-09-21T02:36:16.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.641+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc91ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.641+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc921a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.641+0000 7f1ab6a04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8cb1b0 0x55806cc92ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.641+0000 7f1aad000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc91ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.641+0000 7f1aad000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc91ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34426/0 (socket says 172.21.15.79:34426) 2024-09-21T02:36:16.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8074260 con 0x55806c8cb1b0 2024-09-21T02:36:16.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa819bdd0 con 0x55806c8aa4d0 2024-09-21T02:36:16.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1ab6a04740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8074930 con 0x55806c8a22f0 2024-09-21T02:36:16.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1ab6a04740 10 client.0 _ll_register_callbacks cb 0x7f1a9c012520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aad000640 1 -- 172.21.15.79:0/2090338657 learned_addr learned my addr 172.21.15.79:0/2090338657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc921a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aada00640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8cb1b0 0x55806cc92ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aad000640 1 -- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 msgr2=0x55806cc921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aad000640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc921a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aad000640 1 -- 172.21.15.79:0/2090338657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8cb1b0 msgr2=0x55806cc92ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aad000640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8cb1b0 0x55806cc92ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aad000640 1 -- 172.21.15.79:0/2090338657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55806cc93400 con 0x55806c8a22f0 2024-09-21T02:36:16.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.642+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:36:16.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.644+0000 7f1aad000640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc91ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c020520 tx=0x7f1a9c020d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbfa70407dd84227 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:16.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.644+0000 7f1a8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:36:16.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.644+0000 7f1a8ea00640 1 -- 172.21.15.79:0/2090338657 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c009260 con 0x55806c8a22f0 2024-09-21T02:36:16.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.644+0000 7f1a8ea00640 1 -- 172.21.15.79:0/2090338657 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1a9c011bc0 con 0x55806c8a22f0 2024-09-21T02:36:16.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.645+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aa0003e20 con 0x55806c8a22f0 2024-09-21T02:36:16.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.645+0000 7f1a8ea00640 1 -- 172.21.15.79:0/2090338657 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1a9c011de0 con 0x55806c8a22f0 2024-09-21T02:36:16.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.645+0000 7f1ab6a04740 10 client.25393 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:16.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.645+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55806cc94700 con 0x55806c8a22f0 2024-09-21T02:36:16.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1a8ea00640 1 -- 172.21.15.79:0/2090338657 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aa0003e20 con 0x55806c8a22f0 2024-09-21T02:36:16.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1a8ea00640 1 -- 172.21.15.79:0/2090338657 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1a9c01f040 con 0x55806c8a22f0 2024-09-21T02:36:16.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1ab6a04740 10 client.25393 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:16.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1ab6a04740 10 client.25393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:16.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1ab6a04740 20 client.25393 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:16.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c85f1c0 0x55806cd06cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:16.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1ab6a04740 4 client.25393 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:36:16.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.646+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55806cbe04e0 con 0x55806c85f1c0 2024-09-21T02:36:16.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.647+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c85f1c0 0x55806cd06cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:16.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.648+0000 7f1a8ea00640 10 client.25393 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:16.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.648+0000 7f1aa7e00640 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c85f1c0 0x55806cd06cc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8b0af4a2cc94a35 server_cookie=7183374b753b5b01 in_seq=0 out_seq=0 2024-09-21T02:36:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.713+0000 7f1a8ea00640 1 -- 172.21.15.79:0/2090338657 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55806cbe04e0 con 0x55806c85f1c0 2024-09-21T02:36:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.713+0000 7f1a8ea00640 10 client.25393 handle_command_reply: tid=0 2024-09-21T02:36:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.714+0000 7f1ab6a04740 1 client.25393 shutdown 2024-09-21T02:36:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.714+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 msgr2=0x55806cc91ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.714+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc91ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c020520 tx=0x7f1a9c020d90 comp rx=0 tx=0).stop 2024-09-21T02:36:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 shutdown_connections 2024-09-21T02:36:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55806c85f1c0 0x55806cd06cc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55806c8cb1b0 0x55806cc92ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806c8aa4d0 0x55806cc921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1ab6a04740 1 --2- 172.21.15.79:0/2090338657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55806c8a22f0 0x55806cc91ae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 >> 172.21.15.79:0/2090338657 conn(0x55806c8bf300 msgr2=0x55806cc8c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1a8ea00640 0 client.25393 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.715+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 shutdown_connections 2024-09-21T02:36:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.716+0000 7f1ab6a04740 1 -- 172.21.15.79:0/2090338657 wait complete. 2024-09-21T02:36:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.716+0000 7f1ab6a04740 20 client.25393 trim_cache size 0 max 16384 2024-09-21T02:36:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:36:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:36:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:36:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1a900b6590 msgr2=0x7f1a900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1a900b6590 0x7f1a900b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c005fd0 tx=0x7f1a9c015850 comp rx=0 tx=0).stop 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa80770f0 msgr2=0x7f1aa8103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa80770f0 0x7f1aa8103c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400e9f0 tx=0x7f1a9400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 shutdown_connections 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1a900b6590 0x7f1a900b8aa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa810b630 0x7f1aa81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1aa80770f0 0x7f1aa8103c30 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400e9f0 tx=0x7f1a9400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 --2- 172.21.15.79:0/3650996991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1aa8075cf0 0x7f1aa81035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 >> 172.21.15.79:0/3650996991 conn(0x7f1aa80fefe0 msgr2=0x7f1aa8107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 shutdown_connections 2024-09-21T02:36:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:16.718+0000 7f1aafa00640 1 -- 172.21.15.79:0/3650996991 wait complete. 2024-09-21T02:36:16.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:16 smithi079 ceph-mon[30788]: pgmap v431: 129 pgs: 129 active+clean; 901 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 3.1 MiB/s wr, 172 op/s 2024-09-21T02:36:16.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:16 smithi148 ceph-mon[34626]: pgmap v431: 129 pgs: 129 active+clean; 901 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 3.1 MiB/s wr, 172 op/s 2024-09-21T02:36:16.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:16 smithi098 ceph-mon[34832]: pgmap v431: 129 pgs: 129 active+clean; 901 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 3.1 MiB/s wr, 172 op/s 2024-09-21T02:36:17.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:17 smithi098 ceph-mon[34832]: pgmap v432: 129 pgs: 129 active+clean; 906 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 3.8 MiB/s wr, 168 op/s 2024-09-21T02:36:17.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:17 smithi148 ceph-mon[34626]: pgmap v432: 129 pgs: 129 active+clean; 906 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 3.8 MiB/s wr, 168 op/s 2024-09-21T02:36:17.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:17 smithi079 ceph-mon[30788]: pgmap v432: 129 pgs: 129 active+clean; 906 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 3.8 MiB/s wr, 168 op/s 2024-09-21T02:36:19.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:19 smithi148 ceph-mon[34626]: pgmap v433: 129 pgs: 129 active+clean; 923 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 83 op/s 2024-09-21T02:36:19.899 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:19 smithi079 ceph-mon[30788]: pgmap v433: 129 pgs: 129 active+clean; 923 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 83 op/s 2024-09-21T02:36:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:19 smithi098 ceph-mon[34832]: pgmap v433: 129 pgs: 129 active+clean; 923 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 83 op/s 2024-09-21T02:36:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 25.0 s, 2416.7 tps, lat 41.623 ms stddev 58.034 2024-09-21T02:36:21.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:21 smithi148 ceph-mon[34626]: pgmap v434: 129 pgs: 129 active+clean; 955 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 274 op/s 2024-09-21T02:36:21.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:21 smithi098 ceph-mon[34832]: pgmap v434: 129 pgs: 129 active+clean; 955 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 274 op/s 2024-09-21T02:36:21.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:21 smithi079 ceph-mon[30788]: pgmap v434: 129 pgs: 129 active+clean; 955 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 274 op/s 2024-09-21T02:36:23.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:23 smithi148 ceph-mon[34626]: pgmap v435: 129 pgs: 129 active+clean; 965 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 422 op/s 2024-09-21T02:36:23.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:23 smithi098 ceph-mon[34832]: pgmap v435: 129 pgs: 129 active+clean; 965 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 422 op/s 2024-09-21T02:36:23.981 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:23 smithi079 ceph-mon[30788]: pgmap v435: 129 pgs: 129 active+clean; 965 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 422 op/s 2024-09-21T02:36:25.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:25 smithi148 ceph-mon[34626]: pgmap v436: 129 pgs: 129 active+clean; 979 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 520 op/s 2024-09-21T02:36:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:25 smithi098 ceph-mon[34832]: pgmap v436: 129 pgs: 129 active+clean; 979 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 520 op/s 2024-09-21T02:36:25.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:25 smithi079 ceph-mon[30788]: pgmap v436: 129 pgs: 129 active+clean; 979 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 520 op/s 2024-09-21T02:36:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 30.0 s, 2020.3 tps, lat 47.745 ms stddev 53.376 2024-09-21T02:36:27.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:27 smithi148 ceph-mon[34626]: pgmap v437: 129 pgs: 129 active+clean; 985 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 608 op/s 2024-09-21T02:36:27.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:27 smithi098 ceph-mon[34832]: pgmap v437: 129 pgs: 129 active+clean; 985 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 608 op/s 2024-09-21T02:36:27.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:27 smithi079 ceph-mon[30788]: pgmap v437: 129 pgs: 129 active+clean; 985 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 608 op/s 2024-09-21T02:36:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:29 smithi148 ceph-mon[34626]: pgmap v438: 129 pgs: 129 active+clean; 985 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 651 op/s 2024-09-21T02:36:29.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:29 smithi098 ceph-mon[34832]: pgmap v438: 129 pgs: 129 active+clean; 985 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 651 op/s 2024-09-21T02:36:29.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:29 smithi079 ceph-mon[30788]: pgmap v438: 129 pgs: 129 active+clean; 985 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 651 op/s 2024-09-21T02:36:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 -- 172.21.15.79:0/1726509527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c141034e0 msgr2=0x7f9c14103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1726509527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c141034e0 0x7f9c14103950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009900 tx=0x7f9c0802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 -- 172.21.15.79:0/1726509527 shutdown_connections 2024-09-21T02:36:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1726509527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c14104f00 0x7f9c1410b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1726509527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c14104560 0x7f9c14104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1726509527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c141034e0 0x7f9c14103950 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 -- 172.21.15.79:0/1726509527 >> 172.21.15.79:0/1726509527 conn(0x7f9c140fee20 msgr2=0x7f9c141012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 -- 172.21.15.79:0/1726509527 shutdown_connections 2024-09-21T02:36:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.045+0000 7f9c1a000640 1 -- 172.21.15.79:0/1726509527 wait complete. 2024-09-21T02:36:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.047+0000 7f9c1a000640 1 Processor -- start 2024-09-21T02:36:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.047+0000 7f9c1a000640 1 -- start start 2024-09-21T02:36:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.047+0000 7f9c1a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c141034e0 0x7f9c1419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c1a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c14104560 0x7f9c1419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c1a000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c14104f00 0x7f9c1419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c1a000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141113f0 con 0x7f9c141034e0 2024-09-21T02:36:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c1a000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14111270 con 0x7f9c14104f00 2024-09-21T02:36:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c1a000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14111570 con 0x7f9c14104560 2024-09-21T02:36:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c14104560 0x7f9c1419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c14104560 0x7f9c1419c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:53880/0 (socket says 172.21.15.79:53880) 2024-09-21T02:36:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c13e00640 1 -- 172.21.15.79:0/1810661387 learned_addr learned my addr 172.21.15.79:0/1810661387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.048+0000 7f9c18c00640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c141034e0 0x7f9c1419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.049+0000 7f9c19600640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c14104f00 0x7f9c1419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.049+0000 7f9c19600640 1 -- 172.21.15.79:0/1810661387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c14104560 msgr2=0x7f9c1419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.049+0000 7f9c19600640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c14104560 0x7f9c1419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.049+0000 7f9c19600640 1 -- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c141034e0 msgr2=0x7f9c1419bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.049+0000 7f9c19600640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c141034e0 0x7f9c1419bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.049+0000 7f9c19600640 1 -- 172.21.15.79:0/1810661387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1419d9e0 con 0x7f9c14104f00 2024-09-21T02:36:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.050+0000 7f9c19600640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c14104f00 0x7f9c1419d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00ca30 tx=0x7f9c0c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.050+0000 7f9c11600640 1 -- 172.21.15.79:0/1810661387 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c007d90 con 0x7f9c14104f00 2024-09-21T02:36:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.050+0000 7f9c11600640 1 -- 172.21.15.79:0/1810661387 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c0c005020 con 0x7f9c14104f00 2024-09-21T02:36:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.050+0000 7f9c11600640 1 -- 172.21.15.79:0/1810661387 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00f690 con 0x7f9c14104f00 2024-09-21T02:36:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.050+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1419dcd0 con 0x7f9c14104f00 2024-09-21T02:36:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.051+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c141a43c0 con 0x7f9c14104f00 2024-09-21T02:36:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.056+0000 7f9c2268a740 1 Processor -- start 2024-09-21T02:36:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.064+0000 7f9c11600640 1 -- 172.21.15.79:0/1810661387 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9c0c00f830 con 0x7f9c14104f00 2024-09-21T02:36:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.064+0000 7f9c2268a740 1 -- start start 2024-09-21T02:36:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.065+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9d151b0 0x55f2ca0c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.065+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.065+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.065+0000 7f9c2268a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2ca02f6b0 con 0x55f2c9d151b0 2024-09-21T02:36:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.065+0000 7f9c2268a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2ca01eae0 con 0x55f2c9cf44d0 2024-09-21T02:36:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.065+0000 7f9c2268a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f2ca0228f0 con 0x55f2c9cec2f0 2024-09-21T02:36:30.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.066+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9d151b0 0x55f2ca0c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.066+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9d151b0 0x55f2ca0c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38230/0 (socket says 172.21.15.79:38230) 2024-09-21T02:36:30.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.067+0000 7f9c13e00640 1 -- 172.21.15.79:0/4107475425 learned_addr learned my addr 172.21.15.79:0/4107475425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:30.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.067+0000 7f9c18c00640 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.067+0000 7f9c11600640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9bfc0b65d0 0x7f9bfc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.068+0000 7f9c11600640 1 -- 172.21.15.79:0/1810661387 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9c0c0e7910 con 0x7f9c14104f00 2024-09-21T02:36:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.068+0000 7f9c13e00640 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.068+0000 7f9c13e00640 1 -- 172.21.15.79:0/4107475425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 msgr2=0x55f2ca0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.068+0000 7f9c13e00640 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.068+0000 7f9c13e00640 1 -- 172.21.15.79:0/4107475425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 msgr2=0x55f2ca0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.068+0000 7f9c13e00640 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.068+0000 7f9c13e00640 1 -- 172.21.15.79:0/4107475425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c9feb780 con 0x55f2c9d151b0 2024-09-21T02:36:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.069+0000 7f9c19600640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9bfc0b65d0 0x7f9bfc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.069+0000 7f9c13e00640 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9d151b0 0x55f2ca0c4ac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009f10 tx=0x7f9c00009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6245ec86307198b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.070+0000 7f9c05c00640 1 -- 172.21.15.79:0/4107475425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0001a030 con 0x55f2c9d151b0 2024-09-21T02:36:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.071+0000 7f9c19600640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9bfc0b65d0 0x7f9bfc0b8ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0a9eb0 tx=0x7f9c0c0a9d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.071+0000 7f9c05c00640 1 -- 172.21.15.79:0/4107475425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c0000fd70 con 0x55f2c9d151b0 2024-09-21T02:36:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.071+0000 7f9c05c00640 1 -- 172.21.15.79:0/4107475425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0001edb0 con 0x55f2c9d151b0 2024-09-21T02:36:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 -- 172.21.15.79:0/4107475425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9d151b0 msgr2=0x55f2ca0c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9d151b0 0x55f2ca0c4ac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009f10 tx=0x7f9c00009a70 comp rx=0 tx=0).stop 2024-09-21T02:36:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 -- 172.21.15.79:0/4107475425 shutdown_connections 2024-09-21T02:36:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 --2- 172.21.15.79:0/4107475425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9d151b0 0x55f2ca0c4ac0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 -- 172.21.15.79:0/4107475425 >> 172.21.15.79:0/4107475425 conn(0x55f2c9d09300 msgr2=0x55f2ca0c0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.073+0000 7f9c2268a740 1 -- 172.21.15.79:0/4107475425 shutdown_connections 2024-09-21T02:36:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.074+0000 7f9c2268a740 1 -- 172.21.15.79:0/4107475425 wait complete. 2024-09-21T02:36:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.074+0000 7f9c2268a740 1 -- start start 2024-09-21T02:36:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.075+0000 7f9c2268a740 1 Processor -- start 2024-09-21T02:36:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0b9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c2268a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2c9f56ab0 con 0x55f2c9cd3d80 2024-09-21T02:36:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c2268a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2c9fc5570 con 0x55f2c9cf44d0 2024-09-21T02:36:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c2268a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f2ca0c67a0 con 0x55f2c9cec2f0 2024-09-21T02:36:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c18c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c18c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0b9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50364/0 (socket says 172.21.15.79:50364) 2024-09-21T02:36:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.076+0000 7f9c18c00640 1 -- 172.21.15.79:0/3491956129 learned_addr learned my addr 172.21.15.79:0/3491956129 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.077+0000 7f9c2268a740 10 client.0 _ll_register_callbacks cb 0x55f2c9fd4100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.077+0000 7f9c18c00640 1 -- 172.21.15.79:0/3491956129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 msgr2=0x55f2ca0b8c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:36:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.077+0000 7f9c18c00640 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0b8c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.077+0000 7f9c18c00640 1 -- 172.21.15.79:0/3491956129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 msgr2=0x55f2ca0b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.077+0000 7f9c13e00640 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.077+0000 7f9c18c00640 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0b9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.077+0000 7f9c18c00640 1 -- 172.21.15.79:0/3491956129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c9d80790 con 0x55f2c9cf44d0 2024-09-21T02:36:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.078+0000 7f9c18c00640 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0b9310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009230 tx=0x7f9c080052e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba0fdcd1e6c538e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.078+0000 7f9bfa000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:36:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.078+0000 7f9bfa000640 1 -- 172.21.15.79:0/3491956129 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08035040 con 0x55f2c9cf44d0 2024-09-21T02:36:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.078+0000 7f9bfa000640 1 -- 172.21.15.79:0/3491956129 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9c080048c0 con 0x55f2c9cf44d0 2024-09-21T02:36:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.078+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c0000fd70 con 0x55f2c9cf44d0 2024-09-21T02:36:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.079+0000 7f9bfa000640 1 -- 172.21.15.79:0/3491956129 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9c08004ac0 con 0x55f2c9cf44d0 2024-09-21T02:36:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.079+0000 7f9c2268a740 10 client.25412 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.079+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f2c9df9620 con 0x55f2c9cf44d0 2024-09-21T02:36:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.079+0000 7f9bfa000640 1 -- 172.21.15.79:0/3491956129 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c0000fd70 con 0x55f2c9cf44d0 2024-09-21T02:36:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.080+0000 7f9bfa000640 1 -- 172.21.15.79:0/3491956129 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9c080315a0 con 0x55f2c9cf44d0 2024-09-21T02:36:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.081+0000 7f9c2268a740 10 client.25412 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.081+0000 7f9c2268a740 10 client.25412 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.081+0000 7f9c2268a740 20 client.25412 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.081+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2c9ca91c0 0x55f2ca0e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.081+0000 7f9c2268a740 4 client.25412 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.081+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2ca031600 con 0x55f2c9ca91c0 2024-09-21T02:36:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.081+0000 7f9c13e00640 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2c9ca91c0 0x55f2ca0e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.082+0000 7f9c13e00640 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2c9ca91c0 0x55f2ca0e42d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dec8b26919530402 server_cookie=3fe995790103267b in_seq=0 out_seq=0 2024-09-21T02:36:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.082+0000 7f9bfa000640 10 client.25412 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.083+0000 7f9bfa000640 1 -- 172.21.15.79:0/3491956129 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2ca031600 con 0x55f2c9ca91c0 2024-09-21T02:36:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.083+0000 7f9bfa000640 10 client.25412 handle_command_reply: tid=0 2024-09-21T02:36:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.083+0000 7f9c2268a740 1 client.25412 shutdown 2024-09-21T02:36:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.084+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 msgr2=0x55f2ca0b9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.084+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0b9310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009230 tx=0x7f9c080052e0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 shutdown_connections 2024-09-21T02:36:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2c9ca91c0 0x55f2ca0e42d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0b9310 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9bfa000640 0 client.25412 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3491956129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 >> 172.21.15.79:0/3491956129 conn(0x55f2c9d09300 msgr2=0x55f2ca0b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 shutdown_connections 2024-09-21T02:36:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 1 -- 172.21.15.79:0/3491956129 wait complete. 2024-09-21T02:36:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.085+0000 7f9c2268a740 20 client.25412 trim_cache size 0 max 16384 2024-09-21T02:36:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.113+0000 7f9c2268a740 1 Processor -- start 2024-09-21T02:36:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.113+0000 7f9c2268a740 1 -- start start 2024-09-21T02:36:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0bff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c2268a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141a8390 con 0x55f2c9cd3d80 2024-09-21T02:36:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c2268a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141aac10 con 0x55f2c9cec2f0 2024-09-21T02:36:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c2268a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141a8a00 con 0x55f2c9cf44d0 2024-09-21T02:36:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c18c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c18c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0bff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50378/0 (socket says 172.21.15.79:50378) 2024-09-21T02:36:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c18c00640 1 -- 172.21.15.79:0/833036378 learned_addr learned my addr 172.21.15.79:0/833036378 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.114+0000 7f9c13e00640 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.115+0000 7f9c18c00640 1 -- 172.21.15.79:0/833036378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 msgr2=0x55f2ca0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.115+0000 7f9c18c00640 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.115+0000 7f9c18c00640 1 -- 172.21.15.79:0/833036378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 msgr2=0x55f2ca0cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.115+0000 7f9c18c00640 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.115+0000 7f9c18c00640 1 -- 172.21.15.79:0/833036378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2ca0b2000 con 0x55f2c9cec2f0 2024-09-21T02:36:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.115+0000 7f9c13e00640 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:36:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.115+0000 7f9c18c00640 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0bff00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c08005f70 tx=0x7f9c08005350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f6f9a90f25ba548 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.116+0000 7f9c05200640 1 -- 172.21.15.79:0/833036378 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08035070 con 0x55f2c9cec2f0 2024-09-21T02:36:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.116+0000 7f9c05200640 1 -- 172.21.15.79:0/833036378 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c08040070 con 0x55f2c9cec2f0 2024-09-21T02:36:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.116+0000 7f9c05200640 1 -- 172.21.15.79:0/833036378 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08035070 con 0x55f2c9cec2f0 2024-09-21T02:36:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.117+0000 7f9c2268a740 1 -- 172.21.15.79:0/833036378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 msgr2=0x55f2ca0bff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0bff00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c08005f70 tx=0x7f9c08005350 comp rx=0 tx=0).stop 2024-09-21T02:36:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 -- 172.21.15.79:0/833036378 shutdown_connections 2024-09-21T02:36:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0bff00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 --2- 172.21.15.79:0/833036378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 -- 172.21.15.79:0/833036378 >> 172.21.15.79:0/833036378 conn(0x55f2c9d09300 msgr2=0x55f2ca0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 -- 172.21.15.79:0/833036378 shutdown_connections 2024-09-21T02:36:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 -- 172.21.15.79:0/833036378 wait complete. 2024-09-21T02:36:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.118+0000 7f9c2268a740 1 -- start start 2024-09-21T02:36:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.119+0000 7f9c2268a740 1 Processor -- start 2024-09-21T02:36:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.119+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0f6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.119+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.119+0000 7f9c2268a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0f5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.120+0000 7f9c2268a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141a90d0 con 0x55f2c9cd3d80 2024-09-21T02:36:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.120+0000 7f9c2268a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141aa540 con 0x55f2c9cec2f0 2024-09-21T02:36:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.120+0000 7f9c2268a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141a97a0 con 0x55f2c9cf44d0 2024-09-21T02:36:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.120+0000 7f9c2268a740 10 client.0 _ll_register_callbacks cb 0x7f9c08009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.120+0000 7f9c13e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.121+0000 7f9c18c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.121+0000 7f9c18c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50388/0 (socket says 172.21.15.79:50388) 2024-09-21T02:36:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.121+0000 7f9c18c00640 1 -- 172.21.15.79:0/3241919139 learned_addr learned my addr 172.21.15.79:0/3241919139 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.121+0000 7f9c13e00640 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.122+0000 7f9c13e00640 1 -- 172.21.15.79:0/3241919139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 msgr2=0x55f2ca0f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.122+0000 7f9c13e00640 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.122+0000 7f9c13e00640 1 -- 172.21.15.79:0/3241919139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 msgr2=0x55f2ca0f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.122+0000 7f9c13e00640 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.122+0000 7f9c13e00640 1 -- 172.21.15.79:0/3241919139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2ca0f3b10 con 0x55f2c9cd3d80 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.123+0000 7f9c13e00640 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0f6290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c00008000 tx=0x7f9c00011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1c548bab7587e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.123+0000 7f9bfa000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.123+0000 7f9bfa000640 1 -- 172.21.15.79:0/3241919139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00024030 con 0x55f2c9cd3d80 2024-09-21T02:36:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.124+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c08040070 con 0x55f2c9cd3d80 2024-09-21T02:36:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.124+0000 7f9bfa000640 1 -- 172.21.15.79:0/3241919139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9c0000f840 con 0x55f2c9cd3d80 2024-09-21T02:36:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.124+0000 7f9bfa000640 1 -- 172.21.15.79:0/3241919139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9c00039050 con 0x55f2c9cd3d80 2024-09-21T02:36:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.125+0000 7f9c2268a740 10 client.15399 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.125+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f2ca14ed70 con 0x55f2c9cd3d80 2024-09-21T02:36:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.125+0000 7f9bfa000640 1 -- 172.21.15.79:0/3241919139 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c08040070 con 0x55f2c9cd3d80 2024-09-21T02:36:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.125+0000 7f9bfa000640 1 -- 172.21.15.79:0/3241919139 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9c0001e830 con 0x55f2c9cd3d80 2024-09-21T02:36:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.126+0000 7f9c2268a740 10 client.15399 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.126+0000 7f9c2268a740 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.127+0000 7f9c2268a740 20 client.15399 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.127+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2ca14f480 0x55f2ca1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.127+0000 7f9c2268a740 4 client.15399 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:36:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.127+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f2ca02d0b0 con 0x55f2ca14f480 2024-09-21T02:36:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.127+0000 7f9c18c00640 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2ca14f480 0x55f2ca1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.127+0000 7f9c18c00640 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2ca14f480 0x55f2ca1518a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d4fd4fab339170 server_cookie=b664bd0245da778 in_seq=0 out_seq=0 2024-09-21T02:36:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.128+0000 7f9bfa000640 10 client.15399 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.202+0000 7f9bfa000640 1 -- 172.21.15.79:0/3241919139 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f2ca02d0b0 con 0x55f2ca14f480 2024-09-21T02:36:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.202+0000 7f9bfa000640 10 client.15399 handle_command_reply: tid=0 2024-09-21T02:36:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.202+0000 7f9c2268a740 1 client.15399 shutdown 2024-09-21T02:36:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.202+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 msgr2=0x55f2ca0f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.202+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0f6290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c00008000 tx=0x7f9c00011660 comp rx=0 tx=0).stop 2024-09-21T02:36:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 shutdown_connections 2024-09-21T02:36:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f2ca14f480 0x55f2ca1518a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9bfa000640 0 client.15399 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2c9cf44d0 0x55f2ca0f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2c9cec2f0 0x55f2ca0f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 --2- 172.21.15.79:0/3241919139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2c9cd3d80 0x55f2ca0f6290 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 >> 172.21.15.79:0/3241919139 conn(0x55f2c9d09300 msgr2=0x55f2ca0bfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 shutdown_connections 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.203+0000 7f9c2268a740 1 -- 172.21.15.79:0/3241919139 wait complete. 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.204+0000 7f9c2268a740 20 client.15399 trim_cache size 0 max 16384 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:36:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:36:30.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:36:30.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:36:30.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9bfc0b65d0 msgr2=0x7f9bfc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9bfc0b65d0 0x7f9bfc0b8ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0a9eb0 tx=0x7f9c0c0a9d40 comp rx=0 tx=0).stop 2024-09-21T02:36:30.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c14104f00 msgr2=0x7f9c1419d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:30.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c14104f00 0x7f9c1419d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00ca30 tx=0x7f9c0c00cef0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 shutdown_connections 2024-09-21T02:36:30.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9bfc0b65d0 0x7f9bfc0b8ae0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c14104f00 0x7f9c1419d1c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c14104560 0x7f9c1419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 --2- 172.21.15.79:0/1810661387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c141034e0 0x7f9c1419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:30.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 >> 172.21.15.79:0/1810661387 conn(0x7f9c140fee20 msgr2=0x7f9c14107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:30.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.206+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 shutdown_connections 2024-09-21T02:36:30.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:30.207+0000 7f9c1a000640 1 -- 172.21.15.79:0/1810661387 wait complete. 2024-09-21T02:36:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 35.0 s, 2568.3 tps, lat 40.121 ms stddev 53.778 2024-09-21T02:36:31.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:31 smithi148 ceph-mon[34626]: pgmap v439: 129 pgs: 129 active+clean; 987 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 795 op/s 2024-09-21T02:36:31.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:31 smithi098 ceph-mon[34832]: pgmap v439: 129 pgs: 129 active+clean; 987 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 795 op/s 2024-09-21T02:36:31.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:31 smithi079 ceph-mon[30788]: pgmap v439: 129 pgs: 129 active+clean; 987 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 795 op/s 2024-09-21T02:36:33.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:33 smithi079 ceph-mon[30788]: pgmap v440: 129 pgs: 129 active+clean; 988 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8.6 MiB/s wr, 687 op/s 2024-09-21T02:36:33.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:33 smithi148 ceph-mon[34626]: pgmap v440: 129 pgs: 129 active+clean; 988 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8.6 MiB/s wr, 687 op/s 2024-09-21T02:36:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:33 smithi098 ceph-mon[34832]: pgmap v440: 129 pgs: 129 active+clean; 988 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 8.6 MiB/s wr, 687 op/s 2024-09-21T02:36:35.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:35 smithi148 ceph-mon[34626]: pgmap v441: 129 pgs: 129 active+clean; 988 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 651 op/s 2024-09-21T02:36:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:35 smithi098 ceph-mon[34832]: pgmap v441: 129 pgs: 129 active+clean; 988 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 651 op/s 2024-09-21T02:36:35.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:35 smithi079 ceph-mon[30788]: pgmap v441: 129 pgs: 129 active+clean; 988 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 651 op/s 2024-09-21T02:36:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 40.0 s, 2792.7 tps, lat 36.337 ms stddev 43.712 2024-09-21T02:36:37.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:37 smithi148 ceph-mon[34626]: pgmap v442: 129 pgs: 129 active+clean; 993 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 648 op/s 2024-09-21T02:36:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:37 smithi098 ceph-mon[34832]: pgmap v442: 129 pgs: 129 active+clean; 993 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 648 op/s 2024-09-21T02:36:37.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:37 smithi079 ceph-mon[30788]: pgmap v442: 129 pgs: 129 active+clean; 993 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 648 op/s 2024-09-21T02:36:39.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:39 smithi148 ceph-mon[34626]: pgmap v443: 129 pgs: 129 active+clean; 995 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-09-21T02:36:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:39 smithi098 ceph-mon[34832]: pgmap v443: 129 pgs: 129 active+clean; 995 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-09-21T02:36:39.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:39 smithi079 ceph-mon[30788]: pgmap v443: 129 pgs: 129 active+clean; 995 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-09-21T02:36:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 45.0 s, 2360.6 tps, lat 42.091 ms stddev 47.622 2024-09-21T02:36:42.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:42 smithi148 ceph-mon[34626]: pgmap v444: 129 pgs: 129 active+clean; 1013 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.7 MiB/s wr, 767 op/s 2024-09-21T02:36:42.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:42 smithi098 ceph-mon[34832]: pgmap v444: 129 pgs: 129 active+clean; 1013 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.7 MiB/s wr, 767 op/s 2024-09-21T02:36:42.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:42 smithi079 ceph-mon[30788]: pgmap v444: 129 pgs: 129 active+clean; 1013 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.7 MiB/s wr, 767 op/s 2024-09-21T02:36:43.366 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T02:36:43.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.528+0000 7f94cc600640 1 -- 172.21.15.79:0/1296619143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 msgr2=0x7f94c410ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.528+0000 7f94cc600640 1 --2- 172.21.15.79:0/1296619143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 0x7f94c410ba60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009860 tx=0x7f94bc02a340 comp rx=0 tx=0).stop 2024-09-21T02:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.532+0000 7f94cc600640 1 -- 172.21.15.79:0/1296619143 shutdown_connections 2024-09-21T02:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.532+0000 7f94cc600640 1 --2- 172.21.15.79:0/1296619143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 0x7f94c410ba60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.532+0000 7f94cc600640 1 --2- 172.21.15.79:0/1296619143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c4104720 0x7f94c4104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.532+0000 7f94cc600640 1 --2- 172.21.15.79:0/1296619143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c41036a0 0x7f94c4103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.532+0000 7f94cc600640 1 -- 172.21.15.79:0/1296619143 >> 172.21.15.79:0/1296619143 conn(0x7f94c40fefe0 msgr2=0x7f94c4101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.532+0000 7f94cc600640 1 -- 172.21.15.79:0/1296619143 shutdown_connections 2024-09-21T02:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.533+0000 7f94cc600640 1 -- 172.21.15.79:0/1296619143 wait complete. 2024-09-21T02:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.535+0000 7f94cc600640 1 Processor -- start 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.535+0000 7f94cc600640 1 -- start start 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.535+0000 7f94cc600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c41036a0 0x7f94c4076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.535+0000 7f94cc600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c4104720 0x7f94c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.535+0000 7f94cc600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 0x7f94c4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.535+0000 7f94cc600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f94c410f320 con 0x7f94c41036a0 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.536+0000 7f94cc600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94c410f1a0 con 0x7f94c4104720 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.536+0000 7f94cc600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94c410f4a0 con 0x7f94c41050c0 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.536+0000 7f94c9200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c4104720 0x7f94c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.536+0000 7f94c9200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c4104720 0x7f94c4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58010/0 (socket says 172.21.15.79:58010) 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.536+0000 7f94c9200640 1 -- 172.21.15.79:0/1717025313 learned_addr learned my addr 172.21.15.79:0/1717025313 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.536+0000 7f94ca600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 0x7f94c4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.537+0000 7f94c9200640 1 -- 172.21.15.79:0/1717025313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 msgr2=0x7f94c4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.537+0000 7f94c9200640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 0x7f94c4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.537+0000 7f94c9200640 1 -- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c41036a0 msgr2=0x7f94c4076e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.537+0000 7f94c9200640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c41036a0 0x7f94c4076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.537+0000 7f94c9200640 1 -- 172.21.15.79:0/1717025313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c419dcd0 con 0x7f94c4104720 2024-09-21T02:36:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.538+0000 7f94c9200640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c4104720 0x7f94c4075710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c920 tx=0x7f94b000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.538+0000 7f94c2000640 1 -- 172.21.15.79:0/1717025313 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0007c70 con 0x7f94c4104720 2024-09-21T02:36:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.538+0000 7f94c2000640 1 -- 172.21.15.79:0/1717025313 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94b0007e10 con 0x7f94c4104720 2024-09-21T02:36:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.538+0000 7f94c2000640 1 -- 172.21.15.79:0/1717025313 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0018820 con 0x7f94c4104720 2024-09-21T02:36:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.541+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c419dfc0 con 0x7f94c4104720 2024-09-21T02:36:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.542+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c419e490 con 0x7f94c4104720 2024-09-21T02:36:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.552+0000 7f94d36c6740 1 Processor -- start 2024-09-21T02:36:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94d36c6740 1 -- start start 2024-09-21T02:36:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f59221b0 0x55d8f5cc9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f59014d0 0x55d8f5cca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94d36c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d8f5c3c6b0 con 0x55d8f59221b0 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94d36c6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d8f5c2bae0 con 0x55d8f59014d0 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94d36c6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d8f5c2f8f0 con 0x55d8f58f92f0 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.553+0000 7f94c9c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40322/0 (socket says 172.21.15.79:40322) 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 -- 172.21.15.79:0/2820043909 learned_addr learned my addr 172.21.15.79:0/2820043909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 -- 172.21.15.79:0/2820043909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f59014d0 msgr2=0x55d8f5cca2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2820043909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f59014d0 0x55d8f5cca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 -- 172.21.15.79:0/2820043909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f59221b0 msgr2=0x55d8f5cc9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2820043909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f59221b0 0x55d8f5cc9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 -- 172.21.15.79:0/2820043909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f5bf8780 con 0x55d8f58f92f0 2024-09-21T02:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.554+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2820043909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc9780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009e00 tx=0x7f94b400e760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84519e8403b7b16d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.555+0000 7f94baa00640 1 -- 172.21.15.79:0/2820043909 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b400f810 con 0x55d8f58f92f0 2024-09-21T02:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.555+0000 7f94baa00640 1 -- 172.21.15.79:0/2820043909 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94b40173f0 con 0x55d8f58f92f0 2024-09-21T02:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.555+0000 7f94baa00640 1 -- 172.21.15.79:0/2820043909 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b400fe60 con 0x55d8f58f92f0 2024-09-21T02:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.556+0000 7f94d36c6740 1 -- 172.21.15.79:0/2820043909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 msgr2=0x55d8f5cc9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.556+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2820043909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc9780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009e00 tx=0x7f94b400e760 comp rx=0 tx=0).stop 2024-09-21T02:36:43.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.556+0000 7f94d36c6740 1 -- 172.21.15.79:0/2820043909 shutdown_connections 2024-09-21T02:36:43.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.556+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2820043909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f59014d0 0x55d8f5cca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.557+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2820043909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc9780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.557+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2820043909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f59221b0 0x55d8f5cc9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.557+0000 7f94d36c6740 1 -- 172.21.15.79:0/2820043909 >> 172.21.15.79:0/2820043909 conn(0x55d8f5916300 msgr2=0x55d8f5cc4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:43.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.559+0000 7f94c2000640 1 -- 172.21.15.79:0/1717025313 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f94b000f450 con 0x7f94c4104720 2024-09-21T02:36:43.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.560+0000 7f94d36c6740 1 -- 172.21.15.79:0/2820043909 shutdown_connections 2024-09-21T02:36:43.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.560+0000 7f94d36c6740 1 -- 172.21.15.79:0/2820043909 wait complete. 2024-09-21T02:36:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.562+0000 7f94d36c6740 1 -- start start 2024-09-21T02:36:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.562+0000 7f94d36c6740 1 Processor -- start 2024-09-21T02:36:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.562+0000 7f94c2000640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f94a80b64d0 0x7f94a80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.562+0000 7f94c2000640 1 -- 172.21.15.79:0/1717025313 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f94b00e7640 con 0x7f94c4104720 2024-09-21T02:36:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.563+0000 7f94ca600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f94a80b64d0 0x7f94a80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.564+0000 7f94ca600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f94a80b64d0 0x7f94a80b89e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0303f0 tx=0x7f94bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.564+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58f92f0 0x55d8f5cd2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.564+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f59221b0 0x55d8f5cd2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 0x55d8f5cd3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94d36c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d8f5b63ab0 con 0x55d8f58f92f0 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94d36c6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d8f5bd2570 con 0x55d8f58e0d80 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94d36c6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d8f5ccadf0 con 0x55d8f59221b0 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94d36c6740 10 client.0 _ll_register_callbacks cb 0x55d8f5be1100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f59221b0 0x55d8f5cd2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f59221b0 0x55d8f5cd2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40338/0 (socket says 172.21.15.79:40338) 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 -- 172.21.15.79:0/2474819049 learned_addr learned my addr 172.21.15.79:0/2474819049 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 -- 172.21.15.79:0/2474819049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 msgr2=0x55d8f5cd3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 0x55d8f5cd3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 -- 172.21.15.79:0/2474819049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58f92f0 msgr2=0x55d8f5cd2890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:36:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58f92f0 0x55d8f5cd2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.565+0000 7f94c9200640 1 -- 172.21.15.79:0/2474819049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f598d790 con 0x55d8f59221b0 2024-09-21T02:36:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.566+0000 7f94c9200640 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f59221b0 0x55d8f5cd2f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f94b00e4d90 tx=0x7f94b000fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff39bb49d18ad953 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.566+0000 7f94af400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:36:43.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.566+0000 7f94af400640 1 -- 172.21.15.79:0/2474819049 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b00adb20 con 0x55d8f59221b0 2024-09-21T02:36:43.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.566+0000 7f94af400640 1 -- 172.21.15.79:0/2474819049 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f94b0094bb0 con 0x55d8f59221b0 2024-09-21T02:36:43.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.567+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94b40173f0 con 0x55d8f59221b0 2024-09-21T02:36:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.570+0000 7f94af400640 1 -- 172.21.15.79:0/2474819049 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f94b00b1f00 con 0x55d8f59221b0 2024-09-21T02:36:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.572+0000 7f94d36c6740 10 client.25420 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.572+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d8f5a06620 con 0x55d8f59221b0 2024-09-21T02:36:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.573+0000 7f94af400640 1 -- 172.21.15.79:0/2474819049 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94b40173f0 con 0x55d8f59221b0 2024-09-21T02:36:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.573+0000 7f94af400640 1 -- 172.21.15.79:0/2474819049 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f94b0020020 con 0x55d8f59221b0 2024-09-21T02:36:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.573+0000 7f94d36c6740 10 client.25420 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.573+0000 7f94d36c6740 10 client.25420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.574+0000 7f94d36c6740 20 client.25420 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.574+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f58b61c0 0x55d8f5ce00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.574+0000 7f94d36c6740 4 client.25420 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.574+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8f5c3e600 con 0x55d8f58b61c0 2024-09-21T02:36:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.575+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f58b61c0 0x55d8f5ce00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.577+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f58b61c0 0x55d8f5ce00b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=868a011c0277fba4 server_cookie=4f4eee3b50baa7a6 in_seq=0 out_seq=0 2024-09-21T02:36:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.578+0000 7f94af400640 10 client.25420 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.578+0000 7f94af400640 1 -- 172.21.15.79:0/2474819049 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8f5c3e600 con 0x55d8f58b61c0 2024-09-21T02:36:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.578+0000 7f94af400640 10 client.25420 handle_command_reply: tid=0 2024-09-21T02:36:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.579+0000 7f94d36c6740 1 client.25420 shutdown 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.579+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f59221b0 msgr2=0x55d8f5cd2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.579+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f59221b0 0x55d8f5cd2f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f94b00e4d90 tx=0x7f94b000fcc0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.579+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 shutdown_connections 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.579+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f58b61c0 0x55d8f5ce00b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.579+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 0x55d8f5cd3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.580+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f59221b0 0x55d8f5cd2f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.580+0000 7f94af400640 0 client.25420 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.580+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2474819049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58f92f0 0x55d8f5cd2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.580+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 >> 172.21.15.79:0/2474819049 conn(0x55d8f5916300 msgr2=0x55d8f5cc30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.580+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 shutdown_connections 2024-09-21T02:36:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.580+0000 7f94d36c6740 1 -- 172.21.15.79:0/2474819049 wait complete. 2024-09-21T02:36:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.580+0000 7f94d36c6740 20 client.25420 trim_cache size 0 max 16384 2024-09-21T02:36:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.611+0000 7f94d36c6740 1 Processor -- start 2024-09-21T02:36:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.611+0000 7f94d36c6740 1 -- start start 2024-09-21T02:36:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58b61c0 0x55d8f5cc38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58e0d80 0x55d8f5cda9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94d36c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4103b10 con 0x55d8f58e0d80 2024-09-21T02:36:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94d36c6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41bbd70 con 0x55d8f58b61c0 2024-09-21T02:36:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94d36c6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41b9b60 con 0x55d8f58f92f0 2024-09-21T02:36:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94c9c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58b61c0 0x55d8f5cc38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94ca600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94ca600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40354/0 (socket says 172.21.15.79:40354) 2024-09-21T02:36:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94ca600640 1 -- 172.21.15.79:0/2946348701 learned_addr learned my addr 172.21.15.79:0/2946348701 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.612+0000 7f94c9c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58b61c0 0x55d8f5cc38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58014/0 (socket says 172.21.15.79:58014) 2024-09-21T02:36:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.613+0000 7f94c9200640 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58e0d80 0x55d8f5cda9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.613+0000 7f94c9c00640 1 -- 172.21.15.79:0/2946348701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 msgr2=0x55d8f5cc3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.613+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.613+0000 7f94c9c00640 1 -- 172.21.15.79:0/2946348701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58e0d80 msgr2=0x55d8f5cda9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.613+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58e0d80 0x55d8f5cda9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.613+0000 7f94c9c00640 1 -- 172.21.15.79:0/2946348701 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f5cd3e30 con 0x55d8f58b61c0 2024-09-21T02:36:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.613+0000 7f94c9200640 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58e0d80 0x55d8f5cda9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:36:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.617+0000 7f94c9c00640 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58b61c0 0x55d8f5cc38c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94b4019040 tx=0x7f94b40096f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f81844d8241539 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.617+0000 7f94ba000640 1 -- 172.21.15.79:0/2946348701 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4003a30 con 0x55d8f58b61c0 2024-09-21T02:36:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.617+0000 7f94ba000640 1 -- 172.21.15.79:0/2946348701 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94b4003bd0 con 0x55d8f58b61c0 2024-09-21T02:36:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.617+0000 7f94ba000640 1 -- 172.21.15.79:0/2946348701 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4004040 con 0x55d8f58b61c0 2024-09-21T02:36:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.619+0000 7f94d36c6740 1 -- 172.21.15.79:0/2946348701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58b61c0 msgr2=0x55d8f5cc38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.619+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58b61c0 0x55d8f5cc38c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94b4019040 tx=0x7f94b40096f0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.619+0000 7f94d36c6740 1 -- 172.21.15.79:0/2946348701 shutdown_connections 2024-09-21T02:36:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.619+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cc3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.619+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58e0d80 0x55d8f5cda9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.619+0000 7f94d36c6740 1 --2- 172.21.15.79:0/2946348701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58b61c0 0x55d8f5cc38c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.619+0000 7f94d36c6740 1 -- 172.21.15.79:0/2946348701 >> 172.21.15.79:0/2946348701 conn(0x55d8f5916300 msgr2=0x55d8f5cd1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.620+0000 7f94d36c6740 1 -- 172.21.15.79:0/2946348701 shutdown_connections 2024-09-21T02:36:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.620+0000 7f94d36c6740 1 -- 172.21.15.79:0/2946348701 wait complete. 2024-09-21T02:36:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.621+0000 7f94d36c6740 1 -- start start 2024-09-21T02:36:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.621+0000 7f94d36c6740 1 Processor -- start 2024-09-21T02:36:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.622+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58b61c0 0x55d8f5cd7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 0x55d8f5cd8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94d36c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cd8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94c9c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58b61c0 0x55d8f5cd7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94c9c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58b61c0 0x55d8f5cd7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33788/0 (socket says 172.21.15.79:33788) 2024-09-21T02:36:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94c9c00640 1 -- 172.21.15.79:0/3211779411 learned_addr learned my addr 172.21.15.79:0/3211779411 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94c9200640 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 0x55d8f5cd8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94ca600640 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cd8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41ba230 con 0x55d8f58b61c0 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41bb6a0 con 0x55d8f58e0d80 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41ba900 con 0x55d8f58f92f0 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.623+0000 7f94d36c6740 10 client.0 _ll_register_callbacks cb 0x7f94b00ad280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.624+0000 7f94c9c00640 1 -- 172.21.15.79:0/3211779411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 msgr2=0x55d8f5cd8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.624+0000 7f94c9c00640 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cd8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.624+0000 7f94c9c00640 1 -- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 msgr2=0x55d8f5cd8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.624+0000 7f94c9c00640 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 0x55d8f5cd8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.624+0000 7f94c9c00640 1 -- 172.21.15.79:0/3211779411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f5cd9670 con 0x55d8f58b61c0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.625+0000 7f94c9c00640 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58b61c0 0x55d8f5cd7dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009bc0 tx=0x7f94b4004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4397f1e04aee552 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.625+0000 7f94af400640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.626+0000 7f94af400640 1 -- 172.21.15.79:0/3211779411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4036060 con 0x55d8f58b61c0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.626+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94b4003bd0 con 0x55d8f58b61c0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.626+0000 7f94af400640 1 -- 172.21.15.79:0/3211779411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f94b400f820 con 0x55d8f58b61c0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.627+0000 7f94af400640 1 -- 172.21.15.79:0/3211779411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f94b400faa0 con 0x55d8f58b61c0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.627+0000 7f94d36c6740 10 client.15402 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.627+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d8f5cda8e0 con 0x55d8f58b61c0 2024-09-21T02:36:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.627+0000 7f94af400640 1 -- 172.21.15.79:0/3211779411 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94b4003bd0 con 0x55d8f58b61c0 2024-09-21T02:36:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.628+0000 7f94af400640 1 -- 172.21.15.79:0/3211779411 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f94b400b030 con 0x55d8f58b61c0 2024-09-21T02:36:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.628+0000 7f94d36c6740 10 client.15402 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.628+0000 7f94d36c6740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.628+0000 7f94d36c6740 20 client.15402 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.629+0000 7f94d36c6740 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f59221b0 0x55d8f5d4cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.629+0000 7f94d36c6740 4 client.15402 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:36:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.629+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8f5c3a0b0 con 0x55d8f59221b0 2024-09-21T02:36:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.629+0000 7f94c9200640 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f59221b0 0x55d8f5d4cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.630+0000 7f94c9200640 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f59221b0 0x55d8f5d4cc20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c5b5502eee987cb server_cookie=5bdcc4be867fbf64 in_seq=0 out_seq=0 2024-09-21T02:36:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.630+0000 7f94af400640 10 client.15402 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.652+0000 7f94af400640 1 -- 172.21.15.79:0/3211779411 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8f5c3a0b0 con 0x55d8f59221b0 2024-09-21T02:36:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.653+0000 7f94af400640 10 client.15402 handle_command_reply: tid=0 2024-09-21T02:36:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.653+0000 7f94d36c6740 1 client.15402 shutdown 2024-09-21T02:36:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.653+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58b61c0 msgr2=0x55d8f5cd7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.653+0000 7f94d36c6740 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58b61c0 0x55d8f5cd7dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009bc0 tx=0x7f94b4004db0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.654+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 shutdown_connections 2024-09-21T02:36:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.654+0000 7f94d36c6740 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d8f59221b0 0x55d8f5d4cc20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.654+0000 7f94d36c6740 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f58f92f0 0x55d8f5cd8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.654+0000 7f94d36c6740 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8f58e0d80 0x55d8f5cd8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.654+0000 7f94d36c6740 1 --2- 172.21.15.79:0/3211779411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d8f58b61c0 0x55d8f5cd7dc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.654+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 >> 172.21.15.79:0/3211779411 conn(0x55d8f5916300 msgr2=0x55d8f5cc3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.654+0000 7f94af400640 0 client.15402 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.655+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 shutdown_connections 2024-09-21T02:36:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.655+0000 7f94d36c6740 1 -- 172.21.15.79:0/3211779411 wait complete. 2024-09-21T02:36:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.655+0000 7f94d36c6740 20 client.15402 trim_cache size 0 max 16384 2024-09-21T02:36:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:36:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:36:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:36:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:36:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.656+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f94a80b64d0 msgr2=0x7f94a80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.656+0000 7f94cc600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f94a80b64d0 0x7f94a80b89e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0303f0 tx=0x7f94bc005f90 comp rx=0 tx=0).stop 2024-09-21T02:36:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.656+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c4104720 msgr2=0x7f94c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.656+0000 7f94cc600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c4104720 0x7f94c4075710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c920 tx=0x7f94b000cde0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.657+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 shutdown_connections 2024-09-21T02:36:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.657+0000 7f94cc600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f94a80b64d0 0x7f94a80b89e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.657+0000 7f94cc600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94c41050c0 0x7f94c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.657+0000 7f94cc600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94c4104720 0x7f94c4075710 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.657+0000 7f94cc600640 1 --2- 172.21.15.79:0/1717025313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94c41036a0 0x7f94c4076e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.657+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 >> 172.21.15.79:0/1717025313 conn(0x7f94c40fefe0 msgr2=0x7f94c4107a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.659+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 shutdown_connections 2024-09-21T02:36:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:43.660+0000 7f94cc600640 1 -- 172.21.15.79:0/1717025313 wait complete. 2024-09-21T02:36:44.101 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:36:44.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:44 smithi148 ceph-mon[34626]: pgmap v445: 129 pgs: 129 active+clean; 1021 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-09-21T02:36:44.833 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:44 smithi079 ceph-mon[30788]: pgmap v445: 129 pgs: 129 active+clean; 1021 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-09-21T02:36:44.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:44 smithi098 ceph-mon[34832]: pgmap v445: 129 pgs: 129 active+clean; 1021 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-09-21T02:36:45.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.271+0000 7fddb3a00640 1 -- 172.21.15.79:0/685174498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac101da0 msgr2=0x7fddac1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:45.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.271+0000 7fddb3a00640 1 --2- 172.21.15.79:0/685174498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac101da0 0x7fddac1021b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdda0008570 tx=0x7fdda002c3e0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.271+0000 7fddb3a00640 1 -- 172.21.15.79:0/685174498 shutdown_connections 2024-09-21T02:36:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.271+0000 7fddb3a00640 1 --2- 172.21.15.79:0/685174498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac108030 0x7fddac10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.271+0000 7fddb3a00640 1 --2- 172.21.15.79:0/685174498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 0x7fddac107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.271+0000 7fddb3a00640 1 --2- 172.21.15.79:0/685174498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac101da0 0x7fddac1021b0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdda0008570 tx=0x7fdda002c3e0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.271+0000 7fddb3a00640 1 -- 172.21.15.79:0/685174498 >> 172.21.15.79:0/685174498 conn(0x7fddac077800 msgr2=0x7fddac077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.272+0000 7fddb3a00640 1 -- 172.21.15.79:0/685174498 shutdown_connections 2024-09-21T02:36:45.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.272+0000 7fddb3a00640 1 -- 172.21.15.79:0/685174498 wait complete. 2024-09-21T02:36:45.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.274+0000 7fddb3a00640 1 Processor -- start 2024-09-21T02:36:45.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.274+0000 7fddb3a00640 1 -- start start 2024-09-21T02:36:45.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.274+0000 7fddb3a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 0x7fddac19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:45.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.275+0000 7fddb3a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac108030 0x7fddac1981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:45.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.275+0000 7fddb3a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac198820 0x7fddac19db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.275+0000 7fddb1000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 0x7fddac19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.275+0000 7fddb1000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 0x7fddac19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53398/0 (socket says 172.21.15.79:53398) 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.275+0000 7fddabe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac108030 0x7fddac1981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.275+0000 7fddabe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac108030 0x7fddac1981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54512/0 (socket says 172.21.15.79:54512) 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.275+0000 7fddb1a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac198820 0x7fddac19db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb3a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fddac111840 con 0x7fddac198820 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb3a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fddac1116c0 con 0x7fddac1076e0 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb3a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fddac1119c0 con 0x7fddac108030 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb1000640 1 -- 172.21.15.79:0/1594797905 learned_addr learned my addr 172.21.15.79:0/1594797905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb1000640 1 -- 172.21.15.79:0/1594797905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac108030 msgr2=0x7fddac1981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb1000640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac108030 0x7fddac1981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb1000640 1 -- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac198820 msgr2=0x7fddac19db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb1000640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac198820 0x7fddac19db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.276+0000 7fddb1000640 1 -- 172.21.15.79:0/1594797905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac19e060 con 0x7fddac1076e0 2024-09-21T02:36:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.277+0000 7fddb1000640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 0x7fddac19ef70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdda0035040 tx=0x7fdda000a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.278+0000 7fdda9600640 1 -- 172.21.15.79:0/1594797905 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0040020 con 0x7fddac1076e0 2024-09-21T02:36:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.278+0000 7fdda9600640 1 -- 172.21.15.79:0/1594797905 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdda000a880 con 0x7fddac1076e0 2024-09-21T02:36:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.278+0000 7fdda9600640 1 -- 172.21.15.79:0/1594797905 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0004ff0 con 0x7fddac1076e0 2024-09-21T02:36:45.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.278+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddac19e2f0 con 0x7fddac1076e0 2024-09-21T02:36:45.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.278+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddac19e7e0 con 0x7fddac1076e0 2024-09-21T02:36:45.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.280+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddac103020 con 0x7fddac1076e0 2024-09-21T02:36:45.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.284+0000 7fdda9600640 1 -- 172.21.15.79:0/1594797905 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdda0043020 con 0x7fddac1076e0 2024-09-21T02:36:45.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.289+0000 7fdda9600640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd940b6660 0x7fdd940b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:45.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.291+0000 7fdda9600640 1 -- 172.21.15.79:0/1594797905 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdda0107640 con 0x7fddac1076e0 2024-09-21T02:36:45.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.292+0000 7fdda9600640 1 -- 172.21.15.79:0/1594797905 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdda0107b40 con 0x7fddac1076e0 2024-09-21T02:36:45.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.292+0000 7fddabe00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd940b6660 0x7fdd940b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:45.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.293+0000 7fddabe00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd940b6660 0x7fdd940b8b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fddac107190 tx=0x7fdd98005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.736+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddac1021b0 con 0x7fddac1076e0 2024-09-21T02:36:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:36:45.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.742+0000 7fdda9600640 1 -- 172.21.15.79:0/1594797905 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fdda00cdba0 con 0x7fddac1076e0 2024-09-21T02:36:45.745 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:36:45.745 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:36:45.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.748+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd940b6660 msgr2=0x7fdd940b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:45.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.748+0000 7fddb3a00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd940b6660 0x7fdd940b8b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fddac107190 tx=0x7fdd98005f90 comp rx=0 tx=0).stop 2024-09-21T02:36:45.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.748+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 msgr2=0x7fddac19ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:45.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.748+0000 7fddb3a00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 0x7fddac19ef70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdda0035040 tx=0x7fdda000a300 comp rx=0 tx=0).stop 2024-09-21T02:36:45.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.749+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 shutdown_connections 2024-09-21T02:36:45.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.749+0000 7fddb3a00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd940b6660 0x7fdd940b8b70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.749+0000 7fddb3a00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac198820 0x7fddac19db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.749+0000 7fddb3a00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddac108030 0x7fddac1981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.749+0000 7fddb3a00640 1 --2- 172.21.15.79:0/1594797905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddac1076e0 0x7fddac19ef70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:45.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.749+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 >> 172.21.15.79:0/1594797905 conn(0x7fddac077800 msgr2=0x7fddac105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:45.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.750+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 shutdown_connections 2024-09-21T02:36:45.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:45.750+0000 7fddb3a00640 1 -- 172.21.15.79:0/1594797905 wait complete. 2024-09-21T02:36:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 50.0 s, 1389.4 tps, lat 71.125 ms stddev 116.259 2024-09-21T02:36:46.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:46 smithi079 ceph-mon[30788]: pgmap v446: 129 pgs: 129 active+clean; 987 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-21T02:36:46.573 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:46 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1594797905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:46 smithi098 ceph-mon[34832]: pgmap v446: 129 pgs: 129 active+clean; 987 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-21T02:36:46.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:46 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1594797905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:47.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:46 smithi148 ceph-mon[34626]: pgmap v446: 129 pgs: 129 active+clean; 987 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-21T02:36:47.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:46 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1594797905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:36:48.864 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:48 smithi148 ceph-mon[34626]: pgmap v447: 129 pgs: 129 active+clean; 977 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 761 op/s 2024-09-21T02:36:48.864 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:48 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:48.897 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:48 smithi079 ceph-mon[30788]: pgmap v447: 129 pgs: 129 active+clean; 977 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 761 op/s 2024-09-21T02:36:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:48 smithi098 ceph-mon[34832]: pgmap v447: 129 pgs: 129 active+clean; 977 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 761 op/s 2024-09-21T02:36:48.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:48 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:49.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:48 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:50.352 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T02:36:50.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T02:36:50.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:50 smithi079 ceph-mon[30788]: pgmap v448: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 13 MiB/s wr, 767 op/s 2024-09-21T02:36:50.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:50 smithi098 ceph-mon[34832]: pgmap v448: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 13 MiB/s wr, 767 op/s 2024-09-21T02:36:51.040 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:36:51.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:50 smithi148 ceph-mon[34626]: pgmap v448: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 13 MiB/s wr, 767 op/s 2024-09-21T02:36:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 55.0 s, 1401.5 tps, lat 71.162 ms stddev 109.918 2024-09-21T02:36:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:51 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:36:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:51 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:36:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.925+0000 7f822c400640 1 -- 172.21.15.79:0/1573605583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224103b80 msgr2=0x7f8224103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.925+0000 7f822c400640 1 --2- 172.21.15.79:0/1573605583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224103b80 0x7f8224103f90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f821c009ca0 tx=0x7f821c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.925+0000 7f822c400640 1 -- 172.21.15.79:0/1573605583 shutdown_connections 2024-09-21T02:36:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.925+0000 7f822c400640 1 --2- 172.21.15.79:0/1573605583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8224109e10 0x7f8224110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.925+0000 7f822c400640 1 --2- 172.21.15.79:0/1573605583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82241094c0 0x7f82241098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.925+0000 7f822c400640 1 --2- 172.21.15.79:0/1573605583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224103b80 0x7f8224103f90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.925+0000 7f822c400640 1 -- 172.21.15.79:0/1573605583 >> 172.21.15.79:0/1573605583 conn(0x7f82240ff5b0 msgr2=0x7f8224101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.926+0000 7f822c400640 1 -- 172.21.15.79:0/1573605583 shutdown_connections 2024-09-21T02:36:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.926+0000 7f822c400640 1 -- 172.21.15.79:0/1573605583 wait complete. 2024-09-21T02:36:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.927+0000 7f822c400640 1 Processor -- start 2024-09-21T02:36:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.927+0000 7f822c400640 1 -- start start 2024-09-21T02:36:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f822c400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8224103b80 0x7f822410eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f822c400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82241094c0 0x7f822410f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f822c400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109e10 0x7f82241ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f822c400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8224111910 con 0x7f82241094c0 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f822c400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8224111790 con 0x7f8224109e10 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f822c400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8224111a90 con 0x7f8224103b80 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f8229a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8224103b80 0x7f822410eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f8229a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8224103b80 0x7f822410eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54524/0 (socket says 172.21.15.79:54524) 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f822a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109e10 0x7f82241ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.928+0000 7f8229a00640 1 -- 172.21.15.79:0/4235146117 learned_addr learned my addr 172.21.15.79:0/4235146117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.929+0000 7f8229a00640 1 -- 172.21.15.79:0/4235146117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109e10 msgr2=0x7f82241ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.929+0000 7f8229a00640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109e10 0x7f82241ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.929+0000 7f8229a00640 1 -- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82241094c0 msgr2=0x7f822410f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.929+0000 7f8229a00640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82241094c0 0x7f822410f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.929+0000 7f8229a00640 1 -- 172.21.15.79:0/4235146117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822410fa90 con 0x7f8224103b80 2024-09-21T02:36:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.929+0000 7f822a400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109e10 0x7f82241ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:36:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.930+0000 7f8229a00640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8224103b80 0x7f822410eca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f821c0097b0 tx=0x7f821c0093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.930+0000 7f8222000640 1 -- 172.21.15.79:0/4235146117 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c003db0 con 0x7f8224103b80 2024-09-21T02:36:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.931+0000 7f8222000640 1 -- 172.21.15.79:0/4235146117 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c0044f0 con 0x7f8224103b80 2024-09-21T02:36:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.931+0000 7f8222000640 1 -- 172.21.15.79:0/4235146117 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c030ca0 con 0x7f8224103b80 2024-09-21T02:36:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.931+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82241ace20 con 0x7f8224103b80 2024-09-21T02:36:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.931+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241ad220 con 0x7f8224103b80 2024-09-21T02:36:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.937+0000 7f8222000640 1 -- 172.21.15.79:0/4235146117 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f821c004040 con 0x7f8224103b80 2024-09-21T02:36:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.937+0000 7f823307e740 1 Processor -- start 2024-09-21T02:36:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.938+0000 7f823307e740 1 -- start start 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.938+0000 7f823307e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9c2840 0x55804fd6a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.938+0000 7f823307e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd6a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.938+0000 7f823307e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.938+0000 7f823307e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55804fcdfca0 con 0x55804f9a1b60 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.938+0000 7f823307e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55804fccf0d0 con 0x55804f999980 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.938+0000 7f823307e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55804fcd2ee0 con 0x55804f9c2840 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.939+0000 7f822a400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9c2840 0x55804fd6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.939+0000 7f8229000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.939+0000 7f822a400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9c2840 0x55804fd6a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54528/0 (socket says 172.21.15.79:54528) 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.939+0000 7f822a400640 1 -- 172.21.15.79:0/574598866 learned_addr learned my addr 172.21.15.79:0/574598866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.939+0000 7f8222000640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82080b6590 0x7f82080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.939+0000 7f8229a00640 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd6a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f8229000640 1 -- 172.21.15.79:0/574598866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9c2840 msgr2=0x55804fd6a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f8229000640 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9c2840 0x55804fd6a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f8229000640 1 -- 172.21.15.79:0/574598866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 msgr2=0x55804fd6a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f8229000640 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd6a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f8229000640 1 -- 172.21.15.79:0/574598866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55804fc81400 con 0x55804f9a1b60 2024-09-21T02:36:51.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f822a400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82080b6590 0x7f82080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f8222000640 1 -- 172.21.15.79:0/4235146117 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f821c108aa0 con 0x7f8224103b80 2024-09-21T02:36:51.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.940+0000 7f8229000640 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd6add0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f822406c6b0 tx=0x7f821000e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9518a46e354677ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:51.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.941+0000 7f821aa00640 1 -- 172.21.15.79:0/574598866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821000ecf0 con 0x55804f9a1b60 2024-09-21T02:36:51.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.941+0000 7f822a400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82080b6590 0x7f82080b8aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8214009fd0 tx=0x7f8214004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:51.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.941+0000 7f821aa00640 1 -- 172.21.15.79:0/574598866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821000ee90 con 0x55804f9a1b60 2024-09-21T02:36:51.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.941+0000 7f821aa00640 1 -- 172.21.15.79:0/574598866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210004a90 con 0x55804f9a1b60 2024-09-21T02:36:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.943+0000 7f823307e740 1 -- 172.21.15.79:0/574598866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 msgr2=0x55804fd6add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.943+0000 7f823307e740 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd6add0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f822406c6b0 tx=0x7f821000e350 comp rx=0 tx=0).stop 2024-09-21T02:36:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.943+0000 7f823307e740 1 -- 172.21.15.79:0/574598866 shutdown_connections 2024-09-21T02:36:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.943+0000 7f823307e740 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd6add0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.943+0000 7f823307e740 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd6a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.943+0000 7f823307e740 1 --2- 172.21.15.79:0/574598866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9c2840 0x55804fd6a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.943+0000 7f823307e740 1 -- 172.21.15.79:0/574598866 >> 172.21.15.79:0/574598866 conn(0x55804f9b6990 msgr2=0x55804fd68240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:51.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.944+0000 7f823307e740 1 -- 172.21.15.79:0/574598866 shutdown_connections 2024-09-21T02:36:51.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.945+0000 7f823307e740 1 -- 172.21.15.79:0/574598866 wait complete. 2024-09-21T02:36:51.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.947+0000 7f823307e740 1 -- start start 2024-09-21T02:36:51.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.947+0000 7f823307e740 1 Processor -- start 2024-09-21T02:36:51.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.949+0000 7f823307e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd75970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.949+0000 7f823307e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd75eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.949+0000 7f823307e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd76410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.949+0000 7f823307e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55804fb307a0 con 0x55804f9a1b60 2024-09-21T02:36:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.949+0000 7f823307e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55804fc74a10 con 0x55804f9c2840 2024-09-21T02:36:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.949+0000 7f823307e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55804fd78b30 con 0x55804f999980 2024-09-21T02:36:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.949+0000 7f823307e740 10 client.0 _ll_register_callbacks cb 0x55804fc84be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.950+0000 7f8229a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd75970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.951+0000 7f822a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd76410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.951+0000 7f822a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd76410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53418/0 (socket says 172.21.15.79:53418) 2024-09-21T02:36:51.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.951+0000 7f822a400640 1 -- 172.21.15.79:0/21506528 learned_addr learned my addr 172.21.15.79:0/21506528 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:51.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.952+0000 7f8229a00640 1 -- 172.21.15.79:0/21506528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 msgr2=0x55804fd76410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:51.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.952+0000 7f8229a00640 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd76410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.952+0000 7f8229a00640 1 -- 172.21.15.79:0/21506528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 msgr2=0x55804fd75eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:36:51.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.956+0000 7f8229000640 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd75eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.956+0000 7f8229a00640 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd75eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.956+0000 7f8229a00640 1 -- 172.21.15.79:0/21506528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55804fa3cb90 con 0x55804f999980 2024-09-21T02:36:51.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.957+0000 7f8229a00640 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd75970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f821c0cba90 tx=0x7f821c0ca090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95fb10efd4401ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:51.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.957+0000 7f820f400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:36:51.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.957+0000 7f820f400640 1 -- 172.21.15.79:0/21506528 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c0cdf90 con 0x55804f999980 2024-09-21T02:36:51.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.958+0000 7f820f400640 1 -- 172.21.15.79:0/21506528 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f821c004b40 con 0x55804f999980 2024-09-21T02:36:51.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.958+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821000ee90 con 0x55804f999980 2024-09-21T02:36:51.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.958+0000 7f820f400640 1 -- 172.21.15.79:0/21506528 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f821c004330 con 0x55804f999980 2024-09-21T02:36:51.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.958+0000 7f823307e740 10 client.25444 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:51.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.959+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55804fd847b0 con 0x55804f999980 2024-09-21T02:36:51.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.960+0000 7f820f400640 1 -- 172.21.15.79:0/21506528 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821000ee90 con 0x55804f999980 2024-09-21T02:36:51.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.960+0000 7f820f400640 1 -- 172.21.15.79:0/21506528 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f821c0ca170 con 0x55804f999980 2024-09-21T02:36:51.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.961+0000 7f823307e740 10 client.25444 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:51.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.961+0000 7f823307e740 10 client.25444 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:36:51.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.961+0000 7f823307e740 20 client.25444 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:51.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.961+0000 7f823307e740 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f9811c0 0x55804fd87ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.961+0000 7f823307e740 4 client.25444 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:51.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.961+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55804fce1bf0 con 0x55804f9811c0 2024-09-21T02:36:51.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.961+0000 7f8229000640 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f9811c0 0x55804fd87ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.962+0000 7f8229000640 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f9811c0 0x55804fd87ca0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae866a843b5f165d server_cookie=d59026a67f781a1 in_seq=0 out_seq=0 2024-09-21T02:36:51.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.962+0000 7f820f400640 10 client.25444 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:51.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.963+0000 7f820f400640 1 -- 172.21.15.79:0/21506528 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55804fce1bf0 con 0x55804f9811c0 2024-09-21T02:36:51.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.963+0000 7f820f400640 10 client.25444 handle_command_reply: tid=0 2024-09-21T02:36:51.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.963+0000 7f823307e740 1 client.25444 shutdown 2024-09-21T02:36:51.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 msgr2=0x55804fd75970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:51.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd75970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f821c0cba90 tx=0x7f821c0ca090 comp rx=0 tx=0).stop 2024-09-21T02:36:51.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 shutdown_connections 2024-09-21T02:36:51.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f9811c0 0x55804fd87ca0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd76410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd75eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 --2- 172.21.15.79:0/21506528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd75970 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f820f400640 0 client.25444 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:51.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.964+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 >> 172.21.15.79:0/21506528 conn(0x55804f9b6990 msgr2=0x55804fd669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:51.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.965+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 shutdown_connections 2024-09-21T02:36:51.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.965+0000 7f823307e740 1 -- 172.21.15.79:0/21506528 wait complete. 2024-09-21T02:36:51.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.966+0000 7f823307e740 20 client.25444 trim_cache size 0 max 16384 2024-09-21T02:36:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 Processor -- start 2024-09-21T02:36:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 -- start start 2024-09-21T02:36:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd77850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9a1b60 0x55804fd6ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9c2840 0x55804fd679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b51e0 con 0x55804f9c2840 2024-09-21T02:36:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b7aa0 con 0x55804f999980 2024-09-21T02:36:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.993+0000 7f823307e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b5890 con 0x55804f9a1b60 2024-09-21T02:36:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd77850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd77850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53430/0 (socket says 172.21.15.79:53430) 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 -- 172.21.15.79:0/3237387144 learned_addr learned my addr 172.21.15.79:0/3237387144 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229000640 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9a1b60 0x55804fd6ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 -- 172.21.15.79:0/3237387144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9a1b60 msgr2=0x55804fd6ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9a1b60 0x55804fd6ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 -- 172.21.15.79:0/3237387144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9c2840 msgr2=0x55804fd679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9c2840 0x55804fd679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 -- 172.21.15.79:0/3237387144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55804fd81d20 con 0x55804f999980 2024-09-21T02:36:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.994+0000 7f8229a00640 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd77850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f821c0ca100 tx=0x7f821c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1208d0b3b9818a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.995+0000 7f821a000640 1 -- 172.21.15.79:0/3237387144 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c10d030 con 0x55804f999980 2024-09-21T02:36:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.995+0000 7f821a000640 1 -- 172.21.15.79:0/3237387144 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c036030 con 0x55804f999980 2024-09-21T02:36:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.995+0000 7f821a000640 1 -- 172.21.15.79:0/3237387144 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c004330 con 0x55804f999980 2024-09-21T02:36:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 -- 172.21.15.79:0/3237387144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 msgr2=0x55804fd77850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd77850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f821c0ca100 tx=0x7f821c0095c0 comp rx=0 tx=0).stop 2024-09-21T02:36:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 -- 172.21.15.79:0/3237387144 shutdown_connections 2024-09-21T02:36:51.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9c2840 0x55804fd679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f9a1b60 0x55804fd6ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 --2- 172.21.15.79:0/3237387144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f999980 0x55804fd77850 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 -- 172.21.15.79:0/3237387144 >> 172.21.15.79:0/3237387144 conn(0x55804f9b6990 msgr2=0x55804fd6b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 -- 172.21.15.79:0/3237387144 shutdown_connections 2024-09-21T02:36:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.996+0000 7f823307e740 1 -- 172.21.15.79:0/3237387144 wait complete. 2024-09-21T02:36:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.997+0000 7f823307e740 1 -- start start 2024-09-21T02:36:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.997+0000 7f823307e740 1 Processor -- start 2024-09-21T02:36:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.998+0000 7f823307e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd79e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.998+0000 7f823307e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd7a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.998+0000 7f823307e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd7a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.998+0000 7f8229000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd7a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f823307e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b5f60 con 0x55804f9a1b60 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd7a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f8229a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd79e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd7a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53442/0 (socket says 172.21.15.79:53442) 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 -- 172.21.15.79:0/3078855733 learned_addr learned my addr 172.21.15.79:0/3078855733 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b73d0 con 0x55804f9c2840 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b6630 con 0x55804f999980 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f823307e740 10 client.0 _ll_register_callbacks cb 0x7f821c0ca7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 -- 172.21.15.79:0/3078855733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 msgr2=0x55804fd79e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd79e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 -- 172.21.15.79:0/3078855733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 msgr2=0x55804fd7a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd7a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f822a400640 1 -- 172.21.15.79:0/3078855733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55804fdf1730 con 0x55804f9c2840 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f8229a00640 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd79e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:51.999+0000 7f8229000640 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.000+0000 7f822a400640 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd7a8b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82140115f0 tx=0x7f8214011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dde9d6becea2249 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.000+0000 7f820f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:36:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.000+0000 7f820f400640 1 -- 172.21.15.79:0/3078855733 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214005020 con 0x55804f9c2840 2024-09-21T02:36:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.000+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c036030 con 0x55804f9c2840 2024-09-21T02:36:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.000+0000 7f820f400640 1 -- 172.21.15.79:0/3078855733 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f82140051c0 con 0x55804f9c2840 2024-09-21T02:36:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.001+0000 7f820f400640 1 -- 172.21.15.79:0/3078855733 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8214046050 con 0x55804f9c2840 2024-09-21T02:36:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.001+0000 7f823307e740 10 client.25454 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.001+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55804fdf29c0 con 0x55804f9c2840 2024-09-21T02:36:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.001+0000 7f820f400640 1 -- 172.21.15.79:0/3078855733 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c036030 con 0x55804f9c2840 2024-09-21T02:36:52.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.001+0000 7f820f400640 1 -- 172.21.15.79:0/3078855733 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f821403c550 con 0x55804f9c2840 2024-09-21T02:36:52.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.003+0000 7f823307e740 10 client.25454 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:52.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.003+0000 7f823307e740 10 client.25454 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:36:52.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.003+0000 7f823307e740 20 client.25454 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.003+0000 7f823307e740 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f956570 0x55804fdf51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.003+0000 7f823307e740 4 client.25454 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T02:36:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.003+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x55804fcdd6a0 con 0x55804f956570 2024-09-21T02:36:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.004+0000 7f8229a00640 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f956570 0x55804fdf51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:52.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.007+0000 7f820f400640 10 client.25454 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:52.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.007+0000 7f8229a00640 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f956570 0x55804fdf51f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a90eab73dffca622 server_cookie=c2a5d9c4a263d873 in_seq=0 out_seq=0 2024-09-21T02:36:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:51 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:36:52.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f820f400640 1 -- 172.21.15.79:0/3078855733 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55804fcdd6a0 con 0x55804f956570 2024-09-21T02:36:52.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f820f400640 10 client.25454 handle_command_reply: tid=0 2024-09-21T02:36:52.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f823307e740 1 client.25454 shutdown 2024-09-21T02:36:52.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 msgr2=0x55804fd7a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:52.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f823307e740 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd7a8b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82140115f0 tx=0x7f8214011440 comp rx=0 tx=0).stop 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 shutdown_connections 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f823307e740 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55804f956570 0x55804fdf51f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.284+0000 7f823307e740 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55804f9c2840 0x55804fd7a8b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.285+0000 7f823307e740 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55804f9a1b60 0x55804fd7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.285+0000 7f823307e740 1 --2- 172.21.15.79:0/3078855733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55804f999980 0x55804fd79e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.285+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 >> 172.21.15.79:0/3078855733 conn(0x55804f9b6990 msgr2=0x55804fd814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.285+0000 7f820f400640 0 client.25454 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.285+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 shutdown_connections 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.285+0000 7f823307e740 1 -- 172.21.15.79:0/3078855733 wait complete. 2024-09-21T02:36:52.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.285+0000 7f823307e740 20 client.25454 trim_cache size 0 max 16384 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 6, 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ddc04b25": { 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 6, 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:36:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 137.0, 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:36:52.290 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:36:52.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82080b6590 msgr2=0x7f82080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:52.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82080b6590 0x7f82080b8aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8214009fd0 tx=0x7f8214004730 comp rx=0 tx=0).stop 2024-09-21T02:36:52.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8224103b80 msgr2=0x7f822410eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8224103b80 0x7f822410eca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f821c0097b0 tx=0x7f821c0093d0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 shutdown_connections 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f82080b6590 0x7f82080b8aa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109e10 0x7f82241ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82241094c0 0x7f822410f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 --2- 172.21.15.79:0/4235146117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8224103b80 0x7f822410eca0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 >> 172.21.15.79:0/4235146117 conn(0x7f82240ff5b0 msgr2=0x7f8224108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 shutdown_connections 2024-09-21T02:36:52.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:36:52.286+0000 7f822c400640 1 -- 172.21.15.79:0/4235146117 wait complete. 2024-09-21T02:36:53.153 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ddc04b25', quiesce took 9.8 seconds. Will release after: 7.199999999999999 2024-09-21T02:36:53.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:53 smithi098 ceph-mon[34832]: pgmap v449: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 914 op/s 2024-09-21T02:36:53.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:53 smithi079 ceph-mon[30788]: pgmap v449: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 914 op/s 2024-09-21T02:36:53.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:53 smithi148 ceph-mon[34626]: pgmap v449: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 914 op/s 2024-09-21T02:36:55.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:55 smithi098 ceph-mon[34832]: pgmap v450: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 14 MiB/s wr, 844 op/s 2024-09-21T02:36:55.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:55 smithi079 ceph-mon[30788]: pgmap v450: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 14 MiB/s wr, 844 op/s 2024-09-21T02:36:55.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:55 smithi148 ceph-mon[34626]: pgmap v450: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 14 MiB/s wr, 844 op/s 2024-09-21T02:36:56.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 60.0 s, 181.2 tps, lat 64.675 ms stddev 93.686 2024-09-21T02:36:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 -- 172.21.15.79:0/243671670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c104560 msgr2=0x7fe14c104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 --2- 172.21.15.79:0/243671670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c104560 0x7fe14c104970 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe138009900 tx=0x7fe13802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 -- 172.21.15.79:0/243671670 shutdown_connections 2024-09-21T02:36:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 --2- 172.21.15.79:0/243671670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c104f00 0x7fe14c10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 --2- 172.21.15.79:0/243671670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c104560 0x7fe14c104970 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 --2- 172.21.15.79:0/243671670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c1034e0 0x7fe14c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 -- 172.21.15.79:0/243671670 >> 172.21.15.79:0/243671670 conn(0x7fe14c0fee20 msgr2=0x7fe14c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 -- 172.21.15.79:0/243671670 shutdown_connections 2024-09-21T02:36:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.879+0000 7fe150a00640 1 -- 172.21.15.79:0/243671670 wait complete. 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.880+0000 7fe150a00640 1 Processor -- start 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe150a00640 1 -- start start 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe150a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c1034e0 0x7fe14c076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe150a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c104560 0x7fe14c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe150a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c104f00 0x7fe14c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe150a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10f180 con 0x7fe14c1034e0 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe150a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10f000 con 0x7fe14c104f00 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe150a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10f300 con 0x7fe14c104560 2024-09-21T02:36:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe14b400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c1034e0 0x7fe14c076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe14b400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c1034e0 0x7fe14c076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33462/0 (socket says 172.21.15.79:33462) 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe14b400640 1 -- 172.21.15.79:0/2451733346 learned_addr learned my addr 172.21.15.79:0/2451733346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe14be00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c104f00 0x7fe14c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.881+0000 7fe14aa00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c104560 0x7fe14c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe14b400640 1 -- 172.21.15.79:0/2451733346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c104560 msgr2=0x7fe14c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe14b400640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c104560 0x7fe14c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe14b400640 1 -- 172.21.15.79:0/2451733346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c104f00 msgr2=0x7fe14c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe14b400640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c104f00 0x7fe14c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe14b400640 1 -- 172.21.15.79:0/2451733346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c076380 con 0x7fe14c1034e0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe14be00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c104f00 0x7fe14c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe14b400640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c1034e0 0x7fe14c076e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00e9f0 tx=0x7fe13c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe143e00640 1 -- 172.21.15.79:0/2451733346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00cd80 con 0x7fe14c1034e0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe143e00640 1 -- 172.21.15.79:0/2451733346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe13c0108e0 con 0x7fe14c1034e0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c1a3e20 con 0x7fe14c1034e0 2024-09-21T02:36:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.882+0000 7fe143e00640 1 -- 172.21.15.79:0/2451733346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c018980 con 0x7fe14c1034e0 2024-09-21T02:36:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.883+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c1a4230 con 0x7fe14c1034e0 2024-09-21T02:36:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.885+0000 7fe159057740 1 Processor -- start 2024-09-21T02:36:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe159057740 1 -- start start 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe159057740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a881002b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe159057740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d302f0 0x564a88100920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe159057740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a88101470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe159057740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a880736b0 con 0x564a87d302f0 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe159057740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564a88062ae0 con 0x564a87d384d0 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe159057740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564a880668f0 con 0x564a87d591b0 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe143e00640 1 -- 172.21.15.79:0/2451733346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe13c010430 con 0x7fe14c1034e0 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe14be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a881002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe14be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a881002b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47144/0 (socket says 172.21.15.79:47144) 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe14aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a88101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe14be00640 1 -- 172.21.15.79:0/1912090180 learned_addr learned my addr 172.21.15.79:0/1912090180 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.886+0000 7fe14b400640 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d302f0 0x564a88100920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe14be00640 1 -- 172.21.15.79:0/1912090180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 msgr2=0x564a88101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe14be00640 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a88101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe14be00640 1 -- 172.21.15.79:0/1912090180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d302f0 msgr2=0x564a88100920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe14be00640 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d302f0 0x564a88100920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe14be00640 1 -- 172.21.15.79:0/1912090180 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8802f780 con 0x564a87d591b0 2024-09-21T02:36:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe14be00640 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a881002b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1440117e0 tx=0x7fe144011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786093dcb796989b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe137e00640 1 -- 172.21.15.79:0/1912090180 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144011310 con 0x564a87d591b0 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe137e00640 1 -- 172.21.15.79:0/1912090180 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe144003e20 con 0x564a87d591b0 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.887+0000 7fe137e00640 1 -- 172.21.15.79:0/1912090180 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1440044f0 con 0x564a87d591b0 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe143e00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe1300b6590 0x7fe1300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe143e00640 1 -- 172.21.15.79:0/2451733346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe13c0e7980 con 0x7fe14c1034e0 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe14b400640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe1300b6590 0x7fe1300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe159057740 1 -- 172.21.15.79:0/1912090180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 msgr2=0x564a881002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe159057740 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a881002b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1440117e0 tx=0x7fe144011ca0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe159057740 1 -- 172.21.15.79:0/1912090180 shutdown_connections 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe159057740 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a88101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe159057740 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d302f0 0x564a88100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe159057740 1 --2- 172.21.15.79:0/1912090180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a881002b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.888+0000 7fe159057740 1 -- 172.21.15.79:0/1912090180 >> 172.21.15.79:0/1912090180 conn(0x564a87d4d300 msgr2=0x564a880fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.889+0000 7fe159057740 1 -- 172.21.15.79:0/1912090180 shutdown_connections 2024-09-21T02:36:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.889+0000 7fe159057740 1 -- 172.21.15.79:0/1912090180 wait complete. 2024-09-21T02:36:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.889+0000 7fe14b400640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe1300b6590 0x7fe1300b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0a9d80 tx=0x7fe13c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.889+0000 7fe159057740 1 -- start start 2024-09-21T02:36:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.889+0000 7fe159057740 1 Processor -- start 2024-09-21T02:36:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe159057740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d302f0 0x564a88109980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe159057740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a8810a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe159057740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a8810abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe159057740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a87f9aab0 con 0x564a87d591b0 2024-09-21T02:36:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe159057740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564a88009570 con 0x564a87d384d0 2024-09-21T02:36:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe159057740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564a88101f90 con 0x564a87d302f0 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe159057740 10 client.0 _ll_register_callbacks cb 0x564a88018100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe14be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d302f0 0x564a88109980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe14be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a8810abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe14aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a8810a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe14aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a8810a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:34166/0 (socket says 172.21.15.79:34166) 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe14be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a8810abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33476/0 (socket says 172.21.15.79:33476) 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.890+0000 7fe14aa00640 1 -- 172.21.15.79:0/1270233279 learned_addr learned my addr 172.21.15.79:0/1270233279 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe14be00640 1 -- 172.21.15.79:0/1270233279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d302f0 msgr2=0x564a88109980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe14be00640 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d302f0 0x564a88109980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe14be00640 1 -- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 msgr2=0x564a8810a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe14be00640 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a8810a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe14be00640 1 -- 172.21.15.79:0/1270233279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a87dc4790 con 0x564a87d591b0 2024-09-21T02:36:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe14aa00640 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a8810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe14be00640 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a8810abb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe144004000 tx=0x7fe144005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d3240db8b66a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe134c00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe134c00640 1 -- 172.21.15.79:0/1270233279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144025040 con 0x564a87d591b0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe134c00640 1 -- 172.21.15.79:0/1270233279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe144004a40 con 0x564a87d591b0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe144003e20 con 0x564a87d591b0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe134c00640 1 -- 172.21.15.79:0/1270233279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe144031050 con 0x564a87d591b0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe159057740 10 client.15429 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.891+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564a87e3d620 con 0x564a87d591b0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe134c00640 1 -- 172.21.15.79:0/1270233279 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe144003e20 con 0x564a87d591b0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe134c00640 1 -- 172.21.15.79:0/1270233279 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe144018020 con 0x564a87d591b0 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe159057740 10 client.15429 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe159057740 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe159057740 20 client.15429 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe159057740 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87d17d80 0x564a88116df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe159057740 4 client.15429 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:36:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a88075600 con 0x564a87d17d80 2024-09-21T02:36:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.892+0000 7fe14aa00640 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87d17d80 0x564a88116df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.893+0000 7fe14aa00640 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87d17d80 0x564a88116df0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abd56bbe61d65e04 server_cookie=7f07311866358520 in_seq=0 out_seq=0 2024-09-21T02:36:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.893+0000 7fe134c00640 10 client.15429 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe134c00640 1 -- 172.21.15.79:0/1270233279 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a88075600 con 0x564a87d17d80 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe134c00640 10 client.15429 handle_command_reply: tid=0 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 client.15429 shutdown 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 msgr2=0x564a8810abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a8810abb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe144004000 tx=0x7fe144005fd0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 shutdown_connections 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87d17d80 0x564a88116df0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a8810abb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d384d0 0x564a8810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe134c00640 0 client.15429 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 --2- 172.21.15.79:0/1270233279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d302f0 0x564a88109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 >> 172.21.15.79:0/1270233279 conn(0x564a87d4d300 msgr2=0x564a88101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 shutdown_connections 2024-09-21T02:36:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.894+0000 7fe159057740 1 -- 172.21.15.79:0/1270233279 wait complete. 2024-09-21T02:36:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.895+0000 7fe159057740 20 client.15429 trim_cache size 0 max 16384 2024-09-21T02:36:56.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.909+0000 7fe159057740 1 Processor -- start 2024-09-21T02:36:56.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe159057740 1 -- start start 2024-09-21T02:36:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe159057740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a880fb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe159057740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d384d0 0x564a880fbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe159057740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a880fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe159057740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c1a8420 con 0x564a87d591b0 2024-09-21T02:36:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe159057740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c1aaca0 con 0x564a87d302f0 2024-09-21T02:36:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe159057740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c1a8a90 con 0x564a87d384d0 2024-09-21T02:36:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe14be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a880fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe14be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a880fc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33492/0 (socket says 172.21.15.79:33492) 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe14be00640 1 -- 172.21.15.79:0/1663940274 learned_addr learned my addr 172.21.15.79:0/1663940274 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe14be00640 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a880fb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.910+0000 7fe14aa00640 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d384d0 0x564a880fbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe14be00640 1 -- 172.21.15.79:0/1663940274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d384d0 msgr2=0x564a880fbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe14be00640 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d384d0 0x564a880fbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe14be00640 1 -- 172.21.15.79:0/1663940274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 msgr2=0x564a880fb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe14be00640 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a880fb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe14be00640 1 -- 172.21.15.79:0/1663940274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a88109710 con 0x564a87d591b0 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe14be00640 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a880fc8e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe144011560 tx=0x7fe144011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f858625d060229 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe137400640 1 -- 172.21.15.79:0/1663940274 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14400f790 con 0x564a87d591b0 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe137400640 1 -- 172.21.15.79:0/1663940274 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe14401abf0 con 0x564a87d591b0 2024-09-21T02:36:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.911+0000 7fe137400640 1 -- 172.21.15.79:0/1663940274 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144003e00 con 0x564a87d591b0 2024-09-21T02:36:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 -- 172.21.15.79:0/1663940274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 msgr2=0x564a880fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a880fc8e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe144011560 tx=0x7fe144011ca0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 -- 172.21.15.79:0/1663940274 shutdown_connections 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d591b0 0x564a880fc8e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d384d0 0x564a880fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 --2- 172.21.15.79:0/1663940274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a880fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 -- 172.21.15.79:0/1663940274 >> 172.21.15.79:0/1663940274 conn(0x564a87d4d300 msgr2=0x564a880ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 -- 172.21.15.79:0/1663940274 shutdown_connections 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 -- 172.21.15.79:0/1663940274 wait complete. 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.912+0000 7fe159057740 1 -- start start 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 1 Processor -- start 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a88111400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d384d0 0x564a8810d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a8810d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c1a9160 con 0x564a87d384d0 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c1aa5d0 con 0x564a87d302f0 2024-09-21T02:36:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c1a9830 con 0x564a87d591b0 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe159057740 10 client.0 _ll_register_callbacks cb 0x7fe1440093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe14aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d384d0 0x564a8810d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe14aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d384d0 0x564a8810d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33494/0 (socket says 172.21.15.79:33494) 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe14aa00640 1 -- 172.21.15.79:0/576507538 learned_addr learned my addr 172.21.15.79:0/576507538 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe14be00640 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a88111400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.913+0000 7fe14be00640 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a8810d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe14aa00640 1 -- 172.21.15.79:0/576507538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 msgr2=0x564a8810d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe14aa00640 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a8810d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe14aa00640 1 -- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 msgr2=0x564a88111400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe14aa00640 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a88111400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe14aa00640 1 -- 172.21.15.79:0/576507538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8810e4e0 con 0x564a87d384d0 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe14aa00640 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d384d0 0x564a8810d210 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe13802a910 tx=0x7fe138004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd080410fe860bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe134c00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe134c00640 1 -- 172.21.15.79:0/576507538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138059060 con 0x564a87d384d0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe134c00640 1 -- 172.21.15.79:0/576507538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe1380035f0 con 0x564a87d384d0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14401abf0 con 0x564a87d384d0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.914+0000 7fe134c00640 1 -- 172.21.15.79:0/576507538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe138060050 con 0x564a87d384d0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 10 client.15435 fetch_fsmap learned FSMap version 21 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564a88181c60 con 0x564a87d384d0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe134c00640 1 -- 172.21.15.79:0/576507538 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe14401abf0 con 0x564a87d384d0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe134c00640 1 -- 172.21.15.79:0/576507538 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe1380318d0 con 0x564a87d384d0 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 10 client.15435 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 10 client.15435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 20 client.15435 populate_metadata read hostname 'smithi079' 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87ced1c0 0x564a88184680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 4 client.15435 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:36:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a880710b0 con 0x564a87ced1c0 2024-09-21T02:36:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.915+0000 7fe14be00640 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87ced1c0 0x564a88184680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.916+0000 7fe14be00640 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87ced1c0 0x564a88184680 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f42651362ea5e82e server_cookie=1c5f70888a2cbfb6 in_seq=0 out_seq=0 2024-09-21T02:36:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.916+0000 7fe134c00640 10 client.15435 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.940+0000 7fe134c00640 1 -- 172.21.15.79:0/576507538 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a880710b0 con 0x564a87ced1c0 2024-09-21T02:36:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.940+0000 7fe134c00640 10 client.15435 handle_command_reply: tid=0 2024-09-21T02:36:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.940+0000 7fe159057740 1 client.15435 shutdown 2024-09-21T02:36:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d384d0 msgr2=0x564a8810d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d384d0 0x564a8810d210 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe13802a910 tx=0x7fe138004130 comp rx=0 tx=0).stop 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 shutdown_connections 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a87ced1c0 0x564a88184680 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a87d591b0 0x564a8810d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a87d384d0 0x564a8810d210 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe134c00640 0 client.15435 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 --2- 172.21.15.79:0/576507538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a87d302f0 0x564a88111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 >> 172.21.15.79:0/576507538 conn(0x564a87d4d300 msgr2=0x564a880fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 shutdown_connections 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 1 -- 172.21.15.79:0/576507538 wait complete. 2024-09-21T02:36:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.941+0000 7fe159057740 20 client.15435 trim_cache size 0 max 16384 2024-09-21T02:36:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:36:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:36:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:36:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:36:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe1300b6590 msgr2=0x7fe1300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe1300b6590 0x7fe1300b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0a9d80 tx=0x7fe13c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c1034e0 msgr2=0x7fe14c076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c1034e0 0x7fe14c076e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00e9f0 tx=0x7fe13c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 shutdown_connections 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe1300b6590 0x7fe1300b8aa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c104f00 0x7fe14c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe14c104560 0x7fe14c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 --2- 172.21.15.79:0/2451733346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe14c1034e0 0x7fe14c076e50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 >> 172.21.15.79:0/2451733346 conn(0x7fe14c0fee20 msgr2=0x7fe14c107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 shutdown_connections 2024-09-21T02:36:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:36:56.942+0000 7fe150a00640 1 -- 172.21.15.79:0/2451733346 wait complete. 2024-09-21T02:36:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:57 smithi098 ceph-mon[34832]: pgmap v451: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 14 MiB/s wr, 833 op/s 2024-09-21T02:36:57.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:57 smithi079 ceph-mon[30788]: pgmap v451: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 14 MiB/s wr, 833 op/s 2024-09-21T02:36:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:57 smithi148 ceph-mon[34626]: pgmap v451: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 14 MiB/s wr, 833 op/s 2024-09-21T02:36:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:36:59 smithi098 ceph-mon[34832]: pgmap v452: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 13 MiB/s wr, 718 op/s 2024-09-21T02:36:59.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:36:59 smithi079 ceph-mon[30788]: pgmap v452: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 13 MiB/s wr, 718 op/s 2024-09-21T02:36:59.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:36:59 smithi148 ceph-mon[34626]: pgmap v452: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 13 MiB/s wr, 718 op/s 2024-09-21T02:37:00.354 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:37:00.732 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:37:01.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 -- 172.21.15.79:0/1939480734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47881092f0 msgr2=0x7f4788109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 --2- 172.21.15.79:0/1939480734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47881092f0 0x7f4788109700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4778009900 tx=0x7f477802a410 comp rx=0 tx=0).stop 2024-09-21T02:37:01.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 -- 172.21.15.79:0/1939480734 shutdown_connections 2024-09-21T02:37:01.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 --2- 172.21.15.79:0/1939480734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4788109c40 0x7f4788110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 --2- 172.21.15.79:0/1939480734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47881092f0 0x7f4788109700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 --2- 172.21.15.79:0/1939480734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47881039b0 0x7f4788103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 -- 172.21.15.79:0/1939480734 >> 172.21.15.79:0/1939480734 conn(0x7f47880ff440 msgr2=0x7f4788101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:01.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 -- 172.21.15.79:0/1939480734 shutdown_connections 2024-09-21T02:37:01.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.352+0000 7f478ec00640 1 -- 172.21.15.79:0/1939480734 wait complete. 2024-09-21T02:37:01.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.353+0000 7f478ec00640 1 Processor -- start 2024-09-21T02:37:01.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.353+0000 7f478ec00640 1 -- start start 2024-09-21T02:37:01.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478ec00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47881039b0 0x7f478819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478ec00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47881092f0 0x7f478819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478ec00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4788109c40 0x7f47881a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478ec00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4788113950 con 0x7f4788109c40 2024-09-21T02:37:01.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478ec00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f47881137d0 con 0x7f47881092f0 2024-09-21T02:37:01.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478ec00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4788113ad0 con 0x7f47881039b0 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47881039b0 0x7f478819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47881039b0 0x7f478819c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47182/0 (socket says 172.21.15.79:47182) 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478e200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4788109c40 0x7f47881a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478d800640 1 -- 172.21.15.79:0/2848969971 learned_addr learned my addr 172.21.15.79:0/2848969971 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.354+0000 7f478ce00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47881092f0 0x7f478819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f478d800640 1 -- 172.21.15.79:0/2848969971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47881092f0 msgr2=0x7f478819cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f478d800640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47881092f0 0x7f478819cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f478d800640 1 -- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4788109c40 msgr2=0x7f47881a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f478d800640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4788109c40 0x7f47881a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f478d800640 1 -- 172.21.15.79:0/2848969971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47881a24f0 con 0x7f47881039b0 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f478ce00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47881092f0 0x7f478819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f478d800640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47881039b0 0x7f478819c580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f477c00e9f0 tx=0x7f477c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:01.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.355+0000 7f4786000640 1 -- 172.21.15.79:0/2848969971 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c00cd80 con 0x7f47881039b0 2024-09-21T02:37:01.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.356+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47881a27e0 con 0x7f47881039b0 2024-09-21T02:37:01.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.356+0000 7f4786000640 1 -- 172.21.15.79:0/2848969971 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f477c0108e0 con 0x7f47881039b0 2024-09-21T02:37:01.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.356+0000 7f4786000640 1 -- 172.21.15.79:0/2848969971 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c018980 con 0x7f47881039b0 2024-09-21T02:37:01.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.356+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47881a8f40 con 0x7f47881039b0 2024-09-21T02:37:01.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.357+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4788103dc0 con 0x7f47881039b0 2024-09-21T02:37:01.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.359+0000 7f4786000640 1 -- 172.21.15.79:0/2848969971 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f477c010430 con 0x7f47881039b0 2024-09-21T02:37:01.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.360+0000 7f4786000640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f47700b6590 0x7f47700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.361+0000 7f4786000640 1 -- 172.21.15.79:0/2848969971 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f477c0e7e50 con 0x7f47881039b0 2024-09-21T02:37:01.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.361+0000 7f478ce00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f47700b6590 0x7f47700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.361+0000 7f478ce00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f47700b6590 0x7f47700b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f477802aa00 tx=0x7f4778005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:01.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.362+0000 7f4786000640 1 -- 172.21.15.79:0/2848969971 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f477c0b26b0 con 0x7f47881039b0 2024-09-21T02:37:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:01 smithi098 ceph-mon[34832]: pgmap v453: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 11 MiB/s wr, 588 op/s 2024-09-21T02:37:01.456 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:01 smithi079 ceph-mon[30788]: pgmap v453: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 11 MiB/s wr, 588 op/s 2024-09-21T02:37:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 65.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:37:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:01 smithi148 ceph-mon[34626]: pgmap v453: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 11 MiB/s wr, 588 op/s 2024-09-21T02:37:01.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.597+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47881a9220 con 0x7f47881039b0 2024-09-21T02:37:01.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.598+0000 7f4786000640 1 -- 172.21.15.79:0/2848969971 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f477c0b75f0 con 0x7f47881039b0 2024-09-21T02:37:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:37:01.600 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:37:01.600 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.601+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f47700b6590 msgr2=0x7f47700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.601+0000 7f478ec00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f47700b6590 0x7f47700b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f477802aa00 tx=0x7f4778005a20 comp rx=0 tx=0).stop 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.601+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47881039b0 msgr2=0x7f478819c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.601+0000 7f478ec00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47881039b0 0x7f478819c580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f477c00e9f0 tx=0x7f477c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 shutdown_connections 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f47700b6590 0x7f47700b8aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4788109c40 0x7f47881a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47881092f0 0x7f478819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 --2- 172.21.15.79:0/2848969971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47881039b0 0x7f478819c580 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 >> 172.21.15.79:0/2848969971 conn(0x7f47880ff440 msgr2=0x7f478810e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:01.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 shutdown_connections 2024-09-21T02:37:01.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:01.602+0000 7f478ec00640 1 -- 172.21.15.79:0/2848969971 wait complete. 2024-09-21T02:37:02.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:02 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2848969971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:37:02.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:02 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2848969971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:37:02.554 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id ddc04b25 --release --await' 2024-09-21T02:37:02.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id ddc04b25 --release --await 2024-09-21T02:37:02.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:02 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2848969971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:37:02.924 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:37:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:03 smithi098 ceph-mon[34832]: pgmap v454: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.4 MiB/s wr, 492 op/s 2024-09-21T02:37:03.470 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:03 smithi079 ceph-mon[30788]: pgmap v454: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.4 MiB/s wr, 492 op/s 2024-09-21T02:37:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:03 smithi148 ceph-mon[34626]: pgmap v454: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.4 MiB/s wr, 492 op/s 2024-09-21T02:37:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 -- 172.21.15.79:0/985959086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718077940 msgr2=0x7ff718077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 --2- 172.21.15.79:0/985959086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718077940 0x7ff718077d50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff708009900 tx=0x7ff70802a410 comp rx=0 tx=0).stop 2024-09-21T02:37:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 -- 172.21.15.79:0/985959086 shutdown_connections 2024-09-21T02:37:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 --2- 172.21.15.79:0/985959086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff718114740 0x7ff718116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 --2- 172.21.15.79:0/985959086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff718078290 0x7ff718114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 --2- 172.21.15.79:0/985959086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718077940 0x7ff718077d50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 -- 172.21.15.79:0/985959086 >> 172.21.15.79:0/985959086 conn(0x7ff7181017d0 msgr2=0x7ff718103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 -- 172.21.15.79:0/985959086 shutdown_connections 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.652+0000 7ff71d600640 1 -- 172.21.15.79:0/985959086 wait complete. 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.653+0000 7ff71d600640 1 Processor -- start 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff71d600640 1 -- start start 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff71d600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff718077940 0x7ff7181a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff71d600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718078290 0x7ff7181a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff71d600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff718114740 0x7ff7181a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff71d600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff71811a100 con 0x7ff718078290 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff71d600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff718119f80 con 0x7ff718114740 2024-09-21T02:37:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff71d600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff71811a280 con 0x7ff718077940 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff70fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718078290 0x7ff7181a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff70fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718078290 0x7ff7181a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33516/0 (socket says 172.21.15.79:33516) 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff70fe00640 1 -- 172.21.15.79:0/1423613461 learned_addr learned my addr 172.21.15.79:0/1423613461 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff716a00640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff718077940 0x7ff7181a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.654+0000 7ff717400640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff718114740 0x7ff7181a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70fe00640 1 -- 172.21.15.79:0/1423613461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff718077940 msgr2=0x7ff7181a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70fe00640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff718077940 0x7ff7181a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70fe00640 1 -- 172.21.15.79:0/1423613461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff718114740 msgr2=0x7ff7181a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70fe00640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff718114740 0x7ff7181a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70fe00640 1 -- 172.21.15.79:0/1423613461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7181a6a60 con 0x7ff718078290 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70fe00640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718078290 0x7ff7181a1090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff70000e9f0 tx=0x7ff70000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70f400640 1 -- 172.21.15.79:0/1423613461 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70000ccc0 con 0x7ff718078290 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70f400640 1 -- 172.21.15.79:0/1423613461 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7000108e0 con 0x7ff718078290 2024-09-21T02:37:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7181a6d50 con 0x7ff718078290 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.655+0000 7ff70f400640 1 -- 172.21.15.79:0/1423613461 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700018860 con 0x7ff718078290 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.656+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7181ad4b0 con 0x7ff718078290 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 Processor -- start 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 -- start start 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff70f400640 1 -- 172.21.15.79:0/1423613461 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff700010430 con 0x7ff718078290 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9d41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55851c94b290 con 0x55851c60c840 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55851c93a6c0 con 0x55851c62d520 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.659+0000 7ff724235740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55851c93e4d0 con 0x55851c604660 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9d4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47210/0 (socket says 172.21.15.79:47210) 2024-09-21T02:37:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 -- 172.21.15.79:0/891750728 learned_addr learned my addr 172.21.15.79:0/891750728 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff717400640 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9d41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff70fe00640 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 -- 172.21.15.79:0/891750728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 msgr2=0x55851c9d41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9d41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 -- 172.21.15.79:0/891750728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 msgr2=0x55851c9d4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9d4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 -- 172.21.15.79:0/891750728 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851c8c7460 con 0x55851c604660 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff717400640 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9d41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff70fe00640 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.660+0000 7ff716a00640 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9d4700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff708009230 tx=0x7ff708004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df5e44d3ce869c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.661+0000 7ff707400640 1 -- 172.21.15.79:0/891750728 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708035040 con 0x55851c604660 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.661+0000 7ff707400640 1 -- 172.21.15.79:0/891750728 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7080054f0 con 0x55851c604660 2024-09-21T02:37:03.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.661+0000 7ff707400640 1 -- 172.21.15.79:0/891750728 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7080035f0 con 0x55851c604660 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.661+0000 7ff70f400640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6fc0b6590 0x7ff6fc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 -- 172.21.15.79:0/891750728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 msgr2=0x55851c9d4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9d4700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff708009230 tx=0x7ff708004040 comp rx=0 tx=0).stop 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff70f400640 1 -- 172.21.15.79:0/1423613461 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff7000e78e0 con 0x7ff718078290 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 -- 172.21.15.79:0/891750728 shutdown_connections 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff717400640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6fc0b6590 0x7ff6fc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9d4700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 --2- 172.21.15.79:0/891750728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9d41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 -- 172.21.15.79:0/891750728 >> 172.21.15.79:0/891750728 conn(0x55851c621910 msgr2=0x55851c9d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 -- 172.21.15.79:0/891750728 shutdown_connections 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff724235740 1 -- 172.21.15.79:0/891750728 wait complete. 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.662+0000 7ff717400640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6fc0b6590 0x7ff6fc0b8aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff710005fd0 tx=0x7ff710009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.663+0000 7ff724235740 1 -- start start 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.663+0000 7ff724235740 1 Processor -- start 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff724235740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff724235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff724235740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9ebc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff724235740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55851c79bbb0 con 0x55851c60c840 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff724235740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55851c8d56c0 con 0x55851c62d520 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff724235740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55851c9e2940 con 0x55851c604660 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff724235740 10 client.0 _ll_register_callbacks cb 0x55851c8f0490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9e02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33530/0 (socket says 172.21.15.79:33530) 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 -- 172.21.15.79:0/3895568864 learned_addr learned my addr 172.21.15.79:0/3895568864 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff717400640 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9ebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff716a00640 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 -- 172.21.15.79:0/3895568864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 msgr2=0x55851c9dfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9dfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 -- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 msgr2=0x55851c9ebc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9ebc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.664+0000 7ff70fe00640 1 -- 172.21.15.79:0/3895568864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851c698b00 con 0x55851c60c840 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff70fe00640 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9e02c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff7000e4fd0 tx=0x7ff70000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ef208908c9530e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff6fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff6fbe00640 1 -- 172.21.15.79:0/3895568864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700010720 con 0x55851c60c840 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff6fbe00640 1 -- 172.21.15.79:0/3895568864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff7000a9060 con 0x55851c60c840 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7080054f0 con 0x55851c60c840 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff6fbe00640 1 -- 172.21.15.79:0/3895568864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff7000ad220 con 0x55851c60c840 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff724235740 10 client.15453 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55851c70f960 con 0x55851c60c840 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff6fbe00640 1 -- 172.21.15.79:0/3895568864 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7080054f0 con 0x55851c60c840 2024-09-21T02:37:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.665+0000 7ff6fbe00640 1 -- 172.21.15.79:0/3895568864 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff7000b32d0 con 0x55851c60c840 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.666+0000 7ff724235740 10 client.15453 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.666+0000 7ff724235740 10 client.15453 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.666+0000 7ff724235740 20 client.15453 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.666+0000 7ff724235740 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5ebea0 0x55851c9f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.666+0000 7ff724235740 4 client.15453 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.666+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55851c94d1e0 con 0x55851c5ebea0 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.666+0000 7ff716a00640 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5ebea0 0x55851c9f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.667+0000 7ff716a00640 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5ebea0 0x55851c9f1e60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9ed51ad4f68829f server_cookie=1f3fcd902ea2befa in_seq=0 out_seq=0 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.667+0000 7ff6fbe00640 10 client.15453 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.667+0000 7ff6fbe00640 1 -- 172.21.15.79:0/3895568864 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55851c94d1e0 con 0x55851c5ebea0 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.667+0000 7ff6fbe00640 10 client.15453 handle_command_reply: tid=0 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.667+0000 7ff724235740 1 client.15453 shutdown 2024-09-21T02:37:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 msgr2=0x55851c9e02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9e02c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff7000e4fd0 tx=0x7ff70000cef0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 shutdown_connections 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5ebea0 0x55851c9f1e60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c62d520 0x55851c9ebc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c60c840 0x55851c9e02c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 --2- 172.21.15.79:0/3895568864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c604660 0x55851c9dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 >> 172.21.15.79:0/3895568864 conn(0x55851c621910 msgr2=0x55851c9d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff6fbe00640 0 client.15453 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 shutdown_connections 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 1 -- 172.21.15.79:0/3895568864 wait complete. 2024-09-21T02:37:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.668+0000 7ff724235740 20 client.15453 trim_cache size 0 max 16384 2024-09-21T02:37:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 Processor -- start 2024-09-21T02:37:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 -- start start 2024-09-21T02:37:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9dcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181b5170 con 0x55851c604660 2024-09-21T02:37:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181b79f0 con 0x55851c60c840 2024-09-21T02:37:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff724235740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181b57e0 con 0x55851c62d520 2024-09-21T02:37:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff716a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff716a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33548/0 (socket says 172.21.15.79:33548) 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff716a00640 1 -- 172.21.15.79:0/1129521472 learned_addr learned my addr 172.21.15.79:0/1129521472 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.686+0000 7ff70fe00640 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9dcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff717400640 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff70fe00640 1 -- 172.21.15.79:0/1129521472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 msgr2=0x55851c9dd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff70fe00640 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9dd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff70fe00640 1 -- 172.21.15.79:0/1129521472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 msgr2=0x55851c9e17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff70fe00640 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff70fe00640 1 -- 172.21.15.79:0/1129521472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851c9e0e40 con 0x55851c60c840 2024-09-21T02:37:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff70fe00640 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9dcd70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff70000c6a0 tx=0x7ff70000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42b5e68a5dc7fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff706a00640 1 -- 172.21.15.79:0/1129521472 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700098070 con 0x55851c60c840 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff706a00640 1 -- 172.21.15.79:0/1129521472 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7000eae50 con 0x55851c60c840 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.687+0000 7ff706a00640 1 -- 172.21.15.79:0/1129521472 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b32d0 con 0x55851c60c840 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 -- 172.21.15.79:0/1129521472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 msgr2=0x55851c9dcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9dcd70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff70000c6a0 tx=0x7ff70000ce60 comp rx=0 tx=0).stop 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 -- 172.21.15.79:0/1129521472 shutdown_connections 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9dcd70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 --2- 172.21.15.79:0/1129521472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 -- 172.21.15.79:0/1129521472 >> 172.21.15.79:0/1129521472 conn(0x55851c621910 msgr2=0x55851c9e10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 -- 172.21.15.79:0/1129521472 shutdown_connections 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.688+0000 7ff724235740 1 -- 172.21.15.79:0/1129521472 wait complete. 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.689+0000 7ff724235740 1 -- start start 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.689+0000 7ff724235740 1 Processor -- start 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.689+0000 7ff724235740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.689+0000 7ff724235740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.689+0000 7ff724235740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9e4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff724235740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181b5eb0 con 0x55851c604660 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff724235740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181b7320 con 0x55851c60c840 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff724235740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181b6580 con 0x55851c62d520 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff724235740 10 client.0 _ll_register_callbacks cb 0x7ff700011d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff716a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff70fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff716a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33562/0 (socket says 172.21.15.79:33562) 2024-09-21T02:37:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff716a00640 1 -- 172.21.15.79:0/522131168 learned_addr learned my addr 172.21.15.79:0/522131168 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff717400640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9e4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff70fe00640 1 -- 172.21.15.79:0/522131168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 msgr2=0x55851c9e4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff70fe00640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9e4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff70fe00640 1 -- 172.21.15.79:0/522131168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 msgr2=0x55851c9e83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:03.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff70fe00640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff70fe00640 1 -- 172.21.15.79:0/522131168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851c9e5580 con 0x55851c60c840 2024-09-21T02:37:03.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff717400640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9e4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff716a00640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff70fe00640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9e48d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55851c9f2590 tx=0x7ff7000b67d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d5269a1060a8ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.690+0000 7ff6fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff6fbe00640 1 -- 172.21.15.79:0/522131168 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700098040 con 0x55851c60c840 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff6fbe00640 1 -- 172.21.15.79:0/522131168 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff7000a9260 con 0x55851c60c840 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7000eae50 con 0x55851c60c840 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff6fbe00640 1 -- 172.21.15.79:0/522131168 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff7000b7080 con 0x55851c60c840 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff724235740 10 client.25496 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55851c9e5580 con 0x55851c60c840 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff6fbe00640 1 -- 172.21.15.79:0/522131168 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7000eae50 con 0x55851c60c840 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.691+0000 7ff6fbe00640 1 -- 172.21.15.79:0/522131168 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff7000cf270 con 0x55851c60c840 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff724235740 10 client.25496 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff724235740 10 client.25496 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:37:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff724235740 20 client.25496 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff724235740 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5c1250 0x55851ca5f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff724235740 4 client.25496 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ddc04b25", "release": true, "await": true}] 2024-09-21T02:37:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ddc04b25", "release": true, "await": true}) -- 0x55851c948c90 con 0x55851c5c1250 2024-09-21T02:37:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff716a00640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5c1250 0x55851ca5f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff716a00640 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5c1250 0x55851ca5f9f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3d258dd3e6e071 server_cookie=5765d80260fce41 in_seq=0 out_seq=0 2024-09-21T02:37:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.692+0000 7ff6fbe00640 10 client.25496 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.740+0000 7ff6fbe00640 1 -- 172.21.15.79:0/522131168 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55851c948c90 con 0x55851c5c1250 2024-09-21T02:37:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.741+0000 7ff6fbe00640 10 client.25496 handle_command_reply: tid=0 2024-09-21T02:37:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.741+0000 7ff724235740 1 client.25496 shutdown 2024-09-21T02:37:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.742+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 msgr2=0x55851c9e48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.742+0000 7ff724235740 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9e48d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55851c9f2590 tx=0x7ff7000b67d0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.742+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 shutdown_connections 2024-09-21T02:37:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.742+0000 7ff724235740 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55851c5c1250 0x55851ca5f9f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.743+0000 7ff724235740 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55851c62d520 0x55851c9e4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.743+0000 7ff724235740 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55851c60c840 0x55851c9e48d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.743+0000 7ff724235740 1 --2- 172.21.15.79:0/522131168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55851c604660 0x55851c9e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.743+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 >> 172.21.15.79:0/522131168 conn(0x55851c621910 msgr2=0x55851c9d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:03.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.743+0000 7ff6fbe00640 0 client.25496 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:03.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.743+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 shutdown_connections 2024-09-21T02:37:03.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.743+0000 7ff724235740 1 -- 172.21.15.79:0/522131168 wait complete. 2024-09-21T02:37:03.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.746+0000 7ff724235740 20 client.25496 trim_cache size 0 max 16384 2024-09-21T02:37:03.752 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:37:03.752 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 8, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "ddc04b25": { 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 8, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 137.0, 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:37:03.753 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:03.754 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.752+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6fc0b6590 msgr2=0x7ff6fc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.752+0000 7ff71d600640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6fc0b6590 0x7ff6fc0b8aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff710005fd0 tx=0x7ff710009500 comp rx=0 tx=0).stop 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.752+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718078290 msgr2=0x7ff7181a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.752+0000 7ff71d600640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718078290 0x7ff7181a1090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff70000e9f0 tx=0x7ff70000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 shutdown_connections 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff6fc0b6590 0x7ff6fc0b8aa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff718114740 0x7ff7181a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff718078290 0x7ff7181a1090 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 --2- 172.21.15.79:0/1423613461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff718077940 0x7ff7181a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:03.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 >> 172.21.15.79:0/1423613461 conn(0x7ff7181017d0 msgr2=0x7ff718116800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:03.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 shutdown_connections 2024-09-21T02:37:03.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:03.753+0000 7ff71d600640 1 -- 172.21.15.79:0/1423613461 wait complete. 2024-09-21T02:37:04.737 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ddc04b25', total seconds elapsed: 21.4 2024-09-21T02:37:05.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:05 smithi098 ceph-mon[34832]: pgmap v455: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.5 MiB/s wr, 252 op/s 2024-09-21T02:37:05.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:05 smithi079 ceph-mon[30788]: pgmap v455: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.5 MiB/s wr, 252 op/s 2024-09-21T02:37:05.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:05 smithi148 ceph-mon[34626]: pgmap v455: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.5 MiB/s wr, 252 op/s 2024-09-21T02:37:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 70.0 s, 1248.1 tps, lat 232.783 ms stddev 1491.432 2024-09-21T02:37:07.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:07 smithi098 ceph-mon[34832]: pgmap v456: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-09-21T02:37:07.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:07 smithi079 ceph-mon[30788]: pgmap v456: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-09-21T02:37:07.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:07 smithi148 ceph-mon[34626]: pgmap v456: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-09-21T02:37:09.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:09 smithi098 ceph-mon[34832]: pgmap v457: 129 pgs: 129 active+clean; 967 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 MiB/s wr, 102 op/s 2024-09-21T02:37:09.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:09 smithi079 ceph-mon[30788]: pgmap v457: 129 pgs: 129 active+clean; 967 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 MiB/s wr, 102 op/s 2024-09-21T02:37:09.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:09 smithi148 ceph-mon[34626]: pgmap v457: 129 pgs: 129 active+clean; 967 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 MiB/s wr, 102 op/s 2024-09-21T02:37:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.264+0000 7ffb66800640 1 -- 172.21.15.79:0/710557616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 msgr2=0x7ffb60103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.264+0000 7ffb66800640 1 --2- 172.21.15.79:0/710557616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb60103950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009ca0 tx=0x7ffb5802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.265+0000 7ffb66800640 1 -- 172.21.15.79:0/710557616 shutdown_connections 2024-09-21T02:37:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.265+0000 7ffb66800640 1 --2- 172.21.15.79:0/710557616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60104f00 0x7ffb6010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.265+0000 7ffb66800640 1 --2- 172.21.15.79:0/710557616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb60104560 0x7ffb60104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.265+0000 7ffb66800640 1 --2- 172.21.15.79:0/710557616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb60103950 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.265+0000 7ffb66800640 1 -- 172.21.15.79:0/710557616 >> 172.21.15.79:0/710557616 conn(0x7ffb600fee20 msgr2=0x7ffb601012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.265+0000 7ffb66800640 1 -- 172.21.15.79:0/710557616 shutdown_connections 2024-09-21T02:37:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.265+0000 7ffb66800640 1 -- 172.21.15.79:0/710557616 wait complete. 2024-09-21T02:37:10.268 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.267+0000 7ffb66800640 1 Processor -- start 2024-09-21T02:37:10.269 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.268+0000 7ffb66800640 1 -- start start 2024-09-21T02:37:10.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.268+0000 7ffb66800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb6019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.269+0000 7ffb65400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb6019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.269+0000 7ffb65400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb6019c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:43096/0 (socket says 172.21.15.79:43096) 2024-09-21T02:37:10.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb66800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60104560 0x7ffb6019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb65400640 1 -- 172.21.15.79:0/2218270071 learned_addr learned my addr 172.21.15.79:0/2218270071 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:10.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb66800640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb60104f00 0x7ffb6019d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60075980 con 0x7ffb60104f00 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60075800 con 0x7ffb60104560 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60075b00 con 0x7ffb601034e0 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb65400640 1 -- 172.21.15.79:0/2218270071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60104560 msgr2=0x7ffb6019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb65400640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60104560 0x7ffb6019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb65400640 1 -- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb60104f00 msgr2=0x7ffb6019d220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.271+0000 7ffb65e00640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb60104f00 0x7ffb6019d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.272+0000 7ffb65400640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb60104f00 0x7ffb6019d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.272+0000 7ffb65400640 1 -- 172.21.15.79:0/2218270071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6019da40 con 0x7ffb601034e0 2024-09-21T02:37:10.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.272+0000 7ffb65400640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb6019c000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb5802ade0 tx=0x7ffb58003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.273+0000 7ffb5e000640 1 -- 172.21.15.79:0/2218270071 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58004040 con 0x7ffb601034e0 2024-09-21T02:37:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.273+0000 7ffb5e000640 1 -- 172.21.15.79:0/2218270071 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb58004690 con 0x7ffb601034e0 2024-09-21T02:37:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.273+0000 7ffb5e000640 1 -- 172.21.15.79:0/2218270071 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5802fe60 con 0x7ffb601034e0 2024-09-21T02:37:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.274+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6019dcd0 con 0x7ffb601034e0 2024-09-21T02:37:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.274+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb601a4420 con 0x7ffb601034e0 2024-09-21T02:37:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.290+0000 7ffb6efc8740 1 Processor -- start 2024-09-21T02:37:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.291+0000 7ffb6efc8740 1 -- start start 2024-09-21T02:37:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.291+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d5322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.291+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d532920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.291+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d533470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.291+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aa2d4a56b0 con 0x55aa2d1622f0 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.291+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aa2d494ae0 con 0x55aa2d16a4d0 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.291+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55aa2d4988f0 con 0x55aa2d18b1b0 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb65e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d5322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb65e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d5322b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:43108/0 (socket says 172.21.15.79:43108) 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb65e00640 1 -- 172.21.15.79:0/3271902906 learned_addr learned my addr 172.21.15.79:0/3271902906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb64a00640 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d533470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb64a00640 1 -- 172.21.15.79:0/3271902906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 msgr2=0x55aa2d5322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb64a00640 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d5322b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb64a00640 1 -- 172.21.15.79:0/3271902906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 msgr2=0x55aa2d532920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:37:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb64a00640 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d532920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.292+0000 7ffb64a00640 1 -- 172.21.15.79:0/3271902906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2d461780 con 0x55aa2d16a4d0 2024-09-21T02:37:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.293+0000 7ffb5e000640 1 -- 172.21.15.79:0/2218270071 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ffb5802f620 con 0x7ffb601034e0 2024-09-21T02:37:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.294+0000 7ffb64a00640 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d533470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009750 tx=0x7ffb54009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dd6ef2d9c881abf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.294+0000 7ffb4e600640 1 -- 172.21.15.79:0/3271902906 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54015020 con 0x55aa2d16a4d0 2024-09-21T02:37:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.295+0000 7ffb4e600640 1 -- 172.21.15.79:0/3271902906 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb54011420 con 0x55aa2d16a4d0 2024-09-21T02:37:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.295+0000 7ffb4e600640 1 -- 172.21.15.79:0/3271902906 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54015020 con 0x55aa2d16a4d0 2024-09-21T02:37:10.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.297+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3271902906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 msgr2=0x55aa2d533470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.297+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d533470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009750 tx=0x7ffb54009c10 comp rx=0 tx=0).stop 2024-09-21T02:37:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.299+0000 7ffb5e000640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb480b66e0 0x7ffb480b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.301+0000 7ffb5e000640 1 -- 172.21.15.79:0/2218270071 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ffb58108fb0 con 0x7ffb601034e0 2024-09-21T02:37:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.302+0000 7ffb65e00640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb480b66e0 0x7ffb480b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.302+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3271902906 shutdown_connections 2024-09-21T02:37:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.302+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d533470 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.302+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d532920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.302+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3271902906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d5322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.302+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3271902906 >> 172.21.15.79:0/3271902906 conn(0x55aa2d17f300 msgr2=0x55aa2d52dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.303+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3271902906 shutdown_connections 2024-09-21T02:37:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.304+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3271902906 wait complete. 2024-09-21T02:37:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.305+0000 7ffb6efc8740 1 -- start start 2024-09-21T02:37:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.305+0000 7ffb6efc8740 1 Processor -- start 2024-09-21T02:37:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.308+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d1622f0 0x55aa2d53b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.308+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d16a4d0 0x55aa2d53c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.308+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d53cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.308+0000 7ffb65400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d1622f0 0x55aa2d53b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.308+0000 7ffb65400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d1622f0 0x55aa2d53b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54216/0 (socket says 172.21.15.79:54216) 2024-09-21T02:37:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.309+0000 7ffb65e00640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb480b66e0 0x7ffb480b8bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000bb90 tx=0x7ffb5000b340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65400640 1 -- 172.21.15.79:0/1933854137 learned_addr learned my addr 172.21.15.79:0/1933854137 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aa2d3ccab0 con 0x55aa2d16a4d0 2024-09-21T02:37:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aa2d43b570 con 0x55aa2d1622f0 2024-09-21T02:37:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55aa2d533f90 con 0x55aa2d18b1b0 2024-09-21T02:37:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb6efc8740 10 client.0 _ll_register_callbacks cb 0x55aa2d44a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65e00640 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d53cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65400640 1 -- 172.21.15.79:0/1933854137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 msgr2=0x55aa2d53cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65400640 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d53cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65400640 1 -- 172.21.15.79:0/1933854137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d16a4d0 msgr2=0x55aa2d53c090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65400640 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d16a4d0 0x55aa2d53c090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65400640 1 -- 172.21.15.79:0/1933854137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa2d1f6790 con 0x55aa2d1622f0 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.310+0000 7ffb65400640 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d1622f0 0x55aa2d53b9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffb580cbfa0 tx=0x7ffb580ce740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce63e009c4870370 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.311+0000 7ffb42a00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.311+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb54011420 con 0x55aa2d1622f0 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.311+0000 7ffb42a00640 1 -- 172.21.15.79:0/1933854137 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb580ce840 con 0x55aa2d1622f0 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.311+0000 7ffb42a00640 1 -- 172.21.15.79:0/1933854137 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ffb580f6170 con 0x55aa2d1622f0 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.312+0000 7ffb42a00640 1 -- 172.21.15.79:0/1933854137 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb580cf430 con 0x55aa2d1622f0 2024-09-21T02:37:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.312+0000 7ffb6efc8740 10 client.25502 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.312+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55aa2d26f620 con 0x55aa2d1622f0 2024-09-21T02:37:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.315+0000 7ffb42a00640 1 -- 172.21.15.79:0/1933854137 <== mon.2 v2:172.21.15.98:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffb58106b60 con 0x55aa2d1622f0 2024-09-21T02:37:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.315+0000 7ffb6efc8740 10 client.25502 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.315+0000 7ffb6efc8740 10 client.25502 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.315+0000 7ffb6efc8740 20 client.25502 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.315+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d149d80 0x55aa2d551770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.315+0000 7ffb6efc8740 4 client.25502 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:37:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.315+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa2d4a7600 con 0x55aa2d149d80 2024-09-21T02:37:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.316+0000 7ffb64a00640 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d149d80 0x55aa2d551770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.317+0000 7ffb42a00640 10 client.25502 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.317+0000 7ffb64a00640 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d149d80 0x55aa2d551770 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f78c34c24d8a97c8 server_cookie=f323b49f8dc3a024 in_seq=0 out_seq=0 2024-09-21T02:37:10.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.318+0000 7ffb42a00640 1 -- 172.21.15.79:0/1933854137 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa2d4a7600 con 0x55aa2d149d80 2024-09-21T02:37:10.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.318+0000 7ffb42a00640 10 client.25502 handle_command_reply: tid=0 2024-09-21T02:37:10.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.318+0000 7ffb6efc8740 1 client.25502 shutdown 2024-09-21T02:37:10.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.318+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d1622f0 msgr2=0x55aa2d53b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.318+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d1622f0 0x55aa2d53b9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffb580cbfa0 tx=0x7ffb580ce740 comp rx=0 tx=0).stop 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 shutdown_connections 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d149d80 0x55aa2d551770 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d53cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d16a4d0 0x55aa2d53c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/1933854137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d1622f0 0x55aa2d53b9d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb42a00640 0 client.25502 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 >> 172.21.15.79:0/1933854137 conn(0x55aa2d17f300 msgr2=0x55aa2d52c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.319+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 shutdown_connections 2024-09-21T02:37:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.320+0000 7ffb6efc8740 1 -- 172.21.15.79:0/1933854137 wait complete. 2024-09-21T02:37:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.320+0000 7ffb6efc8740 20 client.25502 trim_cache size 0 max 16384 2024-09-21T02:37:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.373+0000 7ffb6efc8740 1 Processor -- start 2024-09-21T02:37:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.373+0000 7ffb6efc8740 1 -- start start 2024-09-21T02:37:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.374+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d536a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.374+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d52e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.374+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d52e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.374+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601a83f0 con 0x55aa2d1622f0 2024-09-21T02:37:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.374+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601aac30 con 0x55aa2d16a4d0 2024-09-21T02:37:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.374+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601a8a40 con 0x55aa2d18b1b0 2024-09-21T02:37:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.374+0000 7ffb65e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d52e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.375+0000 7ffb65e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d52e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:43124/0 (socket says 172.21.15.79:43124) 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.375+0000 7ffb65e00640 1 -- 172.21.15.79:0/2097760113 learned_addr learned my addr 172.21.15.79:0/2097760113 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.375+0000 7ffb64a00640 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d52e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.376+0000 7ffb65e00640 1 -- 172.21.15.79:0/2097760113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 msgr2=0x55aa2d52e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.376+0000 7ffb65e00640 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d52e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.376+0000 7ffb65e00640 1 -- 172.21.15.79:0/2097760113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 msgr2=0x55aa2d536a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.376+0000 7ffb65e00640 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d536a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.376+0000 7ffb65e00640 1 -- 172.21.15.79:0/2097760113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2d539b50 con 0x55aa2d18b1b0 2024-09-21T02:37:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.377+0000 7ffb65e00640 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d52e6c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffb5001d690 tx=0x7ffb50013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=319c571457c15f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.378+0000 7ffb4dc00640 1 -- 172.21.15.79:0/2097760113 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5001db30 con 0x55aa2d18b1b0 2024-09-21T02:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.378+0000 7ffb4dc00640 1 -- 172.21.15.79:0/2097760113 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb5001d320 con 0x55aa2d18b1b0 2024-09-21T02:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.378+0000 7ffb4dc00640 1 -- 172.21.15.79:0/2097760113 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50004d00 con 0x55aa2d18b1b0 2024-09-21T02:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 -- 172.21.15.79:0/2097760113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 msgr2=0x55aa2d52e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d52e6c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffb5001d690 tx=0x7ffb50013000 comp rx=0 tx=0).stop 2024-09-21T02:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 -- 172.21.15.79:0/2097760113 shutdown_connections 2024-09-21T02:37:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d52e6c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d52e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/2097760113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d536a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 -- 172.21.15.79:0/2097760113 >> 172.21.15.79:0/2097760113 conn(0x55aa2d17f300 msgr2=0x55aa2d536370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 -- 172.21.15.79:0/2097760113 shutdown_connections 2024-09-21T02:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.380+0000 7ffb6efc8740 1 -- 172.21.15.79:0/2097760113 wait complete. 2024-09-21T02:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.381+0000 7ffb6efc8740 1 -- start start 2024-09-21T02:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.381+0000 7ffb6efc8740 1 Processor -- start 2024-09-21T02:37:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d54bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d54a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb6efc8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d54ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601a90f0 con 0x55aa2d1622f0 2024-09-21T02:37:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601aa560 con 0x55aa2d16a4d0 2024-09-21T02:37:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb6efc8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601a97c0 con 0x55aa2d18b1b0 2024-09-21T02:37:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb6efc8740 10 client.0 _ll_register_callbacks cb 0x7ffb58009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb65e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d54ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb65e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d54ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:43140/0 (socket says 172.21.15.79:43140) 2024-09-21T02:37:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.382+0000 7ffb65e00640 1 -- 172.21.15.79:0/3826852493 learned_addr learned my addr 172.21.15.79:0/3826852493 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.383+0000 7ffb65e00640 1 -- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 msgr2=0x55aa2d54a7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:37:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.383+0000 7ffb64a00640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d54a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.383+0000 7ffb65400640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d54bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.383+0000 7ffb65e00640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d54a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.383+0000 7ffb65e00640 1 -- 172.21.15.79:0/3826852493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 msgr2=0x55aa2d54bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.383+0000 7ffb65e00640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d54bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.383+0000 7ffb65e00640 1 -- 172.21.15.79:0/3826852493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa2d54b4f0 con 0x55aa2d18b1b0 2024-09-21T02:37:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.384+0000 7ffb65400640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d54bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:37:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.384+0000 7ffb65e00640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d54ad60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb50005e50 tx=0x7ffb50028690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3aa32f1c747f98f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.384+0000 7ffb42a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:37:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.385+0000 7ffb42a00640 1 -- 172.21.15.79:0/3826852493 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50047060 con 0x55aa2d18b1b0 2024-09-21T02:37:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.385+0000 7ffb42a00640 1 -- 172.21.15.79:0/3826852493 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ffb500288b0 con 0x55aa2d18b1b0 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.385+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb5001d320 con 0x55aa2d18b1b0 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.385+0000 7ffb42a00640 1 -- 172.21.15.79:0/3826852493 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb50028270 con 0x55aa2d18b1b0 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.385+0000 7ffb6efc8740 10 client.25510 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.385+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aa2d5bc140 con 0x55aa2d18b1b0 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb42a00640 1 -- 172.21.15.79:0/3826852493 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb5001d320 con 0x55aa2d18b1b0 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb42a00640 1 -- 172.21.15.79:0/3826852493 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffb50026a80 con 0x55aa2d18b1b0 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb6efc8740 10 client.25510 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb6efc8740 10 client.25510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb6efc8740 20 client.25510 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d11f1c0 0x55aa2d5be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb6efc8740 4 client.25510 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:37:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa2d4a30b0 con 0x55aa2d11f1c0 2024-09-21T02:37:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.386+0000 7ffb65400640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d11f1c0 0x55aa2d5be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.387+0000 7ffb42a00640 10 client.25510 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.387+0000 7ffb65400640 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d11f1c0 0x55aa2d5be9f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e9dde00a23f1d89 server_cookie=d04da8b3f3ca4630 in_seq=0 out_seq=0 2024-09-21T02:37:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.465+0000 7ffb42a00640 1 -- 172.21.15.79:0/3826852493 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa2d4a30b0 con 0x55aa2d11f1c0 2024-09-21T02:37:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.465+0000 7ffb42a00640 10 client.25510 handle_command_reply: tid=0 2024-09-21T02:37:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 client.25510 shutdown 2024-09-21T02:37:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 msgr2=0x55aa2d54ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d54ad60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb50005e50 tx=0x7ffb50028690 comp rx=0 tx=0).stop 2024-09-21T02:37:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 shutdown_connections 2024-09-21T02:37:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aa2d11f1c0 0x55aa2d5be9f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aa2d18b1b0 0x55aa2d54ad60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aa2d16a4d0 0x55aa2d54a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 --2- 172.21.15.79:0/3826852493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aa2d1622f0 0x55aa2d54bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 >> 172.21.15.79:0/3826852493 conn(0x55aa2d17f300 msgr2=0x55aa2d53a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb42a00640 0 client.25510 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.466+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 shutdown_connections 2024-09-21T02:37:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.467+0000 7ffb6efc8740 1 -- 172.21.15.79:0/3826852493 wait complete. 2024-09-21T02:37:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.467+0000 7ffb6efc8740 20 client.25510 trim_cache size 0 max 16384 2024-09-21T02:37:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:37:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:37:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:37:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:37:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb480b66e0 msgr2=0x7ffb480b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb480b66e0 0x7ffb480b8bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000bb90 tx=0x7ffb5000b340 comp rx=0 tx=0).stop 2024-09-21T02:37:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 msgr2=0x7ffb6019c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb6019c000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb5802ade0 tx=0x7ffb58003ba0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 shutdown_connections 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffb480b66e0 0x7ffb480b8bf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb60104f00 0x7ffb6019d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb60104560 0x7ffb6019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 --2- 172.21.15.79:0/2218270071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601034e0 0x7ffb6019c000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.469+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 >> 172.21.15.79:0/2218270071 conn(0x7ffb600fee20 msgr2=0x7ffb60100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.470+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 shutdown_connections 2024-09-21T02:37:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:10.470+0000 7ffb66800640 1 -- 172.21.15.79:0/2218270071 wait complete. 2024-09-21T02:37:11.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:11 smithi079 ceph-mon[30788]: pgmap v458: 129 pgs: 129 active+clean; 967 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-09-21T02:37:11.492 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 75.0 s, 3306.6 tps, lat 29.974 ms stddev 32.732 2024-09-21T02:37:11.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:11 smithi148 ceph-mon[34626]: pgmap v458: 129 pgs: 129 active+clean; 967 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-09-21T02:37:11.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:11 smithi098 ceph-mon[34832]: pgmap v458: 129 pgs: 129 active+clean; 967 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-09-21T02:37:13.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:13 smithi079 ceph-mon[30788]: pgmap v459: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 376 op/s 2024-09-21T02:37:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:13 smithi148 ceph-mon[34626]: pgmap v459: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 376 op/s 2024-09-21T02:37:13.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:13 smithi098 ceph-mon[34832]: pgmap v459: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 376 op/s 2024-09-21T02:37:15.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:15 smithi079 ceph-mon[30788]: pgmap v460: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.0 MiB/s wr, 484 op/s 2024-09-21T02:37:15.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:15 smithi148 ceph-mon[34626]: pgmap v460: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.0 MiB/s wr, 484 op/s 2024-09-21T02:37:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:15 smithi098 ceph-mon[34832]: pgmap v460: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.0 MiB/s wr, 484 op/s 2024-09-21T02:37:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 80.0 s, 1846.0 tps, lat 54.359 ms stddev 65.138 2024-09-21T02:37:17.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:17 smithi079 ceph-mon[30788]: pgmap v461: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.8 MiB/s wr, 591 op/s 2024-09-21T02:37:17.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:17 smithi148 ceph-mon[34626]: pgmap v461: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.8 MiB/s wr, 591 op/s 2024-09-21T02:37:17.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:17 smithi098 ceph-mon[34832]: pgmap v461: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.8 MiB/s wr, 591 op/s 2024-09-21T02:37:19.457 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:19 smithi098 ceph-mon[34832]: pgmap v462: 129 pgs: 129 active+clean; 982 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2024-09-21T02:37:19.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:19 smithi079 ceph-mon[30788]: pgmap v462: 129 pgs: 129 active+clean; 982 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2024-09-21T02:37:19.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:19 smithi148 ceph-mon[34626]: pgmap v462: 129 pgs: 129 active+clean; 982 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2024-09-21T02:37:21.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:21 smithi079 ceph-mon[30788]: pgmap v463: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9.7 MiB/s wr, 732 op/s 2024-09-21T02:37:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 85.0 s, 1724.2 tps, lat 58.093 ms stddev 99.128 2024-09-21T02:37:21.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:21 smithi148 ceph-mon[34626]: pgmap v463: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9.7 MiB/s wr, 732 op/s 2024-09-21T02:37:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:21 smithi098 ceph-mon[34832]: pgmap v463: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9.7 MiB/s wr, 732 op/s 2024-09-21T02:37:23.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:23 smithi079 ceph-mon[30788]: pgmap v464: 129 pgs: 129 active+clean; 982 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-21T02:37:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:23 smithi148 ceph-mon[34626]: pgmap v464: 129 pgs: 129 active+clean; 982 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-21T02:37:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:23 smithi098 ceph-mon[34832]: pgmap v464: 129 pgs: 129 active+clean; 982 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-21T02:37:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.765+0000 7fb9ed800640 1 -- 172.21.15.79:0/1926852832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e81036a0 msgr2=0x7fb9e8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.765+0000 7fb9ed800640 1 --2- 172.21.15.79:0/1926852832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e81036a0 0x7fb9e8103b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009900 tx=0x7fb9d802a410 comp rx=0 tx=0).stop 2024-09-21T02:37:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.765+0000 7fb9ed800640 1 -- 172.21.15.79:0/1926852832 shutdown_connections 2024-09-21T02:37:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.765+0000 7fb9ed800640 1 --2- 172.21.15.79:0/1926852832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9e81050c0 0x7fb9e810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.765+0000 7fb9ed800640 1 --2- 172.21.15.79:0/1926852832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9e8104720 0x7fb9e8104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.765+0000 7fb9ed800640 1 --2- 172.21.15.79:0/1926852832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e81036a0 0x7fb9e8103b10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.765+0000 7fb9ed800640 1 -- 172.21.15.79:0/1926852832 >> 172.21.15.79:0/1926852832 conn(0x7fb9e80fefe0 msgr2=0x7fb9e8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.766+0000 7fb9ed800640 1 -- 172.21.15.79:0/1926852832 shutdown_connections 2024-09-21T02:37:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.766+0000 7fb9ed800640 1 -- 172.21.15.79:0/1926852832 wait complete. 2024-09-21T02:37:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.767+0000 7fb9ed800640 1 Processor -- start 2024-09-21T02:37:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.768+0000 7fb9ed800640 1 -- start start 2024-09-21T02:37:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.768+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9e81036a0 0x7fb9e81a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.768+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e8104720 0x7fb9e81a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.768+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9e81050c0 0x7fb9e81a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.768+0000 7fb9ed800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e810f390 con 0x7fb9e81050c0 2024-09-21T02:37:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.768+0000 7fb9ed800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e810f210 con 0x7fb9e81036a0 2024-09-21T02:37:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.768+0000 7fb9ed800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e810f510 con 0x7fb9e8104720 2024-09-21T02:37:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e8104720 0x7fb9e81a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e8104720 0x7fb9e81a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:45982/0 (socket says 172.21.15.79:45982) 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 -- 172.21.15.79:0/2984398859 learned_addr learned my addr 172.21.15.79:0/2984398859 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9e81036a0 0x7fb9e81a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 -- 172.21.15.79:0/2984398859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9e81036a0 msgr2=0x7fb9e81a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9e81036a0 0x7fb9e81a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 -- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9e81050c0 msgr2=0x7fb9e81a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9e81050c0 0x7fb9e81a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.769+0000 7fb9e6000640 1 -- 172.21.15.79:0/2984398859 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e81a1f40 con 0x7fb9e8104720 2024-09-21T02:37:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.770+0000 7fb9e6000640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e8104720 0x7fb9e81a0c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b4a0 tx=0x7fb9d400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.771+0000 7fb9df400640 1 -- 172.21.15.79:0/2984398859 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4014070 con 0x7fb9e8104720 2024-09-21T02:37:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.771+0000 7fb9df400640 1 -- 172.21.15.79:0/2984398859 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d4010ac0 con 0x7fb9e8104720 2024-09-21T02:37:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.771+0000 7fb9df400640 1 -- 172.21.15.79:0/2984398859 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4017c30 con 0x7fb9e8104720 2024-09-21T02:37:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.771+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e81a2230 con 0x7fb9e8104720 2024-09-21T02:37:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.771+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e81a8850 con 0x7fb9e8104720 2024-09-21T02:37:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 Processor -- start 2024-09-21T02:37:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 -- start start 2024-09-21T02:37:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a62f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a25f2f0 0x56390a62f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a2674d0 0x56390a630290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56390a5a26b0 con 0x56390a2881b0 2024-09-21T02:37:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56390a591ae0 con 0x56390a2674d0 2024-09-21T02:37:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.776+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56390a5958f0 con 0x56390a25f2f0 2024-09-21T02:37:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.777+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a62f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.777+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a25f2f0 0x56390a62f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.777+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a25f2f0 0x56390a62f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:45992/0 (socket says 172.21.15.79:45992) 2024-09-21T02:37:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.777+0000 7fb9e6a00640 1 -- 172.21.15.79:0/838551232 learned_addr learned my addr 172.21.15.79:0/838551232 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9df400640 1 -- 172.21.15.79:0/2984398859 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb9d4017070 con 0x7fb9e8104720 2024-09-21T02:37:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9e6a00640 1 -- 172.21.15.79:0/838551232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a2674d0 msgr2=0x56390a630290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/838551232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a2674d0 0x56390a630290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9e6a00640 1 -- 172.21.15.79:0/838551232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 msgr2=0x56390a62f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/838551232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a62f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9e6a00640 1 -- 172.21.15.79:0/838551232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390a55e780 con 0x56390a25f2f0 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/838551232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a25f2f0 0x56390a62f740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009900 tx=0x7fb9d80043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85b720a3dca56e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.778+0000 7fb9d3e00640 1 -- 172.21.15.79:0/838551232 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8035030 con 0x56390a25f2f0 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.779+0000 7fb9d3e00640 1 -- 172.21.15.79:0/838551232 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d8040070 con 0x56390a25f2f0 2024-09-21T02:37:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.779+0000 7fb9d3e00640 1 -- 172.21.15.79:0/838551232 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8031c40 con 0x56390a25f2f0 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.779+0000 7fb9f4a07740 1 -- 172.21.15.79:0/838551232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a25f2f0 msgr2=0x56390a62f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.779+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/838551232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a25f2f0 0x56390a62f740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009900 tx=0x7fb9d80043d0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.780+0000 7fb9f4a07740 1 -- 172.21.15.79:0/838551232 shutdown_connections 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.780+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/838551232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a2674d0 0x56390a630290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.780+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/838551232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a25f2f0 0x56390a62f740 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.780+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/838551232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a62f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.780+0000 7fb9f4a07740 1 -- 172.21.15.79:0/838551232 >> 172.21.15.79:0/838551232 conn(0x56390a27c300 msgr2=0x56390a62ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.780+0000 7fb9df400640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb9cc0b6590 0x7fb9cc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.781+0000 7fb9df400640 1 -- 172.21.15.79:0/2984398859 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb9d40e6c00 con 0x7fb9e8104720 2024-09-21T02:37:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.781+0000 7fb9e7400640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb9cc0b6590 0x7fb9cc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.781+0000 7fb9f4a07740 1 -- 172.21.15.79:0/838551232 shutdown_connections 2024-09-21T02:37:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.782+0000 7fb9f4a07740 1 -- 172.21.15.79:0/838551232 wait complete. 2024-09-21T02:37:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.782+0000 7fb9f4a07740 1 -- start start 2024-09-21T02:37:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.783+0000 7fb9f4a07740 1 Processor -- start 2024-09-21T02:37:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.784+0000 7fb9e7400640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb9cc0b6590 0x7fb9cc0b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0005fd0 tx=0x7fb9e0007520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a25f2f0 0x56390a6497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a649e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a64a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56390a4c9ab0 con 0x56390a2881b0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56390a538570 con 0x56390a25f2f0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56390a630d50 con 0x56390a2674d0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9f4a07740 10 client.0 _ll_register_callbacks cb 0x56390a547100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a649e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a649e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:46004/0 (socket says 172.21.15.79:46004) 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.785+0000 7fb9e6000640 1 -- 172.21.15.79:0/3217622477 learned_addr learned my addr 172.21.15.79:0/3217622477 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a25f2f0 0x56390a6497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e7400640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a64a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e6000640 1 -- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a25f2f0 msgr2=0x56390a6497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e6000640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a25f2f0 0x56390a6497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e6000640 1 -- 172.21.15.79:0/3217622477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 msgr2=0x56390a64a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e6000640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a64a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e6000640 1 -- 172.21.15.79:0/3217622477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390a2f3790 con 0x56390a2674d0 2024-09-21T02:37:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e7400640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a64a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:37:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9e6000640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a649e80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009420 tx=0x7fb9d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3665373984bf547 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:37:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3217622477 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d401e070 con 0x56390a2674d0 2024-09-21T02:37:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3217622477 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb9d4010610 con 0x56390a2674d0 2024-09-21T02:37:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.786+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d8040070 con 0x56390a2674d0 2024-09-21T02:37:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.787+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3217622477 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb9d4017360 con 0x56390a2674d0 2024-09-21T02:37:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.787+0000 7fb9f4a07740 10 client.25522 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.787+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56390a36c620 con 0x56390a2674d0 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.787+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3217622477 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d8040070 con 0x56390a2674d0 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.788+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3217622477 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb9d40a8330 con 0x56390a2674d0 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.788+0000 7fb9f4a07740 10 client.25522 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.788+0000 7fb9f4a07740 10 client.25522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.788+0000 7fb9f4a07740 20 client.25522 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.788+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a246d80 0x56390a667ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.788+0000 7fb9f4a07740 4 client.25522 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.788+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56390a5a4600 con 0x56390a246d80 2024-09-21T02:37:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.789+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a246d80 0x56390a667ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.790+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a246d80 0x56390a667ee0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe951a66e3a02e0c server_cookie=d8d477a6e6a87a2d in_seq=0 out_seq=0 2024-09-21T02:37:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.790+0000 7fb9d0c00640 10 client.25522 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.791+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3217622477 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56390a5a4600 con 0x56390a246d80 2024-09-21T02:37:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.791+0000 7fb9d0c00640 10 client.25522 handle_command_reply: tid=0 2024-09-21T02:37:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.791+0000 7fb9f4a07740 1 client.25522 shutdown 2024-09-21T02:37:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 msgr2=0x56390a649e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a649e80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009420 tx=0x7fb9d40046c0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 shutdown_connections 2024-09-21T02:37:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a246d80 0x56390a667ee0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a2881b0 0x56390a64a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9d0c00640 0 client.25522 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a649e80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3217622477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a25f2f0 0x56390a6497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 >> 172.21.15.79:0/3217622477 conn(0x56390a27c300 msgr2=0x56390a6290e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 shutdown_connections 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.792+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3217622477 wait complete. 2024-09-21T02:37:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.793+0000 7fb9f4a07740 20 client.25522 trim_cache size 0 max 16384 2024-09-21T02:37:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.824+0000 7fb9f4a07740 1 Processor -- start 2024-09-21T02:37:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.824+0000 7fb9f4a07740 1 -- start start 2024-09-21T02:37:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.824+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a62a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.824+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a62ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.824+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a62b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e819cc00 con 0x56390a25f2f0 2024-09-21T02:37:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806eff0 con 0x56390a246d80 2024-09-21T02:37:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a62a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806cde0 con 0x56390a2674d0 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a62a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38944/0 (socket says 172.21.15.79:38944) 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a62b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a62b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:35036/0 (socket says 172.21.15.79:35036) 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.825+0000 7fb9e7400640 1 -- 172.21.15.79:0/362387701 learned_addr learned my addr 172.21.15.79:0/362387701 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.826+0000 7fb9e7400640 1 -- 172.21.15.79:0/362387701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 msgr2=0x56390a62a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.826+0000 7fb9e7400640 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a62a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.826+0000 7fb9e7400640 1 -- 172.21.15.79:0/362387701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 msgr2=0x56390a62ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.826+0000 7fb9e6000640 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a62ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.826+0000 7fb9e7400640 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a62ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.826+0000 7fb9e7400640 1 -- 172.21.15.79:0/362387701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390a637070 con 0x56390a2674d0 2024-09-21T02:37:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.826+0000 7fb9e6000640 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a62ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:37:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.827+0000 7fb9e7400640 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a62b310 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00107d0 tx=0x7fb9e0012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20fd6add3728042 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.828+0000 7fb9d3400640 1 -- 172.21.15.79:0/362387701 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e001cb30 con 0x56390a2674d0 2024-09-21T02:37:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.828+0000 7fb9d3400640 1 -- 172.21.15.79:0/362387701 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9e001ccd0 con 0x56390a2674d0 2024-09-21T02:37:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.828+0000 7fb9d3400640 1 -- 172.21.15.79:0/362387701 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e001a670 con 0x56390a2674d0 2024-09-21T02:37:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.830+0000 7fb9f4a07740 1 -- 172.21.15.79:0/362387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 msgr2=0x56390a62b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.830+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a62b310 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00107d0 tx=0x7fb9e0012000 comp rx=0 tx=0).stop 2024-09-21T02:37:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.830+0000 7fb9f4a07740 1 -- 172.21.15.79:0/362387701 shutdown_connections 2024-09-21T02:37:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.831+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a62b310 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.831+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a62ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.831+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/362387701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a62a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.831+0000 7fb9f4a07740 1 -- 172.21.15.79:0/362387701 >> 172.21.15.79:0/362387701 conn(0x56390a27c300 msgr2=0x56390a667e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.831+0000 7fb9f4a07740 1 -- 172.21.15.79:0/362387701 shutdown_connections 2024-09-21T02:37:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.831+0000 7fb9f4a07740 1 -- 172.21.15.79:0/362387701 wait complete. 2024-09-21T02:37:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.833+0000 7fb9f4a07740 1 -- start start 2024-09-21T02:37:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.833+0000 7fb9f4a07740 1 Processor -- start 2024-09-21T02:37:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.836+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a6512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.836+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a64ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.836+0000 7fb9f4a07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a650670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806d4b0 con 0x56390a25f2f0 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806e920 con 0x56390a246d80 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9f4a07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806db80 con 0x56390a2674d0 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9f4a07740 10 client.0 _ll_register_callbacks cb 0x7fb9d4017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a64ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a650670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a64ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56692/0 (socket says 172.21.15.79:56692) 2024-09-21T02:37:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 -- 172.21.15.79:0/3904161883 learned_addr learned my addr 172.21.15.79:0/3904161883 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 -- 172.21.15.79:0/3904161883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 msgr2=0x56390a650670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a650670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 -- 172.21.15.79:0/3904161883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 msgr2=0x56390a6512c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:37:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a6512c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.837+0000 7fb9e6000640 1 -- 172.21.15.79:0/3904161883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390a64eb40 con 0x56390a25f2f0 2024-09-21T02:37:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.838+0000 7fb9e6000640 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a64ff80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b470 tx=0x7fb9d40a89b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a412b9f10292c827 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.838+0000 7fb9d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:37:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.838+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3904161883 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d401e030 con 0x56390a25f2f0 2024-09-21T02:37:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.839+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3904161883 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb9d4010610 con 0x56390a25f2f0 2024-09-21T02:37:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.839+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9e001ccd0 con 0x56390a25f2f0 2024-09-21T02:37:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.839+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3904161883 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb9d4095020 con 0x56390a25f2f0 2024-09-21T02:37:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.839+0000 7fb9f4a07740 10 client.15465 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.839+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56390a6d29b0 con 0x56390a25f2f0 2024-09-21T02:37:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.840+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3904161883 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9e001ccd0 con 0x56390a25f2f0 2024-09-21T02:37:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.840+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3904161883 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb9d40ab6b0 con 0x56390a25f2f0 2024-09-21T02:37:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.841+0000 7fb9f4a07740 10 client.15465 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.841+0000 7fb9f4a07740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.841+0000 7fb9f4a07740 20 client.15465 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.841+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a2881b0 0x56390a6d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.841+0000 7fb9f4a07740 4 client.15465 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:37:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.841+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56390a5a00b0 con 0x56390a2881b0 2024-09-21T02:37:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.841+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a2881b0 0x56390a6d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.843+0000 7fb9e6a00640 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a2881b0 0x56390a6d53a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=114649ac7604e4bc server_cookie=fc4b7f168fdf5694 in_seq=0 out_seq=0 2024-09-21T02:37:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.843+0000 7fb9d0c00640 10 client.15465 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.917+0000 7fb9d0c00640 1 -- 172.21.15.79:0/3904161883 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56390a5a00b0 con 0x56390a2881b0 2024-09-21T02:37:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.917+0000 7fb9d0c00640 10 client.15465 handle_command_reply: tid=0 2024-09-21T02:37:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.917+0000 7fb9f4a07740 1 client.15465 shutdown 2024-09-21T02:37:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 msgr2=0x56390a64ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a64ff80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b470 tx=0x7fb9d40a89b0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 shutdown_connections 2024-09-21T02:37:23.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56390a2881b0 0x56390a6d53a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56390a2674d0 0x56390a650670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56390a25f2f0 0x56390a64ff80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 --2- 172.21.15.79:0/3904161883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56390a246d80 0x56390a6512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 >> 172.21.15.79:0/3904161883 conn(0x56390a27c300 msgr2=0x56390a62ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.918+0000 7fb9d0c00640 0 client.15465 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.919+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 shutdown_connections 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.919+0000 7fb9f4a07740 1 -- 172.21.15.79:0/3904161883 wait complete. 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.919+0000 7fb9f4a07740 20 client.15465 trim_cache size 0 max 16384 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:37:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:37:23.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb9cc0b6590 msgr2=0x7fb9cc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb9cc0b6590 0x7fb9cc0b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0005fd0 tx=0x7fb9e0007520 comp rx=0 tx=0).stop 2024-09-21T02:37:23.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e8104720 msgr2=0x7fb9e81a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e8104720 0x7fb9e81a0c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b4a0 tx=0x7fb9d400b960 comp rx=0 tx=0).stop 2024-09-21T02:37:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 shutdown_connections 2024-09-21T02:37:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb9cc0b6590 0x7fb9cc0b8aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9e81050c0 0x7fb9e81a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e8104720 0x7fb9e81a0c00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 --2- 172.21.15.79:0/2984398859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9e81036a0 0x7fb9e81a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.921+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 >> 172.21.15.79:0/2984398859 conn(0x7fb9e80fefe0 msgr2=0x7fb9e8105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.923+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 shutdown_connections 2024-09-21T02:37:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:23.923+0000 7fb9ed800640 1 -- 172.21.15.79:0/2984398859 wait complete. 2024-09-21T02:37:25.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:25 smithi079 ceph-mon[30788]: pgmap v465: 129 pgs: 129 active+clean; 991 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-21T02:37:25.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:25 smithi148 ceph-mon[34626]: pgmap v465: 129 pgs: 129 active+clean; 991 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-21T02:37:25.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:25 smithi098 ceph-mon[34832]: pgmap v465: 129 pgs: 129 active+clean; 991 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-21T02:37:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 90.0 s, 2293.2 tps, lat 43.364 ms stddev 53.472 2024-09-21T02:37:27.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:27 smithi079 ceph-mon[30788]: pgmap v466: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-09-21T02:37:27.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:27 smithi148 ceph-mon[34626]: pgmap v466: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-09-21T02:37:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:27 smithi098 ceph-mon[34832]: pgmap v466: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-09-21T02:37:29.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:29 smithi079 ceph-mon[30788]: pgmap v467: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-21T02:37:29.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:29 smithi148 ceph-mon[34626]: pgmap v467: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-21T02:37:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:29 smithi098 ceph-mon[34832]: pgmap v467: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-21T02:37:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 95.0 s, 1433.4 tps, lat 69.970 ms stddev 86.194 2024-09-21T02:37:31.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:31 smithi148 ceph-mon[34626]: pgmap v468: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-21T02:37:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:31 smithi098 ceph-mon[34832]: pgmap v468: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-21T02:37:31.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:31 smithi079 ceph-mon[30788]: pgmap v468: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-21T02:37:33.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:33 smithi148 ceph-mon[34626]: pgmap v469: 129 pgs: 129 active+clean; 999 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 870 op/s 2024-09-21T02:37:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:33 smithi098 ceph-mon[34832]: pgmap v469: 129 pgs: 129 active+clean; 999 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 870 op/s 2024-09-21T02:37:33.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:33 smithi079 ceph-mon[30788]: pgmap v469: 129 pgs: 129 active+clean; 999 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 870 op/s 2024-09-21T02:37:35.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:35 smithi148 ceph-mon[34626]: pgmap v470: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 8.8 MiB/s wr, 746 op/s 2024-09-21T02:37:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:35 smithi098 ceph-mon[34832]: pgmap v470: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 8.8 MiB/s wr, 746 op/s 2024-09-21T02:37:35.731 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:35 smithi079 ceph-mon[30788]: pgmap v470: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 8.8 MiB/s wr, 746 op/s 2024-09-21T02:37:36.310 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T02:37:36.310 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T02:37:36.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:37:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 100.0 s, 1281.6 tps, lat 78.097 ms stddev 96.298 2024-09-21T02:37:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:37:37.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.259+0000 7f0b3b000640 1 -- 172.21.15.79:0/1098779289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 msgr2=0x7f0b3411ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.259+0000 7f0b3b000640 1 --2- 172.21.15.79:0/1098779289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 0x7f0b3411ab90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009ca0 tx=0x7f0b2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.260+0000 7f0b3b000640 1 -- 172.21.15.79:0/1098779289 shutdown_connections 2024-09-21T02:37:37.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.260+0000 7f0b3b000640 1 --2- 172.21.15.79:0/1098779289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 0x7f0b3411ab90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.260+0000 7f0b3b000640 1 --2- 172.21.15.79:0/1098779289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3410cdb0 0x7f0b3410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.260+0000 7f0b3b000640 1 --2- 172.21.15.79:0/1098779289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 0x7f0b3410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.260+0000 7f0b3b000640 1 -- 172.21.15.79:0/1098779289 >> 172.21.15.79:0/1098779289 conn(0x7f0b34070810 msgr2=0x7f0b34072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:37.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.260+0000 7f0b3b000640 1 -- 172.21.15.79:0/1098779289 shutdown_connections 2024-09-21T02:37:37.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.260+0000 7f0b3b000640 1 -- 172.21.15.79:0/1098779289 wait complete. 2024-09-21T02:37:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.262+0000 7f0b3b000640 1 Processor -- start 2024-09-21T02:37:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.263+0000 7f0b3b000640 1 -- start start 2024-09-21T02:37:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.263+0000 7f0b3b000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 0x7f0b341a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.263+0000 7f0b3b000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3410cdb0 0x7f0b341a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.263+0000 7f0b3b000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 0x7f0b341a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.263+0000 7f0b3b000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3411e0f0 con 0x7f0b3410a3c0 2024-09-21T02:37:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.263+0000 7f0b3b000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3411df70 con 0x7f0b3410cdb0 2024-09-21T02:37:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.263+0000 7f0b3b000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3411e270 con 0x7f0b3410f9d0 2024-09-21T02:37:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.264+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 0x7f0b341a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.264+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 0x7f0b341a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60558/0 (socket says 172.21.15.79:60558) 2024-09-21T02:37:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.264+0000 7f0b33e00640 1 -- 172.21.15.79:0/2474851631 learned_addr learned my addr 172.21.15.79:0/2474851631 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b33400640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3410cdb0 0x7f0b341a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b39000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 0x7f0b341a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b33e00640 1 -- 172.21.15.79:0/2474851631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 msgr2=0x7f0b341a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b33e00640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 0x7f0b341a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b33e00640 1 -- 172.21.15.79:0/2474851631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3410cdb0 msgr2=0x7f0b341a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b33e00640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3410cdb0 0x7f0b341a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b33e00640 1 -- 172.21.15.79:0/2474851631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b341aa760 con 0x7f0b3410a3c0 2024-09-21T02:37:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b33400640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3410cdb0 0x7f0b341a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:37:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.265+0000 7f0b39000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 0x7f0b341a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:37:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.266+0000 7f0b33e00640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 0x7f0b341a8d20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400ea60 tx=0x7f0b2400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.268+0000 7f0b30c00640 1 -- 172.21.15.79:0/2474851631 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400cde0 con 0x7f0b3410a3c0 2024-09-21T02:37:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.268+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b341aaa50 con 0x7f0b3410a3c0 2024-09-21T02:37:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.268+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b341b1140 con 0x7f0b3410a3c0 2024-09-21T02:37:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.269+0000 7f0b30c00640 1 -- 172.21.15.79:0/2474851631 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b240035f0 con 0x7f0b3410a3c0 2024-09-21T02:37:37.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.269+0000 7f0b30c00640 1 -- 172.21.15.79:0/2474851631 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24018670 con 0x7f0b3410a3c0 2024-09-21T02:37:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.278+0000 7f0b421db740 1 Processor -- start 2024-09-21T02:37:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b421db740 1 -- start start 2024-09-21T02:37:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b30c00640 1 -- 172.21.15.79:0/2474851631 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f0b24004020 con 0x7f0b3410a3c0 2024-09-21T02:37:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b421db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004ee1b0 0x55b8008950d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b421db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b800895740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b421db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004cd4d0 0x55b800896290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b421db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b8008086b0 con 0x55b8004ee1b0 2024-09-21T02:37:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b421db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b8007f7ae0 con 0x55b8004c52f0 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b421db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b8007fb8f0 con 0x55b8004cd4d0 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b800895740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b800895740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50492/0 (socket says 172.21.15.79:50492) 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.279+0000 7f0b33e00640 1 -- 172.21.15.79:0/3798597640 learned_addr learned my addr 172.21.15.79:0/3798597640 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.280+0000 7f0b33400640 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004cd4d0 0x55b800896290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.280+0000 7f0b33e00640 1 -- 172.21.15.79:0/3798597640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004cd4d0 msgr2=0x55b800896290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.280+0000 7f0b33e00640 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004cd4d0 0x55b800896290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.280+0000 7f0b33e00640 1 -- 172.21.15.79:0/3798597640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004ee1b0 msgr2=0x55b8008950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.280+0000 7f0b33e00640 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004ee1b0 0x55b8008950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.280+0000 7f0b33e00640 1 -- 172.21.15.79:0/3798597640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8007c4780 con 0x55b8004c52f0 2024-09-21T02:37:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.281+0000 7f0b33e00640 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b800895740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ebac0 tx=0x7f0b240ebf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c804498402df29d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.281+0000 7f0b29600640 1 -- 172.21.15.79:0/3798597640 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b240f0d80 con 0x55b8004c52f0 2024-09-21T02:37:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.281+0000 7f0b29600640 1 -- 172.21.15.79:0/3798597640 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b240f58e0 con 0x55b8004c52f0 2024-09-21T02:37:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.281+0000 7f0b29600640 1 -- 172.21.15.79:0/3798597640 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b240f4840 con 0x55b8004c52f0 2024-09-21T02:37:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.283+0000 7f0b30c00640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0b180b6510 0x7f0b180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.283+0000 7f0b30c00640 1 -- 172.21.15.79:0/2474851631 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f0b240e7ab0 con 0x7f0b3410a3c0 2024-09-21T02:37:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.283+0000 7f0b421db740 1 -- 172.21.15.79:0/3798597640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 msgr2=0x55b800895740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.283+0000 7f0b421db740 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b800895740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ebac0 tx=0x7f0b240ebf80 comp rx=0 tx=0).stop 2024-09-21T02:37:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.284+0000 7f0b39000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0b180b6510 0x7f0b180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b421db740 1 -- 172.21.15.79:0/3798597640 shutdown_connections 2024-09-21T02:37:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b421db740 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004cd4d0 0x55b800896290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b421db740 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b800895740 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b421db740 1 --2- 172.21.15.79:0/3798597640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004ee1b0 0x55b8008950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b421db740 1 -- 172.21.15.79:0/3798597640 >> 172.21.15.79:0/3798597640 conn(0x55b8004e2300 msgr2=0x55b800890b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b421db740 1 -- 172.21.15.79:0/3798597640 shutdown_connections 2024-09-21T02:37:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b39000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0b180b6510 0x7f0b180b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c004af0 tx=0x7f0b2c009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.285+0000 7f0b421db740 1 -- 172.21.15.79:0/3798597640 wait complete. 2024-09-21T02:37:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.286+0000 7f0b421db740 1 -- start start 2024-09-21T02:37:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.287+0000 7f0b421db740 1 Processor -- start 2024-09-21T02:37:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.287+0000 7f0b421db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b80089e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.287+0000 7f0b421db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b80089eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.287+0000 7f0b421db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004ee1b0 0x55b80089fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.287+0000 7f0b421db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b80072fab0 con 0x55b8004cd4d0 2024-09-21T02:37:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.287+0000 7f0b421db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b80079e570 con 0x55b8004c52f0 2024-09-21T02:37:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.287+0000 7f0b421db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b800896db0 con 0x55b8004ee1b0 2024-09-21T02:37:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.288+0000 7f0b421db740 10 client.0 _ll_register_callbacks cb 0x55b8007ad100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.288+0000 7f0b39000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004ee1b0 0x55b80089fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.288+0000 7f0b39000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004ee1b0 0x55b80089fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57610/0 (socket says 172.21.15.79:57610) 2024-09-21T02:37:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.288+0000 7f0b39000640 1 -- 172.21.15.79:0/2850597722 learned_addr learned my addr 172.21.15.79:0/2850597722 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.288+0000 7f0b39000640 1 -- 172.21.15.79:0/2850597722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 msgr2=0x55b80089e7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:37:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.288+0000 7f0b39000640 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b80089e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.288+0000 7f0b39000640 1 -- 172.21.15.79:0/2850597722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 msgr2=0x55b80089eea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:37:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.289+0000 7f0b33400640 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b80089eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.289+0000 7f0b39000640 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b80089eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.290+0000 7f0b39000640 1 -- 172.21.15.79:0/2850597722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b800559790 con 0x55b8004ee1b0 2024-09-21T02:37:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.290+0000 7f0b33400640 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b80089eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:37:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.290+0000 7f0b39000640 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004ee1b0 0x55b80089fa10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c02f500 tx=0x7f0b2c02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ac06f333495b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.290+0000 7f0b1e000640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:37:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.291+0000 7f0b1e000640 1 -- 172.21.15.79:0/2850597722 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c004710 con 0x55b8004ee1b0 2024-09-21T02:37:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.291+0000 7f0b1e000640 1 -- 172.21.15.79:0/2850597722 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f0b2c02f660 con 0x55b8004ee1b0 2024-09-21T02:37:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.291+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b240f58e0 con 0x55b8004ee1b0 2024-09-21T02:37:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.293+0000 7f0b1e000640 1 -- 172.21.15.79:0/2850597722 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0b2c05a050 con 0x55b8004ee1b0 2024-09-21T02:37:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.293+0000 7f0b421db740 10 client.25540 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.293+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b8005d2620 con 0x55b8004ee1b0 2024-09-21T02:37:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.293+0000 7f0b1e000640 1 -- 172.21.15.79:0/2850597722 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b240f58e0 con 0x55b8004ee1b0 2024-09-21T02:37:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.293+0000 7f0b1e000640 1 -- 172.21.15.79:0/2850597722 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0b2c030780 con 0x55b8004ee1b0 2024-09-21T02:37:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.293+0000 7f0b421db740 10 client.25540 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.294+0000 7f0b421db740 10 client.25540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.294+0000 7f0b421db740 20 client.25540 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.294+0000 7f0b421db740 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004acd80 0x55b8008bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.294+0000 7f0b421db740 4 client.25540 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:37:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.294+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b80080a600 con 0x55b8004acd80 2024-09-21T02:37:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.294+0000 7f0b33e00640 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004acd80 0x55b8008bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.295+0000 7f0b1e000640 10 client.25540 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.298+0000 7f0b33e00640 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004acd80 0x55b8008bd0a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f51b9c7b7b123bc1 server_cookie=21680d1f66cb4d86 in_seq=0 out_seq=0 2024-09-21T02:37:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.299+0000 7f0b1e000640 1 -- 172.21.15.79:0/2850597722 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b80080a600 con 0x55b8004acd80 2024-09-21T02:37:37.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.299+0000 7f0b1e000640 10 client.25540 handle_command_reply: tid=0 2024-09-21T02:37:37.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.299+0000 7f0b421db740 1 client.25540 shutdown 2024-09-21T02:37:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.299+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004ee1b0 msgr2=0x55b80089fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.299+0000 7f0b421db740 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004ee1b0 0x55b80089fa10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c02f500 tx=0x7f0b2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.300+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 shutdown_connections 2024-09-21T02:37:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.300+0000 7f0b421db740 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004acd80 0x55b8008bd0a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.300+0000 7f0b421db740 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004ee1b0 0x55b80089fa10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.300+0000 7f0b421db740 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b80089eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.300+0000 7f0b421db740 1 --2- 172.21.15.79:0/2850597722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004c52f0 0x55b80089e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.300+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 >> 172.21.15.79:0/2850597722 conn(0x55b8004e2300 msgr2=0x55b80088f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.301+0000 7f0b1e000640 0 client.25540 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.302+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 shutdown_connections 2024-09-21T02:37:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.302+0000 7f0b421db740 1 -- 172.21.15.79:0/2850597722 wait complete. 2024-09-21T02:37:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.302+0000 7f0b421db740 20 client.25540 trim_cache size 0 max 16384 2024-09-21T02:37:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.343+0000 7f0b421db740 1 Processor -- start 2024-09-21T02:37:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b421db740 1 -- start start 2024-09-21T02:37:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b421db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004e2300 0x55b800899ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b421db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004c52f0 0x55b8008904a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b421db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004cd4d0 0x55b80089d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b421db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1400dc20 con 0x55b8004c52f0 2024-09-21T02:37:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b421db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140104a0 con 0x55b8004cd4d0 2024-09-21T02:37:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b421db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1400e290 con 0x55b8004e2300 2024-09-21T02:37:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.344+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004e2300 0x55b800899ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b39000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004cd4d0 0x55b80089d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004e2300 0x55b800899ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57612/0 (socket says 172.21.15.79:57612) 2024-09-21T02:37:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b33e00640 1 -- 172.21.15.79:0/338908287 learned_addr learned my addr 172.21.15.79:0/338908287 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b33e00640 1 -- 172.21.15.79:0/338908287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004cd4d0 msgr2=0x55b80089d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b33e00640 1 --2- 172.21.15.79:0/338908287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004cd4d0 0x55b80089d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b33e00640 1 -- 172.21.15.79:0/338908287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004c52f0 msgr2=0x55b8008904a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:37:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b33e00640 1 --2- 172.21.15.79:0/338908287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004c52f0 0x55b8008904a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.345+0000 7f0b33e00640 1 -- 172.21.15.79:0/338908287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b80089e570 con 0x55b8004e2300 2024-09-21T02:37:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.346+0000 7f0b33e00640 1 --2- 172.21.15.79:0/338908287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004e2300 0x55b800899ba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ad820 tx=0x7f0b24000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd89493a0a2bf09d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.347+0000 7f0b28c00640 1 -- 172.21.15.79:0/338908287 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b240a9ee0 con 0x55b8004e2300 2024-09-21T02:37:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.347+0000 7f0b28c00640 1 -- 172.21.15.79:0/338908287 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b240eb3e0 con 0x55b8004e2300 2024-09-21T02:37:37.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.347+0000 7f0b28c00640 1 -- 172.21.15.79:0/338908287 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ad000 con 0x55b8004e2300 2024-09-21T02:37:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.351+0000 7f0b421db740 1 -- 172.21.15.79:0/338908287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004e2300 msgr2=0x55b800899ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.351+0000 7f0b421db740 1 --2- 172.21.15.79:0/338908287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004e2300 0x55b800899ba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ad820 tx=0x7f0b24000bc0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.352+0000 7f0b421db740 1 -- 172.21.15.79:0/338908287 shutdown_connections 2024-09-21T02:37:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.352+0000 7f0b421db740 1 --2- 172.21.15.79:0/338908287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004cd4d0 0x55b80089d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.352+0000 7f0b421db740 1 --2- 172.21.15.79:0/338908287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004c52f0 0x55b8008904a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.352+0000 7f0b421db740 1 --2- 172.21.15.79:0/338908287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004e2300 0x55b800899ba0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.352+0000 7f0b421db740 1 -- 172.21.15.79:0/338908287 >> 172.21.15.79:0/338908287 conn(0x55b80088bdb0 msgr2=0x55b800894db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:37.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.352+0000 7f0b421db740 1 -- 172.21.15.79:0/338908287 shutdown_connections 2024-09-21T02:37:37.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.352+0000 7f0b421db740 1 -- 172.21.15.79:0/338908287 wait complete. 2024-09-21T02:37:37.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.353+0000 7f0b421db740 1 -- start start 2024-09-21T02:37:37.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.354+0000 7f0b421db740 1 Processor -- start 2024-09-21T02:37:37.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.354+0000 7f0b421db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004c52f0 0x55b8008a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.354+0000 7f0b421db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b8008a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.355+0000 7f0b421db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004e2300 0x55b8008a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.355+0000 7f0b421db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1400e960 con 0x55b8004cd4d0 2024-09-21T02:37:37.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.355+0000 7f0b421db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1400fdd0 con 0x55b8004e2300 2024-09-21T02:37:37.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.355+0000 7f0b421db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1400f030 con 0x55b8004c52f0 2024-09-21T02:37:37.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.355+0000 7f0b421db740 10 client.0 _ll_register_callbacks cb 0x7f0b24005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.355+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004c52f0 0x55b8008a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.356+0000 7f0b33e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004c52f0 0x55b8008a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57622/0 (socket says 172.21.15.79:57622) 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.356+0000 7f0b33e00640 1 -- 172.21.15.79:0/1579573253 learned_addr learned my addr 172.21.15.79:0/1579573253 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.356+0000 7f0b39000640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004e2300 0x55b8008a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.356+0000 7f0b33400640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b8008a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.357+0000 7f0b33400640 1 -- 172.21.15.79:0/1579573253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004c52f0 msgr2=0x55b8008a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.357+0000 7f0b33400640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004c52f0 0x55b8008a53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.357+0000 7f0b33400640 1 -- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004e2300 msgr2=0x55b8008a3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.357+0000 7f0b33400640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004e2300 0x55b8008a3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.357+0000 7f0b33400640 1 -- 172.21.15.79:0/1579573253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8008a6190 con 0x55b8004cd4d0 2024-09-21T02:37:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.357+0000 7f0b33e00640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004c52f0 0x55b8008a53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.357+0000 7f0b39000640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004e2300 0x55b8008a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.359+0000 7f0b33400640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b8008a58f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55b800895d10 tx=0x7f0b20013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529d184644d67338 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.359+0000 7f0b1e000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:37:37.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.360+0000 7f0b1e000640 1 -- 172.21.15.79:0/1579573253 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011d20 con 0x55b8004cd4d0 2024-09-21T02:37:37.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.361+0000 7f0b1e000640 1 -- 172.21.15.79:0/1579573253 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f0b20005020 con 0x55b8004cd4d0 2024-09-21T02:37:37.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.361+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b240eb3e0 con 0x55b8004cd4d0 2024-09-21T02:37:37.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.362+0000 7f0b1e000640 1 -- 172.21.15.79:0/1579573253 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0b20026050 con 0x55b8004cd4d0 2024-09-21T02:37:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.362+0000 7f0b421db740 10 client.15474 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.362+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b800928100 con 0x55b8004cd4d0 2024-09-21T02:37:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.362+0000 7f0b1e000640 1 -- 172.21.15.79:0/1579573253 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b240eb3e0 con 0x55b8004cd4d0 2024-09-21T02:37:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.362+0000 7f0b1e000640 1 -- 172.21.15.79:0/1579573253 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0b2001a030 con 0x55b8004cd4d0 2024-09-21T02:37:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.363+0000 7f0b421db740 10 client.15474 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.363+0000 7f0b421db740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.363+0000 7f0b421db740 20 client.15474 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.363+0000 7f0b421db740 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004ee1b0 0x55b80092ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.363+0000 7f0b421db740 4 client.15474 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:37:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.363+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8008060b0 con 0x55b8004ee1b0 2024-09-21T02:37:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.363+0000 7f0b33e00640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004ee1b0 0x55b80092ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.364+0000 7f0b33e00640 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004ee1b0 0x55b80092ab70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaa555c86eb42848 server_cookie=352299d610b9b3a9 in_seq=0 out_seq=0 2024-09-21T02:37:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.364+0000 7f0b1e000640 10 client.15474 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.378+0000 7f0b1e000640 1 -- 172.21.15.79:0/1579573253 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8008060b0 con 0x55b8004ee1b0 2024-09-21T02:37:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.378+0000 7f0b1e000640 10 client.15474 handle_command_reply: tid=0 2024-09-21T02:37:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.378+0000 7f0b421db740 1 client.15474 shutdown 2024-09-21T02:37:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 msgr2=0x55b8008a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b8008a58f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55b800895d10 tx=0x7f0b20013b70 comp rx=0 tx=0).stop 2024-09-21T02:37:37.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 shutdown_connections 2024-09-21T02:37:37.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b8004ee1b0 0x55b80092ab70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b8004e2300 0x55b8008a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b1e000640 0 client.15474 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8004cd4d0 0x55b8008a58f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 --2- 172.21.15.79:0/1579573253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b8004c52f0 0x55b8008a53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 >> 172.21.15.79:0/1579573253 conn(0x55b80088bdb0 msgr2=0x55b800895f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 shutdown_connections 2024-09-21T02:37:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.379+0000 7f0b421db740 1 -- 172.21.15.79:0/1579573253 wait complete. 2024-09-21T02:37:37.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.380+0000 7f0b421db740 20 client.15474 trim_cache size 0 max 16384 2024-09-21T02:37:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:37:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:37:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:37:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.380+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0b180b6510 msgr2=0x7f0b180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.380+0000 7f0b3b000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0b180b6510 0x7f0b180b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c004af0 tx=0x7f0b2c009360 comp rx=0 tx=0).stop 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 msgr2=0x7f0b341a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 0x7f0b341a8d20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400ea60 tx=0x7f0b2400ef20 comp rx=0 tx=0).stop 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 shutdown_connections 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0b180b6510 0x7f0b180b8a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3410f9d0 0x7f0b341a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3410cdb0 0x7f0b341a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 --2- 172.21.15.79:0/2474851631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3410a3c0 0x7f0b341a8d20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 >> 172.21.15.79:0/2474851631 conn(0x7f0b34070810 msgr2=0x7f0b3410b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.381+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 shutdown_connections 2024-09-21T02:37:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:37.382+0000 7f0b3b000640 1 -- 172.21.15.79:0/2474851631 wait complete. 2024-09-21T02:37:37.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:37 smithi079 ceph-mon[30788]: pgmap v471: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.2 MiB/s wr, 806 op/s 2024-09-21T02:37:37.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:37 smithi148 ceph-mon[34626]: pgmap v471: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.2 MiB/s wr, 806 op/s 2024-09-21T02:37:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:37 smithi098 ceph-mon[34832]: pgmap v471: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.2 MiB/s wr, 806 op/s 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.908+0000 7ffbeda00640 1 -- 172.21.15.79:0/3426828651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe81046b0 msgr2=0x7ffbe8104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.909+0000 7ffbeda00640 1 --2- 172.21.15.79:0/3426828651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe81046b0 0x7ffbe8104ac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009900 tx=0x7ffbd802a440 comp rx=0 tx=0).stop 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.909+0000 7ffbeda00640 1 -- 172.21.15.79:0/3426828651 shutdown_connections 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.909+0000 7ffbeda00640 1 --2- 172.21.15.79:0/3426828651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe810dc60 0x7ffbe8110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.909+0000 7ffbeda00640 1 --2- 172.21.15.79:0/3426828651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbe81050e0 0x7ffbe810d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.909+0000 7ffbeda00640 1 --2- 172.21.15.79:0/3426828651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe81046b0 0x7ffbe8104ac0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.909+0000 7ffbeda00640 1 -- 172.21.15.79:0/3426828651 >> 172.21.15.79:0/3426828651 conn(0x7ffbe80fe2c0 msgr2=0x7ffbe8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.910+0000 7ffbeda00640 1 -- 172.21.15.79:0/3426828651 shutdown_connections 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.911+0000 7ffbeda00640 1 -- 172.21.15.79:0/3426828651 wait complete. 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.914+0000 7ffbeda00640 1 Processor -- start 2024-09-21T02:37:38.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.915+0000 7ffbeda00640 1 -- start start 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbeda00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe81046b0 0x7ffbe81981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbeda00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbe81050e0 0x7ffbe8198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbeda00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe810dc60 0x7ffbe819da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbeda00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe81117c0 con 0x7ffbe81050e0 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbeda00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe8111640 con 0x7ffbe81046b0 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbeda00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe8111940 con 0x7ffbe810dc60 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe81046b0 0x7ffbe81981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbe7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbe81050e0 0x7ffbe8198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe81046b0 0x7ffbe81981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50524/0 (socket says 172.21.15.79:50524) 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.916+0000 7ffbe7e00640 1 -- 172.21.15.79:0/4082760469 learned_addr learned my addr 172.21.15.79:0/4082760469 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.917+0000 7ffbe7e00640 1 -- 172.21.15.79:0/4082760469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe810dc60 msgr2=0x7ffbe819da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.917+0000 7ffbe7e00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe810dc60 0x7ffbe819da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.917+0000 7ffbe7e00640 1 -- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbe81050e0 msgr2=0x7ffbe8198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.917+0000 7ffbe7e00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbe81050e0 0x7ffbe8198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.917+0000 7ffbe7e00640 1 -- 172.21.15.79:0/4082760469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe819e140 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.917+0000 7ffbe7400640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbe81050e0 0x7ffbe8198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.918+0000 7ffbe7e00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe81046b0 0x7ffbe81981d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8005ec0 tx=0x7ffbd8003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.918+0000 7ffbe4c00640 1 -- 172.21.15.79:0/4082760469 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd803f030 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.918+0000 7ffbe4c00640 1 -- 172.21.15.79:0/4082760469 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbd8032b80 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.918+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe819e3d0 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.918+0000 7ffbe4c00640 1 -- 172.21.15.79:0/4082760469 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8035070 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.919+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe81a4b90 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.920+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe8104ac0 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.923+0000 7ffbe4c00640 1 -- 172.21.15.79:0/4082760469 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ffbd8042030 con 0x7ffbe81046b0 2024-09-21T02:37:38.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.926+0000 7ffbe4c00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffbcc0ba9a0 0x7ffbcc0bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:37:38.571 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:37:38.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.927+0000 7ffbe4c00640 1 -- 172.21.15.79:0/4082760469 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ffbd8107d80 con 0x7ffbe81046b0 2024-09-21T02:37:38.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.927+0000 7ffbe4c00640 1 -- 172.21.15.79:0/4082760469 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffbd80ce310 con 0x7ffbe81046b0 2024-09-21T02:37:38.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.927+0000 7ffbe7400640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffbcc0ba9a0 0x7ffbcc0bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:37.928+0000 7ffbe7400640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffbcc0ba9a0 0x7ffbcc0bceb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffbe81100d0 tx=0x7ffbd4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.330+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbe8199300 con 0x7ffbe81046b0 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.331+0000 7ffbe4c00640 1 -- 172.21.15.79:0/4082760469 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7ffbd80d26f0 con 0x7ffbe81046b0 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffbcc0ba9a0 msgr2=0x7ffbcc0bceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffbcc0ba9a0 0x7ffbcc0bceb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffbe81100d0 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe81046b0 msgr2=0x7ffbe81981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe81046b0 0x7ffbe81981d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8005ec0 tx=0x7ffbd8003e00 comp rx=0 tx=0).stop 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 shutdown_connections 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffbcc0ba9a0 0x7ffbcc0bceb0 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffbe81100d0 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe810dc60 0x7ffbe819da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbe81050e0 0x7ffbe8198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 --2- 172.21.15.79:0/4082760469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbe81046b0 0x7ffbe81981d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:38.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.334+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 >> 172.21.15.79:0/4082760469 conn(0x7ffbe80fe2c0 msgr2=0x7ffbe81077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:38.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.335+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 shutdown_connections 2024-09-21T02:37:38.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:38.335+0000 7ffbeda00640 1 -- 172.21.15.79:0/4082760469 wait complete. 2024-09-21T02:37:39.516 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:39 smithi079 ceph-mon[30788]: pgmap v472: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.8 MiB/s wr, 719 op/s 2024-09-21T02:37:39.516 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:39 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4082760469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:37:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:39 smithi148 ceph-mon[34626]: pgmap v472: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.8 MiB/s wr, 719 op/s 2024-09-21T02:37:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:39 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4082760469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:37:39.602 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T02:37:39.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T02:37:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:39 smithi098 ceph-mon[34832]: pgmap v472: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.8 MiB/s wr, 719 op/s 2024-09-21T02:37:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:39 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4082760469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:37:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:37:41.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.160+0000 7f7e1ce00640 1 -- 172.21.15.79:0/148438860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 msgr2=0x7f7e1810bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.160+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/148438860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1810bb10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009900 tx=0x7f7e0402a410 comp rx=0 tx=0).stop 2024-09-21T02:37:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.161+0000 7f7e1ce00640 1 -- 172.21.15.79:0/148438860 shutdown_connections 2024-09-21T02:37:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.161+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/148438860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1810c050 0x7f7e18112880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.161+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/148438860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1810bb10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.161+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/148438860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e18105dc0 0x7f7e181061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.161+0000 7f7e1ce00640 1 -- 172.21.15.79:0/148438860 >> 172.21.15.79:0/148438860 conn(0x7f7e181017d0 msgr2=0x7f7e18103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:41.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.162+0000 7f7e1ce00640 1 -- 172.21.15.79:0/148438860 shutdown_connections 2024-09-21T02:37:41.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.162+0000 7f7e1ce00640 1 -- 172.21.15.79:0/148438860 wait complete. 2024-09-21T02:37:41.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.163+0000 7f7e1ce00640 1 Processor -- start 2024-09-21T02:37:41.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.164+0000 7f7e1ce00640 1 -- start start 2024-09-21T02:37:41.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.164+0000 7f7e1ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e18105dc0 0x7f7e1819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.164+0000 7f7e1ce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.164+0000 7f7e1ce00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1810c050 0x7f7e181a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.164+0000 7f7e1ce00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18115d10 con 0x7f7e18105dc0 2024-09-21T02:37:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.164+0000 7f7e1ce00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18115b90 con 0x7f7e1810b700 2024-09-21T02:37:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.164+0000 7f7e1ce00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18115e90 con 0x7f7e1810c050 2024-09-21T02:37:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e18105dc0 0x7f7e1819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50544/0 (socket says 172.21.15.79:50544) 2024-09-21T02:37:41.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 -- 172.21.15.79:0/1747395092 learned_addr learned my addr 172.21.15.79:0/1747395092 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:41.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e16800640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1810c050 0x7f7e181a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 -- 172.21.15.79:0/1747395092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1810c050 msgr2=0x7f7e181a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1810c050 0x7f7e181a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 -- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e18105dc0 msgr2=0x7f7e1819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e18105dc0 0x7f7e1819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.165+0000 7f7e15400640 1 -- 172.21.15.79:0/1747395092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e181a2630 con 0x7f7e1810b700 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.166+0000 7f7e15400640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1819cc60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e0402a930 tx=0x7f7e04031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.166+0000 7f7e0ea00640 1 -- 172.21.15.79:0/1747395092 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0403f030 con 0x7f7e1810b700 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.166+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e181a28c0 con 0x7f7e1810b700 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.166+0000 7f7e0ea00640 1 -- 172.21.15.79:0/1747395092 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e04004490 con 0x7f7e1810b700 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.166+0000 7f7e0ea00640 1 -- 172.21.15.79:0/1747395092 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04035070 con 0x7f7e1810b700 2024-09-21T02:37:41.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.166+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e181a9080 con 0x7f7e1810b700 2024-09-21T02:37:41.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.172+0000 7f7e0ea00640 1 -- 172.21.15.79:0/1747395092 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7e04042030 con 0x7f7e1810b700 2024-09-21T02:37:41.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.174+0000 7f7e23a96740 1 Processor -- start 2024-09-21T02:37:41.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.174+0000 7f7e23a96740 1 -- start start 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2cd840 0x563edb675350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e0ea00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7dfc0b6610 0x7f7dfc0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2a4980 0x563edb675890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2acb60 0x563edb675dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e23a96740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563edb5eaca0 con 0x563edb2a4980 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e23a96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563edb5da0d0 con 0x563edb2cd840 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e23a96740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563edb5ddee0 con 0x563edb2acb60 2024-09-21T02:37:41.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e0ea00640 1 -- 172.21.15.79:0/1747395092 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7e04107a30 con 0x7f7e1810b700 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e16800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2cd840 0x563edb675350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e16800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2cd840 0x563edb675350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50546/0 (socket says 172.21.15.79:50546) 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e16800640 1 -- 172.21.15.79:0/226862680 learned_addr learned my addr 172.21.15.79:0/226862680 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7dfc0b6610 0x7f7dfc0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.176+0000 7f7e16800640 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2acb60 0x563edb675dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.177+0000 7f7e16800640 1 -- 172.21.15.79:0/226862680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2acb60 msgr2=0x563edb675dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.177+0000 7f7e16800640 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2acb60 0x563edb675dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.177+0000 7f7e16800640 1 -- 172.21.15.79:0/226862680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2a4980 msgr2=0x563edb675890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.177+0000 7f7e16800640 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2a4980 0x563edb675890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.177+0000 7f7e16800640 1 -- 172.21.15.79:0/226862680 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edb58c400 con 0x563edb2cd840 2024-09-21T02:37:41.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.178+0000 7f7e16800640 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2cd840 0x563edb675350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005c40 tx=0x7f7e10005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa118e81454eae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:41.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.178+0000 7f7e03400640 1 -- 172.21.15.79:0/226862680 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10020e10 con 0x563edb2cd840 2024-09-21T02:37:41.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.178+0000 7f7e03400640 1 -- 172.21.15.79:0/226862680 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e10003e20 con 0x563edb2cd840 2024-09-21T02:37:41.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.178+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7dfc0b6610 0x7f7dfc0b8b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009b60 tx=0x7f7e08005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:41.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.178+0000 7f7e03400640 1 -- 172.21.15.79:0/226862680 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10020410 con 0x563edb2cd840 2024-09-21T02:37:41.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.179+0000 7f7e23a96740 1 -- 172.21.15.79:0/226862680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2cd840 msgr2=0x563edb675350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.179+0000 7f7e23a96740 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2cd840 0x563edb675350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005c40 tx=0x7f7e10005bd0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 -- 172.21.15.79:0/226862680 shutdown_connections 2024-09-21T02:37:41.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2acb60 0x563edb675dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2a4980 0x563edb675890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 --2- 172.21.15.79:0/226862680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2cd840 0x563edb675350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 -- 172.21.15.79:0/226862680 >> 172.21.15.79:0/226862680 conn(0x563edb2c1990 msgr2=0x563edb673240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:41.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 -- 172.21.15.79:0/226862680 shutdown_connections 2024-09-21T02:37:41.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 -- 172.21.15.79:0/226862680 wait complete. 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.180+0000 7f7e23a96740 1 -- start start 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 1 Processor -- start 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb680ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 0x563edb681010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb68ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563edb43b7a0 con 0x563edb2cd840 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563edb57fa10 con 0x563edb2acb60 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563edb683b80 con 0x563edb2a4980 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.181+0000 7f7e23a96740 10 client.0 _ll_register_callbacks cb 0x563edb58fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:41.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb680ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb680ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57676/0 (socket says 172.21.15.79:57676) 2024-09-21T02:37:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 -- 172.21.15.79:0/1368810610 learned_addr learned my addr 172.21.15.79:0/1368810610 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 -- 172.21.15.79:0/1368810610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 msgr2=0x563edb681010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:37:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 0x563edb681010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e16800640 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb68ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 -- 172.21.15.79:0/1368810610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 msgr2=0x563edb68ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb68ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.182+0000 7f7e15e00640 1 -- 172.21.15.79:0/1368810610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edb347b90 con 0x563edb2a4980 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.183+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb680ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e08012890 tx=0x7f7e08004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6076f971c40ada80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.183+0000 7f7df7e00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.184+0000 7f7df7e00640 1 -- 172.21.15.79:0/1368810610 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800fce0 con 0x563edb2a4980 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.184+0000 7f7df7e00640 1 -- 172.21.15.79:0/1368810610 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7e0800fae0 con 0x563edb2a4980 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.184+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e10003e20 con 0x563edb2a4980 2024-09-21T02:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.184+0000 7f7df7e00640 1 -- 172.21.15.79:0/1368810610 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7e0800fce0 con 0x563edb2a4980 2024-09-21T02:37:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 10 client.25561 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:41.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563edb68f9b0 con 0x563edb2a4980 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7df7e00640 1 -- 172.21.15.79:0/1368810610 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e10003e20 con 0x563edb2a4980 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7df7e00640 1 -- 172.21.15.79:0/1368810610 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7e0801f420 con 0x563edb2a4980 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 10 client.25561 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 10 client.25561 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 20 client.25561 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb28c1c0 0x563edb692f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 4 client.25561 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.185+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563edb5ecbf0 con 0x563edb28c1c0 2024-09-21T02:37:41.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.186+0000 7f7e15400640 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb28c1c0 0x563edb692f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.187+0000 7f7df7e00640 10 client.25561 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:41.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.187+0000 7f7e15400640 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb28c1c0 0x563edb692f60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbee242def5d7161 server_cookie=ca880dd2aa6a1695 in_seq=0 out_seq=0 2024-09-21T02:37:41.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7df7e00640 1 -- 172.21.15.79:0/1368810610 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563edb5ecbf0 con 0x563edb28c1c0 2024-09-21T02:37:41.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7df7e00640 10 client.25561 handle_command_reply: tid=0 2024-09-21T02:37:41.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 client.25561 shutdown 2024-09-21T02:37:41.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 msgr2=0x563edb680ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb680ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e08012890 tx=0x7f7e08004730 comp rx=0 tx=0).stop 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 shutdown_connections 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb28c1c0 0x563edb692f60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7df7e00640 0 client.25561 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb68ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 0x563edb681010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1368810610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb680ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.188+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 >> 172.21.15.79:0/1368810610 conn(0x563edb2c1990 msgr2=0x563edb676d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.189+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 shutdown_connections 2024-09-21T02:37:41.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.189+0000 7f7e23a96740 1 -- 172.21.15.79:0/1368810610 wait complete. 2024-09-21T02:37:41.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.189+0000 7f7e23a96740 20 client.25561 trim_cache size 0 max 16384 2024-09-21T02:37:41.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.221+0000 7f7e23a96740 1 Processor -- start 2024-09-21T02:37:41.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.221+0000 7f7e23a96740 1 -- start start 2024-09-21T02:37:41.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb681ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 0x563edb68cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb67dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e23a96740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ac9c0 con 0x563edb2cd840 2024-09-21T02:37:41.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e23a96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181af240 con 0x563edb2acb60 2024-09-21T02:37:41.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e23a96740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ad030 con 0x563edb2a4980 2024-09-21T02:37:41.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb681ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.223+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb681ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57684/0 (socket says 172.21.15.79:57684) 2024-09-21T02:37:41.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.223+0000 7f7e15e00640 1 -- 172.21.15.79:0/1301657396 learned_addr learned my addr 172.21.15.79:0/1301657396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:41.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.222+0000 7f7e15400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 0x563edb68cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.224+0000 7f7e15e00640 1 -- 172.21.15.79:0/1301657396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 msgr2=0x563edb68cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:41.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.224+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 0x563edb68cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.224+0000 7f7e16800640 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb67dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.224+0000 7f7e15e00640 1 -- 172.21.15.79:0/1301657396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 msgr2=0x563edb67dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:41.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.224+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb67dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.224+0000 7f7e15e00640 1 -- 172.21.15.79:0/1301657396 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edb66ec50 con 0x563edb2a4980 2024-09-21T02:37:41.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.225+0000 7f7e16800640 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb67dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:37:41.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.225+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb681ff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e0801f890 tx=0x7f7e08009320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36dba65041bd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:41.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.226+0000 7f7e02a00640 1 -- 172.21.15.79:0/1301657396 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0803f070 con 0x563edb2a4980 2024-09-21T02:37:41.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.226+0000 7f7e02a00640 1 -- 172.21.15.79:0/1301657396 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0801fe50 con 0x563edb2a4980 2024-09-21T02:37:41.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.226+0000 7f7e02a00640 1 -- 172.21.15.79:0/1301657396 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08036040 con 0x563edb2a4980 2024-09-21T02:37:41.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.227+0000 7f7e23a96740 1 -- 172.21.15.79:0/1301657396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 msgr2=0x563edb681ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.227+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb681ff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e0801f890 tx=0x7f7e08009320 comp rx=0 tx=0).stop 2024-09-21T02:37:41.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.228+0000 7f7e23a96740 1 -- 172.21.15.79:0/1301657396 shutdown_connections 2024-09-21T02:37:41.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.228+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2cd840 0x563edb67dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.228+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2acb60 0x563edb68cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.228+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1301657396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2a4980 0x563edb681ff0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.228+0000 7f7e23a96740 1 -- 172.21.15.79:0/1301657396 >> 172.21.15.79:0/1301657396 conn(0x563edb2c1990 msgr2=0x563edb676d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.229+0000 7f7e23a96740 1 -- 172.21.15.79:0/1301657396 shutdown_connections 2024-09-21T02:37:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.229+0000 7f7e23a96740 1 -- 172.21.15.79:0/1301657396 wait complete. 2024-09-21T02:37:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.230+0000 7f7e23a96740 1 -- start start 2024-09-21T02:37:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.231+0000 7f7e23a96740 1 Processor -- start 2024-09-21T02:37:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.232+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2a4980 0x563edb6856a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.232+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2acb60 0x563edb685c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.232+0000 7f7e23a96740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2cd840 0x563edb6f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.232+0000 7f7e23a96740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ad700 con 0x563edb2acb60 2024-09-21T02:37:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.232+0000 7f7e23a96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181aeb70 con 0x563edb2a4980 2024-09-21T02:37:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.232+0000 7f7e23a96740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181addd0 con 0x563edb2cd840 2024-09-21T02:37:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.232+0000 7f7e23a96740 10 client.0 _ll_register_callbacks cb 0x7f7e08009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2acb60 0x563edb685c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2a4980 0x563edb6856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2a4980 0x563edb6856a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50582/0 (socket says 172.21.15.79:50582) 2024-09-21T02:37:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2acb60 0x563edb685c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60674/0 (socket says 172.21.15.79:60674) 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15e00640 1 -- 172.21.15.79:0/1151211735 learned_addr learned my addr 172.21.15.79:0/1151211735 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e16800640 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2cd840 0x563edb6f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15e00640 1 -- 172.21.15.79:0/1151211735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2cd840 msgr2=0x563edb6f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2cd840 0x563edb6f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15e00640 1 -- 172.21.15.79:0/1151211735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2acb60 msgr2=0x563edb685c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.233+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2acb60 0x563edb685c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.234+0000 7f7e15e00640 1 -- 172.21.15.79:0/1151211735 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edb6f6f30 con 0x563edb2a4980 2024-09-21T02:37:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.234+0000 7f7e15400640 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2acb60 0x563edb685c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.234+0000 7f7e15e00640 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2a4980 0x563edb6856a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e08012890 tx=0x7f7e0801fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b43649ebe096b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.234+0000 7f7df7e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:37:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.235+0000 7f7df7e00640 1 -- 172.21.15.79:0/1151211735 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08036070 con 0x563edb2a4980 2024-09-21T02:37:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.235+0000 7f7df7e00640 1 -- 172.21.15.79:0/1151211735 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7e08005230 con 0x563edb2a4980 2024-09-21T02:37:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.235+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e0801fe50 con 0x563edb2a4980 2024-09-21T02:37:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.235+0000 7f7df7e00640 1 -- 172.21.15.79:0/1151211735 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7e0804c050 con 0x563edb2a4980 2024-09-21T02:37:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.235+0000 7f7e23a96740 10 client.25544 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.235+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563edb70f1c0 con 0x563edb2a4980 2024-09-21T02:37:41.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.236+0000 7f7df7e00640 1 -- 172.21.15.79:0/1151211735 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0801fe50 con 0x563edb2a4980 2024-09-21T02:37:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.237+0000 7f7df7e00640 1 -- 172.21.15.79:0/1151211735 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7e080314b0 con 0x563edb2a4980 2024-09-21T02:37:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.240+0000 7f7e23a96740 10 client.25544 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.240+0000 7f7e23a96740 10 client.25544 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:37:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.240+0000 7f7e23a96740 20 client.25544 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.240+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb261570 0x563edb711900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.240+0000 7f7e23a96740 4 client.25544 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T02:37:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.240+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x563edb5e86a0 con 0x563edb261570 2024-09-21T02:37:41.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.242+0000 7f7e15400640 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb261570 0x563edb711900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:41.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.243+0000 7f7e15400640 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb261570 0x563edb711900 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba3994d0cbcec3a0 server_cookie=a4b5b00b159d3a52 in_seq=0 out_seq=0 2024-09-21T02:37:41.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.246+0000 7f7df7e00640 10 client.25544 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:41.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:41 smithi079 ceph-mon[30788]: pgmap v473: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.5 MiB/s wr, 694 op/s 2024-09-21T02:37:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.485+0000 7f7df7e00640 1 -- 172.21.15.79:0/1151211735 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563edb5e86a0 con 0x563edb261570 2024-09-21T02:37:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.485+0000 7f7df7e00640 10 client.25544 handle_command_reply: tid=0 2024-09-21T02:37:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.485+0000 7f7e23a96740 1 client.25544 shutdown 2024-09-21T02:37:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.485+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2a4980 msgr2=0x563edb6856a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.485+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2a4980 0x563edb6856a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e08012890 tx=0x7f7e0801fc90 comp rx=0 tx=0).stop 2024-09-21T02:37:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 shutdown_connections 2024-09-21T02:37:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563edb261570 0x563edb711900 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563edb2cd840 0x563edb6f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563edb2acb60 0x563edb685c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 --2- 172.21.15.79:0/1151211735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563edb2a4980 0x563edb6856a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7df7e00640 0 client.25544 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 >> 172.21.15.79:0/1151211735 conn(0x563edb2c1990 msgr2=0x563edb676d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 shutdown_connections 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 1 -- 172.21.15.79:0/1151211735 wait complete. 2024-09-21T02:37:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.486+0000 7f7e23a96740 20 client.25544 trim_cache size 0 max 16384 2024-09-21T02:37:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:37:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:37:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:37:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 10, 2024-09-21T02:37:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "38d584fe": { 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 10, 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:37:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 147.8, 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:37:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:37:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:37:41.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7dfc0b6610 msgr2=0x7f7dfc0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7dfc0b6610 0x7f7dfc0b8b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009b60 tx=0x7f7e08005f90 comp rx=0 tx=0).stop 2024-09-21T02:37:41.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 msgr2=0x7f7e1819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1819cc60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e0402a930 tx=0x7f7e04031a20 comp rx=0 tx=0).stop 2024-09-21T02:37:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 shutdown_connections 2024-09-21T02:37:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7dfc0b6610 0x7f7dfc0b8b20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1810c050 0x7f7e181a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e1810b700 0x7f7e1819cc60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 --2- 172.21.15.79:0/1747395092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e18105dc0 0x7f7e1819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:41.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 >> 172.21.15.79:0/1747395092 conn(0x7f7e181017d0 msgr2=0x7f7e18104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:41.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 shutdown_connections 2024-09-21T02:37:41.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:37:41.487+0000 7f7e1ce00640 1 -- 172.21.15.79:0/1747395092 wait complete. 2024-09-21T02:37:41.496 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 105.0 s, 1792.2 tps, lat 52.639 ms stddev 65.391 2024-09-21T02:37:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:41 smithi148 ceph-mon[34626]: pgmap v473: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.5 MiB/s wr, 694 op/s 2024-09-21T02:37:41.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:41 smithi098 ceph-mon[34832]: pgmap v473: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.5 MiB/s wr, 694 op/s 2024-09-21T02:37:42.514 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '38d584fe', quiesce took 6.2 seconds. Will release after: 21.6 2024-09-21T02:37:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:43 smithi148 ceph-mon[34626]: pgmap v474: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.6 MiB/s wr, 795 op/s 2024-09-21T02:37:43.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:43 smithi098 ceph-mon[34832]: pgmap v474: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.6 MiB/s wr, 795 op/s 2024-09-21T02:37:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:43 smithi079 ceph-mon[30788]: pgmap v474: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.6 MiB/s wr, 795 op/s 2024-09-21T02:37:45.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:45 smithi148 ceph-mon[34626]: pgmap v475: 129 pgs: 129 active+clean; 1005 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.6 MiB/s wr, 708 op/s 2024-09-21T02:37:45.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:45 smithi098 ceph-mon[34832]: pgmap v475: 129 pgs: 129 active+clean; 1005 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.6 MiB/s wr, 708 op/s 2024-09-21T02:37:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:45 smithi079 ceph-mon[30788]: pgmap v475: 129 pgs: 129 active+clean; 1005 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.6 MiB/s wr, 708 op/s 2024-09-21T02:37:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:37:47.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:47 smithi148 ceph-mon[34626]: pgmap v476: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 569 op/s 2024-09-21T02:37:47.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:47 smithi098 ceph-mon[34832]: pgmap v476: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 569 op/s 2024-09-21T02:37:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:47 smithi079 ceph-mon[30788]: pgmap v476: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 569 op/s 2024-09-21T02:37:49.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:49 smithi148 ceph-mon[34626]: pgmap v477: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.2 MiB/s wr, 409 op/s 2024-09-21T02:37:49.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:49 smithi098 ceph-mon[34832]: pgmap v477: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.2 MiB/s wr, 409 op/s 2024-09-21T02:37:49.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:49 smithi079 ceph-mon[30788]: pgmap v477: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.2 MiB/s wr, 409 op/s 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 -- 172.21.15.79:0/2443394020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394078ca0 msgr2=0x7fa3940790b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 --2- 172.21.15.79:0/2443394020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394078ca0 0x7fa3940790b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009900 tx=0x7fa37c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 -- 172.21.15.79:0/2443394020 shutdown_connections 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 --2- 172.21.15.79:0/2443394020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa394079640 0x7fa394079fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 --2- 172.21.15.79:0/2443394020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394078ca0 0x7fa3940790b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 --2- 172.21.15.79:0/2443394020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa394077c20 0x7fa394078090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 -- 172.21.15.79:0/2443394020 >> 172.21.15.79:0/2443394020 conn(0x7fa394101230 msgr2=0x7fa3941036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 -- 172.21.15.79:0/2443394020 shutdown_connections 2024-09-21T02:37:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.594+0000 7fa398e00640 1 -- 172.21.15.79:0/2443394020 wait complete. 2024-09-21T02:37:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.595+0000 7fa398e00640 1 Processor -- start 2024-09-21T02:37:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.595+0000 7fa398e00640 1 -- start start 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa398e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394077c20 0x7fa3941a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa398e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa394078ca0 0x7fa3941a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa398e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa394079640 0x7fa3941a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa398e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa394115990 con 0x7fa394077c20 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa398e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa394115810 con 0x7fa394078ca0 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa398e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa394115b10 con 0x7fa394079640 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394077c20 0x7fa3941a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394077c20 0x7fa3941a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47168/0 (socket says 172.21.15.79:47168) 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 -- 172.21.15.79:0/3000974456 learned_addr learned my addr 172.21.15.79:0/3000974456 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa38be00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa394078ca0 0x7fa3941a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa392800640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa394079640 0x7fa3941a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 -- 172.21.15.79:0/3000974456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa394079640 msgr2=0x7fa3941a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa394079640 0x7fa3941a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 -- 172.21.15.79:0/3000974456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa394078ca0 msgr2=0x7fa3941a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa394078ca0 0x7fa3941a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa391e00640 1 -- 172.21.15.79:0/3000974456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3941a1f80 con 0x7fa394077c20 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.596+0000 7fa392800640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa394079640 0x7fa3941a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.597+0000 7fa391e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394077c20 0x7fa3941a0540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e9f0 tx=0x7fa38400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.597+0000 7fa38aa00640 1 -- 172.21.15.79:0/3000974456 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38400cd80 con 0x7fa394077c20 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.597+0000 7fa38aa00640 1 -- 172.21.15.79:0/3000974456 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3840108e0 con 0x7fa394077c20 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.597+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3941a2270 con 0x7fa394077c20 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.597+0000 7fa38aa00640 1 -- 172.21.15.79:0/3000974456 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384018980 con 0x7fa394077c20 2024-09-21T02:37:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.597+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3941a8960 con 0x7fa394077c20 2024-09-21T02:37:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.600+0000 7fa3a001c740 1 Processor -- start 2024-09-21T02:37:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.600+0000 7fa3a001c740 1 -- start start 2024-09-21T02:37:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.600+0000 7fa38aa00640 1 -- 172.21.15.79:0/3000974456 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa384010430 con 0x7fa394077c20 2024-09-21T02:37:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be000d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be00740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be01290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa3a001c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bd736b0 con 0x55ae7ba302f0 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa3a001c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bd62ae0 con 0x55ae7ba384d0 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa3a001c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bd668f0 con 0x55ae7ba591b0 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa391e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be00740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa392800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa391e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be00740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47174/0 (socket says 172.21.15.79:47174) 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa38be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be01290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa391e00640 1 -- 172.21.15.79:0/1519721297 learned_addr learned my addr 172.21.15.79:0/1519721297 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa38be00640 1 -- 172.21.15.79:0/1519721297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 msgr2=0x55ae7be000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa38be00640 1 --2- 172.21.15.79:0/1519721297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be000d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa38be00640 1 -- 172.21.15.79:0/1519721297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 msgr2=0x55ae7be00740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa38be00640 1 --2- 172.21.15.79:0/1519721297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be00740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.601+0000 7fa38be00640 1 -- 172.21.15.79:0/1519721297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae7bd2f780 con 0x55ae7ba384d0 2024-09-21T02:37:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.602+0000 7fa38be00640 1 --2- 172.21.15.79:0/1519721297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be01290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa37c02a9e0 tx=0x7fa37c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c288283de7fa4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.602+0000 7fa38aa00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa3780b6510 0x7fa3780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.602+0000 7fa383400640 1 -- 172.21.15.79:0/1519721297 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c035030 con 0x55ae7ba384d0 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.602+0000 7fa383400640 1 -- 172.21.15.79:0/1519721297 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa37c040070 con 0x55ae7ba384d0 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.602+0000 7fa383400640 1 -- 172.21.15.79:0/1519721297 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c031900 con 0x55ae7ba384d0 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.602+0000 7fa38aa00640 1 -- 172.21.15.79:0/3000974456 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa3840e7ab0 con 0x7fa394077c20 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.602+0000 7fa392800640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa3780b6510 0x7fa3780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 -- 172.21.15.79:0/1519721297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 msgr2=0x55ae7be01290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa392800640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa3780b6510 0x7fa3780b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa38c005fd0 tx=0x7fa38c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 --2- 172.21.15.79:0/1519721297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be01290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa37c02a9e0 tx=0x7fa37c004040 comp rx=0 tx=0).stop 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 -- 172.21.15.79:0/1519721297 shutdown_connections 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 --2- 172.21.15.79:0/1519721297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be01290 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 --2- 172.21.15.79:0/1519721297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be00740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 --2- 172.21.15.79:0/1519721297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 -- 172.21.15.79:0/1519721297 >> 172.21.15.79:0/1519721297 conn(0x55ae7ba4d300 msgr2=0x55ae7bdfbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 -- 172.21.15.79:0/1519721297 shutdown_connections 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.603+0000 7fa3a001c740 1 -- 172.21.15.79:0/1519721297 wait complete. 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 -- start start 2024-09-21T02:37:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 Processor -- start 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be09770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be09e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7be0a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bc9aab0 con 0x55ae7ba384d0 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bd09570 con 0x55ae7ba591b0 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.604+0000 7fa3a001c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ae7be01d50 con 0x55ae7ba302f0 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa3a001c740 10 client.0 _ll_register_callbacks cb 0x55ae7bd18100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be09e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa392800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7be0a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be09e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47176/0 (socket says 172.21.15.79:47176) 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 -- 172.21.15.79:0/383731965 learned_addr learned my addr 172.21.15.79:0/383731965 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa391e00640 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be09770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 -- 172.21.15.79:0/383731965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 msgr2=0x55ae7be09770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be09770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 -- 172.21.15.79:0/383731965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 msgr2=0x55ae7be0a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7be0a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 -- 172.21.15.79:0/383731965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae7bac4790 con 0x55ae7ba384d0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa38be00640 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be09e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0045d0 tx=0x7fa37c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36c424ec33c5d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.605+0000 7fa377e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.606+0000 7fa377e00640 1 -- 172.21.15.79:0/383731965 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c052060 con 0x55ae7ba384d0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.606+0000 7fa377e00640 1 -- 172.21.15.79:0/383731965 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa37c003ac0 con 0x55ae7ba384d0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.606+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa37c040070 con 0x55ae7ba384d0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.606+0000 7fa377e00640 1 -- 172.21.15.79:0/383731965 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa37c059050 con 0x55ae7ba384d0 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.606+0000 7fa3a001c740 10 client.15498 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.606+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ae7bb3d620 con 0x55ae7ba384d0 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.606+0000 7fa377e00640 1 -- 172.21.15.79:0/383731965 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa37c040070 con 0x55ae7ba384d0 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa377e00640 1 -- 172.21.15.79:0/383731965 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa37c045670 con 0x55ae7ba384d0 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa3a001c740 10 client.15498 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa3a001c740 10 client.15498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa3a001c740 20 client.15498 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa3a001c740 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7ba17d80 0x55ae7be16a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa3a001c740 4 client.15498 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae7bd75600 con 0x55ae7ba17d80 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.607+0000 7fa391e00640 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7ba17d80 0x55ae7be16a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.608+0000 7fa377e00640 10 client.15498 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.608+0000 7fa391e00640 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7ba17d80 0x55ae7be16a10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b76dfc864e0f957 server_cookie=e779eee94e8409ec in_seq=0 out_seq=0 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.608+0000 7fa377e00640 1 -- 172.21.15.79:0/383731965 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae7bd75600 con 0x55ae7ba17d80 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.608+0000 7fa377e00640 10 client.15498 handle_command_reply: tid=0 2024-09-21T02:37:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 client.15498 shutdown 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 msgr2=0x55ae7be09e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be09e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0045d0 tx=0x7fa37c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 shutdown_connections 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7ba17d80 0x55ae7be16a10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7be0a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa377e00640 0 client.15498 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be09e30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 --2- 172.21.15.79:0/383731965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be09770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 >> 172.21.15.79:0/383731965 conn(0x55ae7ba4d300 msgr2=0x55ae7bdfc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 shutdown_connections 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 1 -- 172.21.15.79:0/383731965 wait complete. 2024-09-21T02:37:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.609+0000 7fa3a001c740 20 client.15498 trim_cache size 0 max 16384 2024-09-21T02:37:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 Processor -- start 2024-09-21T02:37:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 -- start start 2024-09-21T02:37:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be11810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7bdfb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b0c30 con 0x55ae7ba384d0 2024-09-21T02:37:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b34b0 con 0x55ae7ba591b0 2024-09-21T02:37:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.624+0000 7fa3a001c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b12a0 con 0x55ae7ba302f0 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be11810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa391e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be11810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47182/0 (socket says 172.21.15.79:47182) 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 -- 172.21.15.79:0/3305294242 learned_addr learned my addr 172.21.15.79:0/3305294242 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa392800640 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7bdfb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 -- 172.21.15.79:0/3305294242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 msgr2=0x55ae7be003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 -- 172.21.15.79:0/3305294242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 msgr2=0x55ae7bdfb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7bdfb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 -- 172.21.15.79:0/3305294242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae7be16d80 con 0x55ae7ba384d0 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.625+0000 7fa38be00640 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be11810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa37c031440 tx=0x7fa37c02ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a649c915533c96d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa382a00640 1 -- 172.21.15.79:0/3305294242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c035050 con 0x55ae7ba384d0 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa382a00640 1 -- 172.21.15.79:0/3305294242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa37c040070 con 0x55ae7ba384d0 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa382a00640 1 -- 172.21.15.79:0/3305294242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c031a70 con 0x55ae7ba384d0 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 -- 172.21.15.79:0/3305294242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 msgr2=0x55ae7be11810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be11810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa37c031440 tx=0x7fa37c02ab70 comp rx=0 tx=0).stop 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 -- 172.21.15.79:0/3305294242 shutdown_connections 2024-09-21T02:37:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba591b0 0x55ae7bdfb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba384d0 0x55ae7be11810 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 --2- 172.21.15.79:0/3305294242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba302f0 0x55ae7be003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 -- 172.21.15.79:0/3305294242 >> 172.21.15.79:0/3305294242 conn(0x55ae7ba4d300 msgr2=0x55ae7bdffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 -- 172.21.15.79:0/3305294242 shutdown_connections 2024-09-21T02:37:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.626+0000 7fa3a001c740 1 -- 172.21.15.79:0/3305294242 wait complete. 2024-09-21T02:37:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.627+0000 7fa3a001c740 1 -- start start 2024-09-21T02:37:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.627+0000 7fa3a001c740 1 Processor -- start 2024-09-21T02:37:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.627+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be0e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.627+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be0f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.627+0000 7fa3a001c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be0fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.627+0000 7fa3a001c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b1970 con 0x55ae7ba302f0 2024-09-21T02:37:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa3a001c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b2de0 con 0x55ae7ba384d0 2024-09-21T02:37:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa3a001c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b2040 con 0x55ae7ba591b0 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa3a001c740 10 client.0 _ll_register_callbacks cb 0x7fa3840eb3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be0e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be0e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47196/0 (socket says 172.21.15.79:47196) 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 -- 172.21.15.79:0/2977616812 learned_addr learned my addr 172.21.15.79:0/2977616812 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa38be00640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be0f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa392800640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be0fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 -- 172.21.15.79:0/2977616812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 msgr2=0x55ae7be0fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be0fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 -- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 msgr2=0x55ae7be0f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be0f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 -- 172.21.15.79:0/2977616812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae7be10300 con 0x55ae7ba302f0 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa38be00640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be0f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa391e00640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be0e970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa3840eb200 tx=0x7fa384018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82feb44333e0b647 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.628+0000 7fa377e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa377e00640 1 -- 172.21.15.79:0/2977616812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3840ad600 con 0x55ae7ba302f0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa377e00640 1 -- 172.21.15.79:0/2977616812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa384018b20 con 0x55ae7ba302f0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa37c040070 con 0x55ae7ba302f0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa377e00640 1 -- 172.21.15.79:0/2977616812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa3840acfa0 con 0x55ae7ba302f0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 10 client.15504 fetch_fsmap learned FSMap version 21 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ae7be11690 con 0x55ae7ba302f0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa377e00640 1 -- 172.21.15.79:0/2977616812 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa37c040070 con 0x55ae7ba302f0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa377e00640 1 -- 172.21.15.79:0/2977616812 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa3840ac500 con 0x55ae7ba302f0 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 10 client.15504 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 20 client.15504 populate_metadata read hostname 'smithi079' 2024-09-21T02:37:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7b9ed1c0 0x55ae7be83670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 4 client.15504 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:37:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.629+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae7bd710b0 con 0x55ae7b9ed1c0 2024-09-21T02:37:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.630+0000 7fa38be00640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7b9ed1c0 0x55ae7be83670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.630+0000 7fa38be00640 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7b9ed1c0 0x55ae7be83670 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e3712db6acad2f server_cookie=e48e245ecdb8a8a in_seq=0 out_seq=0 2024-09-21T02:37:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.630+0000 7fa377e00640 10 client.15504 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa377e00640 1 -- 172.21.15.79:0/2977616812 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae7bd710b0 con 0x55ae7b9ed1c0 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa377e00640 10 client.15504 handle_command_reply: tid=0 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 client.15504 shutdown 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 msgr2=0x55ae7be0e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be0e970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa3840eb200 tx=0x7fa384018420 comp rx=0 tx=0).stop 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 shutdown_connections 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ae7b9ed1c0 0x55ae7be83670 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae7ba591b0 0x55ae7be0fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae7ba384d0 0x55ae7be0f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 --2- 172.21.15.79:0/2977616812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae7ba302f0 0x55ae7be0e970 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa377e00640 0 client.15504 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 >> 172.21.15.79:0/2977616812 conn(0x55ae7ba4d300 msgr2=0x55ae7bdfb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 shutdown_connections 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.650+0000 7fa3a001c740 1 -- 172.21.15.79:0/2977616812 wait complete. 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa3a001c740 20 client.15504 trim_cache size 0 max 16384 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:37:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:37:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:37:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa3780b6510 msgr2=0x7fa3780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa3780b6510 0x7fa3780b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa38c005fd0 tx=0x7fa38c009500 comp rx=0 tx=0).stop 2024-09-21T02:37:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394077c20 msgr2=0x7fa3941a0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394077c20 0x7fa3941a0540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e9f0 tx=0x7fa38400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 shutdown_connections 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa3780b6510 0x7fa3780b8a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa394079640 0x7fa3941a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa394078ca0 0x7fa3941a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 --2- 172.21.15.79:0/3000974456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa394077c20 0x7fa3941a0540 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.651+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 >> 172.21.15.79:0/3000974456 conn(0x7fa394101230 msgr2=0x7fa3941036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.652+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 shutdown_connections 2024-09-21T02:37:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:37:50.652+0000 7fa398e00640 1 -- 172.21.15.79:0/3000974456 wait complete. 2024-09-21T02:37:51.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:37:51.562 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:51 smithi148 ceph-mon[34626]: pgmap v478: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-09-21T02:37:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:51 smithi098 ceph-mon[34832]: pgmap v478: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-09-21T02:37:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:51 smithi079 ceph-mon[30788]: pgmap v478: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-09-21T02:37:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:52.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:37:52.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:52.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:52.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:52.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:37:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:52.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:37:53.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:53 smithi148 ceph-mon[34626]: pgmap v479: 129 pgs: 129 active+clean; 1018 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-09-21T02:37:53.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:53 smithi098 ceph-mon[34832]: pgmap v479: 129 pgs: 129 active+clean; 1018 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-09-21T02:37:53.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:53 smithi079 ceph-mon[30788]: pgmap v479: 129 pgs: 129 active+clean; 1018 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-09-21T02:37:55.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:55 smithi148 ceph-mon[34626]: pgmap v480: 129 pgs: 129 active+clean; 1018 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.5 MiB/s wr, 119 op/s 2024-09-21T02:37:55.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:55 smithi098 ceph-mon[34832]: pgmap v480: 129 pgs: 129 active+clean; 1018 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.5 MiB/s wr, 119 op/s 2024-09-21T02:37:55.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:55 smithi079 ceph-mon[30788]: pgmap v480: 129 pgs: 129 active+clean; 1018 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.5 MiB/s wr, 119 op/s 2024-09-21T02:37:56.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:37:57.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:57 smithi148 ceph-mon[34626]: pgmap v481: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 MiB/s wr, 308 op/s 2024-09-21T02:37:57.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:57 smithi098 ceph-mon[34832]: pgmap v481: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 MiB/s wr, 308 op/s 2024-09-21T02:37:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:57 smithi079 ceph-mon[30788]: pgmap v481: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 MiB/s wr, 308 op/s 2024-09-21T02:37:59.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:37:59 smithi148 ceph-mon[34626]: pgmap v482: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 398 op/s 2024-09-21T02:37:59.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:37:59 smithi098 ceph-mon[34832]: pgmap v482: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 398 op/s 2024-09-21T02:37:59.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:37:59 smithi079 ceph-mon[30788]: pgmap v482: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 398 op/s 2024-09-21T02:38:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:38:01.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:01 smithi098 ceph-mon[34832]: pgmap v483: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 498 op/s 2024-09-21T02:38:01.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:01 smithi079 ceph-mon[30788]: pgmap v483: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 498 op/s 2024-09-21T02:38:01.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:01 smithi148 ceph-mon[34626]: pgmap v483: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 498 op/s 2024-09-21T02:38:03.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:03 smithi098 ceph-mon[34832]: pgmap v484: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 499 op/s 2024-09-21T02:38:03.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:03 smithi079 ceph-mon[30788]: pgmap v484: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 499 op/s 2024-09-21T02:38:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:03 smithi148 ceph-mon[34626]: pgmap v484: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 499 op/s 2024-09-21T02:38:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 -- 172.21.15.79:0/2830985399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 msgr2=0x7f5420103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 --2- 172.21.15.79:0/2830985399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420103b40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5410009900 tx=0x7f541002a410 comp rx=0 tx=0).stop 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 -- 172.21.15.79:0/2830985399 shutdown_connections 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 --2- 172.21.15.79:0/2830985399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54201050f0 0x7f542010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 --2- 172.21.15.79:0/2830985399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5420104750 0x7f5420104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 --2- 172.21.15.79:0/2830985399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420103b40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 -- 172.21.15.79:0/2830985399 >> 172.21.15.79:0/2830985399 conn(0x7f54200ff030 msgr2=0x7f54201014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 -- 172.21.15.79:0/2830985399 shutdown_connections 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.846+0000 7f5426600640 1 -- 172.21.15.79:0/2830985399 wait complete. 2024-09-21T02:38:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.847+0000 7f5426600640 1 Processor -- start 2024-09-21T02:38:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.847+0000 7f5426600640 1 -- start start 2024-09-21T02:38:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f5426600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f5426600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5420104750 0x7f5420075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f5426600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54201050f0 0x7f5420075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f5426600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f542010f360 con 0x7f54201036d0 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f5426600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f542010f1e0 con 0x7f54201050f0 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f5426600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f542010f4e0 con 0x7f5420104750 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f541f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f541f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53488/0 (socket says 172.21.15.79:53488) 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f541f400640 1 -- 172.21.15.79:0/2066642035 learned_addr learned my addr 172.21.15.79:0/2066642035 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f541ea00640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5420104750 0x7f5420075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.848+0000 7f541fe00640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54201050f0 0x7f5420075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f541f400640 1 -- 172.21.15.79:0/2066642035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5420104750 msgr2=0x7f5420075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f541f400640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5420104750 0x7f5420075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f541f400640 1 -- 172.21.15.79:0/2066642035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54201050f0 msgr2=0x7f5420075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f541f400640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54201050f0 0x7f5420075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f541f400640 1 -- 172.21.15.79:0/2066642035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5420076380 con 0x7f54201036d0 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f541ea00640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5420104750 0x7f5420075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f541f400640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420076e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5410031440 tx=0x7f5410003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f5417e00640 1 -- 172.21.15.79:0/2066642035 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541003f070 con 0x7f54201036d0 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f5417e00640 1 -- 172.21.15.79:0/2066642035 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5410031c50 con 0x7f54201036d0 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f5417e00640 1 -- 172.21.15.79:0/2066642035 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410035030 con 0x7f54201036d0 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54201a4010 con 0x7f54201036d0 2024-09-21T02:38:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.849+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54201a43c0 con 0x7f54201036d0 2024-09-21T02:38:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.853+0000 7f542d84c740 1 Processor -- start 2024-09-21T02:38:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.853+0000 7f542d84c740 1 -- start start 2024-09-21T02:38:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f542d84c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3ddd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f542d84c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3ddd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f542d84c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dde290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f542d84c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564c3d506b0 con 0x5564c3a154d0 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f542d84c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564c3d3fae0 con 0x5564c3a0d2f0 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f542d84c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5564c3d438f0 con 0x5564c3a361b0 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f541ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dde290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f541fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3ddd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f541fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3ddd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39574/0 (socket says 172.21.15.79:39574) 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f541fe00640 1 -- 172.21.15.79:0/3650709358 learned_addr learned my addr 172.21.15.79:0/3650709358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.854+0000 7f5417e00640 1 -- 172.21.15.79:0/2066642035 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5410042070 con 0x7f54201036d0 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f541fe00640 1 -- 172.21.15.79:0/3650709358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 msgr2=0x5564c3ddd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f541fe00640 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3ddd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f541fe00640 1 -- 172.21.15.79:0/3650709358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 msgr2=0x5564c3dde290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f541fe00640 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dde290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f541fe00640 1 -- 172.21.15.79:0/3650709358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c3d0c780 con 0x5564c3a361b0 2024-09-21T02:38:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f541ea00640 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dde290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f541fe00640 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3ddd0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5418009fd0 tx=0x7f54180118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3857d2d73a47f5e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f5414c00640 1 -- 172.21.15.79:0/3650709358 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418004d20 con 0x5564c3a361b0 2024-09-21T02:38:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f5414c00640 1 -- 172.21.15.79:0/3650709358 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5418004050 con 0x5564c3a361b0 2024-09-21T02:38:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.855+0000 7f5414c00640 1 -- 172.21.15.79:0/3650709358 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418005220 con 0x5564c3a361b0 2024-09-21T02:38:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f5417e00640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f54040b6510 0x7f54040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f5417e00640 1 -- 172.21.15.79:0/2066642035 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f5410107d70 con 0x7f54201036d0 2024-09-21T02:38:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 -- 172.21.15.79:0/3650709358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 msgr2=0x5564c3ddd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3ddd0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5418009fd0 tx=0x7f54180118d0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f541f400640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f54040b6510 0x7f54040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 -- 172.21.15.79:0/3650709358 shutdown_connections 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dde290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3ddd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 --2- 172.21.15.79:0/3650709358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3ddd0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 -- 172.21.15.79:0/3650709358 >> 172.21.15.79:0/3650709358 conn(0x5564c3a2a300 msgr2=0x5564c3dd8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.856+0000 7f542d84c740 1 -- 172.21.15.79:0/3650709358 shutdown_connections 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.857+0000 7f542d84c740 1 -- 172.21.15.79:0/3650709358 wait complete. 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.857+0000 7f541f400640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f54040b6510 0x7f54040b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54100cd900 tx=0x7f5410009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.857+0000 7f542d84c740 1 -- start start 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.857+0000 7f542d84c740 1 Processor -- start 2024-09-21T02:38:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f542d84c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f542d84c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3de6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f542d84c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f542d84c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564c3c77ab0 con 0x5564c3a154d0 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f542d84c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564c3ce6570 con 0x5564c3a0d2f0 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f542d84c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5564c3ddedb0 con 0x5564c3a361b0 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f542d84c740 10 client.0 _ll_register_callbacks cb 0x5564c3cf5100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38248/0 (socket says 172.21.15.79:38248) 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 -- 172.21.15.79:0/1293488992 learned_addr learned my addr 172.21.15.79:0/1293488992 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541ea00640 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3de6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 -- 172.21.15.79:0/1293488992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 msgr2=0x5564c3de79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 -- 172.21.15.79:0/1293488992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 msgr2=0x5564c3de6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3de6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.858+0000 7f541fe00640 1 -- 172.21.15.79:0/1293488992 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c3aa1790 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f541fe00640 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de6790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5418004910 tx=0x7f5418004880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99250a98394d909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f5409600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f5409600640 1 -- 172.21.15.79:0/1293488992 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541800f8f0 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5418004050 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f5409600640 1 -- 172.21.15.79:0/1293488992 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f541800fa90 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f5409600640 1 -- 172.21.15.79:0/1293488992 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5418035050 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f542d84c740 10 client.25571 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5564c3b1a620 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.859+0000 7f5409600640 1 -- 172.21.15.79:0/1293488992 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5418004050 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f5409600640 1 -- 172.21.15.79:0/1293488992 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5418019c80 con 0x5564c3a0d2f0 2024-09-21T02:38:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f542d84c740 10 client.25571 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:03.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f542d84c740 10 client.25571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:03.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f542d84c740 20 client.25571 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:03.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f542d84c740 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39f4d80 0x5564c3df3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f542d84c740 4 client.25571 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:03.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564c3d52600 con 0x5564c39f4d80 2024-09-21T02:38:03.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.860+0000 7f541ea00640 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39f4d80 0x5564c3df3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.861+0000 7f541ea00640 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39f4d80 0x5564c3df3cc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12f0f1d3c565b85d server_cookie=effd4f4bfecfd36 in_seq=0 out_seq=0 2024-09-21T02:38:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.861+0000 7f5409600640 10 client.25571 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f5409600640 1 -- 172.21.15.79:0/1293488992 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564c3d52600 con 0x5564c39f4d80 2024-09-21T02:38:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f5409600640 10 client.25571 handle_command_reply: tid=0 2024-09-21T02:38:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 client.25571 shutdown 2024-09-21T02:38:03.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 msgr2=0x5564c3de6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de6790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5418004910 tx=0x7f5418004880 comp rx=0 tx=0).stop 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 shutdown_connections 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39f4d80 0x5564c3df3cc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f5409600640 0 client.25571 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3de6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 --2- 172.21.15.79:0/1293488992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de6790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 >> 172.21.15.79:0/1293488992 conn(0x5564c3a2a300 msgr2=0x5564c3dd70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 shutdown_connections 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 1 -- 172.21.15.79:0/1293488992 wait complete. 2024-09-21T02:38:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.862+0000 7f542d84c740 20 client.25571 trim_cache size 0 max 16384 2024-09-21T02:38:03.878 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.877+0000 7f542d84c740 1 Processor -- start 2024-09-21T02:38:03.878 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.877+0000 7f542d84c740 1 -- start start 2024-09-21T02:38:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f542d84c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f542d84c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dd3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f542d84c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f542d84c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54201ac910 con 0x5564c3a154d0 2024-09-21T02:38:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f542d84c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f54201af190 con 0x5564c3a0d2f0 2024-09-21T02:38:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f542d84c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54201acf80 con 0x5564c3a361b0 2024-09-21T02:38:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dd3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dd3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53500/0 (socket says 172.21.15.79:53500) 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38250/0 (socket says 172.21.15.79:38250) 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541ea00640 1 -- 172.21.15.79:0/2243429173 learned_addr learned my addr 172.21.15.79:0/2243429173 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 -- 172.21.15.79:0/2243429173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 msgr2=0x5564c3de6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 -- 172.21.15.79:0/2243429173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 msgr2=0x5564c3dd3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dd3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541fe00640 1 -- 172.21.15.79:0/2243429173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c3dde600 con 0x5564c3a0d2f0 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.878+0000 7f541ea00640 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dd3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.879+0000 7f541fe00640 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de1be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5418033040 tx=0x7f54180118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45ebebe26fe8654b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.879+0000 7f540be00640 1 -- 172.21.15.79:0/2243429173 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418027800 con 0x5564c3a0d2f0 2024-09-21T02:38:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.879+0000 7f540be00640 1 -- 172.21.15.79:0/2243429173 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f541802c070 con 0x5564c3a0d2f0 2024-09-21T02:38:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.879+0000 7f540be00640 1 -- 172.21.15.79:0/2243429173 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541800f6f0 con 0x5564c3a0d2f0 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 -- 172.21.15.79:0/2243429173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 msgr2=0x5564c3de1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de1be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5418033040 tx=0x7f54180118d0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 -- 172.21.15.79:0/2243429173 shutdown_connections 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a361b0 0x5564c3de6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a154d0 0x5564c3dd3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 --2- 172.21.15.79:0/2243429173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a0d2f0 0x5564c3de1be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 -- 172.21.15.79:0/2243429173 >> 172.21.15.79:0/2243429173 conn(0x5564c3a2a300 msgr2=0x5564c3dd9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 -- 172.21.15.79:0/2243429173 shutdown_connections 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 -- 172.21.15.79:0/2243429173 wait complete. 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 -- start start 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.880+0000 7f542d84c740 1 Processor -- start 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f542d84c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a0d2f0 0x5564c3dee310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f542d84c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a154d0 0x5564c3decfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f542d84c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a361b0 0x5564c3ded510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f542d84c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54201ad650 con 0x5564c3a361b0 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f542d84c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f54201aeac0 con 0x5564c3a154d0 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f542d84c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54201add20 con 0x5564c3a0d2f0 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f542d84c740 10 client.0 _ll_register_callbacks cb 0x7f540c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f541fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a361b0 0x5564c3ded510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f541fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a0d2f0 0x5564c3dee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f541fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a0d2f0 0x5564c3dee310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39592/0 (socket says 172.21.15.79:39592) 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f541fe00640 1 -- 172.21.15.79:0/1663748771 learned_addr learned my addr 172.21.15.79:0/1663748771 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.881+0000 7f541ea00640 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a154d0 0x5564c3decfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f541fe00640 1 -- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a154d0 msgr2=0x5564c3decfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f541fe00640 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a154d0 0x5564c3decfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f541fe00640 1 -- 172.21.15.79:0/1663748771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a361b0 msgr2=0x5564c3ded510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f541fe00640 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a361b0 0x5564c3ded510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f541fe00640 1 -- 172.21.15.79:0/1663748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c3df4030 con 0x5564c3a0d2f0 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f541ea00640 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a154d0 0x5564c3decfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f541fe00640 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a0d2f0 0x5564c3dee310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f54180048e0 tx=0x7f541800ffd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9728a78b7fabd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f5409600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f5409600640 1 -- 172.21.15.79:0/1663748771 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418004650 con 0x5564c3a0d2f0 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f541802c070 con 0x5564c3a0d2f0 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f5409600640 1 -- 172.21.15.79:0/1663748771 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f5418027b00 con 0x5564c3a0d2f0 2024-09-21T02:38:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f5409600640 1 -- 172.21.15.79:0/1663748771 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f541804c050 con 0x5564c3a0d2f0 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f542d84c740 10 client.25603 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.882+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5564c3dec6d0 con 0x5564c3a0d2f0 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f5409600640 1 -- 172.21.15.79:0/1663748771 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f541802c070 con 0x5564c3a0d2f0 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f5409600640 1 -- 172.21.15.79:0/1663748771 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f54180315d0 con 0x5564c3a0d2f0 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f542d84c740 10 client.25603 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f542d84c740 10 client.25603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f542d84c740 20 client.25603 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f542d84c740 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39ca1c0 0x5564c3e60ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f542d84c740 4 client.25603 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564c3d4e0b0 con 0x5564c39ca1c0 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.883+0000 7f541ea00640 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39ca1c0 0x5564c3e60ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.884+0000 7f541ea00640 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39ca1c0 0x5564c3e60ac0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a74c9b908fc2a211 server_cookie=c06885621a7b0a2e in_seq=0 out_seq=0 2024-09-21T02:38:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.884+0000 7f5409600640 10 client.25603 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f5409600640 1 -- 172.21.15.79:0/1663748771 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564c3d4e0b0 con 0x5564c39ca1c0 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f5409600640 10 client.25603 handle_command_reply: tid=0 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 client.25603 shutdown 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a0d2f0 msgr2=0x5564c3dee310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a0d2f0 0x5564c3dee310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f54180048e0 tx=0x7f541800ffd0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 shutdown_connections 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5564c39ca1c0 0x5564c3e60ac0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564c3a361b0 0x5564c3ded510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c3a154d0 0x5564c3decfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 --2- 172.21.15.79:0/1663748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5564c3a0d2f0 0x5564c3dee310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f5409600640 0 client.25603 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.900+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 >> 172.21.15.79:0/1663748771 conn(0x5564c3a2a300 msgr2=0x5564c3de19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 shutdown_connections 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f542d84c740 1 -- 172.21.15.79:0/1663748771 wait complete. 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f542d84c740 20 client.25603 trim_cache size 0 max 16384 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:38:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:38:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f54040b6510 msgr2=0x7f54040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f54040b6510 0x7f54040b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54100cd900 tx=0x7f5410009260 comp rx=0 tx=0).stop 2024-09-21T02:38:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 msgr2=0x7f5420076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420076e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5410031440 tx=0x7f5410003c10 comp rx=0 tx=0).stop 2024-09-21T02:38:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 shutdown_connections 2024-09-21T02:38:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f54040b6510 0x7f54040b8a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54201050f0 0x7f5420075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5420104750 0x7f5420075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 --2- 172.21.15.79:0/2066642035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54201036d0 0x7f5420076e50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.901+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 >> 172.21.15.79:0/2066642035 conn(0x7f54200ff030 msgr2=0x7f5420107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.902+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 shutdown_connections 2024-09-21T02:38:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:03.902+0000 7f5426600640 1 -- 172.21.15.79:0/2066642035 wait complete. 2024-09-21T02:38:04.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:38:04.486 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:05.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 -- 172.21.15.79:0/3687835094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d78109c40 msgr2=0x7f6d78110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/3687835094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d78109c40 0x7f6d78110470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009ca0 tx=0x7f6d7002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 -- 172.21.15.79:0/3687835094 shutdown_connections 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/3687835094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d78109c40 0x7f6d78110470 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/3687835094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d781092f0 0x7f6d78109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/3687835094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d781039b0 0x7f6d78103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 -- 172.21.15.79:0/3687835094 >> 172.21.15.79:0/3687835094 conn(0x7f6d780ff440 msgr2=0x7f6d78101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 -- 172.21.15.79:0/3687835094 shutdown_connections 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.137+0000 7f6d7dc00640 1 -- 172.21.15.79:0/3687835094 wait complete. 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.138+0000 7f6d7dc00640 1 Processor -- start 2024-09-21T02:38:05.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.138+0000 7f6d7dc00640 1 -- start start 2024-09-21T02:38:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d7dc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d781039b0 0x7f6d7819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d7dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d781092f0 0x7f6d7819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d7dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d78109c40 0x7f6d7819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d7dc00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78113950 con 0x7f6d781039b0 2024-09-21T02:38:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d7dc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6d781137d0 con 0x7f6d781092f0 2024-09-21T02:38:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d7dc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78113ad0 con 0x7f6d78109c40 2024-09-21T02:38:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d77e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d781039b0 0x7f6d7819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d77e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d781039b0 0x7f6d7819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53534/0 (socket says 172.21.15.79:53534) 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d77e00640 1 -- 172.21.15.79:0/2442128458 learned_addr learned my addr 172.21.15.79:0/2442128458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d6f400640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d781092f0 0x7f6d7819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.139+0000 7f6d7d200640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d78109c40 0x7f6d7819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d77e00640 1 -- 172.21.15.79:0/2442128458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d78109c40 msgr2=0x7f6d7819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d77e00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d78109c40 0x7f6d7819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d77e00640 1 -- 172.21.15.79:0/2442128458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d781092f0 msgr2=0x7f6d7819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d77e00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d781092f0 0x7f6d7819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d77e00640 1 -- 172.21.15.79:0/2442128458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d781a0210 con 0x7f6d781039b0 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d77e00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d781039b0 0x7f6d7819a2a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800e9f0 tx=0x7f6d6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d75600640 1 -- 172.21.15.79:0/2442128458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800cd80 con 0x7f6d781039b0 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d75600640 1 -- 172.21.15.79:0/2442128458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d680054d0 con 0x7f6d781039b0 2024-09-21T02:38:05.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.140+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d781a0500 con 0x7f6d781039b0 2024-09-21T02:38:05.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.141+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d781a6c60 con 0x7f6d781039b0 2024-09-21T02:38:05.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.141+0000 7f6d75600640 1 -- 172.21.15.79:0/2442128458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68018630 con 0x7f6d781039b0 2024-09-21T02:38:05.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.142+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d78103dc0 con 0x7f6d781039b0 2024-09-21T02:38:05.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.144+0000 7f6d75600640 1 -- 172.21.15.79:0/2442128458 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6d68004e70 con 0x7f6d781039b0 2024-09-21T02:38:05.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.145+0000 7f6d75600640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6d5c0b6510 0x7f6d5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:05.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.146+0000 7f6d75600640 1 -- 172.21.15.79:0/2442128458 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f6d680e82c0 con 0x7f6d781039b0 2024-09-21T02:38:05.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.146+0000 7f6d6f400640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6d5c0b6510 0x7f6d5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:05.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.146+0000 7f6d6f400640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6d5c0b6510 0x7f6d5c0b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6d78105ca0 tx=0x7f6d60005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:05.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.148+0000 7f6d75600640 1 -- 172.21.15.79:0/2442128458 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d680ae740 con 0x7f6d781039b0 2024-09-21T02:38:05.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.372+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d7819b3d0 con 0x7f6d781039b0 2024-09-21T02:38:05.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.373+0000 7f6d75600640 1 -- 172.21.15.79:0/2442128458 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f6d680b2b20 con 0x7f6d781039b0 2024-09-21T02:38:05.376 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:38:05.376 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:38:05.376 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:38:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.375+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6d5c0b6510 msgr2=0x7f6d5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.375+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6d5c0b6510 0x7f6d5c0b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6d78105ca0 tx=0x7f6d60005f90 comp rx=0 tx=0).stop 2024-09-21T02:38:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d781039b0 msgr2=0x7f6d7819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d781039b0 0x7f6d7819a2a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800e9f0 tx=0x7f6d6800edf0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 shutdown_connections 2024-09-21T02:38:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6d5c0b6510 0x7f6d5c0b8a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d78109c40 0x7f6d7819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d781092f0 0x7f6d7819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 --2- 172.21.15.79:0/2442128458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d781039b0 0x7f6d7819a2a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:05.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 >> 172.21.15.79:0/2442128458 conn(0x7f6d780ff440 msgr2=0x7f6d78101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:05.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 shutdown_connections 2024-09-21T02:38:05.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:05.376+0000 7f6d7dc00640 1 -- 172.21.15.79:0/2442128458 wait complete. 2024-09-21T02:38:05.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:05 smithi098 ceph-mon[34832]: pgmap v485: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 490 op/s 2024-09-21T02:38:05.719 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:05 smithi079 ceph-mon[30788]: pgmap v485: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 490 op/s 2024-09-21T02:38:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:05 smithi148 ceph-mon[34626]: pgmap v485: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 490 op/s 2024-09-21T02:38:06.208 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 38d584fe --release --await' 2024-09-21T02:38:06.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 38d584fe --release --await 2024-09-21T02:38:06.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:06 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2442128458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:38:06.579 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:06.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:06 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2442128458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:06.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:06 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2442128458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:07.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 -- 172.21.15.79:0/823260343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c1047d0 msgr2=0x7f9a8c104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 --2- 172.21.15.79:0/823260343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c104be0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009900 tx=0x7f9a7c02a410 comp rx=0 tx=0).stop 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 -- 172.21.15.79:0/823260343 shutdown_connections 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 --2- 172.21.15.79:0/823260343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a8c10dc30 0x7f9a8c110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 --2- 172.21.15.79:0/823260343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c105120 0x7f9a8c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 --2- 172.21.15.79:0/823260343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c104be0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 -- 172.21.15.79:0/823260343 >> 172.21.15.79:0/823260343 conn(0x7f9a8c0fe2d0 msgr2=0x7f9a8c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 -- 172.21.15.79:0/823260343 shutdown_connections 2024-09-21T02:38:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.339+0000 7f9a91400640 1 -- 172.21.15.79:0/823260343 wait complete. 2024-09-21T02:38:07.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.340+0000 7f9a91400640 1 Processor -- start 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.340+0000 7f9a91400640 1 -- start start 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a91400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a91400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a8c105120 0x7f9a8c19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a91400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c10dc30 0x7f9a8c1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a91400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c113900 con 0x7f9a8c10dc30 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a91400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c113780 con 0x7f9a8c1047d0 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a91400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c113a80 con 0x7f9a8c105120 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a90a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c10dc30 0x7f9a8c1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a83400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a8c105120 0x7f9a8c19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a90a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c10dc30 0x7f9a8c1a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53546/0 (socket says 172.21.15.79:53546) 2024-09-21T02:38:07.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c19c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38292/0 (socket says 172.21.15.79:38292) 2024-09-21T02:38:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a90a00640 1 -- 172.21.15.79:0/3030636357 learned_addr learned my addr 172.21.15.79:0/3030636357 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a90a00640 1 -- 172.21.15.79:0/3030636357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a8c105120 msgr2=0x7f9a8c19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a90a00640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a8c105120 0x7f9a8c19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a90a00640 1 -- 172.21.15.79:0/3030636357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c1047d0 msgr2=0x7f9a8c19c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.341+0000 7f9a90a00640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c19c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a90a00640 1 -- 172.21.15.79:0/3030636357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c1a2420 con 0x7f9a8c10dc30 2024-09-21T02:38:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a8be00640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c19c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:07.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a90a00640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c10dc30 0x7f9a8c1a1cf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400eb10 tx=0x7f9a8400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:07.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a89600640 1 -- 172.21.15.79:0/3030636357 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84004b20 con 0x7f9a8c10dc30 2024-09-21T02:38:07.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a89600640 1 -- 172.21.15.79:0/3030636357 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a84004cc0 con 0x7f9a8c10dc30 2024-09-21T02:38:07.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c1a2710 con 0x7f9a8c10dc30 2024-09-21T02:38:07.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a89600640 1 -- 172.21.15.79:0/3030636357 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84010670 con 0x7f9a8c10dc30 2024-09-21T02:38:07.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.342+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8c1a8e70 con 0x7f9a8c10dc30 2024-09-21T02:38:07.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.346+0000 7f9a99630740 1 Processor -- start 2024-09-21T02:38:07.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.347+0000 7f9a89600640 1 -- 172.21.15.79:0/3030636357 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9a84005020 con 0x7f9a8c10dc30 2024-09-21T02:38:07.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.347+0000 7f9a99630740 1 -- start start 2024-09-21T02:38:07.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a99630740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30edf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a99630740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b0f660 0x55be30edf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a99630740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b17840 0x55be30edfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a99630740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be30e56290 con 0x55be30b17840 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a99630740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55be30e456c0 con 0x55be30b0f660 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a99630740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55be30e494d0 con 0x55be30b38520 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b0f660 0x55be30edf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a83400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b17840 0x55be30edfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b0f660 0x55be30edf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38298/0 (socket says 172.21.15.79:38298) 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 -- 172.21.15.79:0/2778533272 learned_addr learned my addr 172.21.15.79:0/2778533272 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a83400640 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30edf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 -- 172.21.15.79:0/2778533272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 msgr2=0x55be30edf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30edf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 -- 172.21.15.79:0/2778533272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b17840 msgr2=0x55be30edfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b17840 0x55be30edfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.348+0000 7f9a8be00640 1 -- 172.21.15.79:0/2778533272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be30dd2460 con 0x55be30b0f660 2024-09-21T02:38:07.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a83400640 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b17840 0x55be30edfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:38:07.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a8be00640 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b0f660 0x55be30edf880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009230 tx=0x7f9a7c004520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652619243be26067 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:07.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a81200640 1 -- 172.21.15.79:0/2778533272 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c035040 con 0x55be30b0f660 2024-09-21T02:38:07.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a89600640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a700b6590 0x7f9a700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a81200640 1 -- 172.21.15.79:0/2778533272 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a7c004c20 con 0x55be30b0f660 2024-09-21T02:38:07.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a81200640 1 -- 172.21.15.79:0/2778533272 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c003ac0 con 0x55be30b0f660 2024-09-21T02:38:07.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a89600640 1 -- 172.21.15.79:0/3030636357 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9a840e7bb0 con 0x7f9a8c10dc30 2024-09-21T02:38:07.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.349+0000 7f9a83400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a700b6590 0x7f9a700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 -- 172.21.15.79:0/2778533272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b0f660 msgr2=0x55be30edf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b0f660 0x55be30edf880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009230 tx=0x7f9a7c004520 comp rx=0 tx=0).stop 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a83400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a700b6590 0x7f9a700b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c101b20 tx=0x7f9a74004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 -- 172.21.15.79:0/2778533272 shutdown_connections 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b17840 0x55be30edfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b0f660 0x55be30edf880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 --2- 172.21.15.79:0/2778533272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30edf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 -- 172.21.15.79:0/2778533272 >> 172.21.15.79:0/2778533272 conn(0x55be30b2c910 msgr2=0x55be30edd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 -- 172.21.15.79:0/2778533272 shutdown_connections 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.350+0000 7f9a99630740 1 -- 172.21.15.79:0/2778533272 wait complete. 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.351+0000 7f9a99630740 1 -- start start 2024-09-21T02:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.351+0000 7f9a99630740 1 Processor -- start 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a99630740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b0f660 0x55be30eeaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a99630740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30eeb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a99630740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b38520 0x55be30ef6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a99630740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be30ca6bb0 con 0x55be30b38520 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a99630740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55be30de06c0 con 0x55be30b17840 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a99630740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55be30eedac0 con 0x55be30b0f660 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a99630740 10 client.0 _ll_register_callbacks cb 0x55be30dfb490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a90a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b38520 0x55be30ef6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b0f660 0x55be30eeaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a90a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b38520 0x55be30ef6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53568/0 (socket says 172.21.15.79:53568) 2024-09-21T02:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a90a00640 1 -- 172.21.15.79:0/2045185965 learned_addr learned my addr 172.21.15.79:0/2045185965 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a83400640 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30eeb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a90a00640 1 -- 172.21.15.79:0/2045185965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b0f660 msgr2=0x55be30eeaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.352+0000 7f9a90a00640 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b0f660 0x55be30eeaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a90a00640 1 -- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 msgr2=0x55be30eeb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a90a00640 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30eeb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a90a00640 1 -- 172.21.15.79:0/2045185965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be30ba3b00 con 0x55be30b38520 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a90a00640 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b38520 0x55be30ef6de0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400cf20 tx=0x7f9a840a97d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940a338d8356b2cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a79600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a79600640 1 -- 172.21.15.79:0/2045185965 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b2070 con 0x55be30b38520 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a79600640 1 -- 172.21.15.79:0/2045185965 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9a840a9280 con 0x55be30b38520 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a7c004c20 con 0x55be30b38520 2024-09-21T02:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a79600640 1 -- 172.21.15.79:0/2045185965 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9a840ad0a0 con 0x55be30b38520 2024-09-21T02:38:07.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a99630740 10 client.15540 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:07.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.353+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55be30c1a960 con 0x55be30b38520 2024-09-21T02:38:07.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a79600640 1 -- 172.21.15.79:0/2045185965 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a7c004c20 con 0x55be30b38520 2024-09-21T02:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a79600640 1 -- 172.21.15.79:0/2045185965 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9a840a9480 con 0x55be30b38520 2024-09-21T02:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a99630740 10 client.15540 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a99630740 10 client.15540 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a99630740 20 client.15540 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a99630740 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30af6ea0 0x55be30efce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a99630740 4 client.15540 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.354+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be30e581e0 con 0x55be30af6ea0 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.355+0000 7f9a8be00640 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30af6ea0 0x55be30efce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.355+0000 7f9a8be00640 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30af6ea0 0x55be30efce00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a3b2f3dde49c513 server_cookie=a03dc599edfb5c6d in_seq=0 out_seq=0 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.355+0000 7f9a79600640 10 client.15540 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a79600640 1 -- 172.21.15.79:0/2045185965 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be30e581e0 con 0x55be30af6ea0 2024-09-21T02:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a79600640 10 client.15540 handle_command_reply: tid=0 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 client.15540 shutdown 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b38520 msgr2=0x55be30ef6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b38520 0x55be30ef6de0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400cf20 tx=0x7f9a840a97d0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 shutdown_connections 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30af6ea0 0x55be30efce00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b38520 0x55be30ef6de0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30eeb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 --2- 172.21.15.79:0/2045185965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b0f660 0x55be30eeaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 >> 172.21.15.79:0/2045185965 conn(0x55be30b2c910 msgr2=0x55be30ee24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a79600640 0 client.15540 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.356+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 shutdown_connections 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.357+0000 7f9a99630740 1 -- 172.21.15.79:0/2045185965 wait complete. 2024-09-21T02:38:07.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.357+0000 7f9a99630740 20 client.15540 trim_cache size 0 max 16384 2024-09-21T02:38:07.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.374+0000 7f9a99630740 1 Processor -- start 2024-09-21T02:38:07.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.374+0000 7f9a99630740 1 -- start start 2024-09-21T02:38:07.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.374+0000 7f9a99630740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30edd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.374+0000 7f9a99630740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b17840 0x55be30ef6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a99630740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b38520 0x55be30ef7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a99630740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b0be0 con 0x55be30b0f660 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a99630740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b3460 con 0x55be30b38520 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a99630740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b1250 con 0x55be30b17840 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30edd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30edd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53578/0 (socket says 172.21.15.79:53578) 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 -- 172.21.15.79:0/3791960026 learned_addr learned my addr 172.21.15.79:0/3791960026 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a90a00640 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b38520 0x55be30ef7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a83400640 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b17840 0x55be30ef6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 -- 172.21.15.79:0/3791960026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b17840 msgr2=0x55be30ef6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b17840 0x55be30ef6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 -- 172.21.15.79:0/3791960026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b38520 msgr2=0x55be30ef7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b38520 0x55be30ef7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.375+0000 7f9a8be00640 1 -- 172.21.15.79:0/3791960026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be30edc960 con 0x55be30b0f660 2024-09-21T02:38:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.376+0000 7f9a8be00640 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30edd260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0096c0 tx=0x7f9a7c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bb31517e5b5923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.376+0000 7f9a7be00640 1 -- 172.21.15.79:0/3791960026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c05c070 con 0x55be30b0f660 2024-09-21T02:38:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.376+0000 7f9a7be00640 1 -- 172.21.15.79:0/3791960026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a7c0054c0 con 0x55be30b0f660 2024-09-21T02:38:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.376+0000 7f9a7be00640 1 -- 172.21.15.79:0/3791960026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c035040 con 0x55be30b0f660 2024-09-21T02:38:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 -- 172.21.15.79:0/3791960026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 msgr2=0x55be30edd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30edd260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0096c0 tx=0x7f9a7c004610 comp rx=0 tx=0).stop 2024-09-21T02:38:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 -- 172.21.15.79:0/3791960026 shutdown_connections 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b38520 0x55be30ef7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b17840 0x55be30ef6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 --2- 172.21.15.79:0/3791960026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30edd260 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 -- 172.21.15.79:0/3791960026 >> 172.21.15.79:0/3791960026 conn(0x55be30b2c910 msgr2=0x55be30edcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 -- 172.21.15.79:0/3791960026 shutdown_connections 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 -- 172.21.15.79:0/3791960026 wait complete. 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.377+0000 7f9a99630740 1 -- start start 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 1 Processor -- start 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30ef30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30ef3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30eedda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b1920 con 0x55be30b0f660 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b2d90 con 0x55be30b17840 2024-09-21T02:38:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b1ff0 con 0x55be30b38520 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a99630740 10 client.0 _ll_register_callbacks cb 0x7f9a840a9f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30ef30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a8be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30ef30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53594/0 (socket says 172.21.15.79:53594) 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a8be00640 1 -- 172.21.15.79:0/1201103585 learned_addr learned my addr 172.21.15.79:0/1201103585 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.378+0000 7f9a83400640 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30ef3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a90a00640 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30eedda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a8be00640 1 -- 172.21.15.79:0/1201103585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 msgr2=0x55be30eedda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a8be00640 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30eedda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a8be00640 1 -- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 msgr2=0x55be30ef3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a8be00640 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30ef3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a8be00640 1 -- 172.21.15.79:0/1201103585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be30eee530 con 0x55be30b0f660 2024-09-21T02:38:07.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a8be00640 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30ef30b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c02aa00 tx=0x7f9a7c02ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e697c873d376ca8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a79600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a79600640 1 -- 172.21.15.79:0/1201103585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c035050 con 0x55be30b0f660 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a79600640 1 -- 172.21.15.79:0/1201103585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9a7c003770 con 0x55be30b0f660 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.379+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a7c0054c0 con 0x55be30b0f660 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a79600640 1 -- 172.21.15.79:0/1201103585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9a7c06b050 con 0x55be30b0f660 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 10 client.15546 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55be30f682a0 con 0x55be30b0f660 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a79600640 1 -- 172.21.15.79:0/1201103585 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a7c0054c0 con 0x55be30b0f660 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a79600640 1 -- 172.21.15.79:0/1201103585 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9a7c0314a0 con 0x55be30b0f660 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 10 client.15546 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 10 client.15546 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:38:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 20 client.15546 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30acc250 0x55be30f6a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 4 client.15546 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "38d584fe", "release": true, "await": true}] 2024-09-21T02:38:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.380+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "38d584fe", "release": true, "await": true}) -- 0x55be30e53c90 con 0x55be30acc250 2024-09-21T02:38:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.381+0000 7f9a83400640 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30acc250 0x55be30f6a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.381+0000 7f9a83400640 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30acc250 0x55be30f6a530 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ddf4e312791b82b server_cookie=86267ed37a0938c9 in_seq=0 out_seq=0 2024-09-21T02:38:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.381+0000 7f9a79600640 10 client.15546 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:07.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.450+0000 7f9a79600640 1 -- 172.21.15.79:0/1201103585 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55be30e53c90 con 0x55be30acc250 2024-09-21T02:38:07.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.450+0000 7f9a79600640 10 client.15546 handle_command_reply: tid=0 2024-09-21T02:38:07.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.450+0000 7f9a99630740 1 client.15546 shutdown 2024-09-21T02:38:07.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 msgr2=0x55be30ef30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30ef30b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c02aa00 tx=0x7f9a7c02ab90 comp rx=0 tx=0).stop 2024-09-21T02:38:07.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 shutdown_connections 2024-09-21T02:38:07.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55be30acc250 0x55be30f6a530 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be30b38520 0x55be30eedda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55be30b17840 0x55be30ef3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 --2- 172.21.15.79:0/1201103585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be30b0f660 0x55be30ef30b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 >> 172.21.15.79:0/1201103585 conn(0x55be30b2c910 msgr2=0x55be30ee0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:07.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.451+0000 7f9a79600640 0 client.15546 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:07.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.455+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 shutdown_connections 2024-09-21T02:38:07.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.455+0000 7f9a99630740 1 -- 172.21.15.79:0/1201103585 wait complete. 2024-09-21T02:38:07.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.456+0000 7f9a99630740 20 client.15546 trim_cache size 0 max 16384 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 12, 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "38d584fe": { 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 12, 2024-09-21T02:38:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 147.8, 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:38:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:07.464 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:38:07.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a700b6590 msgr2=0x7f9a700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a700b6590 0x7f9a700b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c101b20 tx=0x7f9a74004730 comp rx=0 tx=0).stop 2024-09-21T02:38:07.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c10dc30 msgr2=0x7f9a8c1a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:07.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c10dc30 0x7f9a8c1a1cf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400eb10 tx=0x7f9a8400c2d0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 shutdown_connections 2024-09-21T02:38:07.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9a700b6590 0x7f9a700b8aa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a8c10dc30 0x7f9a8c1a1cf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a8c105120 0x7f9a8c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 --2- 172.21.15.79:0/3030636357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a8c1047d0 0x7f9a8c19c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:07.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.464+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 >> 172.21.15.79:0/3030636357 conn(0x7f9a8c0fe2d0 msgr2=0x7f9a8c1023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:07.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.465+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 shutdown_connections 2024-09-21T02:38:07.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:07.465+0000 7f9a91400640 1 -- 172.21.15.79:0/3030636357 wait complete. 2024-09-21T02:38:07.599 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:07 smithi079 ceph-mon[30788]: pgmap v486: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 486 op/s 2024-09-21T02:38:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:07 smithi098 ceph-mon[34832]: pgmap v486: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 486 op/s 2024-09-21T02:38:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:07 smithi148 ceph-mon[34626]: pgmap v486: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 486 op/s 2024-09-21T02:38:08.631 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '38d584fe', total seconds elapsed: 32.3 2024-09-21T02:38:08.631 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T02:38:08.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:38:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:09.642 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:09 smithi079 ceph-mon[30788]: pgmap v487: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.6 MiB/s wr, 225 op/s 2024-09-21T02:38:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:09 smithi098 ceph-mon[34832]: pgmap v487: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.6 MiB/s wr, 225 op/s 2024-09-21T02:38:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:09 smithi148 ceph-mon[34626]: pgmap v487: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.6 MiB/s wr, 225 op/s 2024-09-21T02:38:10.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.121+0000 7f2805200640 1 -- 172.21.15.79:0/2373647618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010c020 msgr2=0x7f2800112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:10.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.121+0000 7f2805200640 1 --2- 172.21.15.79:0/2373647618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010c020 0x7f2800112850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009ca0 tx=0x7f27f802a8f0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.121+0000 7f2805200640 1 -- 172.21.15.79:0/2373647618 shutdown_connections 2024-09-21T02:38:10.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.121+0000 7f2805200640 1 --2- 172.21.15.79:0/2373647618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010c020 0x7f2800112850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.121+0000 7f2805200640 1 --2- 172.21.15.79:0/2373647618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280010b6d0 0x7f280010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.121+0000 7f2805200640 1 --2- 172.21.15.79:0/2373647618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 0x7f28001061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.121+0000 7f2805200640 1 -- 172.21.15.79:0/2373647618 >> 172.21.15.79:0/2373647618 conn(0x7f28001017e0 msgr2=0x7f2800103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:10.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.123+0000 7f2805200640 1 -- 172.21.15.79:0/2373647618 shutdown_connections 2024-09-21T02:38:10.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.123+0000 7f2805200640 1 -- 172.21.15.79:0/2373647618 wait complete. 2024-09-21T02:38:10.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.125+0000 7f2805200640 1 Processor -- start 2024-09-21T02:38:10.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.125+0000 7f2805200640 1 -- start start 2024-09-21T02:38:10.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f2805200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 0x7f2800111080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:10.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f2805200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010b6d0 0x7f2800111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:10.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f2805200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280010c020 0x7f28001ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:10.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f2805200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28000784b0 con 0x7f280010c020 2024-09-21T02:38:10.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f2805200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2800078330 con 0x7f280010b6d0 2024-09-21T02:38:10.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f2805200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2800078630 con 0x7f2800105d90 2024-09-21T02:38:10.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f27fde00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 0x7f2800111080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:10.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f27fde00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 0x7f2800111080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39674/0 (socket says 172.21.15.79:39674) 2024-09-21T02:38:10.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f27fde00640 1 -- 172.21.15.79:0/4052572016 learned_addr learned my addr 172.21.15.79:0/4052572016 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:10.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f27fe800640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280010c020 0x7f28001ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:10.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.126+0000 7f27fd400640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010b6d0 0x7f2800111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:10.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f27fde00640 1 -- 172.21.15.79:0/4052572016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010b6d0 msgr2=0x7f2800111600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:10.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f27fde00640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010b6d0 0x7f2800111600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f27fde00640 1 -- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280010c020 msgr2=0x7f28001ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:10.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f27fde00640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280010c020 0x7f28001ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f27fde00640 1 -- 172.21.15.79:0/4052572016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28001acbd0 con 0x7f2800105d90 2024-09-21T02:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f27fde00640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 0x7f2800111080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b450 tx=0x7f27f000b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f27f6a00640 1 -- 172.21.15.79:0/4052572016 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0015020 con 0x7f2800105d90 2024-09-21T02:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.127+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28001ace00 con 0x7f2800105d90 2024-09-21T02:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.128+0000 7f27f6a00640 1 -- 172.21.15.79:0/4052572016 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f0011ce0 con 0x7f2800105d90 2024-09-21T02:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.128+0000 7f27f6a00640 1 -- 172.21.15.79:0/4052572016 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0010de0 con 0x7f2800105d90 2024-09-21T02:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.128+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001ad330 con 0x7f2800105d90 2024-09-21T02:38:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.130+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28001061a0 con 0x7f2800105d90 2024-09-21T02:38:10.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.133+0000 7f27f6a00640 1 -- 172.21.15.79:0/4052572016 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f27f0018020 con 0x7f2800105d90 2024-09-21T02:38:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.136+0000 7f27f6a00640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f27e40b6590 0x7f27e40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.136+0000 7f27f6a00640 1 -- 172.21.15.79:0/4052572016 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f27f00e6de0 con 0x7f2800105d90 2024-09-21T02:38:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.136+0000 7f27fd400640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f27e40b6590 0x7f27e40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.137+0000 7f27fd400640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f27e40b6590 0x7f27e40b8aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f280010a100 tx=0x7f27ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:10.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.140+0000 7f27f6a00640 1 -- 172.21.15.79:0/4052572016 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27f001f020 con 0x7f2800105d90 2024-09-21T02:38:10.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.580+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28001ad7c0 con 0x7f2800105d90 2024-09-21T02:38:10.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.581+0000 7f27f6a00640 1 -- 172.21.15.79:0/4052572016 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f27f00ad2c0 con 0x7f2800105d90 2024-09-21T02:38:10.584 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:38:10.584 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:38:10.584 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f27e40b6590 msgr2=0x7f27e40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f27e40b6590 0x7f27e40b8aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f280010a100 tx=0x7f27ec00a2d0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 msgr2=0x7f2800111080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 0x7f2800111080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b450 tx=0x7f27f000b850 comp rx=0 tx=0).stop 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 shutdown_connections 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f27e40b6590 0x7f27e40b8aa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280010c020 0x7f28001ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f280010b6d0 0x7f2800111600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 --2- 172.21.15.79:0/4052572016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800105d90 0x7f2800111080 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.584+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 >> 172.21.15.79:0/4052572016 conn(0x7f28001017e0 msgr2=0x7f280007ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:10.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.585+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 shutdown_connections 2024-09-21T02:38:10.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:10.585+0000 7f2805200640 1 -- 172.21.15.79:0/4052572016 wait complete. 2024-09-21T02:38:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 135.0 s, 1282.5 tps, lat 472.502 ms stddev 3271.453 2024-09-21T02:38:11.586 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T02:38:11.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T02:38:11.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:11 smithi098 ceph-mon[34832]: pgmap v488: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 114 op/s 2024-09-21T02:38:11.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:11 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4052572016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:11.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:11 smithi079 ceph-mon[30788]: pgmap v488: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 114 op/s 2024-09-21T02:38:11.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:11 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4052572016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:11 smithi148 ceph-mon[34626]: pgmap v488: 129 pgs: 129 active+clean; 1019 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 114 op/s 2024-09-21T02:38:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:11 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4052572016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:12.247 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.102+0000 7f8706a00640 1 -- 172.21.15.79:0/2422836332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87001083c0 msgr2=0x7f87001087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.102+0000 7f8706a00640 1 --2- 172.21.15.79:0/2422836332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87001083c0 0x7f87001087d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009900 tx=0x7f86e802a440 comp rx=0 tx=0).stop 2024-09-21T02:38:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.103+0000 7f8706a00640 1 -- 172.21.15.79:0/2422836332 shutdown_connections 2024-09-21T02:38:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.103+0000 7f8706a00640 1 --2- 172.21.15.79:0/2422836332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8700108d10 0x7f870010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.103+0000 7f8706a00640 1 --2- 172.21.15.79:0/2422836332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87001083c0 0x7f87001087d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.103+0000 7f8706a00640 1 --2- 172.21.15.79:0/2422836332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700102a80 0x7f8700102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.103+0000 7f8706a00640 1 -- 172.21.15.79:0/2422836332 >> 172.21.15.79:0/2422836332 conn(0x7f8700079760 msgr2=0x7f8700079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.103+0000 7f8706a00640 1 -- 172.21.15.79:0/2422836332 shutdown_connections 2024-09-21T02:38:13.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.104+0000 7f8706a00640 1 -- 172.21.15.79:0/2422836332 wait complete. 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.106+0000 7f8706a00640 1 Processor -- start 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.106+0000 7f8706a00640 1 -- start start 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f8706a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700102a80 0x7f87001136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f8706a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87001083c0 0x7f8700113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f8706a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8700108d10 0x7f8700118ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f8706a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8700111a00 con 0x7f8700108d10 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f8706a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8700111880 con 0x7f87001083c0 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f8706a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8700111b80 con 0x7f8700102a80 2024-09-21T02:38:13.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f86f7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87001083c0 0x7f8700113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f8704a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8700108d10 0x7f8700118ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f86f7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87001083c0 0x7f8700113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38346/0 (socket says 172.21.15.79:38346) 2024-09-21T02:38:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f86f7400640 1 -- 172.21.15.79:0/2147218500 learned_addr learned my addr 172.21.15.79:0/2147218500 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.107+0000 7f86ffe00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700102a80 0x7f87001136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.108+0000 7f8704a00640 1 -- 172.21.15.79:0/2147218500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700102a80 msgr2=0x7f87001136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.108+0000 7f8704a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700102a80 0x7f87001136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.108+0000 7f8704a00640 1 -- 172.21.15.79:0/2147218500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87001083c0 msgr2=0x7f8700113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.108+0000 7f8704a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87001083c0 0x7f8700113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.108+0000 7f8704a00640 1 -- 172.21.15.79:0/2147218500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8700119430 con 0x7f8700108d10 2024-09-21T02:38:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.109+0000 7f8704a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8700108d10 0x7f8700118ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86f800b3e0 tx=0x7f86f800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:13.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.111+0000 7f86fd600640 1 -- 172.21.15.79:0/2147218500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8015020 con 0x7f8700108d10 2024-09-21T02:38:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.111+0000 7f86fd600640 1 -- 172.21.15.79:0/2147218500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86f8011ce0 con 0x7f8700108d10 2024-09-21T02:38:13.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.112+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87001196c0 con 0x7f8700108d10 2024-09-21T02:38:13.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.112+0000 7f86fd600640 1 -- 172.21.15.79:0/2147218500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8010e20 con 0x7f8700108d10 2024-09-21T02:38:13.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.113+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8700119c50 con 0x7f8700108d10 2024-09-21T02:38:13.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.121+0000 7f870d633740 1 Processor -- start 2024-09-21T02:38:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.123+0000 7f86fd600640 1 -- 172.21.15.79:0/2147218500 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f86f8018020 con 0x7f8700108d10 2024-09-21T02:38:13.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.124+0000 7f870d633740 1 -- start start 2024-09-21T02:38:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f870d633740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de50840 0x560c9e1f8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f870d633740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de27980 0x560c9e1f8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f870d633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de2fb60 0x560c9e1f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f870d633740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560c9e16dca0 con 0x560c9de50840 2024-09-21T02:38:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f870d633740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c9e15d0d0 con 0x560c9de27980 2024-09-21T02:38:13.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f870d633740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560c9e160ee0 con 0x560c9de2fb60 2024-09-21T02:38:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de27980 0x560c9e1f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de27980 0x560c9e1f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38354/0 (socket says 172.21.15.79:38354) 2024-09-21T02:38:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f86ffe00640 1 -- 172.21.15.79:0/2443645732 learned_addr learned my addr 172.21.15.79:0/2443645732 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.125+0000 7f86f7400640 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de2fb60 0x560c9e1f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.126+0000 7f86ffe00640 1 -- 172.21.15.79:0/2443645732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de2fb60 msgr2=0x560c9e1f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.126+0000 7f86ffe00640 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de2fb60 0x560c9e1f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.126+0000 7f86ffe00640 1 -- 172.21.15.79:0/2443645732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de50840 msgr2=0x560c9e1f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.126+0000 7f86ffe00640 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de50840 0x560c9e1f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.126+0000 7f86ffe00640 1 -- 172.21.15.79:0/2443645732 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9e10f400 con 0x560c9de27980 2024-09-21T02:38:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.127+0000 7f86fd600640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86e40b6660 0x7f86e40b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.127+0000 7f86ffe00640 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de27980 0x560c9e1f8890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009fc0 tx=0x7f86f000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5086e15fcc529ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.128+0000 7f86fd600640 1 -- 172.21.15.79:0/2147218500 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f86f80e6b10 con 0x7f8700108d10 2024-09-21T02:38:13.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.129+0000 7f86f7400640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86e40b6660 0x7f86e40b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.129+0000 7f86f5200640 1 -- 172.21.15.79:0/2443645732 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f001a070 con 0x560c9de27980 2024-09-21T02:38:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.129+0000 7f86f5200640 1 -- 172.21.15.79:0/2443645732 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86f00158c0 con 0x560c9de27980 2024-09-21T02:38:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.129+0000 7f86f5200640 1 -- 172.21.15.79:0/2443645732 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f001a070 con 0x560c9de27980 2024-09-21T02:38:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.131+0000 7f870d633740 1 -- 172.21.15.79:0/2443645732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de27980 msgr2=0x560c9e1f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.131+0000 7f870d633740 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de27980 0x560c9e1f8890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009fc0 tx=0x7f86f000c8b0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.131+0000 7f870d633740 1 -- 172.21.15.79:0/2443645732 shutdown_connections 2024-09-21T02:38:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.131+0000 7f870d633740 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de2fb60 0x560c9e1f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.131+0000 7f870d633740 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de27980 0x560c9e1f8890 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.131+0000 7f870d633740 1 --2- 172.21.15.79:0/2443645732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de50840 0x560c9e1f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.131+0000 7f870d633740 1 -- 172.21.15.79:0/2443645732 >> 172.21.15.79:0/2443645732 conn(0x560c9de44990 msgr2=0x560c9e1f6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.132+0000 7f870d633740 1 -- 172.21.15.79:0/2443645732 shutdown_connections 2024-09-21T02:38:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.132+0000 7f870d633740 1 -- 172.21.15.79:0/2443645732 wait complete. 2024-09-21T02:38:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.132+0000 7f86f7400640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86e40b6660 0x7f86e40b8b70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f86e8005ec0 tx=0x7f86e8005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:13.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.133+0000 7f870d633740 1 -- start start 2024-09-21T02:38:13.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.134+0000 7f870d633740 1 Processor -- start 2024-09-21T02:38:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.136+0000 7f870d633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e203a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f870d633740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de2fb60 0x560c9e203f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f870d633740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f870d633740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560c9dfbe7a0 con 0x560c9de2fb60 2024-09-21T02:38:13.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f870d633740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c9e102a10 con 0x560c9de50840 2024-09-21T02:38:13.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f8704a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f8704a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38358/0 (socket says 172.21.15.79:38358) 2024-09-21T02:38:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f8704a00640 1 -- 172.21.15.79:0/267889759 learned_addr learned my addr 172.21.15.79:0/267889759 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560c9e206b30 con 0x560c9de27980 2024-09-21T02:38:13.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f870d633740 10 client.0 _ll_register_callbacks cb 0x560c9e112be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f86f7400640 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de2fb60 0x560c9e203f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.137+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e203a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.138+0000 7f86f7400640 1 -- 172.21.15.79:0/267889759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 msgr2=0x560c9e203a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.138+0000 7f86f7400640 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e203a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.138+0000 7f86f7400640 1 -- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 msgr2=0x560c9e20fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.139+0000 7f86f7400640 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.139+0000 7f86f7400640 1 -- 172.21.15.79:0/267889759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9decab90 con 0x560c9de2fb60 2024-09-21T02:38:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.139+0000 7f8704a00640 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.140+0000 7f86f7400640 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de2fb60 0x560c9e203f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f86e802aa30 tx=0x7f86e802a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940f715eb37cc5e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.140+0000 7f86ed600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:13.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.142+0000 7f86ed600640 1 -- 172.21.15.79:0/267889759 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e804e070 con 0x560c9de2fb60 2024-09-21T02:38:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.143+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86f00158c0 con 0x560c9de2fb60 2024-09-21T02:38:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.143+0000 7f86ed600640 1 -- 172.21.15.79:0/267889759 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f86e80318b0 con 0x560c9de2fb60 2024-09-21T02:38:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.144+0000 7f86ed600640 1 -- 172.21.15.79:0/267889759 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86e805a050 con 0x560c9de2fb60 2024-09-21T02:38:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.144+0000 7f870d633740 10 client.15558 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:13.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.144+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560c9e2127e0 con 0x560c9de2fb60 2024-09-21T02:38:13.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.145+0000 7f86ed600640 1 -- 172.21.15.79:0/267889759 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86f00158c0 con 0x560c9de2fb60 2024-09-21T02:38:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.148+0000 7f86ed600640 1 -- 172.21.15.79:0/267889759 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f86e804ab60 con 0x560c9de2fb60 2024-09-21T02:38:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.148+0000 7f870d633740 10 client.15558 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.148+0000 7f870d633740 10 client.15558 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:38:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.149+0000 7f870d633740 20 client.15558 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.149+0000 7f870d633740 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9de0f1c0 0x560c9e215ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.149+0000 7f870d633740 4 client.15558 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.149+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c9e16fbf0 con 0x560c9de0f1c0 2024-09-21T02:38:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.149+0000 7f86ffe00640 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9de0f1c0 0x560c9e215ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.150+0000 7f86ffe00640 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9de0f1c0 0x560c9e215ca0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=973b59cf161f4981 server_cookie=4e857914ff8c999 in_seq=0 out_seq=0 2024-09-21T02:38:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.150+0000 7f86ed600640 10 client.15558 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:13.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.151+0000 7f86ed600640 1 -- 172.21.15.79:0/267889759 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c9e16fbf0 con 0x560c9de0f1c0 2024-09-21T02:38:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.151+0000 7f86ed600640 10 client.15558 handle_command_reply: tid=0 2024-09-21T02:38:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.151+0000 7f870d633740 1 client.15558 shutdown 2024-09-21T02:38:13.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de2fb60 msgr2=0x560c9e203f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de2fb60 0x560c9e203f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f86e802aa30 tx=0x7f86e802a440 comp rx=0 tx=0).stop 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 shutdown_connections 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9de0f1c0 0x560c9e215ca0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9de2fb60 0x560c9e203f50 secure :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f86e802aa30 tx=0x7f86e802a440 comp rx=0 tx=0).stop 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 --2- 172.21.15.79:0/267889759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e203a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 >> 172.21.15.79:0/267889759 conn(0x560c9de44990 msgr2=0x560c9e1f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:13.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.152+0000 7f86ed600640 0 client.15558 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:13.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.154+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 shutdown_connections 2024-09-21T02:38:13.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.154+0000 7f870d633740 1 -- 172.21.15.79:0/267889759 wait complete. 2024-09-21T02:38:13.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.154+0000 7f870d633740 20 client.15558 trim_cache size 0 max 16384 2024-09-21T02:38:13.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.208+0000 7f870d633740 1 Processor -- start 2024-09-21T02:38:13.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.208+0000 7f870d633740 1 -- start start 2024-09-21T02:38:13.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f870d633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e1f5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f870d633740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f870d633740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e200c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f870d633740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f87001bdab0 con 0x560c9dde4570 2024-09-21T02:38:13.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f870d633740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87001c0330 con 0x560c9de50840 2024-09-21T02:38:13.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f870d633740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87001be120 con 0x560c9de27980 2024-09-21T02:38:13.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e1f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f86f7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e1f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39722/0 (socket says 172.21.15.79:39722) 2024-09-21T02:38:13.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.209+0000 7f86f7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38364/0 (socket says 172.21.15.79:38364) 2024-09-21T02:38:13.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.210+0000 7f86ffe00640 1 -- 172.21.15.79:0/1801901170 learned_addr learned my addr 172.21.15.79:0/1801901170 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:13.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.210+0000 7f86f7400640 1 -- 172.21.15.79:0/1801901170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 msgr2=0x560c9e1f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.210+0000 7f86f7400640 1 --2- 172.21.15.79:0/1801901170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e1f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.210+0000 7f86f7400640 1 -- 172.21.15.79:0/1801901170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 msgr2=0x560c9e200c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.210+0000 7f86f7400640 1 --2- 172.21.15.79:0/1801901170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e200c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.210+0000 7f86f7400640 1 -- 172.21.15.79:0/1801901170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9e1f1c50 con 0x560c9de50840 2024-09-21T02:38:13.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.211+0000 7f86f7400640 1 --2- 172.21.15.79:0/1801901170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fd20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86e8031440 tx=0x7f86e8005a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e158c485903cd860 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:13.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.211+0000 7f86efe00640 1 -- 172.21.15.79:0/1801901170 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e804e070 con 0x560c9de50840 2024-09-21T02:38:13.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.211+0000 7f86efe00640 1 -- 172.21.15.79:0/1801901170 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e803d5c0 con 0x560c9de50840 2024-09-21T02:38:13.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.211+0000 7f86efe00640 1 -- 172.21.15.79:0/1801901170 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8035040 con 0x560c9de50840 2024-09-21T02:38:13.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 -- 172.21.15.79:0/1801901170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 msgr2=0x560c9e20fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 --2- 172.21.15.79:0/1801901170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fd20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86e8031440 tx=0x7f86e8005a60 comp rx=0 tx=0).stop 2024-09-21T02:38:13.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 -- 172.21.15.79:0/1801901170 shutdown_connections 2024-09-21T02:38:13.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 --2- 172.21.15.79:0/1801901170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e200c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 --2- 172.21.15.79:0/1801901170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e20fd20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 --2- 172.21.15.79:0/1801901170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e1f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 -- 172.21.15.79:0/1801901170 >> 172.21.15.79:0/1801901170 conn(0x560c9de44990 msgr2=0x560c9e202900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:13.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 -- 172.21.15.79:0/1801901170 shutdown_connections 2024-09-21T02:38:13.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.213+0000 7f870d633740 1 -- 172.21.15.79:0/1801901170 wait complete. 2024-09-21T02:38:13.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.214+0000 7f870d633740 1 -- start start 2024-09-21T02:38:13.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.214+0000 7f870d633740 1 Processor -- start 2024-09-21T02:38:13.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.216+0000 7f870d633740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e20c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.217+0000 7f870d633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e20c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.217+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e20c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.217+0000 7f870d633740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e209ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.217+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e20c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53690/0 (socket says 172.21.15.79:53690) 2024-09-21T02:38:13.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.217+0000 7f86ffe00640 1 -- 172.21.15.79:0/3886513331 learned_addr learned my addr 172.21.15.79:0/3886513331 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:13.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.217+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f87001be7f0 con 0x560c9dde4570 2024-09-21T02:38:13.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.218+0000 7f86f7400640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e20c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.218+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87001bfc60 con 0x560c9de50840 2024-09-21T02:38:13.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.218+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87001beec0 con 0x560c9de27980 2024-09-21T02:38:13.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.218+0000 7f870d633740 10 client.0 _ll_register_callbacks cb 0x7f86e8004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:13.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.218+0000 7f8704a00640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e209ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.219+0000 7f86ffe00640 1 -- 172.21.15.79:0/3886513331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 msgr2=0x560c9e20c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.219+0000 7f86ffe00640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e20c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.219+0000 7f86ffe00640 1 -- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 msgr2=0x560c9e209ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:13.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.219+0000 7f86ffe00640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e209ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.219+0000 7f86ffe00640 1 -- 172.21.15.79:0/3886513331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9e20a680 con 0x560c9dde4570 2024-09-21T02:38:13.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.220+0000 7f86ffe00640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e20c1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000f80 tx=0x7f86f0003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a90da704da9201c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:13.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.220+0000 7f86ed600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:13.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.221+0000 7f86ed600640 1 -- 172.21.15.79:0/3886513331 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f001a040 con 0x560c9dde4570 2024-09-21T02:38:13.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.221+0000 7f86ed600640 1 -- 172.21.15.79:0/3886513331 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f86f0015530 con 0x560c9dde4570 2024-09-21T02:38:13.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.221+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e803d5c0 con 0x560c9dde4570 2024-09-21T02:38:13.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.221+0000 7f8704a00640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e209ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:38:13.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.221+0000 7f86f7400640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e20c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.223+0000 7f86ed600640 1 -- 172.21.15.79:0/3886513331 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86f0015730 con 0x560c9dde4570 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.223+0000 7f870d633740 10 client.15561 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.223+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560c9e2921c0 con 0x560c9dde4570 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.224+0000 7f86ed600640 1 -- 172.21.15.79:0/3886513331 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e803d5c0 con 0x560c9dde4570 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.224+0000 7f86ed600640 1 -- 172.21.15.79:0/3886513331 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f86f0022970 con 0x560c9dde4570 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.225+0000 7f870d633740 10 client.15561 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.225+0000 7f870d633740 10 client.15561 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:38:13.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.225+0000 7f870d633740 20 client.15561 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:13.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.225+0000 7f870d633740 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9e292840 0x560c9e294c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:13.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.225+0000 7f870d633740 4 client.15561 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T02:38:13.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.225+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x560c9e16b6a0 con 0x560c9e292840 2024-09-21T02:38:13.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.225+0000 7f86f7400640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9e292840 0x560c9e294c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:13.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.226+0000 7f86ed600640 10 client.15561 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:13.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.226+0000 7f86f7400640 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9e292840 0x560c9e294c60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1eeee6db315b7db server_cookie=707fc8cce8b2ade6 in_seq=0 out_seq=0 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f86ed600640 1 -- 172.21.15.79:0/3886513331 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x560c9e16b6a0 con 0x560c9e292840 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f86ed600640 10 client.15561 handle_command_reply: tid=0 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 client.15561 shutdown 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 msgr2=0x560c9e20c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e20c1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000f80 tx=0x7f86f0003b70 comp rx=0 tx=0).stop 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 shutdown_connections 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560c9e292840 0x560c9e294c60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c9de50840 0x560c9e209ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560c9de27980 0x560c9e20c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 --2- 172.21.15.79:0/3886513331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560c9dde4570 0x560c9e20c1a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f86ed600640 0 client.15561 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 >> 172.21.15.79:0/3886513331 conn(0x560c9de44990 msgr2=0x560c9e1f9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 shutdown_connections 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.590+0000 7f870d633740 1 -- 172.21.15.79:0/3886513331 wait complete. 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f870d633740 20 client.15561 trim_cache size 0 max 16384 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:38:13.593 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 14, 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: "881ae21": { 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 14, 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:38:13.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:38:13.595 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:38:13.595 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 147.8, 2024-09-21T02:38:13.595 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:38:13.595 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:38:13.595 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:38:13.595 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:38:13.595 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:38:13.596 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:38:13.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:13.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:13.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:13.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:13.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:13.597 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:38:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86e40b6660 msgr2=0x7f86e40b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86e40b6660 0x7f86e40b8b70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f86e8005ec0 tx=0x7f86e8005ef0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8700108d10 msgr2=0x7f8700118ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8700108d10 0x7f8700118ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86f800b3e0 tx=0x7f86f800b8a0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 shutdown_connections 2024-09-21T02:38:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f86e40b6660 0x7f86e40b8b70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8700108d10 0x7f8700118ef0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87001083c0 0x7f8700113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 --2- 172.21.15.79:0/2147218500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700102a80 0x7f87001136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.591+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 >> 172.21.15.79:0/2147218500 conn(0x7f8700079760 msgr2=0x7f87001043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.592+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 shutdown_connections 2024-09-21T02:38:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:13.592+0000 7f8706a00640 1 -- 172.21.15.79:0/2147218500 wait complete. 2024-09-21T02:38:13.613 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:13 smithi079 ceph-mon[30788]: pgmap v489: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 944 KiB/s wr, 104 op/s 2024-09-21T02:38:13.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:13 smithi098 ceph-mon[34832]: pgmap v489: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 944 KiB/s wr, 104 op/s 2024-09-21T02:38:13.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:13 smithi148 ceph-mon[34626]: pgmap v489: 129 pgs: 129 active+clean; 1020 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 944 KiB/s wr, 104 op/s 2024-09-21T02:38:14.411 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '881ae21', quiesce took 5.8 seconds. Will release after: 22.0 2024-09-21T02:38:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:15 smithi098 ceph-mon[34832]: pgmap v490: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-09-21T02:38:15.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:15 smithi079 ceph-mon[30788]: pgmap v490: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-09-21T02:38:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:15 smithi148 ceph-mon[34626]: pgmap v490: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-09-21T02:38:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 140.0 s, 687.2 tps, lat 53.337 ms stddev 56.638 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 -- 172.21.15.79:0/3888988834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb008106950 msgr2=0x7fb008106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 --2- 172.21.15.79:0/3888988834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb008106950 0x7fb008106d60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faff4009900 tx=0x7faff402a410 comp rx=0 tx=0).stop 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 -- 172.21.15.79:0/3888988834 shutdown_connections 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 --2- 172.21.15.79:0/3888988834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0081072f0 0x7fb00810dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 --2- 172.21.15.79:0/3888988834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb008106950 0x7fb008106d60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 --2- 172.21.15.79:0/3888988834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0081058d0 0x7fb008105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 -- 172.21.15.79:0/3888988834 >> 172.21.15.79:0/3888988834 conn(0x7fb008101230 msgr2=0x7fb0081036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 -- 172.21.15.79:0/3888988834 shutdown_connections 2024-09-21T02:38:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.093+0000 7fb00d000640 1 -- 172.21.15.79:0/3888988834 wait complete. 2024-09-21T02:38:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.094+0000 7fb00d000640 1 Processor -- start 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.094+0000 7fb00d000640 1 -- start start 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb00d000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0081058d0 0x7fb00819c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb00d000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb008106950 0x7fb00819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb00d000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0081072f0 0x7fb00819d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb00d000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb008111570 con 0x7fb0081058d0 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb00d000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081113f0 con 0x7fb0081072f0 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb00d000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081116f0 con 0x7fb008106950 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0081058d0 0x7fb00819c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0081058d0 0x7fb00819c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52180/0 (socket says 172.21.15.79:52180) 2024-09-21T02:38:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 -- 172.21.15.79:0/3421750539 learned_addr learned my addr 172.21.15.79:0/3421750539 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb006800640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0081072f0 0x7fb00819d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005400640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb008106950 0x7fb00819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 -- 172.21.15.79:0/3421750539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb008106950 msgr2=0x7fb00819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb008106950 0x7fb00819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 -- 172.21.15.79:0/3421750539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0081072f0 msgr2=0x7fb00819d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0081072f0 0x7fb00819d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb005e00640 1 -- 172.21.15.79:0/3421750539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00819dba0 con 0x7fb0081058d0 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.095+0000 7fb006800640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0081072f0 0x7fb00819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.096+0000 7fb005e00640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0081058d0 0x7fb00819c160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faff800eb90 tx=0x7faff800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.096+0000 7faffea00640 1 -- 172.21.15.79:0/3421750539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8004d20 con 0x7fb0081058d0 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.096+0000 7faffea00640 1 -- 172.21.15.79:0/3421750539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff800ee90 con 0x7fb0081058d0 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.096+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00819de90 con 0x7fb0081058d0 2024-09-21T02:38:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.096+0000 7faffea00640 1 -- 172.21.15.79:0/3421750539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8010670 con 0x7fb0081058d0 2024-09-21T02:38:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.096+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0081a4580 con 0x7fb0081058d0 2024-09-21T02:38:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.099+0000 7fb014019740 1 Processor -- start 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.099+0000 7fb014019740 1 -- start start 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.099+0000 7faffea00640 1 -- 172.21.15.79:0/3421750539 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7faff8005020 con 0x7fb0081058d0 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb014019740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64dde0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb014019740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a0e2f0 0x560b64dde740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb014019740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a164d0 0x560b64ddf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb014019740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560b64d516b0 con 0x560b64a0e2f0 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb014019740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b64d40ae0 con 0x560b64a164d0 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb014019740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560b64d448f0 con 0x560b64a371b0 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a0e2f0 0x560b64dde740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a0e2f0 0x560b64dde740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52194/0 (socket says 172.21.15.79:52194) 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 -- 172.21.15.79:0/2892957129 learned_addr learned my addr 172.21.15.79:0/2892957129 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005400640 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a164d0 0x560b64ddf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb006800640 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64dde0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 -- 172.21.15.79:0/2892957129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 msgr2=0x560b64dde0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64dde0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 -- 172.21.15.79:0/2892957129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a164d0 msgr2=0x560b64ddf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a164d0 0x560b64ddf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.100+0000 7fb005e00640 1 -- 172.21.15.79:0/2892957129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b64d0d780 con 0x560b64a0e2f0 2024-09-21T02:38:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.101+0000 7fb005e00640 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a0e2f0 0x560b64dde740 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faff80ebdc0 tx=0x7faff80ebeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79bafb6bdee396d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.101+0000 7faff3400640 1 -- 172.21.15.79:0/2892957129 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff80fb070 con 0x560b64a0e2f0 2024-09-21T02:38:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.101+0000 7faff3400640 1 -- 172.21.15.79:0/2892957129 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff80f0bf0 con 0x560b64a0e2f0 2024-09-21T02:38:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.101+0000 7faff3400640 1 -- 172.21.15.79:0/2892957129 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff80f5600 con 0x560b64a0e2f0 2024-09-21T02:38:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.101+0000 7faffea00640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fafec0b6510 0x7fafec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7faffea00640 1 -- 172.21.15.79:0/3421750539 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7faff80e7e40 con 0x7fb0081058d0 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb006800640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fafec0b6510 0x7fafec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 -- 172.21.15.79:0/2892957129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a0e2f0 msgr2=0x560b64dde740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a0e2f0 0x560b64dde740 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faff80ebdc0 tx=0x7faff80ebeb0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 -- 172.21.15.79:0/2892957129 shutdown_connections 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a164d0 0x560b64ddf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a0e2f0 0x560b64dde740 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 --2- 172.21.15.79:0/2892957129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64dde0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 -- 172.21.15.79:0/2892957129 >> 172.21.15.79:0/2892957129 conn(0x560b64a2b300 msgr2=0x560b64dd9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 -- 172.21.15.79:0/2892957129 shutdown_connections 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb006800640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fafec0b6510 0x7fafec0b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d30 tx=0x7fb000005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.102+0000 7fb014019740 1 -- 172.21.15.79:0/2892957129 wait complete. 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.103+0000 7fb014019740 1 -- start start 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.103+0000 7fb014019740 1 Processor -- start 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.103+0000 7fb014019740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.103+0000 7fb014019740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a164d0 0x560b64de7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb014019740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a371b0 0x560b64de8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb014019740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560b64c78ab0 con 0x560b64a371b0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb014019740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b64ce7570 con 0x560b64a0e2f0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb014019740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560b64ddfdb0 con 0x560b64a164d0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb014019740 10 client.0 _ll_register_callbacks cb 0x560b64cf6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a371b0 0x560b64de8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb005e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a371b0 0x560b64de8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52208/0 (socket says 172.21.15.79:52208) 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 -- 172.21.15.79:0/44735035 learned_addr learned my addr 172.21.15.79:0/44735035 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb005400640 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a164d0 0x560b64de7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 -- 172.21.15.79:0/44735035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a164d0 msgr2=0x560b64de7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a164d0 0x560b64de7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 -- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 msgr2=0x560b64de7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb006800640 1 -- 172.21.15.79:0/44735035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b64aa2790 con 0x560b64a371b0 2024-09-21T02:38:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.104+0000 7fb005e00640 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fb006800640 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a371b0 0x560b64de8980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb0000209e0 tx=0x7fb000004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb6b89d6d4aa731 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fafe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fafe7e00640 1 -- 172.21.15.79:0/44735035 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00002d060 con 0x560b64a371b0 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fafe7e00640 1 -- 172.21.15.79:0/44735035 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb000018030 con 0x560b64a371b0 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff80f0bf0 con 0x560b64a371b0 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fafe7e00640 1 -- 172.21.15.79:0/44735035 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb000034050 con 0x560b64a371b0 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fb014019740 10 client.15573 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560b64b1b620 con 0x560b64a371b0 2024-09-21T02:38:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.105+0000 7fafe7e00640 1 -- 172.21.15.79:0/44735035 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff80f0bf0 con 0x560b64a371b0 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fafe7e00640 1 -- 172.21.15.79:0/44735035 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb000028b30 con 0x560b64a371b0 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fb014019740 10 client.15573 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fb014019740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fb014019740 20 client.15573 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fb014019740 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649f5d80 0x560b64df4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fb014019740 4 client.15573 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b64d53600 con 0x560b649f5d80 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.106+0000 7fb005e00640 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649f5d80 0x560b64df4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.107+0000 7fafe7e00640 10 client.15573 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.107+0000 7fb005e00640 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649f5d80 0x560b64df4ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6921374e63136df server_cookie=2892671a2514c86e in_seq=0 out_seq=0 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.107+0000 7fafe7e00640 1 -- 172.21.15.79:0/44735035 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b64d53600 con 0x560b649f5d80 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.107+0000 7fafe7e00640 10 client.15573 handle_command_reply: tid=0 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 client.15573 shutdown 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a371b0 msgr2=0x560b64de8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a371b0 0x560b64de8980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb0000209e0 tx=0x7fb000004730 comp rx=0 tx=0).stop 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 shutdown_connections 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649f5d80 0x560b64df4ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a371b0 0x560b64de8980 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a164d0 0x560b64de7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 --2- 172.21.15.79:0/44735035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fafe7e00640 0 client.15573 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 >> 172.21.15.79:0/44735035 conn(0x560b64a2b300 msgr2=0x560b64ddf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 shutdown_connections 2024-09-21T02:38:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 1 -- 172.21.15.79:0/44735035 wait complete. 2024-09-21T02:38:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.108+0000 7fb014019740 20 client.15573 trim_cache size 0 max 16384 2024-09-21T02:38:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.123+0000 7fb014019740 1 Processor -- start 2024-09-21T02:38:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.123+0000 7fb014019740 1 -- start start 2024-09-21T02:38:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb014019740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb014019740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64de6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb014019740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64de6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb014019740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081ac960 con 0x560b64a164d0 2024-09-21T02:38:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb014019740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081af1e0 con 0x560b64a0e2f0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb014019740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081acfd0 con 0x560b64a371b0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64de6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64de6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52218/0 (socket says 172.21.15.79:52218) 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 -- 172.21.15.79:0/3724022675 learned_addr learned my addr 172.21.15.79:0/3724022675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005e00640 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb006800640 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64de6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 -- 172.21.15.79:0/3724022675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 msgr2=0x560b64de6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64de6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 -- 172.21.15.79:0/3724022675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 msgr2=0x560b64de6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.124+0000 7fb005400640 1 -- 172.21.15.79:0/3724022675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b64def920 con 0x560b64a164d0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.125+0000 7fb005400640 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64de6780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff4009230 tx=0x7faff4004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedcc108a29a3892 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.125+0000 7faff2a00640 1 -- 172.21.15.79:0/3724022675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff4035040 con 0x560b64a164d0 2024-09-21T02:38:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.125+0000 7faff2a00640 1 -- 172.21.15.79:0/3724022675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff40054f0 con 0x560b64a164d0 2024-09-21T02:38:17.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.125+0000 7faff2a00640 1 -- 172.21.15.79:0/3724022675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff40035f0 con 0x560b64a164d0 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 -- 172.21.15.79:0/3724022675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 msgr2=0x560b64de6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64de6780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff4009230 tx=0x7faff4004310 comp rx=0 tx=0).stop 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 -- 172.21.15.79:0/3724022675 shutdown_connections 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a371b0 0x560b64de6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64de6780 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 --2- 172.21.15.79:0/3724022675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a0e2f0 0x560b64de6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 -- 172.21.15.79:0/3724022675 >> 172.21.15.79:0/3724022675 conn(0x560b64a2b300 msgr2=0x560b64dd94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 -- 172.21.15.79:0/3724022675 shutdown_connections 2024-09-21T02:38:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 -- 172.21.15.79:0/3724022675 wait complete. 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.126+0000 7fb014019740 1 -- start start 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 1 Processor -- start 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a0e2f0 0x560b64deb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64deb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a371b0 0x560b64dec3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081ad6a0 con 0x560b64a164d0 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081aeb10 con 0x560b64a371b0 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0081add70 con 0x560b64a0e2f0 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb014019740 10 client.0 _ll_register_callbacks cb 0x7fb0000099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb005400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64deb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb005e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a0e2f0 0x560b64deb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb005400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64deb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52230/0 (socket says 172.21.15.79:52230) 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb005400640 1 -- 172.21.15.79:0/1918402906 learned_addr learned my addr 172.21.15.79:0/1918402906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.127+0000 7fb006800640 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a371b0 0x560b64dec3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb005400640 1 -- 172.21.15.79:0/1918402906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a0e2f0 msgr2=0x560b64deb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb005400640 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a0e2f0 0x560b64deb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb005400640 1 -- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a371b0 msgr2=0x560b64dec3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb005400640 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a371b0 0x560b64dec3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb005400640 1 -- 172.21.15.79:0/1918402906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b64def740 con 0x560b64a164d0 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb005400640 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64deb820 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faff4031440 tx=0x7faff4005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7203d76fec5c5392 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fafe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fafe7e00640 1 -- 172.21.15.79:0/1918402906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff4035030 con 0x560b64a164d0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fafe7e00640 1 -- 172.21.15.79:0/1918402906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7faff40315a0 con 0x560b64a164d0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff40054f0 con 0x560b64a164d0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fafe7e00640 1 -- 172.21.15.79:0/1918402906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faff4059050 con 0x560b64a164d0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.128+0000 7fb014019740 10 client.15579 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560b64e5ff00 con 0x560b64a164d0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fafe7e00640 1 -- 172.21.15.79:0/1918402906 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff40054f0 con 0x560b64a164d0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fafe7e00640 1 -- 172.21.15.79:0/1918402906 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faff4044020 con 0x560b64a164d0 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb014019740 10 client.15579 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb014019740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb014019740 20 client.15579 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb014019740 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649cb1c0 0x560b64e62920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb014019740 4 client.15579 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:38:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b64dda0c0 con 0x560b649cb1c0 2024-09-21T02:38:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.129+0000 7fb005e00640 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649cb1c0 0x560b64e62920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.130+0000 7fb005e00640 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649cb1c0 0x560b64e62920 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14a03e917656e15e server_cookie=34548f4ee5c792d0 in_seq=0 out_seq=0 2024-09-21T02:38:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.130+0000 7fafe7e00640 10 client.15579 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fafe7e00640 1 -- 172.21.15.79:0/1918402906 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b64dda0c0 con 0x560b649cb1c0 2024-09-21T02:38:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fafe7e00640 10 client.15579 handle_command_reply: tid=0 2024-09-21T02:38:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 client.15579 shutdown 2024-09-21T02:38:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 msgr2=0x560b64deb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64deb820 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faff4031440 tx=0x7faff4005030 comp rx=0 tx=0).stop 2024-09-21T02:38:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 shutdown_connections 2024-09-21T02:38:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560b649cb1c0 0x560b64e62920 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b64a371b0 0x560b64dec3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b64a164d0 0x560b64deb820 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 --2- 172.21.15.79:0/1918402906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560b64a0e2f0 0x560b64deb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fafe7e00640 0 client.15579 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.156+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 >> 172.21.15.79:0/1918402906 conn(0x560b64a2b300 msgr2=0x560b64dd80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.157+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 shutdown_connections 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.157+0000 7fb014019740 1 -- 172.21.15.79:0/1918402906 wait complete. 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.157+0000 7fb014019740 20 client.15579 trim_cache size 0 max 16384 2024-09-21T02:38:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:38:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:38:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:38:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.157+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fafec0b6510 msgr2=0x7fafec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.157+0000 7fb00d000640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fafec0b6510 0x7fafec0b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d30 tx=0x7fb000005f90 comp rx=0 tx=0).stop 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.157+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0081058d0 msgr2=0x7fb00819c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.157+0000 7fb00d000640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0081058d0 0x7fb00819c160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faff800eb90 tx=0x7faff800c6a0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 shutdown_connections 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fafec0b6510 0x7fafec0b8a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0081072f0 0x7fb00819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb008106950 0x7fb00819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 --2- 172.21.15.79:0/3421750539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0081058d0 0x7fb00819c160 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 >> 172.21.15.79:0/3421750539 conn(0x7fb008101230 msgr2=0x7fb008109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 shutdown_connections 2024-09-21T02:38:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:17.158+0000 7fb00d000640 1 -- 172.21.15.79:0/3421750539 wait complete. 2024-09-21T02:38:17.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:17 smithi098 ceph-mon[34832]: pgmap v491: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.7 MiB/s wr, 305 op/s 2024-09-21T02:38:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:17 smithi079 ceph-mon[30788]: pgmap v491: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.7 MiB/s wr, 305 op/s 2024-09-21T02:38:17.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:17 smithi148 ceph-mon[34626]: pgmap v491: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.7 MiB/s wr, 305 op/s 2024-09-21T02:38:19.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:19 smithi098 ceph-mon[34832]: pgmap v492: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.8 MiB/s wr, 316 op/s 2024-09-21T02:38:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:19 smithi079 ceph-mon[30788]: pgmap v492: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.8 MiB/s wr, 316 op/s 2024-09-21T02:38:19.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:19 smithi148 ceph-mon[34626]: pgmap v492: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.8 MiB/s wr, 316 op/s 2024-09-21T02:38:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 145.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:38:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:21 smithi098 ceph-mon[34832]: pgmap v493: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.8 MiB/s wr, 324 op/s 2024-09-21T02:38:21.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:21 smithi079 ceph-mon[30788]: pgmap v493: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.8 MiB/s wr, 324 op/s 2024-09-21T02:38:21.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:21 smithi148 ceph-mon[34626]: pgmap v493: 129 pgs: 129 active+clean; 1020 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.8 MiB/s wr, 324 op/s 2024-09-21T02:38:23.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:23 smithi079 ceph-mon[30788]: pgmap v494: 129 pgs: 129 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.2 MiB/s wr, 336 op/s 2024-09-21T02:38:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:23 smithi098 ceph-mon[34832]: pgmap v494: 129 pgs: 129 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.2 MiB/s wr, 336 op/s 2024-09-21T02:38:23.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:23 smithi148 ceph-mon[34626]: pgmap v494: 129 pgs: 129 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.2 MiB/s wr, 336 op/s 2024-09-21T02:38:25.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:25 smithi098 ceph-mon[34832]: pgmap v495: 129 pgs: 129 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.6 MiB/s wr, 258 op/s 2024-09-21T02:38:25.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:25 smithi079 ceph-mon[30788]: pgmap v495: 129 pgs: 129 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.6 MiB/s wr, 258 op/s 2024-09-21T02:38:25.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:25 smithi148 ceph-mon[34626]: pgmap v495: 129 pgs: 129 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.6 MiB/s wr, 258 op/s 2024-09-21T02:38:26.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 150.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:38:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:27 smithi098 ceph-mon[34832]: pgmap v496: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.8 MiB/s wr, 216 op/s 2024-09-21T02:38:27.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:27 smithi079 ceph-mon[30788]: pgmap v496: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.8 MiB/s wr, 216 op/s 2024-09-21T02:38:27.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:27 smithi148 ceph-mon[34626]: pgmap v496: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.8 MiB/s wr, 216 op/s 2024-09-21T02:38:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:29 smithi098 ceph-mon[34832]: pgmap v497: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.1 MiB/s wr, 151 op/s 2024-09-21T02:38:29.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:29 smithi079 ceph-mon[30788]: pgmap v497: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.1 MiB/s wr, 151 op/s 2024-09-21T02:38:29.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:29 smithi148 ceph-mon[34626]: pgmap v497: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.1 MiB/s wr, 151 op/s 2024-09-21T02:38:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 -- 172.21.15.79:0/1059508459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881058c0 msgr2=0x7fb588105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 --2- 172.21.15.79:0/1059508459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881058c0 0x7fb588105d30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009900 tx=0x7fb57c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 -- 172.21.15.79:0/1059508459 shutdown_connections 2024-09-21T02:38:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 --2- 172.21.15.79:0/1059508459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5881072e0 0x7fb58810dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 --2- 172.21.15.79:0/1059508459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb588106940 0x7fb588106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 --2- 172.21.15.79:0/1059508459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881058c0 0x7fb588105d30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 -- 172.21.15.79:0/1059508459 >> 172.21.15.79:0/1059508459 conn(0x7fb588101220 msgr2=0x7fb5881036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 -- 172.21.15.79:0/1059508459 shutdown_connections 2024-09-21T02:38:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.349+0000 7fb590800640 1 -- 172.21.15.79:0/1059508459 wait complete. 2024-09-21T02:38:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 Processor -- start 2024-09-21T02:38:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 -- start start 2024-09-21T02:38:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5881058c0 0x7fb58819c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb588106940 0x7fb58819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881072e0 0x7fb58819d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881114e0 con 0x7fb5881072e0 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb588111360 con 0x7fb5881058c0 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.350+0000 7fb590800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb588111660 con 0x7fb588106940 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881072e0 0x7fb58819d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb588106940 0x7fb58819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881072e0 0x7fb58819d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40610/0 (socket says 172.21.15.79:40610) 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 -- 172.21.15.79:0/2093807150 learned_addr learned my addr 172.21.15.79:0/2093807150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb588106940 0x7fb58819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52626/0 (socket says 172.21.15.79:52626) 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58de00640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5881058c0 0x7fb58819c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 -- 172.21.15.79:0/2093807150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb588106940 msgr2=0x7fb58819c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb588106940 0x7fb58819c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 -- 172.21.15.79:0/2093807150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5881058c0 msgr2=0x7fb58819c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5881058c0 0x7fb58819c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 -- 172.21.15.79:0/2093807150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58819dba0 con 0x7fb5881072e0 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb58e800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881072e0 0x7fb58819d380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb584009fd0 tx=0x7fb58400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.351+0000 7fb582a00640 1 -- 172.21.15.79:0/2093807150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584017070 con 0x7fb5881072e0 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.352+0000 7fb582a00640 1 -- 172.21.15.79:0/2093807150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb584003e20 con 0x7fb5881072e0 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.352+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58819de90 con 0x7fb5881072e0 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.352+0000 7fb582a00640 1 -- 172.21.15.79:0/2093807150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584010460 con 0x7fb5881072e0 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.352+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5881a4580 con 0x7fb5881072e0 2024-09-21T02:38:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.355+0000 7fb597823740 1 Processor -- start 2024-09-21T02:38:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.355+0000 7fb582a00640 1 -- 172.21.15.79:0/2093807150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb584003970 con 0x7fb5881072e0 2024-09-21T02:38:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.355+0000 7fb597823740 1 -- start start 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb597823740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e200d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb597823740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e20740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb597823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e21290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb597823740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b58d936b0 con 0x559b58a791b0 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb597823740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559b58d82ae0 con 0x559b58a502f0 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb597823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559b58d868f0 con 0x559b58a584d0 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb58d400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e200d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb58d400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e200d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40620/0 (socket says 172.21.15.79:40620) 2024-09-21T02:38:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb58d400640 1 -- 172.21.15.79:0/2782293635 learned_addr learned my addr 172.21.15.79:0/2782293635 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb58de00640 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e20740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.356+0000 7fb58d400640 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e21290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58d400640 1 -- 172.21.15.79:0/2782293635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 msgr2=0x559b58e21290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58d400640 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e21290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58d400640 1 -- 172.21.15.79:0/2782293635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 msgr2=0x559b58e20740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58d400640 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e20740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58d400640 1 -- 172.21.15.79:0/2782293635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b58d4f780 con 0x559b58a791b0 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58de00640 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e20740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58d400640 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e200d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb578013610 tx=0x7fb578009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb03633d4adafc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb582a00640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b6590 0x7fb5700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb582a00640 1 -- 172.21.15.79:0/2093807150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb5840e7330 con 0x7fb5881072e0 2024-09-21T02:38:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb577000640 1 -- 172.21.15.79:0/2782293635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57800f600 con 0x559b58a791b0 2024-09-21T02:38:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb577000640 1 -- 172.21.15.79:0/2782293635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb57800fc50 con 0x559b58a791b0 2024-09-21T02:38:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb58de00640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b6590 0x7fb5700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.357+0000 7fb577000640 1 -- 172.21.15.79:0/2782293635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578010b80 con 0x559b58a791b0 2024-09-21T02:38:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 -- 172.21.15.79:0/2782293635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 msgr2=0x559b58e200d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb58de00640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b6590 0x7fb5700b8aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb57c000c00 tx=0x7fb57c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e200d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb578013610 tx=0x7fb578009890 comp rx=0 tx=0).stop 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 -- 172.21.15.79:0/2782293635 shutdown_connections 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e21290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e20740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 --2- 172.21.15.79:0/2782293635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e200d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 -- 172.21.15.79:0/2782293635 >> 172.21.15.79:0/2782293635 conn(0x559b58a6d300 msgr2=0x559b58e1bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 -- 172.21.15.79:0/2782293635 shutdown_connections 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.358+0000 7fb597823740 1 -- 172.21.15.79:0/2782293635 wait complete. 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 -- start start 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 Processor -- start 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e297a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e29e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e2a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b58cbaab0 con 0x559b58a791b0 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559b58d29570 con 0x559b58a502f0 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.359+0000 7fb597823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559b58e21db0 con 0x559b58a584d0 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb597823740 10 client.0 _ll_register_callbacks cb 0x559b58d38100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e2a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e2a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40636/0 (socket says 172.21.15.79:40636) 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 -- 172.21.15.79:0/8921804 learned_addr learned my addr 172.21.15.79:0/8921804 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58d400640 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e29e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 -- 172.21.15.79:0/8921804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 msgr2=0x559b58e29e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e29e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 -- 172.21.15.79:0/8921804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 msgr2=0x559b58e297a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e297a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 -- 172.21.15.79:0/8921804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b58ae4790 con 0x559b58a791b0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb58e800640 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e2a9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5840a9730 tx=0x7fb5840042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dfe602536dd250 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.360+0000 7fb56b400640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb56b400640 1 -- 172.21.15.79:0/8921804 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584020070 con 0x559b58a791b0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb56b400640 1 -- 172.21.15.79:0/8921804 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb5840a8cb0 con 0x559b58a791b0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb57800fc50 con 0x559b58a791b0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb56b400640 1 -- 172.21.15.79:0/8921804 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb5840acc70 con 0x559b58a791b0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 10 client.15591 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559b58b5d620 con 0x559b58a791b0 2024-09-21T02:38:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb56b400640 1 -- 172.21.15.79:0/8921804 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb57800fc50 con 0x559b58a791b0 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb56b400640 1 -- 172.21.15.79:0/8921804 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb584096ce0 con 0x559b58a791b0 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 10 client.15591 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 20 client.15591 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a37d80 0x559b58e36f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 4 client.15591 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.361+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b58d95600 con 0x559b58a37d80 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.362+0000 7fb58de00640 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a37d80 0x559b58e36f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.362+0000 7fb58de00640 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a37d80 0x559b58e36f60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7ed8021136e730 server_cookie=4f943624d88dedec in_seq=0 out_seq=0 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.362+0000 7fb56b400640 10 client.15591 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb56b400640 1 -- 172.21.15.79:0/8921804 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b58d95600 con 0x559b58a37d80 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb56b400640 10 client.15591 handle_command_reply: tid=0 2024-09-21T02:38:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 client.15591 shutdown 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 msgr2=0x559b58e2a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e2a9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5840a9730 tx=0x7fb5840042e0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 shutdown_connections 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a37d80 0x559b58e36f60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e2a9d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e29e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb56b400640 0 client.15591 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 --2- 172.21.15.79:0/8921804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a502f0 0x559b58e297a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.363+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 >> 172.21.15.79:0/8921804 conn(0x559b58a6d300 msgr2=0x559b58e1a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.364+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 shutdown_connections 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.364+0000 7fb597823740 1 -- 172.21.15.79:0/8921804 wait complete. 2024-09-21T02:38:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.364+0000 7fb597823740 20 client.15591 trim_cache size 0 max 16384 2024-09-21T02:38:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 Processor -- start 2024-09-21T02:38:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 -- start start 2024-09-21T02:38:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a502f0 0x559b58e283c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a584d0 0x559b58e20fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e24220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881ac910 con 0x559b58a791b0 2024-09-21T02:38:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881af190 con 0x559b58a584d0 2024-09-21T02:38:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb597823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881acf80 con 0x559b58a502f0 2024-09-21T02:38:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb58e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e24220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb58e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e24220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40642/0 (socket says 172.21.15.79:40642) 2024-09-21T02:38:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.379+0000 7fb58e800640 1 -- 172.21.15.79:0/882769367 learned_addr learned my addr 172.21.15.79:0/882769367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58de00640 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a502f0 0x559b58e283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58d400640 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a584d0 0x559b58e20fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58e800640 1 -- 172.21.15.79:0/882769367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a502f0 msgr2=0x559b58e283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58e800640 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a502f0 0x559b58e283c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58e800640 1 -- 172.21.15.79:0/882769367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a584d0 msgr2=0x559b58e20fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58e800640 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a584d0 0x559b58e20fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58e800640 1 -- 172.21.15.79:0/882769367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b58e31c70 con 0x559b58a791b0 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb58e800640 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e24220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb584003ff0 tx=0x7fb5840b2fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56b90afdc245819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb576600640 1 -- 172.21.15.79:0/882769367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584014020 con 0x559b58a791b0 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb576600640 1 -- 172.21.15.79:0/882769367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5840b1b90 con 0x559b58a791b0 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.380+0000 7fb576600640 1 -- 172.21.15.79:0/882769367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584020070 con 0x559b58a791b0 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 -- 172.21.15.79:0/882769367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 msgr2=0x559b58e24220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e24220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb584003ff0 tx=0x7fb5840b2fe0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 -- 172.21.15.79:0/882769367 shutdown_connections 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a791b0 0x559b58e24220 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a584d0 0x559b58e20fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 --2- 172.21.15.79:0/882769367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a502f0 0x559b58e283c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 -- 172.21.15.79:0/882769367 >> 172.21.15.79:0/882769367 conn(0x559b58a6d300 msgr2=0x559b58e27cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 -- 172.21.15.79:0/882769367 shutdown_connections 2024-09-21T02:38:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.381+0000 7fb597823740 1 -- 172.21.15.79:0/882769367 wait complete. 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.382+0000 7fb597823740 1 -- start start 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.382+0000 7fb597823740 1 Processor -- start 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb597823740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a502f0 0x559b58e31450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb597823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e30110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb597823740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a791b0 0x559b58e306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb597823740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881ad650 con 0x559b58a502f0 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb597823740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881aeac0 con 0x559b58a791b0 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb597823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881add20 con 0x559b58a584d0 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb597823740 10 client.0 _ll_register_callbacks cb 0x7fb584009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a502f0 0x559b58e31450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e30110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e30110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52666/0 (socket says 172.21.15.79:52666) 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 -- 172.21.15.79:0/3097334146 learned_addr learned my addr 172.21.15.79:0/3097334146 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58e800640 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a791b0 0x559b58e306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 -- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a791b0 msgr2=0x559b58e306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a791b0 0x559b58e306d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 -- 172.21.15.79:0/3097334146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a502f0 msgr2=0x559b58e31450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a502f0 0x559b58e31450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58d400640 1 -- 172.21.15.79:0/3097334146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b58e30e60 con 0x559b58a584d0 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.383+0000 7fb58de00640 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a502f0 0x559b58e31450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.384+0000 7fb58d400640 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e30110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb578004600 tx=0x7fb578009dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37248df3a55e24e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.384+0000 7fb56b400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.384+0000 7fb56b400640 1 -- 172.21.15.79:0/3097334146 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57802e060 con 0x559b58a584d0 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.384+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5840b1b90 con 0x559b58a584d0 2024-09-21T02:38:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.384+0000 7fb56b400640 1 -- 172.21.15.79:0/3097334146 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb578004680 con 0x559b58a584d0 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.388+0000 7fb56b400640 1 -- 172.21.15.79:0/3097334146 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb578035050 con 0x559b58a584d0 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.388+0000 7fb597823740 10 client.25678 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.388+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559b58ea19f0 con 0x559b58a584d0 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb56b400640 1 -- 172.21.15.79:0/3097334146 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5840b1b90 con 0x559b58a584d0 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb56b400640 1 -- 172.21.15.79:0/3097334146 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb57800fb70 con 0x559b58a584d0 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb597823740 10 client.25678 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb597823740 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb597823740 20 client.25678 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb597823740 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a0d1c0 0x559b58ea4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb597823740 4 client.25678 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b58d910b0 con 0x559b58a0d1c0 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.389+0000 7fb58de00640 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a0d1c0 0x559b58ea4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.390+0000 7fb56b400640 10 client.25678 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.390+0000 7fb58de00640 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a0d1c0 0x559b58ea4180 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ed296e72c553d6 server_cookie=3fd60664f9244cf9 in_seq=0 out_seq=0 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.405+0000 7fb56b400640 1 -- 172.21.15.79:0/3097334146 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b58d910b0 con 0x559b58a0d1c0 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.405+0000 7fb56b400640 10 client.25678 handle_command_reply: tid=0 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.405+0000 7fb597823740 1 client.25678 shutdown 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 msgr2=0x559b58e30110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e30110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb578004600 tx=0x7fb578009dd0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 shutdown_connections 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x559b58a0d1c0 0x559b58ea4180 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b58a791b0 0x559b58e306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb56b400640 0 client.25678 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559b58a584d0 0x559b58e30110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 --2- 172.21.15.79:0/3097334146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b58a502f0 0x559b58e31450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 >> 172.21.15.79:0/3097334146 conn(0x559b58a6d300 msgr2=0x559b58e24220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 shutdown_connections 2024-09-21T02:38:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 1 -- 172.21.15.79:0/3097334146 wait complete. 2024-09-21T02:38:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.406+0000 7fb597823740 20 client.25678 trim_cache size 0 max 16384 2024-09-21T02:38:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:38:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:38:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:38:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b6590 msgr2=0x7fb5700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b6590 0x7fb5700b8aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb57c000c00 tx=0x7fb57c031400 comp rx=0 tx=0).stop 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881072e0 msgr2=0x7fb58819d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881072e0 0x7fb58819d380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb584009fd0 tx=0x7fb58400b260 comp rx=0 tx=0).stop 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 shutdown_connections 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb5700b6590 0x7fb5700b8aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5881072e0 0x7fb58819d380 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb588106940 0x7fb58819c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 --2- 172.21.15.79:0/2093807150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5881058c0 0x7fb58819c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 >> 172.21.15.79:0/2093807150 conn(0x7fb588101220 msgr2=0x7fb588109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 shutdown_connections 2024-09-21T02:38:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:30.407+0000 7fb590800640 1 -- 172.21.15.79:0/2093807150 wait complete. 2024-09-21T02:38:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 155.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:38:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:31 smithi098 ceph-mon[34832]: pgmap v498: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 219 op/s 2024-09-21T02:38:31.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:31 smithi079 ceph-mon[30788]: pgmap v498: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 219 op/s 2024-09-21T02:38:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:31 smithi148 ceph-mon[34626]: pgmap v498: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 219 op/s 2024-09-21T02:38:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:33 smithi098 ceph-mon[34832]: pgmap v499: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.7 MiB/s wr, 215 op/s 2024-09-21T02:38:33.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:33 smithi079 ceph-mon[30788]: pgmap v499: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.7 MiB/s wr, 215 op/s 2024-09-21T02:38:33.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:33 smithi148 ceph-mon[34626]: pgmap v499: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.7 MiB/s wr, 215 op/s 2024-09-21T02:38:35.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:35 smithi079 ceph-mon[30788]: pgmap v500: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.3 MiB/s wr, 197 op/s 2024-09-21T02:38:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:35 smithi148 ceph-mon[34626]: pgmap v500: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.3 MiB/s wr, 197 op/s 2024-09-21T02:38:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:35 smithi098 ceph-mon[34832]: pgmap v500: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.3 MiB/s wr, 197 op/s 2024-09-21T02:38:36.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:38:36.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:38:36.795 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:37.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:37 smithi079 ceph-mon[30788]: pgmap v501: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.481+0000 7f779ca00640 1 -- 172.21.15.79:0/812656393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810c010 msgr2=0x7f7798112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.481+0000 7f779ca00640 1 --2- 172.21.15.79:0/812656393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810c010 0x7f7798112840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7790009ca0 tx=0x7f779002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.482+0000 7f779ca00640 1 -- 172.21.15.79:0/812656393 shutdown_connections 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.482+0000 7f779ca00640 1 --2- 172.21.15.79:0/812656393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810c010 0x7f7798112840 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.482+0000 7f779ca00640 1 --2- 172.21.15.79:0/812656393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779810b6c0 0x7f779810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.482+0000 7f779ca00640 1 --2- 172.21.15.79:0/812656393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7798105d80 0x7f7798106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.482+0000 7f779ca00640 1 -- 172.21.15.79:0/812656393 >> 172.21.15.79:0/812656393 conn(0x7f77981017d0 msgr2=0x7f7798103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:37.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.482+0000 7f779ca00640 1 -- 172.21.15.79:0/812656393 shutdown_connections 2024-09-21T02:38:37.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.482+0000 7f779ca00640 1 -- 172.21.15.79:0/812656393 wait complete. 2024-09-21T02:38:37.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.483+0000 7f779ca00640 1 Processor -- start 2024-09-21T02:38:37.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.483+0000 7f779ca00640 1 -- start start 2024-09-21T02:38:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f779ca00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7798105d80 0x7f779819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f779ca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810b6c0 0x7f779819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f779ca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779810c010 0x7f77981a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f779ca00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7798115cd0 con 0x7f779810b6c0 2024-09-21T02:38:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f779ca00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7798115b50 con 0x7f7798105d80 2024-09-21T02:38:37.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f779ca00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7798115e50 con 0x7f779810c010 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f7795400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810b6c0 0x7f779819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f7795e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7798105d80 0x7f779819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f7795400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810b6c0 0x7f779819cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58742/0 (socket says 172.21.15.79:58742) 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f7795400640 1 -- 172.21.15.79:0/2721601958 learned_addr learned my addr 172.21.15.79:0/2721601958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.484+0000 7f7796800640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779810c010 0x7f77981a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f7795e00640 1 -- 172.21.15.79:0/2721601958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779810c010 msgr2=0x7f77981a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f7795e00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779810c010 0x7f77981a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f7795e00640 1 -- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810b6c0 msgr2=0x7f779819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f7795e00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810b6c0 0x7f779819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f7795e00640 1 -- 172.21.15.79:0/2721601958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77981a25d0 con 0x7f7798105d80 2024-09-21T02:38:37.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f7795400640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810b6c0 0x7f779819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f7795e00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7798105d80 0x7f779819c660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7788005fd0 tx=0x7f778800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f778ea00640 1 -- 172.21.15.79:0/2721601958 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788009c30 con 0x7f7798105d80 2024-09-21T02:38:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f778ea00640 1 -- 172.21.15.79:0/2721601958 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7788009dd0 con 0x7f7798105d80 2024-09-21T02:38:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77981a28c0 con 0x7f7798105d80 2024-09-21T02:38:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f778ea00640 1 -- 172.21.15.79:0/2721601958 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788010460 con 0x7f7798105d80 2024-09-21T02:38:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.485+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77981a9020 con 0x7f7798105d80 2024-09-21T02:38:37.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.486+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7798106190 con 0x7f7798105d80 2024-09-21T02:38:37.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.489+0000 7f778ea00640 1 -- 172.21.15.79:0/2721601958 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7788005030 con 0x7f7798105d80 2024-09-21T02:38:37.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.490+0000 7f778ea00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f777c0b6510 0x7f777c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:37.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.490+0000 7f778ea00640 1 -- 172.21.15.79:0/2721601958 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f77880e7600 con 0x7f7798105d80 2024-09-21T02:38:37.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.491+0000 7f7795400640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f777c0b6510 0x7f777c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:37.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.491+0000 7f7795400640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f777c0b6510 0x7f777c0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7798109110 tx=0x7f778400b440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:37.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.492+0000 7f778ea00640 1 -- 172.21.15.79:0/2721601958 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7788017020 con 0x7f7798105d80 2024-09-21T02:38:37.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.716+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f779819d790 con 0x7f7798105d80 2024-09-21T02:38:37.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.718+0000 7f778ea00640 1 -- 172.21.15.79:0/2721601958 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f77880e6090 con 0x7f7798105d80 2024-09-21T02:38:37.719 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:38:37.719 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:38:37.719 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f777c0b6510 msgr2=0x7f777c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f777c0b6510 0x7f777c0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7798109110 tx=0x7f778400b440 comp rx=0 tx=0).stop 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7798105d80 msgr2=0x7f779819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7798105d80 0x7f779819c660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7788005fd0 tx=0x7f778800dde0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 shutdown_connections 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f777c0b6510 0x7f777c0b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f779810c010 0x7f77981a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f779810b6c0 0x7f779819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 --2- 172.21.15.79:0/2721601958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7798105d80 0x7f779819c660 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 >> 172.21.15.79:0/2721601958 conn(0x7f77981017d0 msgr2=0x7f7798103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 shutdown_connections 2024-09-21T02:38:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:37.720+0000 7f779ca00640 1 -- 172.21.15.79:0/2721601958 wait complete. 2024-09-21T02:38:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:37 smithi148 ceph-mon[34626]: pgmap v501: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-09-21T02:38:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:37 smithi098 ceph-mon[34832]: pgmap v501: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-09-21T02:38:38.619 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 881ae21 --release --await' 2024-09-21T02:38:38.619 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 881ae21 --release --await 2024-09-21T02:38:38.670 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:38 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2721601958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:38.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:38 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2721601958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:38.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:38 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2721601958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:38:38.984 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 -- 172.21.15.79:0/1439100105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd580760a0 msgr2=0x7fdd5810fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/1439100105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd580760a0 0x7fdd5810fc10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009900 tx=0x7fdd4002a410 comp rx=0 tx=0).stop 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 -- 172.21.15.79:0/1439100105 shutdown_connections 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/1439100105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd58110150 0x7fdd58112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/1439100105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd580760a0 0x7fdd5810fc10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/1439100105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd58075750 0x7fdd58075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 -- 172.21.15.79:0/1439100105 >> 172.21.15.79:0/1439100105 conn(0x7fdd580ff600 msgr2=0x7fdd58101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 -- 172.21.15.79:0/1439100105 shutdown_connections 2024-09-21T02:38:39.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.584+0000 7fdd5cc00640 1 -- 172.21.15.79:0/1439100105 wait complete. 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.585+0000 7fdd5cc00640 1 Processor -- start 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.585+0000 7fdd5cc00640 1 -- start start 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd58075750 0x7fdd5819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd580760a0 0x7fdd5819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd58110150 0x7fdd581a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd5cc00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58115c80 con 0x7fdd58075750 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd5cc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58115b00 con 0x7fdd580760a0 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd5cc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58115e00 con 0x7fdd58110150 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd58075750 0x7fdd5819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd58075750 0x7fdd5819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58768/0 (socket says 172.21.15.79:58768) 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 -- 172.21.15.79:0/4242996506 learned_addr learned my addr 172.21.15.79:0/4242996506 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd4d400640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd580760a0 0x7fdd5819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd56800640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd58110150 0x7fdd581a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 -- 172.21.15.79:0/4242996506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd58110150 msgr2=0x7fdd581a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd58110150 0x7fdd581a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 -- 172.21.15.79:0/4242996506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd580760a0 msgr2=0x7fdd5819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd580760a0 0x7fdd5819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.586+0000 7fdd55e00640 1 -- 172.21.15.79:0/4242996506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd581a2660 con 0x7fdd58075750 2024-09-21T02:38:39.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.587+0000 7fdd55e00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd58075750 0x7fdd5819c6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e9f0 tx=0x7fdd4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:39.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.587+0000 7fdd4f400640 1 -- 172.21.15.79:0/4242996506 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800cd80 con 0x7fdd58075750 2024-09-21T02:38:39.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.587+0000 7fdd4f400640 1 -- 172.21.15.79:0/4242996506 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd480108e0 con 0x7fdd58075750 2024-09-21T02:38:39.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.587+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd581a2950 con 0x7fdd58075750 2024-09-21T02:38:39.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.587+0000 7fdd4f400640 1 -- 172.21.15.79:0/4242996506 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48018980 con 0x7fdd58075750 2024-09-21T02:38:39.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.587+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581a90b0 con 0x7fdd58075750 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.590+0000 7fdd6385c740 1 Processor -- start 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd6385c740 1 -- start start 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f903520 0x55c31fcaa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd4f400640 1 -- 172.21.15.79:0/4242996506 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdd48010430 con 0x7fdd58075750 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcaa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd6385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c31fc21290 con 0x55c31f8da660 2024-09-21T02:38:39.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd6385c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c31fc106c0 con 0x55c31f8e2840 2024-09-21T02:38:39.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd6385c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c31fc144d0 con 0x55c31f903520 2024-09-21T02:38:39.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcaa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd4d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcaa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58780/0 (socket says 172.21.15.79:58780) 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd55e00640 1 -- 172.21.15.79:0/2894752029 learned_addr learned my addr 172.21.15.79:0/2894752029 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.591+0000 7fdd56800640 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f903520 0x55c31fcaa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.592+0000 7fdd4d400640 1 -- 172.21.15.79:0/2894752029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f903520 msgr2=0x55c31fcaa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.592+0000 7fdd4d400640 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f903520 0x55c31fcaa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.592+0000 7fdd4d400640 1 -- 172.21.15.79:0/2894752029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 msgr2=0x55c31fcaa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.592+0000 7fdd4d400640 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcaa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.592+0000 7fdd4d400640 1 -- 172.21.15.79:0/2894752029 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31fb9d460 con 0x55c31f8e2840 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.592+0000 7fdd56800640 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f903520 0x55c31fcaa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:39.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.592+0000 7fdd4d400640 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaac40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd4002a930 tx=0x7fdd40000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bead46e5c9610143 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.593+0000 7fdd47000640 1 -- 172.21.15.79:0/2894752029 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40040070 con 0x55c31f8e2840 2024-09-21T02:38:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.593+0000 7fdd47000640 1 -- 172.21.15.79:0/2894752029 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd40004030 con 0x55c31f8e2840 2024-09-21T02:38:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.593+0000 7fdd47000640 1 -- 172.21.15.79:0/2894752029 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40035040 con 0x55c31f8e2840 2024-09-21T02:38:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.593+0000 7fdd4f400640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd3c0b6510 0x7fdd3c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.593+0000 7fdd56800640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd3c0b6510 0x7fdd3c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.593+0000 7fdd4f400640 1 -- 172.21.15.79:0/4242996506 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdd480e7a00 con 0x7fdd58075750 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 -- 172.21.15.79:0/2894752029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 msgr2=0x55c31fcaac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaac40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd4002a930 tx=0x7fdd40000bc0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 -- 172.21.15.79:0/2894752029 shutdown_connections 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaac40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcaa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 --2- 172.21.15.79:0/2894752029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f903520 0x55c31fcaa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 -- 172.21.15.79:0/2894752029 >> 172.21.15.79:0/2894752029 conn(0x55c31f8f7910 msgr2=0x55c31fca80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd56800640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd3c0b6510 0x7fdd3c0b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdd50005fd0 tx=0x7fdd500096a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 -- 172.21.15.79:0/2894752029 shutdown_connections 2024-09-21T02:38:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.594+0000 7fdd6385c740 1 -- 172.21.15.79:0/2894752029 wait complete. 2024-09-21T02:38:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 -- start start 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 Processor -- start 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcb5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8e2840 0x55c31fcb62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcc1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c31fa71bb0 con 0x55c31f8e2840 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c31fbab6c0 con 0x55c31f903520 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.595+0000 7fdd6385c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c31fcb8940 con 0x55c31f8da660 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd6385c740 10 client.0 _ll_register_callbacks cb 0x55c31fbc6490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd4d400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8e2840 0x55c31fcb62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcb5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd4d400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8e2840 0x55c31fcb62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58794/0 (socket says 172.21.15.79:58794) 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd4d400640 1 -- 172.21.15.79:0/505974267 learned_addr learned my addr 172.21.15.79:0/505974267 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd56800640 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcc1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd55e00640 1 -- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 msgr2=0x55c31fcc1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd55e00640 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcc1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd55e00640 1 -- 172.21.15.79:0/505974267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8e2840 msgr2=0x55c31fcb62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd55e00640 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8e2840 0x55c31fcb62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd55e00640 1 -- 172.21.15.79:0/505974267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31f96eb00 con 0x55c31f8da660 2024-09-21T02:38:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd55e00640 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcb5db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd480ad530 tx=0x7fdd480a9050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03f725469db0be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.596+0000 7fdd3b400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:38:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.597+0000 7fdd3b400640 1 -- 172.21.15.79:0/505974267 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480a96d0 con 0x55c31f8da660 2024-09-21T02:38:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.597+0000 7fdd3b400640 1 -- 172.21.15.79:0/505974267 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdd48018d20 con 0x55c31f8da660 2024-09-21T02:38:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.597+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd40004030 con 0x55c31f8da660 2024-09-21T02:38:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.597+0000 7fdd3b400640 1 -- 172.21.15.79:0/505974267 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdd480acfa0 con 0x55c31f8da660 2024-09-21T02:38:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.597+0000 7fdd6385c740 10 client.25696 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.597+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c31f9e5960 con 0x55c31f8da660 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.597+0000 7fdd3b400640 1 -- 172.21.15.79:0/505974267 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd40004030 con 0x55c31f8da660 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd3b400640 1 -- 172.21.15.79:0/505974267 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdd480aeab0 con 0x55c31f8da660 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd6385c740 10 client.25696 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd6385c740 10 client.25696 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd6385c740 20 client.25696 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd6385c740 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f8c1ea0 0x55c31fcc7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd6385c740 4 client.25696 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c31fc231e0 con 0x55c31f8c1ea0 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.598+0000 7fdd4d400640 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f8c1ea0 0x55c31fcc7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.599+0000 7fdd4d400640 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f8c1ea0 0x55c31fcc7d10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70fec8588a2cef3b server_cookie=6bde13705225e6e9 in_seq=0 out_seq=0 2024-09-21T02:38:39.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.599+0000 7fdd3b400640 10 client.25696 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:39.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd3b400640 1 -- 172.21.15.79:0/505974267 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c31fc231e0 con 0x55c31f8c1ea0 2024-09-21T02:38:39.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd3b400640 10 client.25696 handle_command_reply: tid=0 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 client.25696 shutdown 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 msgr2=0x55c31fcb5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcb5db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd480ad530 tx=0x7fdd480a9050 comp rx=0 tx=0).stop 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 shutdown_connections 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f8c1ea0 0x55c31fcc7d10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcc1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8e2840 0x55c31fcb62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 --2- 172.21.15.79:0/505974267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcb5db0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd3b400640 0 client.25696 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 >> 172.21.15.79:0/505974267 conn(0x55c31f8f7910 msgr2=0x55c31fcad350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 shutdown_connections 2024-09-21T02:38:39.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.600+0000 7fdd6385c740 1 -- 172.21.15.79:0/505974267 wait complete. 2024-09-21T02:38:39.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.601+0000 7fdd6385c740 20 client.25696 trim_cache size 0 max 16384 2024-09-21T02:38:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.618+0000 7fdd6385c740 1 Processor -- start 2024-09-21T02:38:39.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.618+0000 7fdd6385c740 1 -- start start 2024-09-21T02:38:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcab900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f903520 0x55c31fcaf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd6385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581b0d70 con 0x55c31f903520 2024-09-21T02:38:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd6385c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581b35f0 con 0x55c31f8e2840 2024-09-21T02:38:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd6385c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581b13e0 con 0x55c31f8da660 2024-09-21T02:38:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd56800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f903520 0x55c31fcaf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd56800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f903520 0x55c31fcaf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58804/0 (socket says 172.21.15.79:58804) 2024-09-21T02:38:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd56800640 1 -- 172.21.15.79:0/1036971644 learned_addr learned my addr 172.21.15.79:0/1036971644 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd4d400640 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd55e00640 1 -- 172.21.15.79:0/1036971644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 msgr2=0x55c31fcaf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd55e00640 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd55e00640 1 -- 172.21.15.79:0/1036971644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f903520 msgr2=0x55c31fcaf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd55e00640 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f903520 0x55c31fcaf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.619+0000 7fdd55e00640 1 -- 172.21.15.79:0/1036971644 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31fcad020 con 0x55c31f8da660 2024-09-21T02:38:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.620+0000 7fdd55e00640 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcab900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd480a9e00 tx=0x7fdd48018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb9b035b0d8956ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.620+0000 7fdd46600640 1 -- 172.21.15.79:0/1036971644 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480ad180 con 0x55c31f8da660 2024-09-21T02:38:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.620+0000 7fdd46600640 1 -- 172.21.15.79:0/1036971644 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd48010720 con 0x55c31f8da660 2024-09-21T02:38:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.620+0000 7fdd46600640 1 -- 172.21.15.79:0/1036971644 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480ad600 con 0x55c31f8da660 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 -- 172.21.15.79:0/1036971644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 msgr2=0x55c31fcab900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcab900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd480a9e00 tx=0x7fdd48018420 comp rx=0 tx=0).stop 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 -- 172.21.15.79:0/1036971644 shutdown_connections 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f903520 0x55c31fcaf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f8e2840 0x55c31fcaf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 --2- 172.21.15.79:0/1036971644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8da660 0x55c31fcab900 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 -- 172.21.15.79:0/1036971644 >> 172.21.15.79:0/1036971644 conn(0x55c31f8f7910 msgr2=0x55c31fcab1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 -- 172.21.15.79:0/1036971644 shutdown_connections 2024-09-21T02:38:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.621+0000 7fdd6385c740 1 -- 172.21.15.79:0/1036971644 wait complete. 2024-09-21T02:38:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 -- start start 2024-09-21T02:38:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 Processor -- start 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcbe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8e2840 0x55c31fcb8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcb90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581b1ab0 con 0x55c31f8da660 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581b2f20 con 0x55c31f903520 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581b2180 con 0x55c31f8e2840 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.622+0000 7fdd6385c740 10 client.0 _ll_register_callbacks cb 0x7fdd4800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcbe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcbe0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58812/0 (socket says 172.21.15.79:58812) 2024-09-21T02:38:39.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd56800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcb90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd55e00640 1 -- 172.21.15.79:0/3469646544 learned_addr learned my addr 172.21.15.79:0/3469646544 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd4d400640 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8e2840 0x55c31fcb8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd56800640 1 -- 172.21.15.79:0/3469646544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8e2840 msgr2=0x55c31fcb8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd56800640 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8e2840 0x55c31fcb8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd56800640 1 -- 172.21.15.79:0/3469646544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 msgr2=0x55c31fcbe0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd56800640 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcbe0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd56800640 1 -- 172.21.15.79:0/3469646544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31fcb9600 con 0x55c31f903520 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd56800640 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcb90c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd500048a0 tx=0x7fdd50004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ae393a35a5d354 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.623+0000 7fdd3b400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.624+0000 7fdd3b400640 1 -- 172.21.15.79:0/3469646544 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5001d410 con 0x55c31f903520 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.624+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c31fc1ec90 con 0x55c31f903520 2024-09-21T02:38:39.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.624+0000 7fdd3b400640 1 -- 172.21.15.79:0/3469646544 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdd5001d5b0 con 0x55c31f903520 2024-09-21T02:38:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.624+0000 7fdd3b400640 1 -- 172.21.15.79:0/3469646544 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdd50034050 con 0x55c31f903520 2024-09-21T02:38:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.624+0000 7fdd6385c740 10 client.25682 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.624+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c31fd33450 con 0x55c31f903520 2024-09-21T02:38:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.624+0000 7fdd3b400640 1 -- 172.21.15.79:0/3469646544 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c31fc1ec90 con 0x55c31f903520 2024-09-21T02:38:39.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd3b400640 1 -- 172.21.15.79:0/3469646544 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdd50029960 con 0x55c31f903520 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd6385c740 10 client.25682 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd6385c740 10 client.25682 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd6385c740 20 client.25682 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd6385c740 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f897250 0x55c31fd35c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd6385c740 4 client.25682 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "881ae21", "release": true, "await": true}] 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "881ae21", "release": true, "await": true}) -- 0x55c31fc1c0c0 con 0x55c31f897250 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.625+0000 7fdd55e00640 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f897250 0x55c31fd35c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.626+0000 7fdd55e00640 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f897250 0x55c31fd35c70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73477cdee791f3f4 server_cookie=bd06183542292f0c in_seq=0 out_seq=0 2024-09-21T02:38:39.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.626+0000 7fdd3b400640 10 client.25682 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:39.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.676+0000 7fdd3b400640 1 -- 172.21.15.79:0/3469646544 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c31fc1c0c0 con 0x55c31f897250 2024-09-21T02:38:39.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.676+0000 7fdd3b400640 10 client.25682 handle_command_reply: tid=0 2024-09-21T02:38:39.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 client.25682 shutdown 2024-09-21T02:38:39.678 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:39 smithi079 ceph-mon[30788]: pgmap v502: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 131 op/s 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 msgr2=0x55c31fcb90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcb90c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd500048a0 tx=0x7fdd50004a40 comp rx=0 tx=0).stop 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 shutdown_connections 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31f897250 0x55c31fd35c70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31f903520 0x55c31fcb90c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31f8e2840 0x55c31fcb8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 --2- 172.21.15.79:0/3469646544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31f8da660 0x55c31fcbe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 >> 172.21.15.79:0/3469646544 conn(0x55c31f8f7910 msgr2=0x55c31fcab1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd3b400640 0 client.25682 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 shutdown_connections 2024-09-21T02:38:39.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.677+0000 7fdd6385c740 1 -- 172.21.15.79:0/3469646544 wait complete. 2024-09-21T02:38:39.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.678+0000 7fdd6385c740 20 client.25682 trim_cache size 0 max 16384 2024-09-21T02:38:39.680 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:38:39.680 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:38:39.680 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:38:39.680 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 16, 2024-09-21T02:38:39.680 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "881ae21": { 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 16, 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 147.8, 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:38:39.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.679+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd3c0b6510 msgr2=0x7fdd3c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.679+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd3c0b6510 0x7fdd3c0b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdd50005fd0 tx=0x7fdd500096a0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.679+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd58075750 msgr2=0x7fdd5819c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.679+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd58075750 0x7fdd5819c6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e9f0 tx=0x7fdd4800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.680+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 shutdown_connections 2024-09-21T02:38:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.680+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdd3c0b6510 0x7fdd3c0b8a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.680+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd58110150 0x7fdd581a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.680+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd580760a0 0x7fdd5819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.680+0000 7fdd5cc00640 1 --2- 172.21.15.79:0/4242996506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd58075750 0x7fdd5819c6f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.680+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 >> 172.21.15.79:0/4242996506 conn(0x7fdd580ff600 msgr2=0x7fdd58109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:39.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.683+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 shutdown_connections 2024-09-21T02:38:39.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:38:39.684+0000 7fdd5cc00640 1 -- 172.21.15.79:0/4242996506 wait complete. 2024-09-21T02:38:39.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:39 smithi148 ceph-mon[34626]: pgmap v502: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 131 op/s 2024-09-21T02:38:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:39 smithi098 ceph-mon[34832]: pgmap v502: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 131 op/s 2024-09-21T02:38:40.886 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '881ae21', total seconds elapsed: 32.3 2024-09-21T02:38:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 165.0 s, 1049.4 tps, lat 537.458 ms stddev 3619.064 2024-09-21T02:38:41.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:41 smithi079 ceph-mon[30788]: pgmap v503: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 MiB/s wr, 91 op/s 2024-09-21T02:38:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:41 smithi148 ceph-mon[34626]: pgmap v503: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 MiB/s wr, 91 op/s 2024-09-21T02:38:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:41 smithi098 ceph-mon[34832]: pgmap v503: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 MiB/s wr, 91 op/s 2024-09-21T02:38:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.697+0000 7f2084e00640 1 -- 172.21.15.79:0/466903254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080106b20 msgr2=0x7f2080108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.697+0000 7f2084e00640 1 --2- 172.21.15.79:0/466903254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080106b20 0x7f2080108f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2070009900 tx=0x7f207002a400 comp rx=0 tx=0).stop 2024-09-21T02:38:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.710+0000 7f2084e00640 1 -- 172.21.15.79:0/466903254 shutdown_connections 2024-09-21T02:38:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.710+0000 7f2084e00640 1 --2- 172.21.15.79:0/466903254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080109480 0x7f208010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.710+0000 7f2084e00640 1 --2- 172.21.15.79:0/466903254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080106b20 0x7f2080108f40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.710+0000 7f2084e00640 1 --2- 172.21.15.79:0/466903254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2080101a90 0x7f2080101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.710+0000 7f2084e00640 1 -- 172.21.15.79:0/466903254 >> 172.21.15.79:0/466903254 conn(0x7f20800fd690 msgr2=0x7f20800ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.711+0000 7f2084e00640 1 -- 172.21.15.79:0/466903254 shutdown_connections 2024-09-21T02:38:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.711+0000 7f2084e00640 1 -- 172.21.15.79:0/466903254 wait complete. 2024-09-21T02:38:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.713+0000 7f2084e00640 1 Processor -- start 2024-09-21T02:38:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.716+0000 7f2084e00640 1 -- start start 2024-09-21T02:38:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.717+0000 7f2084e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080101a90 0x7f2080197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.717+0000 7f2084e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2080106b20 0x7f2080198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.717+0000 7f2084e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080109480 0x7f2080198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.718+0000 7f2084e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f208010f350 con 0x7f2080106b20 2024-09-21T02:38:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.718+0000 7f2084e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f208010f1d0 con 0x7f2080109480 2024-09-21T02:38:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.718+0000 7f2084e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f208010f4d0 con 0x7f2080101a90 2024-09-21T02:38:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.718+0000 7f207e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080109480 0x7f2080198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.718+0000 7f207e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080109480 0x7f2080198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53750/0 (socket says 172.21.15.79:53750) 2024-09-21T02:38:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.718+0000 7f207e800640 1 -- 172.21.15.79:0/2820915255 learned_addr learned my addr 172.21.15.79:0/2820915255 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.719+0000 7f207de00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080101a90 0x7f2080197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.720+0000 7f207d400640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2080106b20 0x7f2080198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.721+0000 7f207de00640 1 -- 172.21.15.79:0/2820915255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080109480 msgr2=0x7f2080198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.721+0000 7f207de00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080109480 0x7f2080198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.724+0000 7f207de00640 1 -- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2080106b20 msgr2=0x7f2080198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.724+0000 7f207de00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2080106b20 0x7f2080198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.724+0000 7f207de00640 1 -- 172.21.15.79:0/2820915255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20801997d0 con 0x7f2080101a90 2024-09-21T02:38:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.724+0000 7f207d400640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2080106b20 0x7f2080198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:43 smithi079 ceph-mon[30788]: pgmap v504: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 371 KiB/s wr, 42 op/s 2024-09-21T02:38:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.727+0000 7f207de00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080101a90 0x7f2080197e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207800dab0 tx=0x7f207800df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.727+0000 7f2076a00640 1 -- 172.21.15.79:0/2820915255 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207800be30 con 0x7f2080101a90 2024-09-21T02:38:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.727+0000 7f2076a00640 1 -- 172.21.15.79:0/2820915255 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2078003e20 con 0x7f2080101a90 2024-09-21T02:38:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.727+0000 7f2076a00640 1 -- 172.21.15.79:0/2820915255 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20780106a0 con 0x7f2080101a90 2024-09-21T02:38:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.730+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2080199ac0 con 0x7f2080101a90 2024-09-21T02:38:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.730+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20801a01b0 con 0x7f2080101a90 2024-09-21T02:38:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.739+0000 7f208c024740 1 Processor -- start 2024-09-21T02:38:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.741+0000 7f208c024740 1 -- start start 2024-09-21T02:38:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f208c024740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f208c024740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c630f2f0 0x5584c66df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f207e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f207e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66df0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53752/0 (socket says 172.21.15.79:53752) 2024-09-21T02:38:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f207e800640 1 -- 172.21.15.79:0/4041254063 learned_addr learned my addr 172.21.15.79:0/4041254063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f208c024740 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63174d0 0x5584c66e0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5584c66526b0 con 0x5584c63174d0 2024-09-21T02:38:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5584c6641ae0 con 0x5584c63381b0 2024-09-21T02:38:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5584c66458f0 con 0x5584c630f2f0 2024-09-21T02:38:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.742+0000 7f2076a00640 1 -- 172.21.15.79:0/2820915255 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2078004000 con 0x7f2080101a90 2024-09-21T02:38:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.743+0000 7f207e800640 1 -- 172.21.15.79:0/4041254063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c630f2f0 msgr2=0x5584c66df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.743+0000 7f207e800640 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c630f2f0 0x5584c66df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.743+0000 7f207e800640 1 -- 172.21.15.79:0/4041254063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63174d0 msgr2=0x5584c66e0290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.743+0000 7f207e800640 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63174d0 0x5584c66e0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.743+0000 7f207e800640 1 -- 172.21.15.79:0/4041254063 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c660e780 con 0x5584c63381b0 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.743+0000 7f207e800640 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66df0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f206c009c20 tx=0x7f206c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af11f4444b326a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.745+0000 7f2076a00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f20640b6650 0x7f20640b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.745+0000 7f2076a00640 1 -- 172.21.15.79:0/2820915255 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f20780e7500 con 0x7f2080101a90 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.746+0000 7f206b400640 1 -- 172.21.15.79:0/4041254063 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c005020 con 0x5584c63381b0 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.746+0000 7f206b400640 1 -- 172.21.15.79:0/4041254063 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f206c0047a0 con 0x5584c63381b0 2024-09-21T02:38:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.746+0000 7f206b400640 1 -- 172.21.15.79:0/4041254063 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c012740 con 0x5584c63381b0 2024-09-21T02:38:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.748+0000 7f207de00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f20640b6650 0x7f20640b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.749+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 msgr2=0x5584c66df0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.749+0000 7f208c024740 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66df0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f206c009c20 tx=0x7f206c0117b0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.749+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 shutdown_connections 2024-09-21T02:38:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.749+0000 7f208c024740 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63174d0 0x5584c66e0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.749+0000 7f208c024740 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c630f2f0 0x5584c66df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.749+0000 7f208c024740 1 --2- 172.21.15.79:0/4041254063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66df0d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.750+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 >> 172.21.15.79:0/4041254063 conn(0x5584c632c300 msgr2=0x5584c66dab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.750+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 shutdown_connections 2024-09-21T02:38:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.752+0000 7f207de00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f20640b6650 0x7f20640b8b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f207800b6f0 tx=0x7f20780a9120 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.752+0000 7f208c024740 1 -- 172.21.15.79:0/4041254063 wait complete. 2024-09-21T02:38:43.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.753+0000 7f208c024740 1 -- start start 2024-09-21T02:38:43.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.754+0000 7f208c024740 1 Processor -- start 2024-09-21T02:38:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.755+0000 7f208c024740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c630f2f0 0x5584c66e8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.755+0000 7f207e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c630f2f0 0x5584c66e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.756+0000 7f207e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c630f2f0 0x5584c66e8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53762/0 (socket says 172.21.15.79:53762) 2024-09-21T02:38:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.756+0000 7f207e800640 1 -- 172.21.15.79:0/3890102580 learned_addr learned my addr 172.21.15.79:0/3890102580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.756+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.757+0000 7f207d400640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.757+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63381b0 0x5584c66e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.757+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5584c6579ab0 con 0x5584c63381b0 2024-09-21T02:38:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.757+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5584c65e8570 con 0x5584c630f2f0 2024-09-21T02:38:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.757+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5584c66e0db0 con 0x5584c63174d0 2024-09-21T02:38:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.757+0000 7f207e800640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63381b0 0x5584c66e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.758+0000 7f208c024740 10 client.0 _ll_register_callbacks cb 0x5584c65f7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.760+0000 7f207e800640 1 -- 172.21.15.79:0/3890102580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 msgr2=0x5584c66e8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.760+0000 7f207e800640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66e8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.760+0000 7f207e800640 1 -- 172.21.15.79:0/3890102580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63381b0 msgr2=0x5584c66e9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.760+0000 7f207e800640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63381b0 0x5584c66e9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.760+0000 7f207e800640 1 -- 172.21.15.79:0/3890102580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c63a3790 con 0x5584c630f2f0 2024-09-21T02:38:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.761+0000 7f207d400640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:38:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.761+0000 7f207e800640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c630f2f0 0x5584c66e8810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f206c009a30 tx=0x7f206c009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec1ac052f029d550 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.761+0000 7f205fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:38:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.762+0000 7f205fe00640 1 -- 172.21.15.79:0/3890102580 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c004040 con 0x5584c630f2f0 2024-09-21T02:38:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.762+0000 7f205fe00640 1 -- 172.21.15.79:0/3890102580 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f206c0041e0 con 0x5584c630f2f0 2024-09-21T02:38:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.763+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f206c0047a0 con 0x5584c630f2f0 2024-09-21T02:38:43.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.765+0000 7f205fe00640 1 -- 172.21.15.79:0/3890102580 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f206c0043e0 con 0x5584c630f2f0 2024-09-21T02:38:43.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.766+0000 7f208c024740 10 client.25694 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:43.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.766+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584c641c620 con 0x5584c630f2f0 2024-09-21T02:38:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.767+0000 7f205fe00640 1 -- 172.21.15.79:0/3890102580 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f206c0047a0 con 0x5584c630f2f0 2024-09-21T02:38:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.767+0000 7f205fe00640 1 -- 172.21.15.79:0/3890102580 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f206c025070 con 0x5584c630f2f0 2024-09-21T02:38:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.767+0000 7f208c024740 10 client.25694 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.767+0000 7f208c024740 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.767+0000 7f208c024740 20 client.25694 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.767+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62f6d80 0x5584c66f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.768+0000 7f208c024740 4 client.25694 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.768+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584c6654600 con 0x5584c62f6d80 2024-09-21T02:38:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.768+0000 7f207d400640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62f6d80 0x5584c66f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.769+0000 7f207d400640 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62f6d80 0x5584c66f5c20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d69c5e578d7d786b server_cookie=25f7ae08b7aaa7b in_seq=0 out_seq=0 2024-09-21T02:38:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.769+0000 7f205fe00640 10 client.25694 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.770+0000 7f205fe00640 1 -- 172.21.15.79:0/3890102580 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584c6654600 con 0x5584c62f6d80 2024-09-21T02:38:43.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.770+0000 7f205fe00640 10 client.25694 handle_command_reply: tid=0 2024-09-21T02:38:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.771+0000 7f208c024740 1 client.25694 shutdown 2024-09-21T02:38:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.774+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c630f2f0 msgr2=0x5584c66e8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.774+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c630f2f0 0x5584c66e8810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f206c009a30 tx=0x7f206c009900 comp rx=0 tx=0).stop 2024-09-21T02:38:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.775+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 shutdown_connections 2024-09-21T02:38:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62f6d80 0x5584c66f5c20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c63381b0 0x5584c66e9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 1 --2- 172.21.15.79:0/3890102580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c630f2f0 0x5584c66e8810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f205fe00640 0 client.25694 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 >> 172.21.15.79:0/3890102580 conn(0x5584c632c300 msgr2=0x5584c66d90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 shutdown_connections 2024-09-21T02:38:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 1 -- 172.21.15.79:0/3890102580 wait complete. 2024-09-21T02:38:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.776+0000 7f208c024740 20 client.25694 trim_cache size 0 max 16384 2024-09-21T02:38:43.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:43 smithi148 ceph-mon[34626]: pgmap v504: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 371 KiB/s wr, 42 op/s 2024-09-21T02:38:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.814+0000 7f208c024740 1 Processor -- start 2024-09-21T02:38:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.814+0000 7f208c024740 1 -- start start 2024-09-21T02:38:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.815+0000 7f208c024740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66e3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f208c024740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66d90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f208c024740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66d9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f208c024740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20801b9760 con 0x5584c630f2f0 2024-09-21T02:38:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f208c024740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20801bbfe0 con 0x5584c63381b0 2024-09-21T02:38:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f208c024740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20801b9dd0 con 0x5584c63174d0 2024-09-21T02:38:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f207d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66d90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f207d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66d90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40830/0 (socket says 172.21.15.79:40830) 2024-09-21T02:38:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f207d400640 1 -- 172.21.15.79:0/141334614 learned_addr learned my addr 172.21.15.79:0/141334614 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.816+0000 7f207e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66d9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.817+0000 7f207e800640 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.818+0000 7f207e800640 1 -- 172.21.15.79:0/141334614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 msgr2=0x5584c66d90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.818+0000 7f207e800640 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66d90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.818+0000 7f207e800640 1 -- 172.21.15.79:0/141334614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 msgr2=0x5584c66e3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.818+0000 7f207e800640 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66e3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.818+0000 7f207e800640 1 -- 172.21.15.79:0/141334614 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c66e9330 con 0x5584c63381b0 2024-09-21T02:38:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.818+0000 7f207e800640 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66d9620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f206c004d00 tx=0x7f206c014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3b4a1d7c10ac3e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.819+0000 7f206aa00640 1 -- 172.21.15.79:0/141334614 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c034070 con 0x5584c63381b0 2024-09-21T02:38:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.819+0000 7f206aa00640 1 -- 172.21.15.79:0/141334614 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f206c035040 con 0x5584c63381b0 2024-09-21T02:38:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.819+0000 7f206aa00640 1 -- 172.21.15.79:0/141334614 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c00f920 con 0x5584c63381b0 2024-09-21T02:38:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.820+0000 7f208c024740 1 -- 172.21.15.79:0/141334614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 msgr2=0x5584c66d9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.820+0000 7f208c024740 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66d9620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f206c004d00 tx=0x7f206c014040 comp rx=0 tx=0).stop 2024-09-21T02:38:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.820+0000 7f208c024740 1 -- 172.21.15.79:0/141334614 shutdown_connections 2024-09-21T02:38:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.820+0000 7f208c024740 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63381b0 0x5584c66d9620 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.820+0000 7f208c024740 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63174d0 0x5584c66d90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.820+0000 7f208c024740 1 --2- 172.21.15.79:0/141334614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.820+0000 7f208c024740 1 -- 172.21.15.79:0/141334614 >> 172.21.15.79:0/141334614 conn(0x5584c632c300 msgr2=0x5584c66e3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.821+0000 7f208c024740 1 -- 172.21.15.79:0/141334614 shutdown_connections 2024-09-21T02:38:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.821+0000 7f208c024740 1 -- 172.21.15.79:0/141334614 wait complete. 2024-09-21T02:38:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.822+0000 7f208c024740 1 -- start start 2024-09-21T02:38:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.822+0000 7f208c024740 1 Processor -- start 2024-09-21T02:38:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.823+0000 7f208c024740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.823+0000 7f208c024740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63174d0 0x5584c66ee070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.823+0000 7f208c024740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63381b0 0x5584c66eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.823+0000 7f208c024740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20801ba4a0 con 0x5584c630f2f0 2024-09-21T02:38:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.823+0000 7f208c024740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20801bb910 con 0x5584c63174d0 2024-09-21T02:38:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.823+0000 7f208c024740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20801bab70 con 0x5584c63381b0 2024-09-21T02:38:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.823+0000 7f208c024740 10 client.0 _ll_register_callbacks cb 0x7f206c009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63174d0 0x5584c66ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66ed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38738/0 (socket says 172.21.15.79:38738) 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207e800640 1 -- 172.21.15.79:0/4279349589 learned_addr learned my addr 172.21.15.79:0/4279349589 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207e800640 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63381b0 0x5584c66eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207d400640 1 -- 172.21.15.79:0/4279349589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63381b0 msgr2=0x5584c66eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207d400640 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63381b0 0x5584c66eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207d400640 1 -- 172.21.15.79:0/4279349589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 msgr2=0x5584c66ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207d400640 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.824+0000 7f207d400640 1 -- 172.21.15.79:0/4279349589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c66ef2f0 con 0x5584c63174d0 2024-09-21T02:38:43.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.825+0000 7f207d400640 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63174d0 0x5584c66ee070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2070031500 tx=0x7f2070009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a316266bfa1313b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:43.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.825+0000 7f205fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:38:43.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.825+0000 7f205fe00640 1 -- 172.21.15.79:0/4279349589 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2070048070 con 0x5584c63174d0 2024-09-21T02:38:43.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.826+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f206c035040 con 0x5584c63174d0 2024-09-21T02:38:43.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.826+0000 7f205fe00640 1 -- 172.21.15.79:0/4279349589 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2070003c90 con 0x5584c63174d0 2024-09-21T02:38:43.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.827+0000 7f205fe00640 1 -- 172.21.15.79:0/4279349589 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2070035040 con 0x5584c63174d0 2024-09-21T02:38:43.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.827+0000 7f208c024740 10 client.25700 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:43.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.827+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584c66f06b0 con 0x5584c63174d0 2024-09-21T02:38:43.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f205fe00640 1 -- 172.21.15.79:0/4279349589 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f206c035040 con 0x5584c63174d0 2024-09-21T02:38:43.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f205fe00640 1 -- 172.21.15.79:0/4279349589 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f207003c440 con 0x5584c63174d0 2024-09-21T02:38:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f208c024740 10 client.25700 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f208c024740 10 client.25700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f208c024740 20 client.25700 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f208c024740 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62cc1c0 0x5584c6762790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f208c024740 4 client.25700 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:38:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.828+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584c66500b0 con 0x5584c62cc1c0 2024-09-21T02:38:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.829+0000 7f207e800640 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62cc1c0 0x5584c6762790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.829+0000 7f205fe00640 10 client.25700 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.829+0000 7f207e800640 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62cc1c0 0x5584c6762790 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e7f7a7a0c888509 server_cookie=a2205892eaaf4556 in_seq=0 out_seq=0 2024-09-21T02:38:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.849+0000 7f205fe00640 1 -- 172.21.15.79:0/4279349589 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584c66500b0 con 0x5584c62cc1c0 2024-09-21T02:38:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f205fe00640 10 client.25700 handle_command_reply: tid=0 2024-09-21T02:38:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 client.25700 shutdown 2024-09-21T02:38:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63174d0 msgr2=0x5584c66ee070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63174d0 0x5584c66ee070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2070031500 tx=0x7f2070009610 comp rx=0 tx=0).stop 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 shutdown_connections 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5584c62cc1c0 0x5584c6762790 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c63381b0 0x5584c66eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584c63174d0 0x5584c66ee070 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 --2- 172.21.15.79:0/4279349589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584c630f2f0 0x5584c66ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f205fe00640 0 client.25700 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.850+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 >> 172.21.15.79:0/4279349589 conn(0x5584c632c300 msgr2=0x5584c66e3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.851+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 shutdown_connections 2024-09-21T02:38:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.851+0000 7f208c024740 1 -- 172.21.15.79:0/4279349589 wait complete. 2024-09-21T02:38:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.851+0000 7f208c024740 20 client.25700 trim_cache size 0 max 16384 2024-09-21T02:38:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:38:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:38:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:38:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:38:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.852+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f20640b6650 msgr2=0x7f20640b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.852+0000 7f2084e00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f20640b6650 0x7f20640b8b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f207800b6f0 tx=0x7f20780a9120 comp rx=0 tx=0).stop 2024-09-21T02:38:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.852+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080101a90 msgr2=0x7f2080197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.852+0000 7f2084e00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080101a90 0x7f2080197e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207800dab0 tx=0x7f207800df70 comp rx=0 tx=0).stop 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 shutdown_connections 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f20640b6650 0x7f20640b8b60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2080109480 0x7f2080198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2080106b20 0x7f2080198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 --2- 172.21.15.79:0/2820915255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2080101a90 0x7f2080197e00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 >> 172.21.15.79:0/2820915255 conn(0x7f20800fd690 msgr2=0x7f20801032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 shutdown_connections 2024-09-21T02:38:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:43.853+0000 7f2084e00640 1 -- 172.21.15.79:0/2820915255 wait complete. 2024-09-21T02:38:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:43 smithi098 ceph-mon[34832]: pgmap v504: 129 pgs: 129 active+clean; 1017 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 371 KiB/s wr, 42 op/s 2024-09-21T02:38:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:45 smithi079 ceph-mon[30788]: pgmap v505: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 835 KiB/s wr, 99 op/s 2024-09-21T02:38:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:45 smithi148 ceph-mon[34626]: pgmap v505: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 835 KiB/s wr, 99 op/s 2024-09-21T02:38:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:45 smithi098 ceph-mon[34832]: pgmap v505: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 835 KiB/s wr, 99 op/s 2024-09-21T02:38:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 170.0 s, 2429.6 tps, lat 41.170 ms stddev 47.026 2024-09-21T02:38:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:47 smithi079 ceph-mon[30788]: pgmap v506: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-09-21T02:38:47.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:47 smithi148 ceph-mon[34626]: pgmap v506: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-09-21T02:38:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:47 smithi098 ceph-mon[34832]: pgmap v506: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-09-21T02:38:49.707 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:49 smithi098 ceph-mon[34832]: pgmap v507: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.5 MiB/s wr, 365 op/s 2024-09-21T02:38:49.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:49 smithi079 ceph-mon[30788]: pgmap v507: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.5 MiB/s wr, 365 op/s 2024-09-21T02:38:49.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:49 smithi148 ceph-mon[34626]: pgmap v507: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.5 MiB/s wr, 365 op/s 2024-09-21T02:38:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 175.0 s, 2787.2 tps, lat 35.788 ms stddev 46.449 2024-09-21T02:38:51.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:51 smithi079 ceph-mon[30788]: pgmap v508: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.9 MiB/s wr, 414 op/s 2024-09-21T02:38:51.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:51 smithi148 ceph-mon[34626]: pgmap v508: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.9 MiB/s wr, 414 op/s 2024-09-21T02:38:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:51 smithi098 ceph-mon[34832]: pgmap v508: 129 pgs: 129 active+clean; 1017 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.9 MiB/s wr, 414 op/s 2024-09-21T02:38:52.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:52 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:52.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:52 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:52.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:52 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:53 smithi148 ceph-mon[34626]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.9 MiB/s wr, 543 op/s 2024-09-21T02:38:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:53 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:53 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:53 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:38:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:53 smithi098 ceph-mon[34832]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.9 MiB/s wr, 543 op/s 2024-09-21T02:38:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:53 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:53 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:53 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:38:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:53 smithi079 ceph-mon[30788]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.9 MiB/s wr, 543 op/s 2024-09-21T02:38:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:53.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:53.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:38:55.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:55 smithi148 ceph-mon[34626]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.4 MiB/s wr, 707 op/s 2024-09-21T02:38:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:55 smithi098 ceph-mon[34832]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.4 MiB/s wr, 707 op/s 2024-09-21T02:38:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:55 smithi079 ceph-mon[30788]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.4 MiB/s wr, 707 op/s 2024-09-21T02:38:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 180.0 s, 1830.4 tps, lat 54.381 ms stddev 62.981 2024-09-21T02:38:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.164+0000 7f0260000640 1 -- 172.21.15.79:0/1293903140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0258103620 msgr2=0x7f0258103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.164+0000 7f0260000640 1 --2- 172.21.15.79:0/1293903140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0258103620 0x7f0258103a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f024400b880 tx=0x7f0244005f90 comp rx=0 tx=0).stop 2024-09-21T02:38:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.165+0000 7f0260000640 1 -- 172.21.15.79:0/1293903140 shutdown_connections 2024-09-21T02:38:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.165+0000 7f0260000640 1 --2- 172.21.15.79:0/1293903140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0258103fc0 0x7f025810a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.165+0000 7f0260000640 1 --2- 172.21.15.79:0/1293903140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0258103620 0x7f0258103a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.165+0000 7f0260000640 1 --2- 172.21.15.79:0/1293903140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02581025a0 0x7f0258102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.165+0000 7f0260000640 1 -- 172.21.15.79:0/1293903140 >> 172.21.15.79:0/1293903140 conn(0x7f02580fdee0 msgr2=0x7f0258100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.165+0000 7f0260000640 1 -- 172.21.15.79:0/1293903140 shutdown_connections 2024-09-21T02:38:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.165+0000 7f0260000640 1 -- 172.21.15.79:0/1293903140 wait complete. 2024-09-21T02:38:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.166+0000 7f0260000640 1 Processor -- start 2024-09-21T02:38:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.167+0000 7f0260000640 1 -- start start 2024-09-21T02:38:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.167+0000 7f0260000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02581025a0 0x7f02581a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.167+0000 7f0260000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258103620 0x7f02581a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.167+0000 7f0260000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0258103fc0 0x7f02581a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02581025a0 0x7f02581a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02581025a0 0x7f02581a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:40690/0 (socket says 172.21.15.79:40690) 2024-09-21T02:38:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258103620 0x7f02581a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0258103fc0 0x7f02581a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025cc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258103620 0x7f02581a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:36230/0 (socket says 172.21.15.79:36230) 2024-09-21T02:38:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f0260000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f025810d160 con 0x7f0258103fc0 2024-09-21T02:38:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f0260000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f025810cfe0 con 0x7f02581025a0 2024-09-21T02:38:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f0260000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f025810d2e0 con 0x7f0258103620 2024-09-21T02:38:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 -- 172.21.15.79:0/3819148308 learned_addr learned my addr 172.21.15.79:0/3819148308 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 -- 172.21.15.79:0/3819148308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258103620 msgr2=0x7f02581a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258103620 0x7f02581a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 -- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0258103fc0 msgr2=0x7f02581a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0258103fc0 0x7f02581a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025d600640 1 -- 172.21.15.79:0/3819148308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02581a1f70 con 0x7f02581025a0 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.168+0000 7f025e000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0258103fc0 0x7f02581a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.169+0000 7f025d600640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02581025a0 0x7f02581a0530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f024c009ad0 tx=0x7f024c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.169+0000 7f0256000640 1 -- 172.21.15.79:0/3819148308 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c00cde0 con 0x7f02581025a0 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.169+0000 7f0256000640 1 -- 172.21.15.79:0/3819148308 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f024c0035f0 con 0x7f02581025a0 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.169+0000 7f0256000640 1 -- 172.21.15.79:0/3819148308 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c017660 con 0x7f02581025a0 2024-09-21T02:38:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.170+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02581a2260 con 0x7f02581025a0 2024-09-21T02:38:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.170+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02581a8950 con 0x7f02581025a0 2024-09-21T02:38:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.174+0000 7f0266fdb740 1 Processor -- start 2024-09-21T02:38:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.174+0000 7f0266fdb740 1 -- start start 2024-09-21T02:38:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf382f0 0x5561ae308740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae309290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f0266fdb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5561ae27b6b0 con 0x5561adf611b0 2024-09-21T02:38:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f0266fdb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561ae26aae0 con 0x5561adf404d0 2024-09-21T02:38:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f0266fdb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5561ae26e8f0 con 0x5561adf382f0 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f025cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae309290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f025cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae309290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:40692/0 (socket says 172.21.15.79:40692) 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f025cc00640 1 -- 172.21.15.79:0/1152101296 learned_addr learned my addr 172.21.15.79:0/1152101296 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f0256000640 1 -- 172.21.15.79:0/3819148308 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f024c003aa0 con 0x7f02581025a0 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.175+0000 7f025d600640 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf382f0 0x5561ae308740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025e000640 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025d600640 1 -- 172.21.15.79:0/1152101296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 msgr2=0x5561ae309290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025d600640 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae309290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025d600640 1 -- 172.21.15.79:0/1152101296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 msgr2=0x5561ae3080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025d600640 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025d600640 1 -- 172.21.15.79:0/1152101296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ae237780 con 0x5561adf382f0 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025cc00640 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae309290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.176+0000 7f025d600640 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf382f0 0x5561ae308740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f024c0e4bd0 tx=0x7f024c0efa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5e6bfe8e907d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.177+0000 7f024a600640 1 -- 172.21.15.79:0/1152101296 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c0fb070 con 0x5561adf382f0 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.177+0000 7f024a600640 1 -- 172.21.15.79:0/1152101296 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f024c0e7d80 con 0x5561adf382f0 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.177+0000 7f024a600640 1 -- 172.21.15.79:0/1152101296 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c0f4a10 con 0x5561adf382f0 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.178+0000 7f0256000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f02400b6610 0x7f02400b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.178+0000 7f0256000640 1 -- 172.21.15.79:0/3819148308 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f024c0e7540 con 0x7f02581025a0 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.179+0000 7f025e000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f02400b6610 0x7f02400b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.180+0000 7f0266fdb740 1 -- 172.21.15.79:0/1152101296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf382f0 msgr2=0x5561ae308740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.180+0000 7f0266fdb740 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf382f0 0x5561ae308740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f024c0e4bd0 tx=0x7f024c0efa30 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.181+0000 7f0266fdb740 1 -- 172.21.15.79:0/1152101296 shutdown_connections 2024-09-21T02:38:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.181+0000 7f0266fdb740 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae309290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.181+0000 7f0266fdb740 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf382f0 0x5561ae308740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.181+0000 7f0266fdb740 1 --2- 172.21.15.79:0/1152101296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.181+0000 7f0266fdb740 1 -- 172.21.15.79:0/1152101296 >> 172.21.15.79:0/1152101296 conn(0x5561adf55300 msgr2=0x5561ae303b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.182+0000 7f0266fdb740 1 -- 172.21.15.79:0/1152101296 shutdown_connections 2024-09-21T02:38:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.182+0000 7f025e000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f02400b6610 0x7f02400b8b20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f02500056e0 tx=0x7f0250004cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.182+0000 7f0266fdb740 1 -- 172.21.15.79:0/1152101296 wait complete. 2024-09-21T02:38:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.183+0000 7f0266fdb740 1 -- start start 2024-09-21T02:38:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.183+0000 7f0266fdb740 1 Processor -- start 2024-09-21T02:38:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf404d0 0x5561ae311eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f0266fdb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5561ae1a2ab0 con 0x5561adf611b0 2024-09-21T02:38:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f0266fdb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561ae211570 con 0x5561adf382f0 2024-09-21T02:38:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f0266fdb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5561ae309db0 con 0x5561adf404d0 2024-09-21T02:38:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f0266fdb740 10 client.0 _ll_register_callbacks cb 0x5561ae220100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f025d600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f025d600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3117f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:40700/0 (socket says 172.21.15.79:40700) 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f025d600640 1 -- 172.21.15.79:0/879055528 learned_addr learned my addr 172.21.15.79:0/879055528 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f025e000640 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f025d600640 1 -- 172.21.15.79:0/879055528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf404d0 msgr2=0x5561ae311eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.185+0000 7f025d600640 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf404d0 0x5561ae311eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f025d600640 1 -- 172.21.15.79:0/879055528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 msgr2=0x5561ae3129b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f025d600640 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3129b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f025d600640 1 -- 172.21.15.79:0/879055528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561adfcc790 con 0x5561adf382f0 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f025e000640 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f025d600640 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3117f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f024c003db0 tx=0x7f024c00c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68ee7c41de8764f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f023ea00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f023ea00640 1 -- 172.21.15.79:0/879055528 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c0a9910 con 0x5561adf382f0 2024-09-21T02:38:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f024c0e7d80 con 0x5561adf382f0 2024-09-21T02:38:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f023ea00640 1 -- 172.21.15.79:0/879055528 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f024c0037a0 con 0x5561adf382f0 2024-09-21T02:38:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f023ea00640 1 -- 172.21.15.79:0/879055528 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f024c0aca30 con 0x5561adf382f0 2024-09-21T02:38:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.186+0000 7f0266fdb740 10 client.25712 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.187+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5561ae045620 con 0x5561adf382f0 2024-09-21T02:38:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.187+0000 7f023ea00640 1 -- 172.21.15.79:0/879055528 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f024c0e7d80 con 0x5561adf382f0 2024-09-21T02:38:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.187+0000 7f023ea00640 1 -- 172.21.15.79:0/879055528 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f024c0a9530 con 0x5561adf382f0 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.188+0000 7f0266fdb740 10 client.25712 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.188+0000 7f0266fdb740 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.188+0000 7f0266fdb740 20 client.25712 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.188+0000 7f0266fdb740 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adf1fd80 0x5561ae31ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.188+0000 7f0266fdb740 4 client.25712 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.188+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561ae27d600 con 0x5561adf1fd80 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.188+0000 7f025cc00640 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adf1fd80 0x5561ae31ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.189+0000 7f025cc00640 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adf1fd80 0x5561ae31ea90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b1896f92a5f1722 server_cookie=b8ef39c8dfbb59fd in_seq=0 out_seq=0 2024-09-21T02:38:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.189+0000 7f023ea00640 10 client.25712 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f023ea00640 1 -- 172.21.15.79:0/879055528 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561ae27d600 con 0x5561adf1fd80 2024-09-21T02:38:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f023ea00640 10 client.25712 handle_command_reply: tid=0 2024-09-21T02:38:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 client.25712 shutdown 2024-09-21T02:38:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 msgr2=0x5561ae3117f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3117f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f024c003db0 tx=0x7f024c00c770 comp rx=0 tx=0).stop 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 shutdown_connections 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adf1fd80 0x5561ae31ea90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf611b0 0x5561ae3129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf404d0 0x5561ae311eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 --2- 172.21.15.79:0/879055528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3117f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 >> 172.21.15.79:0/879055528 conn(0x5561adf55300 msgr2=0x5561ae3020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.190+0000 7f023ea00640 0 client.25712 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.191+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 shutdown_connections 2024-09-21T02:38:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.191+0000 7f0266fdb740 1 -- 172.21.15.79:0/879055528 wait complete. 2024-09-21T02:38:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.191+0000 7f0266fdb740 20 client.25712 trim_cache size 0 max 16384 2024-09-21T02:38:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.216+0000 7f0266fdb740 1 Processor -- start 2024-09-21T02:38:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.217+0000 7f0266fdb740 1 -- start start 2024-09-21T02:38:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf382f0 0x5561ae308f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae310240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae310780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f0266fdb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0258074ff0 con 0x5561adf382f0 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f0266fdb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f02581bbdc0 con 0x5561adf404d0 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f0266fdb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f02581b9bb0 con 0x5561adf611b0 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f025cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae310240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f025cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae310240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:40704/0 (socket says 172.21.15.79:40704) 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.218+0000 7f025cc00640 1 -- 172.21.15.79:0/322351286 learned_addr learned my addr 172.21.15.79:0/322351286 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.219+0000 7f025e000640 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae310780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.219+0000 7f025cc00640 1 -- 172.21.15.79:0/322351286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 msgr2=0x5561ae310780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.219+0000 7f025cc00640 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae310780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.219+0000 7f025cc00640 1 -- 172.21.15.79:0/322351286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf382f0 msgr2=0x5561ae308f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.219+0000 7f025cc00640 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf382f0 0x5561ae308f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.219+0000 7f025cc00640 1 -- 172.21.15.79:0/322351286 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ae309c90 con 0x5561adf404d0 2024-09-21T02:38:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.220+0000 7f025cc00640 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae310240 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f024400b880 tx=0x7f0244000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab1730f652e8aca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.220+0000 7f0249c00640 1 -- 172.21.15.79:0/322351286 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244032e40 con 0x5561adf404d0 2024-09-21T02:38:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.220+0000 7f0249c00640 1 -- 172.21.15.79:0/322351286 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0244004040 con 0x5561adf404d0 2024-09-21T02:38:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.220+0000 7f0249c00640 1 -- 172.21.15.79:0/322351286 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024400ad10 con 0x5561adf404d0 2024-09-21T02:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 -- 172.21.15.79:0/322351286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 msgr2=0x5561ae310240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae310240 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f024400b880 tx=0x7f0244000bc0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 -- 172.21.15.79:0/322351286 shutdown_connections 2024-09-21T02:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae310780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf404d0 0x5561ae310240 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 --2- 172.21.15.79:0/322351286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf382f0 0x5561ae308f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 -- 172.21.15.79:0/322351286 >> 172.21.15.79:0/322351286 conn(0x5561adf55300 msgr2=0x5561ae303300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 -- 172.21.15.79:0/322351286 shutdown_connections 2024-09-21T02:38:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.222+0000 7f0266fdb740 1 -- 172.21.15.79:0/322351286 wait complete. 2024-09-21T02:38:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.223+0000 7f0266fdb740 1 -- start start 2024-09-21T02:38:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.223+0000 7f0266fdb740 1 Processor -- start 2024-09-21T02:38:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf404d0 0x5561ae318170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f0266fdb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae3186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f0266fdb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02581ba280 con 0x5561adf404d0 2024-09-21T02:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f0266fdb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f02581bb6f0 con 0x5561adf382f0 2024-09-21T02:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f0266fdb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f02581ba950 con 0x5561adf611b0 2024-09-21T02:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f0266fdb740 10 client.0 _ll_register_callbacks cb 0x7f024c0f9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f025cc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf404d0 0x5561ae318170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f025cc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf404d0 0x5561ae318170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44210/0 (socket says 172.21.15.79:44210) 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f025cc00640 1 -- 172.21.15.79:0/3735631117 learned_addr learned my addr 172.21.15.79:0/3735631117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.224+0000 7f025d600640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.225+0000 7f025cc00640 1 -- 172.21.15.79:0/3735631117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 msgr2=0x5561ae3186b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.225+0000 7f025e000640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae3186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.225+0000 7f025cc00640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae3186b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.225+0000 7f025cc00640 1 -- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 msgr2=0x5561ae3194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.225+0000 7f025cc00640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.225+0000 7f025cc00640 1 -- 172.21.15.79:0/3735631117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ae318da0 con 0x5561adf404d0 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.226+0000 7f025e000640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae3186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.226+0000 7f025cc00640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf404d0 0x5561ae318170 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0244034040 tx=0x7f0244005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfa99b3b319a383 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.226+0000 7f023ea00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.226+0000 7f023ea00640 1 -- 172.21.15.79:0/3735631117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244052070 con 0x5561adf404d0 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.226+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0244004040 con 0x5561adf404d0 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.227+0000 7f023ea00640 1 -- 172.21.15.79:0/3735631117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f02440041f0 con 0x5561adf404d0 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.227+0000 7f023ea00640 1 -- 172.21.15.79:0/3735631117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f024405e050 con 0x5561adf404d0 2024-09-21T02:38:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.227+0000 7f0266fdb740 10 client.15642 fetch_fsmap learned FSMap version 21 2024-09-21T02:38:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.227+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5561ae3893b0 con 0x5561adf404d0 2024-09-21T02:38:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.228+0000 7f023ea00640 1 -- 172.21.15.79:0/3735631117 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0244004040 con 0x5561adf404d0 2024-09-21T02:38:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f023ea00640 1 -- 172.21.15.79:0/3735631117 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f024400a3f0 con 0x5561adf404d0 2024-09-21T02:38:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f0266fdb740 10 client.15642 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:38:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f0266fdb740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:38:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f0266fdb740 20 client.15642 populate_metadata read hostname 'smithi079' 2024-09-21T02:38:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f0266fdb740 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adef51c0 0x5561ae38bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f0266fdb740 4 client.15642 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:38:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561ae2790b0 con 0x5561adef51c0 2024-09-21T02:38:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.229+0000 7f025d600640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adef51c0 0x5561ae38bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.230+0000 7f025d600640 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adef51c0 0x5561ae38bb90 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e64bec656bf9d1 server_cookie=3ae585ddf9da0be2 in_seq=0 out_seq=0 2024-09-21T02:38:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.230+0000 7f023ea00640 10 client.15642 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.313+0000 7f023ea00640 1 -- 172.21.15.79:0/3735631117 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561ae2790b0 con 0x5561adef51c0 2024-09-21T02:38:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.313+0000 7f023ea00640 10 client.15642 handle_command_reply: tid=0 2024-09-21T02:38:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 client.15642 shutdown 2024-09-21T02:38:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf404d0 msgr2=0x5561ae318170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf404d0 0x5561ae318170 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0244034040 tx=0x7f0244005fa0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 shutdown_connections 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5561adef51c0 0x5561ae38bb90 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5561adf611b0 0x5561ae3186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561adf404d0 0x5561ae318170 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f023ea00640 0 client.15642 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 --2- 172.21.15.79:0/3735631117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561adf382f0 0x5561ae3194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.314+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 >> 172.21.15.79:0/3735631117 conn(0x5561adf55300 msgr2=0x5561ae30c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.315+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 shutdown_connections 2024-09-21T02:38:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.315+0000 7f0266fdb740 1 -- 172.21.15.79:0/3735631117 wait complete. 2024-09-21T02:38:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.315+0000 7f0266fdb740 20 client.15642 trim_cache size 0 max 16384 2024-09-21T02:38:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:38:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:38:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:38:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f02400b6610 msgr2=0x7f02400b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f02400b6610 0x7f02400b8b20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f02500056e0 tx=0x7f0250004cc0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02581025a0 msgr2=0x7f02581a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02581025a0 0x7f02581a0530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f024c009ad0 tx=0x7f024c009f90 comp rx=0 tx=0).stop 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 shutdown_connections 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f02400b6610 0x7f02400b8b20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0258103fc0 0x7f02581a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258103620 0x7f02581a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 --2- 172.21.15.79:0/3819148308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02581025a0 0x7f02581a0530 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.317+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 >> 172.21.15.79:0/3819148308 conn(0x7f02580fdee0 msgr2=0x7f0258106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.318+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 shutdown_connections 2024-09-21T02:38:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:38:57.318+0000 7f0260000640 1 -- 172.21.15.79:0/3819148308 wait complete. 2024-09-21T02:38:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:57 smithi148 ceph-mon[34626]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.3 MiB/s wr, 786 op/s 2024-09-21T02:38:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:57 smithi098 ceph-mon[34832]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.3 MiB/s wr, 786 op/s 2024-09-21T02:38:57.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:57 smithi079 ceph-mon[30788]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.3 MiB/s wr, 786 op/s 2024-09-21T02:38:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:38:59 smithi148 ceph-mon[34626]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.8 MiB/s wr, 654 op/s 2024-09-21T02:38:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:38:59 smithi098 ceph-mon[34832]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.8 MiB/s wr, 654 op/s 2024-09-21T02:38:59.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:38:59 smithi079 ceph-mon[30788]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.8 MiB/s wr, 654 op/s 2024-09-21T02:39:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 185.0 s, 2023.0 tps, lat 49.378 ms stddev 59.427 2024-09-21T02:39:01.780 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:01 smithi079 ceph-mon[30788]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.3 MiB/s wr, 619 op/s 2024-09-21T02:39:01.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:01 smithi148 ceph-mon[34626]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.3 MiB/s wr, 619 op/s 2024-09-21T02:39:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:01 smithi098 ceph-mon[34832]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.3 MiB/s wr, 619 op/s 2024-09-21T02:39:03.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:03 smithi148 ceph-mon[34626]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.6 MiB/s wr, 737 op/s 2024-09-21T02:39:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:03 smithi098 ceph-mon[34832]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.6 MiB/s wr, 737 op/s 2024-09-21T02:39:03.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:03 smithi079 ceph-mon[30788]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.6 MiB/s wr, 737 op/s 2024-09-21T02:39:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:05 smithi148 ceph-mon[34626]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.4 MiB/s wr, 714 op/s 2024-09-21T02:39:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:05 smithi098 ceph-mon[34832]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.4 MiB/s wr, 714 op/s 2024-09-21T02:39:05.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:05 smithi079 ceph-mon[30788]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.4 MiB/s wr, 714 op/s 2024-09-21T02:39:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 190.0 s, 1283.0 tps, lat 77.588 ms stddev 94.960 2024-09-21T02:39:06.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:06 smithi098 ceph-mon[34832]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.6 MiB/s wr, 634 op/s 2024-09-21T02:39:06.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:06 smithi079 ceph-mon[30788]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.6 MiB/s wr, 634 op/s 2024-09-21T02:39:07.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:06 smithi148 ceph-mon[34626]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.6 MiB/s wr, 634 op/s 2024-09-21T02:39:08.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:08 smithi098 ceph-mon[34832]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.7 MiB/s wr, 542 op/s 2024-09-21T02:39:08.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:08 smithi079 ceph-mon[30788]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.7 MiB/s wr, 542 op/s 2024-09-21T02:39:09.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:08 smithi148 ceph-mon[34626]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.7 MiB/s wr, 542 op/s 2024-09-21T02:39:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.636+0000 7f8eff200640 1 -- 172.21.15.79:0/151006225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104f10 msgr2=0x7f8f0010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.636+0000 7f8eff200640 1 --2- 172.21.15.79:0/151006225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104f10 0x7f8f0010b8b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009ca0 tx=0x7f8ef802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.637+0000 7f8eff200640 1 -- 172.21.15.79:0/151006225 shutdown_connections 2024-09-21T02:39:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.637+0000 7f8eff200640 1 --2- 172.21.15.79:0/151006225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104f10 0x7f8f0010b8b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.637+0000 7f8eff200640 1 --2- 172.21.15.79:0/151006225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f00104570 0x7f8f00104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.638+0000 7f8eff200640 1 --2- 172.21.15.79:0/151006225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f001034f0 0x7f8f00103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.638+0000 7f8eff200640 1 -- 172.21.15.79:0/151006225 >> 172.21.15.79:0/151006225 conn(0x7f8f000fee30 msgr2=0x7f8f001012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.638+0000 7f8eff200640 1 -- 172.21.15.79:0/151006225 shutdown_connections 2024-09-21T02:39:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.638+0000 7f8eff200640 1 -- 172.21.15.79:0/151006225 wait complete. 2024-09-21T02:39:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.641+0000 7f8eff200640 1 Processor -- start 2024-09-21T02:39:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.641+0000 7f8eff200640 1 -- start start 2024-09-21T02:39:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.641+0000 7f8eff200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f001034f0 0x7f8f0019bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8eff200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104570 0x7f8f0019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8eff200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f00104f10 0x7f8f0019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8eff200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00076d20 con 0x7f8f001034f0 2024-09-21T02:39:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8eff200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00076ba0 con 0x7f8f00104570 2024-09-21T02:39:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8eff200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00076ea0 con 0x7f8f00104f10 2024-09-21T02:39:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104570 0x7f8f0019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104570 0x7f8f0019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:49346/0 (socket says 172.21.15.79:49346) 2024-09-21T02:39:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 -- 172.21.15.79:0/1682274357 learned_addr learned my addr 172.21.15.79:0/1682274357 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efe800640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f00104f10 0x7f8f0019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 -- 172.21.15.79:0/1682274357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f00104f10 msgr2=0x7f8f0019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f00104f10 0x7f8f0019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 -- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f001034f0 msgr2=0x7f8f0019bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f001034f0 0x7f8f0019bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.642+0000 7f8efd400640 1 -- 172.21.15.79:0/1682274357 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0019d9c0 con 0x7f8f00104570 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.643+0000 7f8efd400640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104570 0x7f8f0019c5f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00e9f0 tx=0x7f8eec00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.643+0000 7f8ef6a00640 1 -- 172.21.15.79:0/1682274357 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00cd80 con 0x7f8f00104570 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.643+0000 7f8ef6a00640 1 -- 172.21.15.79:0/1682274357 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eec0054d0 con 0x7f8f00104570 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.643+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0019dcb0 con 0x7f8f00104570 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.643+0000 7f8ef6a00640 1 -- 172.21.15.79:0/1682274357 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec010690 con 0x7f8f00104570 2024-09-21T02:39:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.643+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f001a43a0 con 0x7f8f00104570 2024-09-21T02:39:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.649+0000 7f8f0bfca740 1 Processor -- start 2024-09-21T02:39:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.650+0000 7f8f0bfca740 1 -- start start 2024-09-21T02:39:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.650+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.650+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.650+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f84d0 0x5606a97c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.650+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5606a97336b0 con 0x5606a93f84d0 2024-09-21T02:39:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.650+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5606a9722ae0 con 0x5606a93f02f0 2024-09-21T02:39:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.650+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5606a97268f0 con 0x5606a94191b0 2024-09-21T02:39:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41712/0 (socket says 172.21.15.79:41712) 2024-09-21T02:39:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 -- 172.21.15.79:0/3386685398 learned_addr learned my addr 172.21.15.79:0/3386685398 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 -- 172.21.15.79:0/3386685398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 msgr2=0x5606a97c9130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:39:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 --2- 172.21.15.79:0/3386685398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97c9130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 -- 172.21.15.79:0/3386685398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f84d0 msgr2=0x5606a97c9c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:39:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 --2- 172.21.15.79:0/3386685398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f84d0 0x5606a97c9c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.651+0000 7f8efe800640 1 -- 172.21.15.79:0/3386685398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a96ef780 con 0x5606a94191b0 2024-09-21T02:39:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.652+0000 7f8efe800640 1 --2- 172.21.15.79:0/3386685398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97c8ac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009800 tx=0x7f8ef8009830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3fa14c83f02bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.652+0000 7f8eeb400640 1 -- 172.21.15.79:0/3386685398 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8031650 con 0x5606a94191b0 2024-09-21T02:39:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.652+0000 7f8eeb400640 1 -- 172.21.15.79:0/3386685398 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef8036040 con 0x5606a94191b0 2024-09-21T02:39:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.652+0000 7f8eeb400640 1 -- 172.21.15.79:0/3386685398 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8004760 con 0x5606a94191b0 2024-09-21T02:39:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.653+0000 7f8ef6a00640 1 -- 172.21.15.79:0/1682274357 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8eec010830 con 0x7f8f00104570 2024-09-21T02:39:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.654+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3386685398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 msgr2=0x5606a97c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.654+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3386685398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97c8ac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009800 tx=0x7f8ef8009830 comp rx=0 tx=0).stop 2024-09-21T02:39:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.654+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3386685398 shutdown_connections 2024-09-21T02:39:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.654+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3386685398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f84d0 0x5606a97c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.654+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3386685398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.654+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3386685398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97c8ac0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.654+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3386685398 >> 172.21.15.79:0/3386685398 conn(0x5606a940d300 msgr2=0x5606a97c4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.655+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3386685398 shutdown_connections 2024-09-21T02:39:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.655+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3386685398 wait complete. 2024-09-21T02:39:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.656+0000 7f8f0bfca740 1 -- start start 2024-09-21T02:39:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.656+0000 7f8f0bfca740 1 Processor -- start 2024-09-21T02:39:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97d2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8efe800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 0x5606a97d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5606a965aab0 con 0x5606a94191b0 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5606a96c9570 con 0x5606a93f02f0 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5606a97ca740 con 0x5606a93f84d0 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.658+0000 7f8f0bfca740 10 client.0 _ll_register_callbacks cb 0x5606a96d8100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8ef6a00640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ee40b64e0 0x7f8ee40b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8efe800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:49364/0 (socket says 172.21.15.79:49364) 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8efe800640 1 -- 172.21.15.79:0/1708049244 learned_addr learned my addr 172.21.15.79:0/1708049244 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8ef6a00640 1 -- 172.21.15.79:0/1682274357 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8eec0e7b40 con 0x7f8f00104570 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8efe800640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ee40b64e0 0x7f8ee40b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8efe800640 1 -- 172.21.15.79:0/1708049244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 msgr2=0x5606a97d2840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8efe800640 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97d2840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.659+0000 7f8efe800640 1 -- 172.21.15.79:0/1708049244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 msgr2=0x5606a97d33b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:39:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.660+0000 7f8efe800640 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 0x5606a97d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.660+0000 7f8efe800640 1 -- 172.21.15.79:0/1708049244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a9484790 con 0x5606a93f02f0 2024-09-21T02:39:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.662+0000 7f8efe800640 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d2180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8031760 tx=0x7f8ef8031790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759b633982b2dc00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.662+0000 7f8edfe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:39:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.662+0000 7f8edfe00640 1 -- 172.21.15.79:0/1708049244 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8057040 con 0x5606a93f02f0 2024-09-21T02:39:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.662+0000 7f8edfe00640 1 -- 172.21.15.79:0/1708049244 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8ef8004b40 con 0x5606a93f02f0 2024-09-21T02:39:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.663+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef8036040 con 0x5606a93f02f0 2024-09-21T02:39:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.663+0000 7f8efe800640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ee40b64e0 0x7f8ee40b89f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ef805b000 tx=0x7f8ef8059000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.665+0000 7f8edfe00640 1 -- 172.21.15.79:0/1708049244 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8ef8004d40 con 0x5606a93f02f0 2024-09-21T02:39:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.665+0000 7f8f0bfca740 10 client.25727 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.665+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5606a94fd620 con 0x5606a93f02f0 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.665+0000 7f8edfe00640 1 -- 172.21.15.79:0/1708049244 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef8036040 con 0x5606a93f02f0 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.665+0000 7f8edfe00640 1 -- 172.21.15.79:0/1708049244 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8ef8030930 con 0x5606a93f02f0 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.666+0000 7f8f0bfca740 10 client.25727 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.666+0000 7f8f0bfca740 10 client.25727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.666+0000 7f8f0bfca740 20 client.25727 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.666+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93d7d80 0x5606a97df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.666+0000 7f8f0bfca740 4 client.25727 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.666+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606a9735600 con 0x5606a93d7d80 2024-09-21T02:39:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.666+0000 7f8efde00640 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93d7d80 0x5606a97df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.667+0000 7f8efde00640 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93d7d80 0x5606a97df5f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a249391061699da server_cookie=6169f61961919a64 in_seq=0 out_seq=0 2024-09-21T02:39:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.667+0000 7f8edfe00640 10 client.25727 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.668+0000 7f8edfe00640 1 -- 172.21.15.79:0/1708049244 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606a9735600 con 0x5606a93d7d80 2024-09-21T02:39:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.668+0000 7f8edfe00640 10 client.25727 handle_command_reply: tid=0 2024-09-21T02:39:10.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.668+0000 7f8f0bfca740 1 client.25727 shutdown 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 msgr2=0x5606a97d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d2180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8031760 tx=0x7f8ef8031790 comp rx=0 tx=0).stop 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 shutdown_connections 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93d7d80 0x5606a97df5f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 0x5606a97d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/1708049244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d2180 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 >> 172.21.15.79:0/1708049244 conn(0x5606a940d300 msgr2=0x5606a97ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8edfe00640 0 client.25727 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 shutdown_connections 2024-09-21T02:39:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.670+0000 7f8f0bfca740 1 -- 172.21.15.79:0/1708049244 wait complete. 2024-09-21T02:39:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.671+0000 7f8f0bfca740 20 client.25727 trim_cache size 0 max 16384 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 Processor -- start 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 -- start start 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 0x5606a97cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001a8390 con 0x5606a94191b0 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001aac10 con 0x5606a93f02f0 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.699+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001a8a00 con 0x5606a93f84d0 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41728/0 (socket says 172.21.15.79:41728) 2024-09-21T02:39:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 -- 172.21.15.79:0/3825848860 learned_addr learned my addr 172.21.15.79:0/3825848860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efde00640 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 -- 172.21.15.79:0/3825848860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 msgr2=0x5606a97d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 -- 172.21.15.79:0/3825848860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 msgr2=0x5606a97cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efe800640 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 0x5606a97cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 0x5606a97cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efd400640 1 -- 172.21.15.79:0/3825848860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a97c9700 con 0x5606a93f84d0 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.700+0000 7f8efde00640 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.701+0000 7f8efd400640 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97cf220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ad5c0 tx=0x7f8eec005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ddd286e4d9fa252 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.701+0000 7f8eeaa00640 1 -- 172.21.15.79:0/3825848860 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0b2070 con 0x5606a93f84d0 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.701+0000 7f8eeaa00640 1 -- 172.21.15.79:0/3825848860 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eec0ad3d0 con 0x5606a93f84d0 2024-09-21T02:39:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.701+0000 7f8eeaa00640 1 -- 172.21.15.79:0/3825848860 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0b72e0 con 0x5606a93f84d0 2024-09-21T02:39:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.702+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3825848860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 msgr2=0x5606a97cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.702+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97cf220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ad5c0 tx=0x7f8eec005780 comp rx=0 tx=0).stop 2024-09-21T02:39:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.702+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3825848860 shutdown_connections 2024-09-21T02:39:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.702+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a94191b0 0x5606a97cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.702+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a93f84d0 0x5606a97cf220 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.702+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3825848860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f02f0 0x5606a97d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.702+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3825848860 >> 172.21.15.79:0/3825848860 conn(0x5606a940d300 msgr2=0x5606a97b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.703+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3825848860 shutdown_connections 2024-09-21T02:39:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.703+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3825848860 wait complete. 2024-09-21T02:39:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.703+0000 7f8f0bfca740 1 -- start start 2024-09-21T02:39:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.704+0000 7f8f0bfca740 1 Processor -- start 2024-09-21T02:39:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f02f0 0x5606a97d5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f84d0 0x5606a97d5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8f0bfca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001a90d0 con 0x5606a93f02f0 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001aa540 con 0x5606a93f84d0 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8f0bfca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001a97a0 con 0x5606a94191b0 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8efd400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f84d0 0x5606a97d5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8f0bfca740 10 client.0 _ll_register_callbacks cb 0x7f8ef8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8efd400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f84d0 0x5606a97d5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:49390/0 (socket says 172.21.15.79:49390) 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.705+0000 7f8efd400640 1 -- 172.21.15.79:0/3188923017 learned_addr learned my addr 172.21.15.79:0/3188923017 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.706+0000 7f8efe800640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.706+0000 7f8efde00640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f02f0 0x5606a97d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.706+0000 7f8efe800640 1 -- 172.21.15.79:0/3188923017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f84d0 msgr2=0x5606a97d5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.706+0000 7f8efe800640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f84d0 0x5606a97d5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.706+0000 7f8efe800640 1 -- 172.21.15.79:0/3188923017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f02f0 msgr2=0x5606a97d5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.708+0000 7f8efe800640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f02f0 0x5606a97d5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.708+0000 7f8efe800640 1 -- 172.21.15.79:0/3188923017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a97da220 con 0x5606a94191b0 2024-09-21T02:39:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.708+0000 7f8efde00640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f02f0 0x5606a97d5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.708+0000 7f8efe800640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97d9ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8030df0 tx=0x7f8ef8004cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232c6961e4c4020f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.708+0000 7f8edfe00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:39:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.709+0000 7f8edfe00640 1 -- 172.21.15.79:0/3188923017 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8057070 con 0x5606a94191b0 2024-09-21T02:39:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.709+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eec0ad3d0 con 0x5606a94191b0 2024-09-21T02:39:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.709+0000 7f8edfe00640 1 -- 172.21.15.79:0/3188923017 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8ef8004ee0 con 0x5606a94191b0 2024-09-21T02:39:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.709+0000 7f8edfe00640 1 -- 172.21.15.79:0/3188923017 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8ef8076050 con 0x5606a94191b0 2024-09-21T02:39:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.709+0000 7f8f0bfca740 10 client.25741 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.709+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5606a97d7610 con 0x5606a94191b0 2024-09-21T02:39:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.710+0000 7f8edfe00640 1 -- 172.21.15.79:0/3188923017 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef8036040 con 0x5606a94191b0 2024-09-21T02:39:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8edfe00640 1 -- 172.21.15.79:0/3188923017 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8ef806c030 con 0x5606a94191b0 2024-09-21T02:39:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8f0bfca740 10 client.25741 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8f0bfca740 10 client.25741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8f0bfca740 20 client.25741 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93ad1c0 0x5606a984c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8f0bfca740 4 client.25741 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:39:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8eec0ad3d0 con 0x5606a93ad1c0 2024-09-21T02:39:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.712+0000 7f8efde00640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93ad1c0 0x5606a984c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.713+0000 7f8edfe00640 10 client.25741 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.713+0000 7f8efde00640 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93ad1c0 0x5606a984c590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5740c3df5cf8b2b server_cookie=93e6436a15111de4 in_seq=0 out_seq=0 2024-09-21T02:39:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.754+0000 7f8edfe00640 1 -- 172.21.15.79:0/3188923017 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8eec0ad3d0 con 0x5606a93ad1c0 2024-09-21T02:39:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.754+0000 7f8edfe00640 10 client.25741 handle_command_reply: tid=0 2024-09-21T02:39:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.754+0000 7f8f0bfca740 1 client.25741 shutdown 2024-09-21T02:39:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.755+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 msgr2=0x5606a97d9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.755+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97d9ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8030df0 tx=0x7f8ef8004cd0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 shutdown_connections 2024-09-21T02:39:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5606a93ad1c0 0x5606a984c590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5606a94191b0 0x5606a97d9ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606a93f84d0 0x5606a97d5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8f0bfca740 1 --2- 172.21.15.79:0/3188923017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606a93f02f0 0x5606a97d5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8edfe00640 0 client.25741 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 >> 172.21.15.79:0/3188923017 conn(0x5606a940d300 msgr2=0x5606a97b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.756+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 shutdown_connections 2024-09-21T02:39:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.758+0000 7f8f0bfca740 1 -- 172.21.15.79:0/3188923017 wait complete. 2024-09-21T02:39:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.758+0000 7f8f0bfca740 20 client.25741 trim_cache size 0 max 16384 2024-09-21T02:39:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:39:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:39:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:39:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:39:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.759+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ee40b64e0 msgr2=0x7f8ee40b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.759+0000 7f8eff200640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ee40b64e0 0x7f8ee40b89f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ef805b000 tx=0x7f8ef8059000 comp rx=0 tx=0).stop 2024-09-21T02:39:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.759+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104570 msgr2=0x7f8f0019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.759+0000 7f8eff200640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104570 0x7f8f0019c5f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00e9f0 tx=0x7f8eec00edf0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.760+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 shutdown_connections 2024-09-21T02:39:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.760+0000 7f8eff200640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ee40b64e0 0x7f8ee40b89f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.760+0000 7f8eff200640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f00104f10 0x7f8f0019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.760+0000 7f8eff200640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f00104570 0x7f8f0019c5f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.760+0000 7f8eff200640 1 --2- 172.21.15.79:0/1682274357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f001034f0 0x7f8f0019bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.760+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 >> 172.21.15.79:0/1682274357 conn(0x7f8f000fee30 msgr2=0x7f8f00107890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.760+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 shutdown_connections 2024-09-21T02:39:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:10.763+0000 7f8eff200640 1 -- 172.21.15.79:0/1682274357 wait complete. 2024-09-21T02:39:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:10 smithi098 ceph-mon[34832]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.1 MiB/s wr, 568 op/s 2024-09-21T02:39:10.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:10 smithi079 ceph-mon[30788]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.1 MiB/s wr, 568 op/s 2024-09-21T02:39:11.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:10 smithi148 ceph-mon[34626]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.1 MiB/s wr, 568 op/s 2024-09-21T02:39:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 195.0 s, 1057.6 tps, lat 95.136 ms stddev 224.667 2024-09-21T02:39:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:12 smithi098 ceph-mon[34832]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-09-21T02:39:12.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:12 smithi079 ceph-mon[30788]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-09-21T02:39:13.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:12 smithi148 ceph-mon[34626]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-09-21T02:39:14.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:14 smithi079 ceph-mon[30788]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 6.6 MiB/s wr, 585 op/s 2024-09-21T02:39:14.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:14 smithi098 ceph-mon[34832]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 6.6 MiB/s wr, 585 op/s 2024-09-21T02:39:15.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:14 smithi148 ceph-mon[34626]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 6.6 MiB/s wr, 585 op/s 2024-09-21T02:39:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 200.0 s, 1866.4 tps, lat 53.295 ms stddev 73.010 2024-09-21T02:39:16.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:16 smithi098 ceph-mon[34832]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-09-21T02:39:16.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:16 smithi079 ceph-mon[30788]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-09-21T02:39:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:16 smithi148 ceph-mon[34626]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-09-21T02:39:18.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:18 smithi098 ceph-mon[34832]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.5 MiB/s wr, 547 op/s 2024-09-21T02:39:18.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:18 smithi079 ceph-mon[30788]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.5 MiB/s wr, 547 op/s 2024-09-21T02:39:19.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:18 smithi148 ceph-mon[34626]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.5 MiB/s wr, 547 op/s 2024-09-21T02:39:20.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:20 smithi098 ceph-mon[34832]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.8 MiB/s wr, 571 op/s 2024-09-21T02:39:20.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:20 smithi079 ceph-mon[30788]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.8 MiB/s wr, 571 op/s 2024-09-21T02:39:21.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:20 smithi148 ceph-mon[34626]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.8 MiB/s wr, 571 op/s 2024-09-21T02:39:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 205.0 s, 1786.5 tps, lat 56.399 ms stddev 70.751 2024-09-21T02:39:22.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:22 smithi098 ceph-mon[34832]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7.5 MiB/s wr, 643 op/s 2024-09-21T02:39:22.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:22 smithi079 ceph-mon[30788]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7.5 MiB/s wr, 643 op/s 2024-09-21T02:39:23.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:22 smithi148 ceph-mon[34626]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7.5 MiB/s wr, 643 op/s 2024-09-21T02:39:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 -- 172.21.15.79:0/4040100944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 msgr2=0x7f9c8810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 --2- 172.21.15.79:0/4040100944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 0x7f9c8810a960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009c90 tx=0x7f9c8002a860 comp rx=0 tx=0).stop 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 -- 172.21.15.79:0/4040100944 shutdown_connections 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 --2- 172.21.15.79:0/4040100944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 0x7f9c8810a960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 --2- 172.21.15.79:0/4040100944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88103620 0x7f9c88103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 --2- 172.21.15.79:0/4040100944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 0x7f9c88102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 -- 172.21.15.79:0/4040100944 >> 172.21.15.79:0/4040100944 conn(0x7f9c880fdee0 msgr2=0x7f9c88100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 -- 172.21.15.79:0/4040100944 shutdown_connections 2024-09-21T02:39:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.052+0000 7f9c90600640 1 -- 172.21.15.79:0/4040100944 wait complete. 2024-09-21T02:39:24.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.053+0000 7f9c90600640 1 Processor -- start 2024-09-21T02:39:24.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.054+0000 7f9c90600640 1 -- start start 2024-09-21T02:39:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.054+0000 7f9c90600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 0x7f9c8810cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.054+0000 7f9c90600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88103620 0x7f9c8810d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c90600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 0x7f9c8810dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c90600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88111570 con 0x7f9c88103620 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c90600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881113f0 con 0x7f9c881025a0 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c90600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881116f0 con 0x7f9c88103fc0 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 0x7f9c8810cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 0x7f9c8810cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:56290/0 (socket says 172.21.15.79:56290) 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 -- 172.21.15.79:0/3154989799 learned_addr learned my addr 172.21.15.79:0/3154989799 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8e600640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 0x7f9c8810dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8d200640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88103620 0x7f9c8810d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 -- 172.21.15.79:0/3154989799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 msgr2=0x7f9c8810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 0x7f9c8810dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 -- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88103620 msgr2=0x7f9c8810d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88103620 0x7f9c8810d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8dc00640 1 -- 172.21.15.79:0/3154989799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8810e550 con 0x7f9c881025a0 2024-09-21T02:39:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.055+0000 7f9c8d200640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88103620 0x7f9c8810d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.056+0000 7f9c8dc00640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 0x7f9c8810cb10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e9f0 tx=0x7f9c7c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.056+0000 7f9c86000640 1 -- 172.21.15.79:0/3154989799 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00cd00 con 0x7f9c881025a0 2024-09-21T02:39:24.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.056+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8810e840 con 0x7f9c881025a0 2024-09-21T02:39:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.056+0000 7f9c86000640 1 -- 172.21.15.79:0/3154989799 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7c0054d0 con 0x7f9c881025a0 2024-09-21T02:39:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.056+0000 7f9c86000640 1 -- 172.21.15.79:0/3154989799 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c010430 con 0x7f9c881025a0 2024-09-21T02:39:24.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.056+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8810ef00 con 0x7f9c881025a0 2024-09-21T02:39:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.061+0000 7f9c97656740 1 Processor -- start 2024-09-21T02:39:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.061+0000 7f9c86000640 1 -- 172.21.15.79:0/3154989799 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9c7c0046c0 con 0x7f9c881025a0 2024-09-21T02:39:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.061+0000 7f9c97656740 1 -- start start 2024-09-21T02:39:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c97656740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c97656740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e68740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c97656740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e69290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c97656740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f368ddb6b0 con 0x55f368a982f0 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c97656740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f368dcaae0 con 0x55f368ac11b0 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c97656740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f368dce8f0 con 0x55f368aa04d0 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c8e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c8e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:56306/0 (socket says 172.21.15.79:56306) 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c8e600640 1 -- 172.21.15.79:0/3515796842 learned_addr learned my addr 172.21.15.79:0/3515796842 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c8dc00640 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e68740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.062+0000 7f9c8d200640 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e69290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.063+0000 7f9c8e600640 1 -- 172.21.15.79:0/3515796842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 msgr2=0x55f368e69290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.063+0000 7f9c8e600640 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e69290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.063+0000 7f9c8e600640 1 -- 172.21.15.79:0/3515796842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 msgr2=0x55f368e68740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.063+0000 7f9c8e600640 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e68740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.063+0000 7f9c8e600640 1 -- 172.21.15.79:0/3515796842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f368d97780 con 0x55f368ac11b0 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.063+0000 7f9c8dc00640 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e68740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.064+0000 7f9c86000640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9c700b65d0 0x7f9c700b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.064+0000 7f9c8e600640 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e680d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009c90 tx=0x7f9c80031a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81392b519bec782 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.064+0000 7f9c86000640 1 -- 172.21.15.79:0/3154989799 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9c7c0e79d0 con 0x7f9c881025a0 2024-09-21T02:39:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.064+0000 7f9c7aa00640 1 -- 172.21.15.79:0/3515796842 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800313f0 con 0x55f368ac11b0 2024-09-21T02:39:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.064+0000 7f9c8dc00640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9c700b65d0 0x7f9c700b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.064+0000 7f9c7aa00640 1 -- 172.21.15.79:0/3515796842 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c80036030 con 0x55f368ac11b0 2024-09-21T02:39:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.064+0000 7f9c7aa00640 1 -- 172.21.15.79:0/3515796842 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80004280 con 0x55f368ac11b0 2024-09-21T02:39:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 -- 172.21.15.79:0/3515796842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 msgr2=0x55f368e680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e680d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009c90 tx=0x7f9c80031a10 comp rx=0 tx=0).stop 2024-09-21T02:39:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c8dc00640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9c700b65d0 0x7f9c700b8ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ad740 tx=0x7f9c7c00cea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 -- 172.21.15.79:0/3515796842 shutdown_connections 2024-09-21T02:39:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e69290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e68740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 --2- 172.21.15.79:0/3515796842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e680d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 -- 172.21.15.79:0/3515796842 >> 172.21.15.79:0/3515796842 conn(0x55f368ab5300 msgr2=0x55f368e63b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 -- 172.21.15.79:0/3515796842 shutdown_connections 2024-09-21T02:39:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.066+0000 7f9c97656740 1 -- 172.21.15.79:0/3515796842 wait complete. 2024-09-21T02:39:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.067+0000 7f9c97656740 1 -- start start 2024-09-21T02:39:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.067+0000 7f9c97656740 1 Processor -- start 2024-09-21T02:39:24.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.069+0000 7f9c97656740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368a982f0 0x55f368e71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.069+0000 7f9c97656740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368aa04d0 0x55f368e71e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.069+0000 7f9c97656740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368ac11b0 0x55f368e72990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.069+0000 7f9c97656740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f368d02ab0 con 0x55f368ac11b0 2024-09-21T02:39:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.069+0000 7f9c97656740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f368d71570 con 0x55f368aa04d0 2024-09-21T02:39:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.069+0000 7f9c97656740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f368e69d50 con 0x55f368a982f0 2024-09-21T02:39:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.069+0000 7f9c97656740 10 client.0 _ll_register_callbacks cb 0x55f368d80100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368ac11b0 0x55f368e72990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368a982f0 0x55f368e71760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368aa04d0 0x55f368e71e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368a982f0 0x55f368e71760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:33718/0 (socket says 172.21.15.79:33718) 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 -- 172.21.15.79:0/1083247583 learned_addr learned my addr 172.21.15.79:0/1083247583 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 -- 172.21.15.79:0/1083247583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368aa04d0 msgr2=0x55f368e71e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368aa04d0 0x55f368e71e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 -- 172.21.15.79:0/1083247583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368ac11b0 msgr2=0x55f368e72990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368ac11b0 0x55f368e72990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.070+0000 7f9c8e600640 1 -- 172.21.15.79:0/1083247583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f368b2c790 con 0x55f368a982f0 2024-09-21T02:39:24.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.071+0000 7f9c8e600640 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368a982f0 0x55f368e71760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9c80031e80 tx=0x7f9c80009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924550eb40744828 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:24.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.071+0000 7f9c6f400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:39:24.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.071+0000 7f9c6f400640 1 -- 172.21.15.79:0/1083247583 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80004d50 con 0x55f368a982f0 2024-09-21T02:39:24.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.071+0000 7f9c6f400640 1 -- 172.21.15.79:0/1083247583 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9c80004b50 con 0x55f368a982f0 2024-09-21T02:39:24.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.072+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c80036030 con 0x55f368a982f0 2024-09-21T02:39:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.072+0000 7f9c6f400640 1 -- 172.21.15.79:0/1083247583 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9c80004d50 con 0x55f368a982f0 2024-09-21T02:39:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.072+0000 7f9c97656740 10 client.25753 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.072+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f368ba5620 con 0x55f368a982f0 2024-09-21T02:39:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c6f400640 1 -- 172.21.15.79:0/1083247583 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c8004a040 con 0x55f368a982f0 2024-09-21T02:39:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c6f400640 1 -- 172.21.15.79:0/1083247583 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9c80043070 con 0x55f368a982f0 2024-09-21T02:39:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c97656740 10 client.25753 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c97656740 10 client.25753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c97656740 20 client.25753 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c97656740 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a7fd80 0x55f368e7ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c97656740 4 client.25753 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:39:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.073+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9c80036030 con 0x55f368a7fd80 2024-09-21T02:39:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.074+0000 7f9c8d200640 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a7fd80 0x55f368e7ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.074+0000 7f9c6f400640 10 client.25753 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.074+0000 7f9c8d200640 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a7fd80 0x55f368e7ea70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42dbf834e399e7da server_cookie=c684274a8251d727 in_seq=0 out_seq=0 2024-09-21T02:39:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.075+0000 7f9c6f400640 1 -- 172.21.15.79:0/1083247583 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f9c80036030 con 0x55f368a7fd80 2024-09-21T02:39:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.075+0000 7f9c6f400640 10 client.25753 handle_command_reply: tid=0 2024-09-21T02:39:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.075+0000 7f9c97656740 1 client.25753 shutdown 2024-09-21T02:39:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.076+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368a982f0 msgr2=0x55f368e71760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.076+0000 7f9c97656740 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368a982f0 0x55f368e71760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9c80031e80 tx=0x7f9c80009440 comp rx=0 tx=0).stop 2024-09-21T02:39:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.077+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 shutdown_connections 2024-09-21T02:39:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.077+0000 7f9c97656740 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a7fd80 0x55f368e7ea70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.077+0000 7f9c97656740 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368ac11b0 0x55f368e72990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.077+0000 7f9c6f400640 0 client.25753 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.077+0000 7f9c97656740 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368aa04d0 0x55f368e71e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.077+0000 7f9c97656740 1 --2- 172.21.15.79:0/1083247583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368a982f0 0x55f368e71760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.077+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 >> 172.21.15.79:0/1083247583 conn(0x55f368ab5300 msgr2=0x55f368e69140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.078+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 shutdown_connections 2024-09-21T02:39:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.078+0000 7f9c97656740 1 -- 172.21.15.79:0/1083247583 wait complete. 2024-09-21T02:39:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.078+0000 7f9c97656740 20 client.25753 trim_cache size 0 max 16384 2024-09-21T02:39:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.113+0000 7f9c97656740 1 Processor -- start 2024-09-21T02:39:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.114+0000 7f9c97656740 1 -- start start 2024-09-21T02:39:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.114+0000 7f9c97656740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368a982f0 0x55f368e627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.115+0000 7f9c97656740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368aa04d0 0x55f368e664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.115+0000 7f9c97656740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368ac11b0 0x55f368e66a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.115+0000 7f9c97656740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881b0d30 con 0x55f368aa04d0 2024-09-21T02:39:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.115+0000 7f9c97656740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881b3560 con 0x55f368a982f0 2024-09-21T02:39:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.115+0000 7f9c97656740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881b1350 con 0x55f368ac11b0 2024-09-21T02:39:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.116+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368aa04d0 0x55f368e664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.116+0000 7f9c8e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368a982f0 0x55f368e627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368a982f0 0x55f368e627f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:56328/0 (socket says 172.21.15.79:56328) 2024-09-21T02:39:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 -- 172.21.15.79:0/411628351 learned_addr learned my addr 172.21.15.79:0/411628351 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 -- 172.21.15.79:0/411628351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368ac11b0 msgr2=0x55f368e66a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 --2- 172.21.15.79:0/411628351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368ac11b0 0x55f368e66a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 -- 172.21.15.79:0/411628351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368aa04d0 msgr2=0x55f368e664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 --2- 172.21.15.79:0/411628351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368aa04d0 0x55f368e664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 -- 172.21.15.79:0/411628351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f368e5dd50 con 0x55f368a982f0 2024-09-21T02:39:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.117+0000 7f9c8e600640 1 --2- 172.21.15.79:0/411628351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368a982f0 0x55f368e627f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c80031d40 tx=0x7f9c8002a860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6b3bfa94b0bec18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.120+0000 7f9c7a000640 1 -- 172.21.15.79:0/411628351 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800047b0 con 0x55f368a982f0 2024-09-21T02:39:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.120+0000 7f9c7a000640 1 -- 172.21.15.79:0/411628351 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c80036070 con 0x55f368a982f0 2024-09-21T02:39:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.120+0000 7f9c7a000640 1 -- 172.21.15.79:0/411628351 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80030c70 con 0x55f368a982f0 2024-09-21T02:39:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.121+0000 7f9c97656740 1 -- 172.21.15.79:0/411628351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368a982f0 msgr2=0x55f368e627f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.121+0000 7f9c97656740 1 --2- 172.21.15.79:0/411628351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368a982f0 0x55f368e627f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c80031d40 tx=0x7f9c8002a860 comp rx=0 tx=0).stop 2024-09-21T02:39:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.121+0000 7f9c97656740 1 -- 172.21.15.79:0/411628351 shutdown_connections 2024-09-21T02:39:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.121+0000 7f9c97656740 1 --2- 172.21.15.79:0/411628351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368ac11b0 0x55f368e66a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.121+0000 7f9c97656740 1 --2- 172.21.15.79:0/411628351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368aa04d0 0x55f368e664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.121+0000 7f9c97656740 1 --2- 172.21.15.79:0/411628351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368a982f0 0x55f368e627f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.121+0000 7f9c97656740 1 -- 172.21.15.79:0/411628351 >> 172.21.15.79:0/411628351 conn(0x55f368ab5300 msgr2=0x55f368e620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.123+0000 7f9c97656740 1 -- 172.21.15.79:0/411628351 shutdown_connections 2024-09-21T02:39:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.123+0000 7f9c97656740 1 -- 172.21.15.79:0/411628351 wait complete. 2024-09-21T02:39:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.124+0000 7f9c97656740 1 -- start start 2024-09-21T02:39:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.124+0000 7f9c97656740 1 Processor -- start 2024-09-21T02:39:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.125+0000 7f9c97656740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e79160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.126+0000 7f9c97656740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e79820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.126+0000 7f9c97656740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e750d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.126+0000 7f9c97656740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881b1a20 con 0x55f368a982f0 2024-09-21T02:39:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.126+0000 7f9c97656740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881b2e90 con 0x55f368ac11b0 2024-09-21T02:39:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.126+0000 7f9c97656740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881b20f0 con 0x55f368aa04d0 2024-09-21T02:39:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.126+0000 7f9c97656740 10 client.0 _ll_register_callbacks cb 0x7f9c740095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.127+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e79820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.127+0000 7f9c8d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e79820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:33740/0 (socket says 172.21.15.79:33740) 2024-09-21T02:39:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.127+0000 7f9c8d200640 1 -- 172.21.15.79:0/2728924703 learned_addr learned my addr 172.21.15.79:0/2728924703 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.127+0000 7f9c8e600640 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.128+0000 7f9c8d200640 1 -- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 msgr2=0x55f368e750d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.128+0000 7f9c8d200640 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e750d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.128+0000 7f9c8d200640 1 -- 172.21.15.79:0/2728924703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 msgr2=0x55f368e79160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.128+0000 7f9c8d200640 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e79160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.128+0000 7f9c8d200640 1 -- 172.21.15.79:0/2728924703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f368e75840 con 0x55f368aa04d0 2024-09-21T02:39:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.129+0000 7f9c8d200640 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e79820 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55f368e7f010 tx=0x7f9c74012980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb5680a9cadbb107 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.129+0000 7f9c6f400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:39:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.130+0000 7f9c6f400640 1 -- 172.21.15.79:0/2728924703 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7402a060 con 0x55f368aa04d0 2024-09-21T02:39:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.130+0000 7f9c6f400640 1 -- 172.21.15.79:0/2728924703 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9c740035f0 con 0x55f368aa04d0 2024-09-21T02:39:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.130+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c80036070 con 0x55f368aa04d0 2024-09-21T02:39:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.132+0000 7f9c6f400640 1 -- 172.21.15.79:0/2728924703 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9c740037f0 con 0x55f368aa04d0 2024-09-21T02:39:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.132+0000 7f9c97656740 10 client.25756 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.132+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f368ee92d0 con 0x55f368aa04d0 2024-09-21T02:39:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.132+0000 7f9c6f400640 1 -- 172.21.15.79:0/2728924703 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c80036070 con 0x55f368aa04d0 2024-09-21T02:39:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c6f400640 1 -- 172.21.15.79:0/2728924703 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9c7401fa60 con 0x55f368aa04d0 2024-09-21T02:39:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c97656740 10 client.25756 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c97656740 10 client.25756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c97656740 20 client.25756 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c97656740 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a551c0 0x55f368eebb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c97656740 4 client.25756 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:39:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f368ddd600 con 0x55f368a551c0 2024-09-21T02:39:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.133+0000 7f9c8e600640 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a551c0 0x55f368eebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.134+0000 7f9c6f400640 10 client.25756 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.135+0000 7f9c8e600640 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a551c0 0x55f368eebb60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb99927b10941e6 server_cookie=104336e21883d5a9 in_seq=0 out_seq=0 2024-09-21T02:39:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.247+0000 7f9c6f400640 1 -- 172.21.15.79:0/2728924703 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f368ddd600 con 0x55f368a551c0 2024-09-21T02:39:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.247+0000 7f9c6f400640 10 client.25756 handle_command_reply: tid=0 2024-09-21T02:39:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.247+0000 7f9c97656740 1 client.25756 shutdown 2024-09-21T02:39:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.247+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 msgr2=0x55f368e79820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.247+0000 7f9c97656740 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e79820 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55f368e7f010 tx=0x7f9c74012980 comp rx=0 tx=0).stop 2024-09-21T02:39:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.247+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 shutdown_connections 2024-09-21T02:39:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.247+0000 7f9c97656740 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f368a551c0 0x55f368eebb60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c6f400640 0 client.25756 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c97656740 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f368ac11b0 0x55f368e750d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c97656740 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f368aa04d0 0x55f368e79820 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c97656740 1 --2- 172.21.15.79:0/2728924703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f368a982f0 0x55f368e79160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 >> 172.21.15.79:0/2728924703 conn(0x55f368ab5300 msgr2=0x55f368e63330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 shutdown_connections 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c97656740 1 -- 172.21.15.79:0/2728924703 wait complete. 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.248+0000 7f9c97656740 20 client.25756 trim_cache size 0 max 16384 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:39:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:39:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9c700b65d0 msgr2=0x7f9c700b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9c700b65d0 0x7f9c700b8ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ad740 tx=0x7f9c7c00cea0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 msgr2=0x7f9c8810cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 0x7f9c8810cb10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e9f0 tx=0x7f9c7c00edf0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 shutdown_connections 2024-09-21T02:39:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9c700b65d0 0x7f9c700b8ae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c88103fc0 0x7f9c8810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88103620 0x7f9c8810d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 --2- 172.21.15.79:0/3154989799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c881025a0 0x7f9c8810cb10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.250+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 >> 172.21.15.79:0/3154989799 conn(0x7f9c880fdee0 msgr2=0x7f9c88106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.251+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 shutdown_connections 2024-09-21T02:39:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:24.251+0000 7f9c90600640 1 -- 172.21.15.79:0/3154989799 wait complete. 2024-09-21T02:39:24.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:24 smithi079 ceph-mon[30788]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8.0 MiB/s wr, 701 op/s 2024-09-21T02:39:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:24 smithi148 ceph-mon[34626]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8.0 MiB/s wr, 701 op/s 2024-09-21T02:39:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:24 smithi098 ceph-mon[34832]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8.0 MiB/s wr, 701 op/s 2024-09-21T02:39:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 210.0 s, 2110.8 tps, lat 47.335 ms stddev 52.347 2024-09-21T02:39:26.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:26 smithi079 ceph-mon[30788]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 652 op/s 2024-09-21T02:39:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:26 smithi148 ceph-mon[34626]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 652 op/s 2024-09-21T02:39:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:26 smithi098 ceph-mon[34832]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 652 op/s 2024-09-21T02:39:28.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:28 smithi079 ceph-mon[30788]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 639 op/s 2024-09-21T02:39:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:28 smithi148 ceph-mon[34626]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 639 op/s 2024-09-21T02:39:29.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:28 smithi098 ceph-mon[34832]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 639 op/s 2024-09-21T02:39:30.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:30 smithi079 ceph-mon[30788]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.2 MiB/s wr, 640 op/s 2024-09-21T02:39:31.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:30 smithi148 ceph-mon[34626]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.2 MiB/s wr, 640 op/s 2024-09-21T02:39:31.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:30 smithi098 ceph-mon[34832]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.2 MiB/s wr, 640 op/s 2024-09-21T02:39:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 215.0 s, 1879.4 tps, lat 53.265 ms stddev 67.043 2024-09-21T02:39:32.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:32 smithi079 ceph-mon[30788]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 688 op/s 2024-09-21T02:39:33.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:32 smithi148 ceph-mon[34626]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 688 op/s 2024-09-21T02:39:33.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:32 smithi098 ceph-mon[34832]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 688 op/s 2024-09-21T02:39:35.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:35 smithi079 ceph-mon[30788]: pgmap v530: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 656 op/s 2024-09-21T02:39:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:35 smithi148 ceph-mon[34626]: pgmap v530: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 656 op/s 2024-09-21T02:39:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:35 smithi098 ceph-mon[34832]: pgmap v530: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 656 op/s 2024-09-21T02:39:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 220.0 s, 1890.2 tps, lat 52.198 ms stddev 63.111 2024-09-21T02:39:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.562+0000 7f4331200640 1 -- 172.21.15.79:0/4112801338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c1025a0 msgr2=0x7f432c102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.562+0000 7f4331200640 1 --2- 172.21.15.79:0/4112801338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c1025a0 0x7f432c102a10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f431c00d910 tx=0x7f431c02c370 comp rx=0 tx=0).stop 2024-09-21T02:39:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.563+0000 7f4331200640 1 -- 172.21.15.79:0/4112801338 shutdown_connections 2024-09-21T02:39:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.563+0000 7f4331200640 1 --2- 172.21.15.79:0/4112801338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c103fc0 0x7f432c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.563+0000 7f4331200640 1 --2- 172.21.15.79:0/4112801338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c103620 0x7f432c103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.563+0000 7f4331200640 1 --2- 172.21.15.79:0/4112801338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c1025a0 0x7f432c102a10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.563+0000 7f4331200640 1 -- 172.21.15.79:0/4112801338 >> 172.21.15.79:0/4112801338 conn(0x7f432c0fdee0 msgr2=0x7f432c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.563+0000 7f4331200640 1 -- 172.21.15.79:0/4112801338 shutdown_connections 2024-09-21T02:39:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.563+0000 7f4331200640 1 -- 172.21.15.79:0/4112801338 wait complete. 2024-09-21T02:39:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.565+0000 7f4331200640 1 Processor -- start 2024-09-21T02:39:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.565+0000 7f4331200640 1 -- start start 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.565+0000 7f4331200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c1025a0 0x7f432c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.565+0000 7f4331200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c103620 0x7f432c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4331200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c103fc0 0x7f432c198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4331200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f432c10d160 con 0x7f432c1025a0 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4331200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f432c10cfe0 con 0x7f432c103620 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4331200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f432c10d2e0 con 0x7f432c103fc0 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c1025a0 0x7f432c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c103620 0x7f432c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c103620 0x7f432c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55568/0 (socket says 172.21.15.79:55568) 2024-09-21T02:39:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329400640 1 -- 172.21.15.79:0/2364878725 learned_addr learned my addr 172.21.15.79:0/2364878725 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f432a800640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c103fc0 0x7f432c198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329e00640 1 -- 172.21.15.79:0/2364878725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c103fc0 msgr2=0x7f432c198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329e00640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c103fc0 0x7f432c198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329e00640 1 -- 172.21.15.79:0/2364878725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c103620 msgr2=0x7f432c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329e00640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c103620 0x7f432c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.566+0000 7f4329e00640 1 -- 172.21.15.79:0/2364878725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432c1997a0 con 0x7f432c1025a0 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.567+0000 7f4329e00640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c1025a0 0x7f432c197dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f431c000c00 tx=0x7f431c034810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.567+0000 7f4322a00640 1 -- 172.21.15.79:0/2364878725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c034c10 con 0x7f432c1025a0 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.567+0000 7f4322a00640 1 -- 172.21.15.79:0/2364878725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431c034db0 con 0x7f432c1025a0 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.567+0000 7f4322a00640 1 -- 172.21.15.79:0/2364878725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c033590 con 0x7f432c1025a0 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.567+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432c199a30 con 0x7f432c1025a0 2024-09-21T02:39:37.569 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.567+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432c199f70 con 0x7f432c1025a0 2024-09-21T02:39:37.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.571+0000 7f4322a00640 1 -- 172.21.15.79:0/2364878725 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f431c043020 con 0x7f432c1025a0 2024-09-21T02:39:37.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.572+0000 7f43381ba740 1 Processor -- start 2024-09-21T02:39:37.574 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.572+0000 7f43381ba740 1 -- start start 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f43381ba740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b60360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f43381ba740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6036740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f43381ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6037290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f43381ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5635b5fa96b0 con 0x5635b5c6e4d0 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f43381ba740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5635b5f98ae0 con 0x5635b5c8f1b0 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f43381ba740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5635b5f9c8f0 con 0x5635b5c662f0 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f432a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b60360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f432a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b60360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55578/0 (socket says 172.21.15.79:55578) 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f432a800640 1 -- 172.21.15.79:0/3017906505 learned_addr learned my addr 172.21.15.79:0/3017906505 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.573+0000 7f4329e00640 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6036740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.574+0000 7f4329400640 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6037290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.574+0000 7f432a800640 1 -- 172.21.15.79:0/3017906505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 msgr2=0x5635b6036740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.574+0000 7f432a800640 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6036740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.574+0000 7f432a800640 1 -- 172.21.15.79:0/3017906505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 msgr2=0x5635b6037290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.574+0000 7f432a800640 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6037290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.574+0000 7f4322a00640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f43100b6590 0x7f43100b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.574+0000 7f432a800640 1 -- 172.21.15.79:0/3017906505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b5f65780 con 0x5635b5c8f1b0 2024-09-21T02:39:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.575+0000 7f4322a00640 1 -- 172.21.15.79:0/2364878725 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f431c1070b0 con 0x7f432c1025a0 2024-09-21T02:39:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.575+0000 7f432a800640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f43100b6590 0x7f43100b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.575+0000 7f432a800640 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b60360d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f432400ae80 tx=0x7f432400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfc9376b67891b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.575+0000 7f4317400640 1 -- 172.21.15.79:0/3017906505 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324019900 con 0x5635b5c8f1b0 2024-09-21T02:39:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.575+0000 7f4317400640 1 -- 172.21.15.79:0/3017906505 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43240173b0 con 0x5635b5c8f1b0 2024-09-21T02:39:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.575+0000 7f4317400640 1 -- 172.21.15.79:0/3017906505 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324017e60 con 0x5635b5c8f1b0 2024-09-21T02:39:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.576+0000 7f43381ba740 1 -- 172.21.15.79:0/3017906505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 msgr2=0x5635b60360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.576+0000 7f43381ba740 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b60360d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f432400ae80 tx=0x7f432400f790 comp rx=0 tx=0).stop 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.576+0000 7f432a800640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f43100b6590 0x7f43100b8aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f432401e000 tx=0x7f432401f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.577+0000 7f43381ba740 1 -- 172.21.15.79:0/3017906505 shutdown_connections 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.577+0000 7f43381ba740 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6037290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.577+0000 7f43381ba740 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6036740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.577+0000 7f43381ba740 1 --2- 172.21.15.79:0/3017906505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b60360d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.577+0000 7f43381ba740 1 -- 172.21.15.79:0/3017906505 >> 172.21.15.79:0/3017906505 conn(0x5635b5c83300 msgr2=0x5635b6031b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.577+0000 7f43381ba740 1 -- 172.21.15.79:0/3017906505 shutdown_connections 2024-09-21T02:39:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.578+0000 7f43381ba740 1 -- 172.21.15.79:0/3017906505 wait complete. 2024-09-21T02:39:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.579+0000 7f43381ba740 1 -- start start 2024-09-21T02:39:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.579+0000 7f43381ba740 1 Processor -- start 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f43381ba740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b603f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f43381ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b603fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f43381ba740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b6040970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f43381ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5635b5ed0ab0 con 0x5635b5c6e4d0 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f43381ba740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5635b5f3f570 con 0x5635b5c8f1b0 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f43381ba740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5635b6037db0 con 0x5635b5c662f0 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f43381ba740 10 client.0 _ll_register_callbacks cb 0x5635b5f4e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f432a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b6040970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f432a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b6040970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55582/0 (socket says 172.21.15.79:55582) 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f432a800640 1 -- 172.21.15.79:0/3861595850 learned_addr learned my addr 172.21.15.79:0/3861595850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f4329400640 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b603fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.580+0000 7f4329e00640 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b603f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f4329e00640 1 -- 172.21.15.79:0/3861595850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 msgr2=0x5635b6040970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f4329e00640 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b6040970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f4329e00640 1 -- 172.21.15.79:0/3861595850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 msgr2=0x5635b603fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f4329e00640 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b603fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f4329e00640 1 -- 172.21.15.79:0/3861595850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b5cfa790 con 0x5635b5c662f0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f4329e00640 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b603f740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ca0a0 tx=0x7f431c034f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6de1470d8a7c2b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f430be00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f430be00640 1 -- 172.21.15.79:0/3861595850 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0c8cd0 con 0x5635b5c662f0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f430be00640 1 -- 172.21.15.79:0/3861595850 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f431c0b40b0 con 0x5635b5c662f0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.581+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43240173b0 con 0x5635b5c662f0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.582+0000 7f430be00640 1 -- 172.21.15.79:0/3861595850 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f431c0cc5a0 con 0x5635b5c662f0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.582+0000 7f43381ba740 10 client.25768 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.582+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5635b5d73620 con 0x5635b5c662f0 2024-09-21T02:39:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.582+0000 7f430be00640 1 -- 172.21.15.79:0/3861595850 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43240173b0 con 0x5635b5c662f0 2024-09-21T02:39:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.583+0000 7f430be00640 1 -- 172.21.15.79:0/3861595850 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f431c1090d0 con 0x5635b5c662f0 2024-09-21T02:39:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.583+0000 7f43381ba740 10 client.25768 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.583+0000 7f43381ba740 10 client.25768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.584+0000 7f43381ba740 20 client.25768 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.584+0000 7f43381ba740 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c4dd80 0x5635b604ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.584+0000 7f43381ba740 4 client.25768 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:39:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.584+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635b5fab600 con 0x5635b5c4dd80 2024-09-21T02:39:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.584+0000 7f4329400640 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c4dd80 0x5635b604ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.585+0000 7f4329400640 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c4dd80 0x5635b604ceb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3117c3735a21a02 server_cookie=6a0cf333c8335c69 in_seq=0 out_seq=0 2024-09-21T02:39:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.585+0000 7f430be00640 10 client.25768 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f430be00640 1 -- 172.21.15.79:0/3861595850 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5635b5fab600 con 0x5635b5c4dd80 2024-09-21T02:39:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f430be00640 10 client.25768 handle_command_reply: tid=0 2024-09-21T02:39:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 client.25768 shutdown 2024-09-21T02:39:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 msgr2=0x5635b603f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b603f740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ca0a0 tx=0x7f431c034f60 comp rx=0 tx=0).stop 2024-09-21T02:39:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 shutdown_connections 2024-09-21T02:39:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c4dd80 0x5635b604ceb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f430be00640 0 client.25768 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c8f1b0 0x5635b6040970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b603fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 --2- 172.21.15.79:0/3861595850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b603f740 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.586+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 >> 172.21.15.79:0/3861595850 conn(0x5635b5c83300 msgr2=0x5635b6037140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.587+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 shutdown_connections 2024-09-21T02:39:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.587+0000 7f43381ba740 1 -- 172.21.15.79:0/3861595850 wait complete. 2024-09-21T02:39:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.588+0000 7f43381ba740 20 client.25768 trim_cache size 0 max 16384 2024-09-21T02:39:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.646+0000 7f43381ba740 1 Processor -- start 2024-09-21T02:39:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f43381ba740 1 -- start start 2024-09-21T02:39:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f43381ba740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c4dd80 0x5635b603e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f43381ba740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c662f0 0x5635b6036f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f43381ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b60314a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f43381ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f432c1b0ca0 con 0x5635b5c6e4d0 2024-09-21T02:39:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f43381ba740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f432c1b3520 con 0x5635b5c662f0 2024-09-21T02:39:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f43381ba740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f432c1b1310 con 0x5635b5c4dd80 2024-09-21T02:39:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f4329e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c4dd80 0x5635b603e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f4329e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c4dd80 0x5635b603e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:46638/0 (socket says 172.21.15.79:46638) 2024-09-21T02:39:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.647+0000 7f4329e00640 1 -- 172.21.15.79:0/197940810 learned_addr learned my addr 172.21.15.79:0/197940810 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.648+0000 7f432a800640 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b60314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.648+0000 7f4329400640 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c662f0 0x5635b6036f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.648+0000 7f4329e00640 1 -- 172.21.15.79:0/197940810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c662f0 msgr2=0x5635b6036f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.648+0000 7f4329e00640 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c662f0 0x5635b6036f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.648+0000 7f4329e00640 1 -- 172.21.15.79:0/197940810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 msgr2=0x5635b60314a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.648+0000 7f4329e00640 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b60314a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.648+0000 7f4329e00640 1 -- 172.21.15.79:0/197940810 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b603d8d0 con 0x5635b5c4dd80 2024-09-21T02:39:37.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.649+0000 7f4329e00640 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c4dd80 0x5635b603e360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f431c02e040 tx=0x7f431c0cbb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0f24e63242b1ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.650+0000 7f4316a00640 1 -- 172.21.15.79:0/197940810 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0cc780 con 0x5635b5c4dd80 2024-09-21T02:39:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.651+0000 7f4316a00640 1 -- 172.21.15.79:0/197940810 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431c030070 con 0x5635b5c4dd80 2024-09-21T02:39:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.651+0000 7f4316a00640 1 -- 172.21.15.79:0/197940810 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0ccc00 con 0x5635b5c4dd80 2024-09-21T02:39:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.652+0000 7f43381ba740 1 -- 172.21.15.79:0/197940810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c4dd80 msgr2=0x5635b603e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.652+0000 7f43381ba740 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c4dd80 0x5635b603e360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f431c02e040 tx=0x7f431c0cbb00 comp rx=0 tx=0).stop 2024-09-21T02:39:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.652+0000 7f43381ba740 1 -- 172.21.15.79:0/197940810 shutdown_connections 2024-09-21T02:39:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.652+0000 7f43381ba740 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b60314a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.652+0000 7f43381ba740 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c662f0 0x5635b6036f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.652+0000 7f43381ba740 1 --2- 172.21.15.79:0/197940810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c4dd80 0x5635b603e360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.652+0000 7f43381ba740 1 -- 172.21.15.79:0/197940810 >> 172.21.15.79:0/197940810 conn(0x5635b5c83300 msgr2=0x5635b603dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.653+0000 7f43381ba740 1 -- 172.21.15.79:0/197940810 shutdown_connections 2024-09-21T02:39:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.653+0000 7f43381ba740 1 -- 172.21.15.79:0/197940810 wait complete. 2024-09-21T02:39:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.654+0000 7f43381ba740 1 -- start start 2024-09-21T02:39:37.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.654+0000 7f43381ba740 1 Processor -- start 2024-09-21T02:39:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.655+0000 7f43381ba740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c4dd80 0x5635b6046f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.655+0000 7f43381ba740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6042de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.655+0000 7f43381ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6043320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f43381ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f432c1b19e0 con 0x5635b5c6e4d0 2024-09-21T02:39:37.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f4329e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c4dd80 0x5635b6046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f43381ba740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f432c1b2e50 con 0x5635b5c4dd80 2024-09-21T02:39:37.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f43381ba740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f432c1b20b0 con 0x5635b5c662f0 2024-09-21T02:39:37.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f4329e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c4dd80 0x5635b6046f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55596/0 (socket says 172.21.15.79:55596) 2024-09-21T02:39:37.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f43381ba740 10 client.0 _ll_register_callbacks cb 0x7f431c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:37.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f4329400640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6042de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.656+0000 7f4329e00640 1 -- 172.21.15.79:0/4208085763 learned_addr learned my addr 172.21.15.79:0/4208085763 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:37.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.657+0000 7f432a800640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6043320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.658+0000 7f4329400640 1 -- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c4dd80 msgr2=0x5635b6046f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.658+0000 7f4329400640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c4dd80 0x5635b6046f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.658+0000 7f4329400640 1 -- 172.21.15.79:0/4208085763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 msgr2=0x5635b6043320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.658+0000 7f4329400640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6043320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.658+0000 7f4329400640 1 -- 172.21.15.79:0/4208085763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b6043ee0 con 0x5635b5c662f0 2024-09-21T02:39:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.659+0000 7f4329e00640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c4dd80 0x5635b6046f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.660+0000 7f430be00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:39:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.660+0000 7f4329400640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6042de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f431800bea0 tx=0x7f4318011b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d41bd9169026ae10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.660+0000 7f430be00640 1 -- 172.21.15.79:0/4208085763 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431801d920 con 0x5635b5c662f0 2024-09-21T02:39:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.660+0000 7f430be00640 1 -- 172.21.15.79:0/4208085763 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f431801dac0 con 0x5635b5c662f0 2024-09-21T02:39:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.661+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431c030070 con 0x5635b5c662f0 2024-09-21T02:39:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.662+0000 7f430be00640 1 -- 172.21.15.79:0/4208085763 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f431801dcc0 con 0x5635b5c662f0 2024-09-21T02:39:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.662+0000 7f43381ba740 10 client.25774 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.662+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5635b60b7a90 con 0x5635b5c662f0 2024-09-21T02:39:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f430be00640 1 -- 172.21.15.79:0/4208085763 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431c030070 con 0x5635b5c662f0 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f430be00640 1 -- 172.21.15.79:0/4208085763 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f431802d510 con 0x5635b5c662f0 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f43381ba740 10 client.25774 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f43381ba740 10 client.25774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f43381ba740 20 client.25774 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f43381ba740 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c8f1b0 0x5635b60ba500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f43381ba740 4 client.25774 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.663+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5635b5fa70b0 con 0x5635b5c8f1b0 2024-09-21T02:39:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.664+0000 7f4329e00640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c8f1b0 0x5635b60ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.665+0000 7f4329e00640 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c8f1b0 0x5635b60ba500 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d4726f9bf84467c server_cookie=41e54e7b637474b in_seq=0 out_seq=0 2024-09-21T02:39:37.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.665+0000 7f430be00640 10 client.25774 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f430be00640 1 -- 172.21.15.79:0/4208085763 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5635b5fa70b0 con 0x5635b5c8f1b0 2024-09-21T02:39:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f430be00640 10 client.25774 handle_command_reply: tid=0 2024-09-21T02:39:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 client.25774 shutdown 2024-09-21T02:39:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 msgr2=0x5635b6042de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6042de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f431800bea0 tx=0x7f4318011b20 comp rx=0 tx=0).stop 2024-09-21T02:39:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 shutdown_connections 2024-09-21T02:39:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5635b5c8f1b0 0x5635b60ba500 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b5c6e4d0 0x5635b6043320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635b5c662f0 0x5635b6042de0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 --2- 172.21.15.79:0/4208085763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5635b5c4dd80 0x5635b6046f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 >> 172.21.15.79:0/4208085763 conn(0x5635b5c83300 msgr2=0x5635b60314a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.681+0000 7f430be00640 0 client.25774 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.682+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 shutdown_connections 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.682+0000 7f43381ba740 1 -- 172.21.15.79:0/4208085763 wait complete. 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.682+0000 7f43381ba740 20 client.25774 trim_cache size 0 max 16384 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:39:37.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.683+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f43100b6590 msgr2=0x7f43100b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.683+0000 7f4331200640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f43100b6590 0x7f43100b8aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f432401e000 tx=0x7f432401f000 comp rx=0 tx=0).stop 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.683+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c1025a0 msgr2=0x7f432c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.683+0000 7f4331200640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c1025a0 0x7f432c197dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f431c000c00 tx=0x7f431c034810 comp rx=0 tx=0).stop 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 shutdown_connections 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f43100b6590 0x7f43100b8aa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c103fc0 0x7f432c198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f432c103620 0x7f432c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 --2- 172.21.15.79:0/2364878725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c1025a0 0x7f432c197dd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 >> 172.21.15.79:0/2364878725 conn(0x7f432c0fdee0 msgr2=0x7f432c106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 shutdown_connections 2024-09-21T02:39:37.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:37.684+0000 7f4331200640 1 -- 172.21.15.79:0/2364878725 wait complete. 2024-09-21T02:39:37.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:37 smithi079 ceph-mon[30788]: pgmap v531: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 655 op/s 2024-09-21T02:39:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:37 smithi148 ceph-mon[34626]: pgmap v531: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 655 op/s 2024-09-21T02:39:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:37 smithi098 ceph-mon[34832]: pgmap v531: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 655 op/s 2024-09-21T02:39:39.730 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:39 smithi079 ceph-mon[30788]: pgmap v532: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.9 MiB/s wr, 605 op/s 2024-09-21T02:39:39.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:39 smithi148 ceph-mon[34626]: pgmap v532: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.9 MiB/s wr, 605 op/s 2024-09-21T02:39:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:39 smithi098 ceph-mon[34832]: pgmap v532: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.9 MiB/s wr, 605 op/s 2024-09-21T02:39:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 225.0 s, 1592.2 tps, lat 63.170 ms stddev 73.741 2024-09-21T02:39:41.731 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:41 smithi079 ceph-mon[30788]: pgmap v533: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 590 op/s 2024-09-21T02:39:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:41 smithi148 ceph-mon[34626]: pgmap v533: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 590 op/s 2024-09-21T02:39:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:41 smithi098 ceph-mon[34832]: pgmap v533: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 590 op/s 2024-09-21T02:39:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:43 smithi079 ceph-mon[30788]: pgmap v534: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.3 MiB/s wr, 656 op/s 2024-09-21T02:39:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:43 smithi148 ceph-mon[34626]: pgmap v534: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.3 MiB/s wr, 656 op/s 2024-09-21T02:39:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:43 smithi098 ceph-mon[34832]: pgmap v534: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.3 MiB/s wr, 656 op/s 2024-09-21T02:39:45.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:45 smithi079 ceph-mon[30788]: pgmap v535: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.0 MiB/s wr, 760 op/s 2024-09-21T02:39:45.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:45 smithi148 ceph-mon[34626]: pgmap v535: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.0 MiB/s wr, 760 op/s 2024-09-21T02:39:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:45 smithi098 ceph-mon[34832]: pgmap v535: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.0 MiB/s wr, 760 op/s 2024-09-21T02:39:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 230.0 s, 1185.2 tps, lat 83.992 ms stddev 134.639 2024-09-21T02:39:47.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:47 smithi079 ceph-mon[30788]: pgmap v536: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 977 op/s 2024-09-21T02:39:47.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:47 smithi148 ceph-mon[34626]: pgmap v536: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 977 op/s 2024-09-21T02:39:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:47 smithi098 ceph-mon[34832]: pgmap v536: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 977 op/s 2024-09-21T02:39:49.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:49 smithi148 ceph-mon[34626]: pgmap v537: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 MiB/s wr, 874 op/s 2024-09-21T02:39:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:49 smithi098 ceph-mon[34832]: pgmap v537: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 MiB/s wr, 874 op/s 2024-09-21T02:39:49.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:49 smithi079 ceph-mon[30788]: pgmap v537: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 MiB/s wr, 874 op/s 2024-09-21T02:39:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.989+0000 7f3d86800640 1 -- 172.21.15.79:0/1906120645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010d9c0 msgr2=0x7f3d801163a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.989+0000 7f3d86800640 1 --2- 172.21.15.79:0/1906120645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010d9c0 0x7f3d801163a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009ca0 tx=0x7f3d7802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.992+0000 7f3d86800640 1 -- 172.21.15.79:0/1906120645 shutdown_connections 2024-09-21T02:39:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.992+0000 7f3d86800640 1 --2- 172.21.15.79:0/1906120645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010d9c0 0x7f3d801163a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.992+0000 7f3d86800640 1 --2- 172.21.15.79:0/1906120645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010cdb0 0x7f3d8010d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.992+0000 7f3d86800640 1 --2- 172.21.15.79:0/1906120645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d8010a3c0 0x7f3d8010c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.992+0000 7f3d86800640 1 -- 172.21.15.79:0/1906120645 >> 172.21.15.79:0/1906120645 conn(0x7f3d80070810 msgr2=0x7f3d80072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:50.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.992+0000 7f3d86800640 1 -- 172.21.15.79:0/1906120645 shutdown_connections 2024-09-21T02:39:50.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.992+0000 7f3d86800640 1 -- 172.21.15.79:0/1906120645 wait complete. 2024-09-21T02:39:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.994+0000 7f3d86800640 1 Processor -- start 2024-09-21T02:39:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.994+0000 7f3d86800640 1 -- start start 2024-09-21T02:39:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.994+0000 7f3d86800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d8010a3c0 0x7f3d801a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d86800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010cdb0 0x7f3d801a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d86800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010d9c0 0x7f3d801a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d86800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80119d60 con 0x7f3d8010a3c0 2024-09-21T02:39:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d86800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80119be0 con 0x7f3d8010cdb0 2024-09-21T02:39:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d86800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80119ee0 con 0x7f3d8010d9c0 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010d9c0 0x7f3d801a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d8010a3c0 0x7f3d801a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010d9c0 0x7f3d801a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49906/0 (socket says 172.21.15.79:49906) 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d7fe00640 1 -- 172.21.15.79:0/3428713000 learned_addr learned my addr 172.21.15.79:0/3428713000 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.995+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010cdb0 0x7f3d801a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d7fe00640 1 -- 172.21.15.79:0/3428713000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010cdb0 msgr2=0x7f3d801a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010cdb0 0x7f3d801a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d7fe00640 1 -- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d8010a3c0 msgr2=0x7f3d801a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d8010a3c0 0x7f3d801a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d7fe00640 1 -- 172.21.15.79:0/3428713000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d801a6340 con 0x7f3d8010d9c0 2024-09-21T02:39:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d7f400640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d8010a3c0 0x7f3d801a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010d9c0 0x7f3d801a5b20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009430 tx=0x7f3d780317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d77e00640 1 -- 172.21.15.79:0/3428713000 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78003bf0 con 0x7f3d8010d9c0 2024-09-21T02:39:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d77e00640 1 -- 172.21.15.79:0/3428713000 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d78003d90 con 0x7f3d8010d9c0 2024-09-21T02:39:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.996+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d801a65d0 con 0x7f3d8010d9c0 2024-09-21T02:39:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.997+0000 7f3d77e00640 1 -- 172.21.15.79:0/3428713000 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78003bf0 con 0x7f3d8010d9c0 2024-09-21T02:39:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:50.997+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d801acd20 con 0x7f3d8010d9c0 2024-09-21T02:39:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 Processor -- start 2024-09-21T02:39:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d77e00640 1 -- 172.21.15.79:0/3428713000 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3d7802f9f0 con 0x7f3d8010d9c0 2024-09-21T02:39:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 -- start start 2024-09-21T02:39:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea4770d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea477740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 0x5615ea478290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615ea3ea6b0 con 0x5615ea0af4d0 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5615ea3d9ae0 con 0x5615ea0a72f0 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.002+0000 7f3d8d861740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5615ea3dd8f0 con 0x5615ea0d01b0 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea4770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea477740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea4770d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49918/0 (socket says 172.21.15.79:49918) 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7ea00640 1 -- 172.21.15.79:0/2218565874 learned_addr learned my addr 172.21.15.79:0/2218565874 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea477740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46204/0 (socket says 172.21.15.79:46204) 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 0x5615ea478290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7f400640 1 -- 172.21.15.79:0/2218565874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 msgr2=0x5615ea4770d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7f400640 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea4770d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7f400640 1 -- 172.21.15.79:0/2218565874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 msgr2=0x5615ea478290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7f400640 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 0x5615ea478290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7f400640 1 -- 172.21.15.79:0/2218565874 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ea3a6780 con 0x5615ea0a72f0 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.003+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea4770d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:51.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.004+0000 7f3d7f400640 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea477740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000bca0 tx=0x7f3d7000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84c094b46bc56bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.004+0000 7f3d77e00640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3d640b6710 0x7f3d640b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.004+0000 7f3d74c00640 1 -- 172.21.15.79:0/2218565874 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70005020 con 0x5615ea0a72f0 2024-09-21T02:39:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.005+0000 7f3d74c00640 1 -- 172.21.15.79:0/2218565874 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d700047a0 con 0x5615ea0a72f0 2024-09-21T02:39:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.005+0000 7f3d74c00640 1 -- 172.21.15.79:0/2218565874 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700116a0 con 0x5615ea0a72f0 2024-09-21T02:39:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.005+0000 7f3d77e00640 1 -- 172.21.15.79:0/3428713000 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3d781087e0 con 0x7f3d8010d9c0 2024-09-21T02:39:51.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.007+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3d640b6710 0x7f3d640b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.010+0000 7f3d8d861740 1 -- 172.21.15.79:0/2218565874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 msgr2=0x5615ea477740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.011+0000 7f3d8d861740 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea477740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000bca0 tx=0x7f3d7000f730 comp rx=0 tx=0).stop 2024-09-21T02:39:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.011+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3d640b6710 0x7f3d640b8c20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009fb0 tx=0x7f3d6c004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.012+0000 7f3d8d861740 1 -- 172.21.15.79:0/2218565874 shutdown_connections 2024-09-21T02:39:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.012+0000 7f3d8d861740 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 0x5615ea478290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.012+0000 7f3d8d861740 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea477740 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.012+0000 7f3d8d861740 1 --2- 172.21.15.79:0/2218565874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea4770d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.012+0000 7f3d8d861740 1 -- 172.21.15.79:0/2218565874 >> 172.21.15.79:0/2218565874 conn(0x5615ea0c4300 msgr2=0x5615ea472b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.012+0000 7f3d8d861740 1 -- 172.21.15.79:0/2218565874 shutdown_connections 2024-09-21T02:39:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.013+0000 7f3d8d861740 1 -- 172.21.15.79:0/2218565874 wait complete. 2024-09-21T02:39:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.013+0000 7f3d8d861740 1 -- start start 2024-09-21T02:39:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.014+0000 7f3d8d861740 1 Processor -- start 2024-09-21T02:39:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.015+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.015+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea480e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.015+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.016+0000 7f3d8d861740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615ea311ab0 con 0x5615ea0d01b0 2024-09-21T02:39:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.016+0000 7f3d8d861740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5615ea380570 con 0x5615ea0a72f0 2024-09-21T02:39:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.016+0000 7f3d8d861740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5615ea478db0 con 0x5615ea0af4d0 2024-09-21T02:39:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.016+0000 7f3d8d861740 10 client.0 _ll_register_callbacks cb 0x5615ea38f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.016+0000 7f3d7ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea480e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.016+0000 7f3d7ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea480e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49930/0 (socket says 172.21.15.79:49930) 2024-09-21T02:39:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.016+0000 7f3d7ea00640 1 -- 172.21.15.79:0/1538427535 learned_addr learned my addr 172.21.15.79:0/1538427535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.017+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.017+0000 7f3d7fe00640 1 -- 172.21.15.79:0/1538427535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 msgr2=0x5615ea480e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.017+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea480e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.017+0000 7f3d7fe00640 1 -- 172.21.15.79:0/1538427535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 msgr2=0x5615ea4807c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:39:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.017+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.017+0000 7f3d7fe00640 1 -- 172.21.15.79:0/1538427535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ea13b790 con 0x5615ea0d01b0 2024-09-21T02:39:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.018+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4819f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d78003fd0 tx=0x7f3d780cdfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c540feb0472109b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.018+0000 7f3d69600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:39:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.019+0000 7f3d69600640 1 -- 172.21.15.79:0/1538427535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780d30a0 con 0x5615ea0d01b0 2024-09-21T02:39:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.019+0000 7f3d69600640 1 -- 172.21.15.79:0/1538427535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3d780d7040 con 0x5615ea0d01b0 2024-09-21T02:39:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.019+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d700047a0 con 0x5615ea0d01b0 2024-09-21T02:39:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.020+0000 7f3d69600640 1 -- 172.21.15.79:0/1538427535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3d780e9050 con 0x5615ea0d01b0 2024-09-21T02:39:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.021+0000 7f3d8d861740 10 client.15684 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.021+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5615ea1b4620 con 0x5615ea0d01b0 2024-09-21T02:39:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.022+0000 7f3d69600640 1 -- 172.21.15.79:0/1538427535 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d700047a0 con 0x5615ea0d01b0 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.023+0000 7f3d69600640 1 -- 172.21.15.79:0/1538427535 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3d780c9f10 con 0x5615ea0d01b0 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.023+0000 7f3d8d861740 10 client.15684 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.023+0000 7f3d8d861740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.023+0000 7f3d8d861740 20 client.15684 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.023+0000 7f3d8d861740 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea08ed80 0x5615ea48df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.023+0000 7f3d8d861740 4 client.15684 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.023+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615ea3ec600 con 0x5615ea08ed80 2024-09-21T02:39:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.024+0000 7f3d7f400640 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea08ed80 0x5615ea48df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.029+0000 7f3d69600640 10 client.15684 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.029+0000 7f3d7f400640 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea08ed80 0x5615ea48df30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff410bb811d1ab7 server_cookie=e8b2ac6831e2cee3 in_seq=0 out_seq=0 2024-09-21T02:39:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.031+0000 7f3d69600640 1 -- 172.21.15.79:0/1538427535 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615ea3ec600 con 0x5615ea08ed80 2024-09-21T02:39:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.031+0000 7f3d69600640 10 client.15684 handle_command_reply: tid=0 2024-09-21T02:39:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.031+0000 7f3d8d861740 1 client.15684 shutdown 2024-09-21T02:39:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.032+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 msgr2=0x5615ea4819f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.032+0000 7f3d8d861740 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4819f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d78003fd0 tx=0x7f3d780cdfd0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 shutdown_connections 2024-09-21T02:39:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea08ed80 0x5615ea48df30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4819f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea480e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d69600640 0 client.15684 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 --2- 172.21.15.79:0/1538427535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 >> 172.21.15.79:0/1538427535 conn(0x5615ea0c4300 msgr2=0x5615ea4710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 shutdown_connections 2024-09-21T02:39:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.033+0000 7f3d8d861740 1 -- 172.21.15.79:0/1538427535 wait complete. 2024-09-21T02:39:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.034+0000 7f3d8d861740 20 client.15684 trim_cache size 0 max 16384 2024-09-21T02:39:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.071+0000 7f3d8d861740 1 Processor -- start 2024-09-21T02:39:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.071+0000 7f3d8d861740 1 -- start start 2024-09-21T02:39:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 0x5615ea4888d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea471850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d8d861740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801b0c30 con 0x5615ea0af4d0 2024-09-21T02:39:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d8d861740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801b3490 con 0x5615ea0a72f0 2024-09-21T02:39:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d8d861740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801b1280 con 0x5615ea0d01b0 2024-09-21T02:39:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea471850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46234/0 (socket says 172.21.15.79:46234) 2024-09-21T02:39:51.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.072+0000 7f3d7f400640 1 -- 172.21.15.79:0/3401957372 learned_addr learned my addr 172.21.15.79:0/3401957372 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:51.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.073+0000 7f3d7f400640 1 -- 172.21.15.79:0/3401957372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 msgr2=0x5615ea471850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:51.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.073+0000 7f3d7f400640 1 --2- 172.21.15.79:0/3401957372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea471850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.073+0000 7f3d7f400640 1 -- 172.21.15.79:0/3401957372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 msgr2=0x5615ea4888d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:51.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.073+0000 7f3d7f400640 1 --2- 172.21.15.79:0/3401957372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 0x5615ea4888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.073+0000 7f3d7f400640 1 -- 172.21.15.79:0/3401957372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ea47e950 con 0x5615ea0a72f0 2024-09-21T02:39:51.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.073+0000 7f3d7f400640 1 --2- 172.21.15.79:0/3401957372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4724a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000bbf0 tx=0x7f3d70000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53bfbda8537b68b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:51.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.074+0000 7f3d6be00640 1 -- 172.21.15.79:0/3401957372 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70005240 con 0x5615ea0a72f0 2024-09-21T02:39:51.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.074+0000 7f3d6be00640 1 -- 172.21.15.79:0/3401957372 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5615ea3ec600 con 0x5615ea0a72f0 2024-09-21T02:39:51.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.074+0000 7f3d6be00640 1 -- 172.21.15.79:0/3401957372 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70027430 con 0x5615ea0a72f0 2024-09-21T02:39:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.076+0000 7f3d8d861740 1 -- 172.21.15.79:0/3401957372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 msgr2=0x5615ea4724a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.076+0000 7f3d8d861740 1 --2- 172.21.15.79:0/3401957372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4724a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000bbf0 tx=0x7f3d70000bc0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.076+0000 7f3d8d861740 1 -- 172.21.15.79:0/3401957372 shutdown_connections 2024-09-21T02:39:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.076+0000 7f3d8d861740 1 --2- 172.21.15.79:0/3401957372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0d01b0 0x5615ea471850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.076+0000 7f3d8d861740 1 --2- 172.21.15.79:0/3401957372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0af4d0 0x5615ea4888d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.076+0000 7f3d8d861740 1 --2- 172.21.15.79:0/3401957372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea4724a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.076+0000 7f3d8d861740 1 -- 172.21.15.79:0/3401957372 >> 172.21.15.79:0/3401957372 conn(0x5615ea0c4300 msgr2=0x5615ea47f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.077+0000 7f3d8d861740 1 -- 172.21.15.79:0/3401957372 shutdown_connections 2024-09-21T02:39:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.077+0000 7f3d8d861740 1 -- 172.21.15.79:0/3401957372 wait complete. 2024-09-21T02:39:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.078+0000 7f3d8d861740 1 -- start start 2024-09-21T02:39:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.078+0000 7f3d8d861740 1 Processor -- start 2024-09-21T02:39:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.080+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea488270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.080+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea486b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.080+0000 7f3d8d861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4870b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.080+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea488270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea488270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46236/0 (socket says 172.21.15.79:46236) 2024-09-21T02:39:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801b1950 con 0x5615ea0d01b0 2024-09-21T02:39:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801b2dc0 con 0x5615ea0a72f0 2024-09-21T02:39:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801b2020 con 0x5615ea0af4d0 2024-09-21T02:39:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d8d861740 10 client.0 _ll_register_callbacks cb 0x7f3d78009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:39:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d7f400640 1 -- 172.21.15.79:0/4073803417 learned_addr learned my addr 172.21.15.79:0/4073803417 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:39:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.081+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea486b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.082+0000 7f3d7f400640 1 -- 172.21.15.79:0/4073803417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 msgr2=0x5615ea486b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.082+0000 7f3d7f400640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea486b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.082+0000 7f3d7f400640 1 -- 172.21.15.79:0/4073803417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 msgr2=0x5615ea4870b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:39:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.082+0000 7f3d7f400640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4870b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.082+0000 7f3d7f400640 1 -- 172.21.15.79:0/4073803417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ea4875f0 con 0x5615ea0a72f0 2024-09-21T02:39:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.082+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea486b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.082+0000 7f3d7fe00640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4870b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.083+0000 7f3d7f400640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea488270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000fc30 tx=0x7f3d7000b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa4cbcef9f04622 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.083+0000 7f3d69600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:39:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.084+0000 7f3d69600640 1 -- 172.21.15.79:0/4073803417 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700052c0 con 0x5615ea0a72f0 2024-09-21T02:39:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.084+0000 7f3d69600640 1 -- 172.21.15.79:0/4073803417 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3d70005460 con 0x5615ea0a72f0 2024-09-21T02:39:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.084+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5615ea3ec600 con 0x5615ea0a72f0 2024-09-21T02:39:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.085+0000 7f3d69600640 1 -- 172.21.15.79:0/4073803417 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3d70027430 con 0x5615ea0a72f0 2024-09-21T02:39:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.085+0000 7f3d8d861740 10 client.25784 fetch_fsmap learned FSMap version 21 2024-09-21T02:39:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.085+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5615ea4f9580 con 0x5615ea0a72f0 2024-09-21T02:39:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d69600640 1 -- 172.21.15.79:0/4073803417 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5615ea3ec600 con 0x5615ea0a72f0 2024-09-21T02:39:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d69600640 1 -- 172.21.15.79:0/4073803417 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3d70003ce0 con 0x5615ea0a72f0 2024-09-21T02:39:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d8d861740 10 client.25784 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:39:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d8d861740 10 client.25784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:39:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d8d861740 20 client.25784 populate_metadata read hostname 'smithi079' 2024-09-21T02:39:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d8d861740 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea0641c0 0x5615ea4fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d8d861740 4 client.25784 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:39:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615ea3e80b0 con 0x5615ea0641c0 2024-09-21T02:39:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.086+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea0641c0 0x5615ea4fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.087+0000 7f3d7ea00640 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea0641c0 0x5615ea4fbe40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b31287523f1b04 server_cookie=8d6825cdab75727e in_seq=0 out_seq=0 2024-09-21T02:39:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.087+0000 7f3d69600640 10 client.25784 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.116+0000 7f3d69600640 1 -- 172.21.15.79:0/4073803417 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5615ea3e80b0 con 0x5615ea0641c0 2024-09-21T02:39:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.116+0000 7f3d69600640 10 client.25784 handle_command_reply: tid=0 2024-09-21T02:39:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.116+0000 7f3d8d861740 1 client.25784 shutdown 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.116+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 msgr2=0x5615ea488270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.116+0000 7f3d8d861740 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea488270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000fc30 tx=0x7f3d7000b810 comp rx=0 tx=0).stop 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 shutdown_connections 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5615ea0641c0 0x5615ea4fbe40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615ea0d01b0 0x5615ea4870b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5615ea0af4d0 0x5615ea486b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 --2- 172.21.15.79:0/4073803417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615ea0a72f0 0x5615ea488270 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 >> 172.21.15.79:0/4073803417 conn(0x5615ea0c4300 msgr2=0x5615ea47f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d69600640 0 client.25784 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:39:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 shutdown_connections 2024-09-21T02:39:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 1 -- 172.21.15.79:0/4073803417 wait complete. 2024-09-21T02:39:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.117+0000 7f3d8d861740 20 client.25784 trim_cache size 0 max 16384 2024-09-21T02:39:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:39:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:39:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:39:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:39:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3d640b6710 msgr2=0x7f3d640b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3d640b6710 0x7f3d640b8c20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009fb0 tx=0x7f3d6c004730 comp rx=0 tx=0).stop 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010d9c0 msgr2=0x7f3d801a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010d9c0 0x7f3d801a5b20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009430 tx=0x7f3d780317c0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 shutdown_connections 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3d640b6710 0x7f3d640b8c20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d8010d9c0 0x7f3d801a5b20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d8010cdb0 0x7f3d801a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 --2- 172.21.15.79:0/3428713000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d8010a3c0 0x7f3d801a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 >> 172.21.15.79:0/3428713000 conn(0x7f3d80070810 msgr2=0x7f3d80112380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 shutdown_connections 2024-09-21T02:39:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:39:51.119+0000 7f3d86800640 1 -- 172.21.15.79:0/3428713000 wait complete. 2024-09-21T02:39:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 235.0 s, 1043.0 tps, lat 95.524 ms stddev 138.023 2024-09-21T02:39:51.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:51 smithi148 ceph-mon[34626]: pgmap v538: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 MiB/s wr, 919 op/s 2024-09-21T02:39:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:51 smithi098 ceph-mon[34832]: pgmap v538: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 MiB/s wr, 919 op/s 2024-09-21T02:39:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:51 smithi079 ceph-mon[30788]: pgmap v538: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 MiB/s wr, 919 op/s 2024-09-21T02:39:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:53 smithi148 ceph-mon[34626]: pgmap v539: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 951 op/s 2024-09-21T02:39:53.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:53 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:53 smithi098 ceph-mon[34832]: pgmap v539: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 951 op/s 2024-09-21T02:39:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:53 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:53.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:53 smithi079 ceph-mon[30788]: pgmap v539: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 951 op/s 2024-09-21T02:39:53.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:53 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:55 smithi148 ceph-mon[34626]: pgmap v540: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 967 op/s 2024-09-21T02:39:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:55 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:39:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:55 smithi098 ceph-mon[34832]: pgmap v540: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 967 op/s 2024-09-21T02:39:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:55 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:39:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:55 smithi079 ceph-mon[30788]: pgmap v540: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 967 op/s 2024-09-21T02:39:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:55 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:39:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 240.0 s, 1191.8 tps, lat 84.036 ms stddev 103.325 2024-09-21T02:39:57.812 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:57 smithi148 ceph-mon[34626]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 867 op/s 2024-09-21T02:39:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:57 smithi098 ceph-mon[34832]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 867 op/s 2024-09-21T02:39:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:57 smithi079 ceph-mon[30788]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 867 op/s 2024-09-21T02:39:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:39:59 smithi148 ceph-mon[34626]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.4 MiB/s wr, 565 op/s 2024-09-21T02:39:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:39:59 smithi098 ceph-mon[34832]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.4 MiB/s wr, 565 op/s 2024-09-21T02:39:59.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:39:59 smithi079 ceph-mon[30788]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.4 MiB/s wr, 565 op/s 2024-09-21T02:40:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:00 smithi148 ceph-mon[34626]: overall HEALTH_OK 2024-09-21T02:40:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:00 smithi098 ceph-mon[34832]: overall HEALTH_OK 2024-09-21T02:40:00.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:00 smithi079 ceph-mon[30788]: overall HEALTH_OK 2024-09-21T02:40:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 245.0 s, 1238.2 tps, lat 81.202 ms stddev 97.046 2024-09-21T02:40:01.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:01 smithi148 ceph-mon[34626]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.6 MiB/s wr, 600 op/s 2024-09-21T02:40:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:01 smithi098 ceph-mon[34832]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.6 MiB/s wr, 600 op/s 2024-09-21T02:40:01.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:01 smithi079 ceph-mon[30788]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.6 MiB/s wr, 600 op/s 2024-09-21T02:40:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:03 smithi148 ceph-mon[34626]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.8 MiB/s wr, 644 op/s 2024-09-21T02:40:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:03 smithi098 ceph-mon[34832]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.8 MiB/s wr, 644 op/s 2024-09-21T02:40:03.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:03 smithi079 ceph-mon[30788]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.8 MiB/s wr, 644 op/s 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 -- 172.21.15.79:0/1854498802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b8104720 msgr2=0x7fe3b8104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 --2- 172.21.15.79:0/1854498802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b8104720 0x7fe3b8104b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009900 tx=0x7fe3a402a400 comp rx=0 tx=0).stop 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 -- 172.21.15.79:0/1854498802 shutdown_connections 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 --2- 172.21.15.79:0/1854498802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81050c0 0x7fe3b810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 --2- 172.21.15.79:0/1854498802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b8104720 0x7fe3b8104b30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 --2- 172.21.15.79:0/1854498802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b81036a0 0x7fe3b8103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 -- 172.21.15.79:0/1854498802 >> 172.21.15.79:0/1854498802 conn(0x7fe3b80fefe0 msgr2=0x7fe3b8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 -- 172.21.15.79:0/1854498802 shutdown_connections 2024-09-21T02:40:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.424+0000 7fe3c0000640 1 -- 172.21.15.79:0/1854498802 wait complete. 2024-09-21T02:40:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.425+0000 7fe3c0000640 1 Processor -- start 2024-09-21T02:40:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3c0000640 1 -- start start 2024-09-21T02:40:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3c0000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81036a0 0x7fe3b8105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3c0000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b8104720 0x7fe3b8106440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3c0000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b81050c0 0x7fe3b8106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3c0000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b810f320 con 0x7fe3b8104720 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3c0000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b810f1a0 con 0x7fe3b81036a0 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3c0000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b810f4a0 con 0x7fe3b81050c0 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3bd600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81036a0 0x7fe3b8105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3bd600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81036a0 0x7fe3b8105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52268/0 (socket says 172.21.15.79:52268) 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3bd600640 1 -- 172.21.15.79:0/3186553460 learned_addr learned my addr 172.21.15.79:0/3186553460 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b8104720 0x7fe3b8106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.426+0000 7fe3be000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b81050c0 0x7fe3b8106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3bd600640 1 -- 172.21.15.79:0/3186553460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b81050c0 msgr2=0x7fe3b8106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3bd600640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b81050c0 0x7fe3b8106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3bd600640 1 -- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b8104720 msgr2=0x7fe3b8106440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3bd600640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b8104720 0x7fe3b8106440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3bd600640 1 -- 172.21.15.79:0/3186553460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b8107780 con 0x7fe3b81036a0 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3be000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b81050c0 0x7fe3b8106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3bd600640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81036a0 0x7fe3b8105dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c920 tx=0x7fe3ac00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.427+0000 7fe3b6000640 1 -- 172.21.15.79:0/3186553460 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac007c70 con 0x7fe3b81036a0 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.428+0000 7fe3b6000640 1 -- 172.21.15.79:0/3186553460 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3ac007e10 con 0x7fe3b81036a0 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.428+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b8107a70 con 0x7fe3b81036a0 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.428+0000 7fe3b6000640 1 -- 172.21.15.79:0/3186553460 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac018820 con 0x7fe3b81036a0 2024-09-21T02:40:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.428+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b81081c0 con 0x7fe3b81036a0 2024-09-21T02:40:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3b6000640 1 -- 172.21.15.79:0/3186553460 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe3ac00f450 con 0x7fe3b81036a0 2024-09-21T02:40:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 Processor -- start 2024-09-21T02:40:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 -- start start 2024-09-21T02:40:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e2a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e2b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555cf7d9d6b0 con 0x555cf7a5a2f0 2024-09-21T02:40:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555cf7d8cae0 con 0x555cf7a831b0 2024-09-21T02:40:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.433+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555cf7d908f0 con 0x555cf7a624d0 2024-09-21T02:40:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.434+0000 7fe3be000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e2a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.434+0000 7fe3bd600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.434+0000 7fe3be000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e2a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52284/0 (socket says 172.21.15.79:52284) 2024-09-21T02:40:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.434+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e2b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.434+0000 7fe3be000640 1 -- 172.21.15.79:0/1747103836 learned_addr learned my addr 172.21.15.79:0/1747103836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3bcc00640 1 -- 172.21.15.79:0/1747103836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 msgr2=0x555cf7e2a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e2a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3bcc00640 1 -- 172.21.15.79:0/1747103836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 msgr2=0x555cf7e2a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3bcc00640 1 -- 172.21.15.79:0/1747103836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf7d59780 con 0x555cf7a624d0 2024-09-21T02:40:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3be000640 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e2a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e2b290 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe3a402a9f0 tx=0x7fe3a40043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79178c9b0dc3ba42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.435+0000 7fe3b6000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe3a00b6590 0x7fe3a00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.436+0000 7fe3b6000640 1 -- 172.21.15.79:0/3186553460 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe3ac0e76d0 con 0x7fe3b81036a0 2024-09-21T02:40:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.436+0000 7fe3aa600640 1 -- 172.21.15.79:0/1747103836 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4035030 con 0x555cf7a624d0 2024-09-21T02:40:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.436+0000 7fe3aa600640 1 -- 172.21.15.79:0/1747103836 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a4040070 con 0x555cf7a624d0 2024-09-21T02:40:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.436+0000 7fe3aa600640 1 -- 172.21.15.79:0/1747103836 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4031be0 con 0x555cf7a624d0 2024-09-21T02:40:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.436+0000 7fe3be000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe3a00b6590 0x7fe3a00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.445+0000 7fe3c70c3740 1 -- 172.21.15.79:0/1747103836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 msgr2=0x555cf7e2b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.445+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e2b290 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe3a402a9f0 tx=0x7fe3a40043d0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.442+0000 7fe3be000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe3a00b6590 0x7fe3a00b8aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005fd0 tx=0x7fe3b000a4d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.445+0000 7fe3c70c3740 1 -- 172.21.15.79:0/1747103836 shutdown_connections 2024-09-21T02:40:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.445+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e2b290 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.445+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.445+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/1747103836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e2a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.446+0000 7fe3c70c3740 1 -- 172.21.15.79:0/1747103836 >> 172.21.15.79:0/1747103836 conn(0x555cf7a77300 msgr2=0x555cf7e25b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.447+0000 7fe3c70c3740 1 -- 172.21.15.79:0/1747103836 shutdown_connections 2024-09-21T02:40:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.447+0000 7fe3c70c3740 1 -- 172.21.15.79:0/1747103836 wait complete. 2024-09-21T02:40:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.448+0000 7fe3c70c3740 1 -- start start 2024-09-21T02:40:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.448+0000 7fe3c70c3740 1 Processor -- start 2024-09-21T02:40:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.449+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a5a2f0 0x555cf7e33720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.449+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a624d0 0x555cf7e33de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.449+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e34950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.449+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555cf7cc4ab0 con 0x555cf7a624d0 2024-09-21T02:40:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.449+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555cf7d33570 con 0x555cf7a831b0 2024-09-21T02:40:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.449+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555cf7e2bd50 con 0x555cf7a5a2f0 2024-09-21T02:40:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.449+0000 7fe3c70c3740 10 client.0 _ll_register_callbacks cb 0x555cf7d42100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.450+0000 7fe3bcc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a624d0 0x555cf7e33de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.450+0000 7fe3be000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e34950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.450+0000 7fe3bcc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a624d0 0x555cf7e33de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37844/0 (socket says 172.21.15.79:37844) 2024-09-21T02:40:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.451+0000 7fe3bcc00640 1 -- 172.21.15.79:0/2905341949 learned_addr learned my addr 172.21.15.79:0/2905341949 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.451+0000 7fe3be000640 1 -- 172.21.15.79:0/2905341949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a5a2f0 msgr2=0x555cf7e33720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.451+0000 7fe3be000640 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a5a2f0 0x555cf7e33720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.451+0000 7fe3be000640 1 -- 172.21.15.79:0/2905341949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a624d0 msgr2=0x555cf7e33de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.451+0000 7fe3be000640 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a624d0 0x555cf7e33de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.451+0000 7fe3be000640 1 -- 172.21.15.79:0/2905341949 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf7aee790 con 0x555cf7a831b0 2024-09-21T02:40:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.454+0000 7fe3be000640 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e34950 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005f60 tx=0x7fe3b0004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d56c9707c2b02bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.454+0000 7fe39ea00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:40:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.455+0000 7fe39ea00640 1 -- 172.21.15.79:0/2905341949 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b002b060 con 0x555cf7a831b0 2024-09-21T02:40:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.455+0000 7fe39ea00640 1 -- 172.21.15.79:0/2905341949 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe3b0016030 con 0x555cf7a831b0 2024-09-21T02:40:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.455+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3a4040070 con 0x555cf7a831b0 2024-09-21T02:40:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.457+0000 7fe39ea00640 1 -- 172.21.15.79:0/2905341949 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe3b001b610 con 0x555cf7a831b0 2024-09-21T02:40:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.458+0000 7fe3c70c3740 10 client.25793 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.458+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555cf7b67620 con 0x555cf7a831b0 2024-09-21T02:40:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.459+0000 7fe39ea00640 1 -- 172.21.15.79:0/2905341949 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a4040070 con 0x555cf7a831b0 2024-09-21T02:40:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.459+0000 7fe39ea00640 1 -- 172.21.15.79:0/2905341949 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe3b0026920 con 0x555cf7a831b0 2024-09-21T02:40:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.462+0000 7fe3c70c3740 10 client.25793 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.462+0000 7fe3c70c3740 10 client.25793 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.462+0000 7fe3c70c3740 20 client.25793 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.462+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7a41d80 0x555cf7e40ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.462+0000 7fe3c70c3740 4 client.25793 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.462+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cf7d9f600 con 0x555cf7a41d80 2024-09-21T02:40:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.463+0000 7fe3bd600640 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7a41d80 0x555cf7e40ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.465+0000 7fe3bd600640 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7a41d80 0x555cf7e40ee0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e869dd015ab525d2 server_cookie=ce42dbcbd5d05108 in_seq=0 out_seq=0 2024-09-21T02:40:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.466+0000 7fe39ea00640 10 client.25793 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.468+0000 7fe39ea00640 1 -- 172.21.15.79:0/2905341949 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cf7d9f600 con 0x555cf7a41d80 2024-09-21T02:40:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.468+0000 7fe39ea00640 10 client.25793 handle_command_reply: tid=0 2024-09-21T02:40:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.469+0000 7fe3c70c3740 1 client.25793 shutdown 2024-09-21T02:40:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 msgr2=0x555cf7e34950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e34950 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005f60 tx=0x7fe3b0004ab0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 shutdown_connections 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7a41d80 0x555cf7e40ee0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e34950 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a624d0 0x555cf7e33de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2905341949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a5a2f0 0x555cf7e33720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 >> 172.21.15.79:0/2905341949 conn(0x555cf7a77300 msgr2=0x555cf7e240e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.470+0000 7fe39ea00640 0 client.25793 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.471+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 shutdown_connections 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.471+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2905341949 wait complete. 2024-09-21T02:40:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.471+0000 7fe3c70c3740 20 client.25793 trim_cache size 0 max 16384 2024-09-21T02:40:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.508+0000 7fe3c70c3740 1 Processor -- start 2024-09-21T02:40:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.508+0000 7fe3c70c3740 1 -- start start 2024-09-21T02:40:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.509+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.509+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e3b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.509+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a831b0 0x555cf7e240e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.509+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81b0c80 con 0x555cf7a831b0 2024-09-21T02:40:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.509+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81b3500 con 0x555cf7a5a2f0 2024-09-21T02:40:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.509+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81b12f0 con 0x555cf7a624d0 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.509+0000 7fe3bcc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e3b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bcc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e3b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38020/0 (socket says 172.21.15.79:38020) 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bcc00640 1 -- 172.21.15.79:0/2516106829 learned_addr learned my addr 172.21.15.79:0/2516106829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bd600640 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3be000640 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a831b0 0x555cf7e240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bcc00640 1 -- 172.21.15.79:0/2516106829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a5a2f0 msgr2=0x555cf7e2a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bcc00640 1 -- 172.21.15.79:0/2516106829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a831b0 msgr2=0x555cf7e240e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a831b0 0x555cf7e240e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.510+0000 7fe3bcc00640 1 -- 172.21.15.79:0/2516106829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf7a41fb0 con 0x555cf7a624d0 2024-09-21T02:40:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.512+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e3b830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40099f0 tx=0x7fe3a4004350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af265c03422f661 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.512+0000 7fe3a9c00640 1 -- 172.21.15.79:0/2516106829 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4054070 con 0x555cf7a624d0 2024-09-21T02:40:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.513+0000 7fe3a9c00640 1 -- 172.21.15.79:0/2516106829 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a4040030 con 0x555cf7a624d0 2024-09-21T02:40:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.513+0000 7fe3a9c00640 1 -- 172.21.15.79:0/2516106829 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4035040 con 0x555cf7a624d0 2024-09-21T02:40:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.514+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2516106829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 msgr2=0x555cf7e3b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.514+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e3b830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40099f0 tx=0x7fe3a4004350 comp rx=0 tx=0).stop 2024-09-21T02:40:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.514+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2516106829 shutdown_connections 2024-09-21T02:40:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.514+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a831b0 0x555cf7e240e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.515+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a624d0 0x555cf7e3b830 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40099f0 tx=0x7fe3a4004350 comp rx=0 tx=0).stop 2024-09-21T02:40:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.515+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/2516106829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a5a2f0 0x555cf7e2a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.515+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2516106829 >> 172.21.15.79:0/2516106829 conn(0x555cf7a77300 msgr2=0x555cf7e29cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.515+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2516106829 shutdown_connections 2024-09-21T02:40:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.515+0000 7fe3c70c3740 1 -- 172.21.15.79:0/2516106829 wait complete. 2024-09-21T02:40:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.516+0000 7fe3c70c3740 1 -- start start 2024-09-21T02:40:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.516+0000 7fe3c70c3740 1 Processor -- start 2024-09-21T02:40:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e3a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e3ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3c70c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a171c0 0x555cf7e3b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81b19c0 con 0x555cf7a5a2f0 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81b2e30 con 0x555cf7a831b0 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3c70c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81b2090 con 0x555cf7a171c0 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3c70c3740 10 client.0 _ll_register_callbacks cb 0x7fe3b000adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3bd600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e3a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3bd600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e3a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37860/0 (socket says 172.21.15.79:37860) 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3bd600640 1 -- 172.21.15.79:0/3997502032 learned_addr learned my addr 172.21.15.79:0/3997502032 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.517+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e3ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.518+0000 7fe3be000640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a171c0 0x555cf7e3b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.518+0000 7fe3bcc00640 1 -- 172.21.15.79:0/3997502032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a171c0 msgr2=0x555cf7e3b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.518+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a171c0 0x555cf7e3b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.518+0000 7fe3bcc00640 1 -- 172.21.15.79:0/3997502032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 msgr2=0x555cf7e3a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.518+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e3a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.518+0000 7fe3bcc00640 1 -- 172.21.15.79:0/3997502032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf7e39300 con 0x555cf7a831b0 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.518+0000 7fe3bd600640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e3a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.519+0000 7fe3bcc00640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e3ab10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x555cf7e34120 tx=0x7fe3a4032cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b5ac5a65b99177 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.519+0000 7fe39ea00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:40:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.519+0000 7fe39ea00640 1 -- 172.21.15.79:0/3997502032 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a405d060 con 0x555cf7a831b0 2024-09-21T02:40:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.519+0000 7fe39ea00640 1 -- 172.21.15.79:0/3997502032 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe3a40035f0 con 0x555cf7a831b0 2024-09-21T02:40:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.520+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3a4040030 con 0x555cf7a831b0 2024-09-21T02:40:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.520+0000 7fe39ea00640 1 -- 172.21.15.79:0/3997502032 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe3a4054040 con 0x555cf7a831b0 2024-09-21T02:40:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.522+0000 7fe3c70c3740 10 client.25796 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.522+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555cf7eabc70 con 0x555cf7a831b0 2024-09-21T02:40:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.523+0000 7fe39ea00640 1 -- 172.21.15.79:0/3997502032 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a4040030 con 0x555cf7a831b0 2024-09-21T02:40:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.523+0000 7fe39ea00640 1 -- 172.21.15.79:0/3997502032 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe3a4057070 con 0x555cf7a831b0 2024-09-21T02:40:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.524+0000 7fe3c70c3740 10 client.25796 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.524+0000 7fe3c70c3740 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.524+0000 7fe3c70c3740 20 client.25796 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.524+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7eac050 0x555cf7eae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.524+0000 7fe3c70c3740 4 client.25796 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:40:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.524+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cf7e2b6a0 con 0x555cf7eac050 2024-09-21T02:40:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.524+0000 7fe3bd600640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7eac050 0x555cf7eae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.526+0000 7fe39ea00640 10 client.25796 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.527+0000 7fe3bd600640 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7eac050 0x555cf7eae470 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=556606fbe512570a server_cookie=8dfaa9324f0c1d47 in_seq=0 out_seq=0 2024-09-21T02:40:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.540+0000 7fe39ea00640 1 -- 172.21.15.79:0/3997502032 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cf7e2b6a0 con 0x555cf7eac050 2024-09-21T02:40:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.540+0000 7fe39ea00640 10 client.25796 handle_command_reply: tid=0 2024-09-21T02:40:04.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.541+0000 7fe3c70c3740 1 client.25796 shutdown 2024-09-21T02:40:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 msgr2=0x555cf7e3ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e3ab10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x555cf7e34120 tx=0x7fe3a4032cb0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 shutdown_connections 2024-09-21T02:40:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555cf7eac050 0x555cf7eae470 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555cf7a171c0 0x555cf7e3b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cf7a831b0 0x555cf7e3ab10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 --2- 172.21.15.79:0/3997502032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555cf7a5a2f0 0x555cf7e3a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 >> 172.21.15.79:0/3997502032 conn(0x555cf7a77300 msgr2=0x555cf7e29cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.542+0000 7fe39ea00640 0 client.25796 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.544+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 shutdown_connections 2024-09-21T02:40:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.544+0000 7fe3c70c3740 1 -- 172.21.15.79:0/3997502032 wait complete. 2024-09-21T02:40:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.544+0000 7fe3c70c3740 20 client.25796 trim_cache size 0 max 16384 2024-09-21T02:40:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:40:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:40:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:40:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:40:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe3a00b6590 msgr2=0x7fe3a00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe3a00b6590 0x7fe3a00b8aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005fd0 tx=0x7fe3b000a4d0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81036a0 msgr2=0x7fe3b8105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81036a0 0x7fe3b8105dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c920 tx=0x7fe3ac00cde0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 shutdown_connections 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe3a00b6590 0x7fe3a00b8aa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b81050c0 0x7fe3b8106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b8104720 0x7fe3b8106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 --2- 172.21.15.79:0/3186553460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3b81036a0 0x7fe3b8105dd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 >> 172.21.15.79:0/3186553460 conn(0x7fe3b80fefe0 msgr2=0x7fe3b8101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 shutdown_connections 2024-09-21T02:40:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:04.547+0000 7fe3c0000640 1 -- 172.21.15.79:0/3186553460 wait complete. 2024-09-21T02:40:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:05 smithi148 ceph-mon[34626]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.5 MiB/s wr, 599 op/s 2024-09-21T02:40:05.847 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:05 smithi098 ceph-mon[34832]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.5 MiB/s wr, 599 op/s 2024-09-21T02:40:05.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:05 smithi079 ceph-mon[30788]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.5 MiB/s wr, 599 op/s 2024-09-21T02:40:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 250.0 s, 958.8 tps, lat 104.088 ms stddev 113.567 2024-09-21T02:40:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:07 smithi148 ceph-mon[34626]: pgmap v546: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-09-21T02:40:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:07 smithi098 ceph-mon[34832]: pgmap v546: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-09-21T02:40:07.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:07 smithi079 ceph-mon[30788]: pgmap v546: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-09-21T02:40:08.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:08 smithi098 ceph-mon[34832]: pgmap v547: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4.8 MiB/s wr, 513 op/s 2024-09-21T02:40:08.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:08 smithi079 ceph-mon[30788]: pgmap v547: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4.8 MiB/s wr, 513 op/s 2024-09-21T02:40:09.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:08 smithi148 ceph-mon[34626]: pgmap v547: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4.8 MiB/s wr, 513 op/s 2024-09-21T02:40:10.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:10 smithi098 ceph-mon[34832]: pgmap v548: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-09-21T02:40:10.982 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:10 smithi079 ceph-mon[30788]: pgmap v548: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-09-21T02:40:11.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:10 smithi148 ceph-mon[34626]: pgmap v548: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-09-21T02:40:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 255.0 s, 924.8 tps, lat 108.198 ms stddev 141.621 2024-09-21T02:40:12.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:12 smithi098 ceph-mon[34832]: pgmap v549: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.1 MiB/s wr, 662 op/s 2024-09-21T02:40:12.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:12 smithi079 ceph-mon[30788]: pgmap v549: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.1 MiB/s wr, 662 op/s 2024-09-21T02:40:13.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:12 smithi148 ceph-mon[34626]: pgmap v549: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.1 MiB/s wr, 662 op/s 2024-09-21T02:40:14.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:14 smithi098 ceph-mon[34832]: pgmap v550: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.9 MiB/s wr, 638 op/s 2024-09-21T02:40:14.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:14 smithi079 ceph-mon[30788]: pgmap v550: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.9 MiB/s wr, 638 op/s 2024-09-21T02:40:15.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:14 smithi148 ceph-mon[34626]: pgmap v550: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.9 MiB/s wr, 638 op/s 2024-09-21T02:40:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 260.0 s, 1345.4 tps, lat 74.218 ms stddev 82.362 2024-09-21T02:40:16.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:16 smithi079 ceph-mon[30788]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-21T02:40:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:16 smithi148 ceph-mon[34626]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-21T02:40:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:16 smithi098 ceph-mon[34832]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.0 MiB/s wr, 648 op/s 2024-09-21T02:40:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.843+0000 7f7d9de00640 1 -- 172.21.15.79:0/3672295897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d98109ce0 msgr2=0x7f7d9810a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.843+0000 7f7d9de00640 1 --2- 172.21.15.79:0/3672295897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d98109ce0 0x7f7d9810a150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009900 tx=0x7f7d8802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.843+0000 7f7d9de00640 1 -- 172.21.15.79:0/3672295897 shutdown_connections 2024-09-21T02:40:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.843+0000 7f7d9de00640 1 --2- 172.21.15.79:0/3672295897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9810b700 0x7f7d981120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.843+0000 7f7d9de00640 1 --2- 172.21.15.79:0/3672295897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 0x7f7d9810b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.843+0000 7f7d9de00640 1 --2- 172.21.15.79:0/3672295897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d98109ce0 0x7f7d9810a150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.843+0000 7f7d9de00640 1 -- 172.21.15.79:0/3672295897 >> 172.21.15.79:0/3672295897 conn(0x7f7d98079060 msgr2=0x7f7d9807b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.845+0000 7f7d9de00640 1 -- 172.21.15.79:0/3672295897 shutdown_connections 2024-09-21T02:40:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.845+0000 7f7d9de00640 1 -- 172.21.15.79:0/3672295897 wait complete. 2024-09-21T02:40:17.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 Processor -- start 2024-09-21T02:40:17.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 -- start start 2024-09-21T02:40:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d98109ce0 0x7f7d981a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 0x7f7d981a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d9810b700 0x7f7d981a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981159d0 con 0x7f7d98109ce0 2024-09-21T02:40:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d98115850 con 0x7f7d9810b700 2024-09-21T02:40:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.846+0000 7f7d9de00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d98115b50 con 0x7f7d9810ad60 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 0x7f7d981a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 0x7f7d981a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42946/0 (socket says 172.21.15.79:42946) 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 -- 172.21.15.79:0/4159617659 learned_addr learned my addr 172.21.15.79:0/4159617659 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96a00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d98109ce0 0x7f7d981a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d97400640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d9810b700 0x7f7d981a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 -- 172.21.15.79:0/4159617659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d9810b700 msgr2=0x7f7d981a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d9810b700 0x7f7d981a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 -- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d98109ce0 msgr2=0x7f7d981a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d98109ce0 0x7f7d981a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.847+0000 7f7d96000640 1 -- 172.21.15.79:0/4159617659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d981a1fd0 con 0x7f7d9810ad60 2024-09-21T02:40:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.849+0000 7f7d96000640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 0x7f7d981a0c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400b4a0 tx=0x7f7d8400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.850+0000 7f7d9ca00640 1 -- 172.21.15.79:0/4159617659 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84014070 con 0x7f7d9810ad60 2024-09-21T02:40:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.850+0000 7f7d9ca00640 1 -- 172.21.15.79:0/4159617659 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d84010ac0 con 0x7f7d9810ad60 2024-09-21T02:40:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.850+0000 7f7d9ca00640 1 -- 172.21.15.79:0/4159617659 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84017c30 con 0x7f7d9810ad60 2024-09-21T02:40:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.850+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d981a22c0 con 0x7f7d9810ad60 2024-09-21T02:40:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.850+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d981a89b0 con 0x7f7d9810ad60 2024-09-21T02:40:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 Processor -- start 2024-09-21T02:40:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 -- start start 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c32976a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32976a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c32976b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3296dd6b0 con 0x55c3293a24d0 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c3296ccae0 con 0x55c3293c31b0 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.857+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c3296d08f0 con 0x55c32939a2f0 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d96a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32976a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c32976a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d96a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32976a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42960/0 (socket says 172.21.15.79:42960) 2024-09-21T02:40:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c32976a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55630/0 (socket says 172.21.15.79:55630) 2024-09-21T02:40:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d96a00640 1 -- 172.21.15.79:0/3511358968 learned_addr learned my addr 172.21.15.79:0/3511358968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 -- 172.21.15.79:0/3511358968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 msgr2=0x55c32976a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 --2- 172.21.15.79:0/3511358968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32976a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 -- 172.21.15.79:0/3511358968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 msgr2=0x55c32976b290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 --2- 172.21.15.79:0/3511358968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c32976b290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 -- 172.21.15.79:0/3511358968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c329699780 con 0x55c3293c31b0 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.858+0000 7f7d97400640 1 --2- 172.21.15.79:0/3511358968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c32976a0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009f30 tx=0x7f7d90010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7ad06b2029bbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.859+0000 7f7d83e00640 1 -- 172.21.15.79:0/3511358968 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90016070 con 0x55c3293c31b0 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.859+0000 7f7d83e00640 1 -- 172.21.15.79:0/3511358968 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d90004d20 con 0x55c3293c31b0 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.859+0000 7f7d83e00640 1 -- 172.21.15.79:0/3511358968 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90012780 con 0x55c3293c31b0 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.859+0000 7f7d9ca00640 1 -- 172.21.15.79:0/4159617659 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7d84017070 con 0x7f7d9810ad60 2024-09-21T02:40:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.860+0000 7f7da4fe4740 1 -- 172.21.15.79:0/3511358968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 msgr2=0x55c32976a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.860+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/3511358968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c32976a0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009f30 tx=0x7f7d90010800 comp rx=0 tx=0).stop 2024-09-21T02:40:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.861+0000 7f7da4fe4740 1 -- 172.21.15.79:0/3511358968 shutdown_connections 2024-09-21T02:40:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.861+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/3511358968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c32976b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.861+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/3511358968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32976a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.861+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/3511358968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c32976a0d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.861+0000 7f7da4fe4740 1 -- 172.21.15.79:0/3511358968 >> 172.21.15.79:0/3511358968 conn(0x55c3293b7300 msgr2=0x55c329765b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.861+0000 7f7da4fe4740 1 -- 172.21.15.79:0/3511358968 shutdown_connections 2024-09-21T02:40:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.861+0000 7f7da4fe4740 1 -- 172.21.15.79:0/3511358968 wait complete. 2024-09-21T02:40:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.862+0000 7f7da4fe4740 1 -- start start 2024-09-21T02:40:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.862+0000 7f7d9ca00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d7c0b64a0 0x7f7d7c0b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.863+0000 7f7d9ca00640 1 -- 172.21.15.79:0/4159617659 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7d840e6b70 con 0x7f7d9810ad60 2024-09-21T02:40:17.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.863+0000 7f7d97400640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d7c0b64a0 0x7f7d7c0b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.863+0000 7f7da4fe4740 1 Processor -- start 2024-09-21T02:40:17.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.864+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c3297737d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.864+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c329773e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.864+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c329774a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.864+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c329604ab0 con 0x55c3293a24d0 2024-09-21T02:40:17.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.864+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c329673570 con 0x55c3293c31b0 2024-09-21T02:40:17.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.864+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c32976bdb0 con 0x55c32939a2f0 2024-09-21T02:40:17.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.864+0000 7f7da4fe4740 10 client.0 _ll_register_callbacks cb 0x55c329682100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:17.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.865+0000 7f7d96a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c3297737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.865+0000 7f7d96a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c3297737d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42972/0 (socket says 172.21.15.79:42972) 2024-09-21T02:40:17.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.865+0000 7f7d96a00640 1 -- 172.21.15.79:0/2198979315 learned_addr learned my addr 172.21.15.79:0/2198979315 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.865+0000 7f7d96a00640 1 -- 172.21.15.79:0/2198979315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 msgr2=0x55c329774a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:40:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.865+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c329774a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.865+0000 7f7d96000640 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c329773e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.865+0000 7f7d96a00640 1 -- 172.21.15.79:0/2198979315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 msgr2=0x55c329773e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.866+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c329773e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.866+0000 7f7d96a00640 1 -- 172.21.15.79:0/2198979315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c32942e790 con 0x55c32939a2f0 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.866+0000 7f7d96000640 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c329773e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.866+0000 7f7d97400640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d7c0b64a0 0x7f7d7c0b89b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d90006010 tx=0x7f7d90010fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.866+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c3297737d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d8802a9e0 tx=0x7f7d880035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e06ac0d5ff8cf831 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.866+0000 7f7d80c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.867+0000 7f7d80c00640 1 -- 172.21.15.79:0/2198979315 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88035040 con 0x55c32939a2f0 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.867+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d90004d20 con 0x55c32939a2f0 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.867+0000 7f7d80c00640 1 -- 172.21.15.79:0/2198979315 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7d88003cb0 con 0x55c32939a2f0 2024-09-21T02:40:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.867+0000 7f7d80c00640 1 -- 172.21.15.79:0/2198979315 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7d8804e050 con 0x55c32939a2f0 2024-09-21T02:40:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.867+0000 7f7da4fe4740 10 client.25816 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.867+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3294a7620 con 0x55c32939a2f0 2024-09-21T02:40:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.868+0000 7f7d80c00640 1 -- 172.21.15.79:0/2198979315 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d90004d20 con 0x55c32939a2f0 2024-09-21T02:40:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.868+0000 7f7d80c00640 1 -- 172.21.15.79:0/2198979315 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7d8803c660 con 0x55c32939a2f0 2024-09-21T02:40:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.868+0000 7f7da4fe4740 10 client.25816 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.868+0000 7f7da4fe4740 10 client.25816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.869+0000 7f7da4fe4740 20 client.25816 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.869+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c329381d80 0x55c329791f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.869+0000 7f7da4fe4740 4 client.25816 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.869+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3296df600 con 0x55c329381d80 2024-09-21T02:40:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.869+0000 7f7d96000640 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c329381d80 0x55c329791f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.870+0000 7f7d96000640 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c329381d80 0x55c329791f50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dddaeb5927c02e6 server_cookie=640b71c3c6879be0 in_seq=0 out_seq=0 2024-09-21T02:40:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.870+0000 7f7d80c00640 10 client.25816 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7d80c00640 1 -- 172.21.15.79:0/2198979315 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3296df600 con 0x55c329381d80 2024-09-21T02:40:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7d80c00640 10 client.25816 handle_command_reply: tid=0 2024-09-21T02:40:17.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 client.25816 shutdown 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 msgr2=0x55c3297737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c3297737d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d8802a9e0 tx=0x7f7d880035f0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 shutdown_connections 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c329381d80 0x55c329791f50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7d80c00640 0 client.25816 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293c31b0 0x55c329774a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c329773e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2198979315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c3297737d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 >> 172.21.15.79:0/2198979315 conn(0x55c3293b7300 msgr2=0x55c3297640e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 shutdown_connections 2024-09-21T02:40:17.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.871+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2198979315 wait complete. 2024-09-21T02:40:17.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.872+0000 7f7da4fe4740 20 client.25816 trim_cache size 0 max 16384 2024-09-21T02:40:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.903+0000 7f7da4fe4740 1 Processor -- start 2024-09-21T02:40:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.904+0000 7f7da4fe4740 1 -- start start 2024-09-21T02:40:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.904+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c32939a2f0 0x55c329771d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.904+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c3297722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.904+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c3293c31b0 0x55c329764850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.904+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d98075040 con 0x55c3293a24d0 2024-09-21T02:40:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.904+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981aaec0 con 0x55c32939a2f0 2024-09-21T02:40:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.904+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981a8cb0 con 0x55c3293c31b0 2024-09-21T02:40:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.905+0000 7f7d96000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c3297722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.905+0000 7f7d96000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c3297722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36032/0 (socket says 172.21.15.79:36032) 2024-09-21T02:40:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.905+0000 7f7d96000640 1 -- 172.21.15.79:0/2694523414 learned_addr learned my addr 172.21.15.79:0/2694523414 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.905+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c32939a2f0 0x55c329771d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.910+0000 7f7d96a00640 1 -- 172.21.15.79:0/2694523414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c3293c31b0 msgr2=0x55c329764850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:17.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.910+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c3293c31b0 0x55c329764850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.910+0000 7f7d96a00640 1 -- 172.21.15.79:0/2694523414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 msgr2=0x55c3297722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:17.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.910+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c3297722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.910+0000 7f7d96a00640 1 -- 172.21.15.79:0/2694523414 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c329774d70 con 0x55c32939a2f0 2024-09-21T02:40:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.914+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c32939a2f0 0x55c329771d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d8803cc20 tx=0x7f7d8802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465db5f64b34c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.914+0000 7f7d83400640 1 -- 172.21.15.79:0/2694523414 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88035070 con 0x55c32939a2f0 2024-09-21T02:40:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.915+0000 7f7d83400640 1 -- 172.21.15.79:0/2694523414 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d880315a0 con 0x55c32939a2f0 2024-09-21T02:40:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.915+0000 7f7d83400640 1 -- 172.21.15.79:0/2694523414 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8803b790 con 0x55c32939a2f0 2024-09-21T02:40:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.916+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2694523414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c32939a2f0 msgr2=0x55c329771d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.916+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c32939a2f0 0x55c329771d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d8803cc20 tx=0x7f7d8802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.919+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2694523414 shutdown_connections 2024-09-21T02:40:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.919+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c3293c31b0 0x55c329764850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.920+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293a24d0 0x55c3297722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.920+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2694523414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c32939a2f0 0x55c329771d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.920+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2694523414 >> 172.21.15.79:0/2694523414 conn(0x55c3293b7300 msgr2=0x55c329769cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.920+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2694523414 shutdown_connections 2024-09-21T02:40:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.920+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2694523414 wait complete. 2024-09-21T02:40:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.921+0000 7f7da4fe4740 1 -- start start 2024-09-21T02:40:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.921+0000 7f7da4fe4740 1 Processor -- start 2024-09-21T02:40:17.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.922+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32977a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.922+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293a24d0 0x55c32977a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7da4fe4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293c31b0 0x55c329778ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7d96000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293a24d0 0x55c32977a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7d96000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293a24d0 0x55c32977a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:55644/0 (socket says 172.21.15.79:55644) 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7d97400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293c31b0 0x55c329778ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7d96a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32977a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981a9380 con 0x55c3293c31b0 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981aa7f0 con 0x55c3293a24d0 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7da4fe4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981a9a50 con 0x55c32939a2f0 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7d96a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32977a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42988/0 (socket says 172.21.15.79:42988) 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.923+0000 7f7d96a00640 1 -- 172.21.15.79:0/2953025430 learned_addr learned my addr 172.21.15.79:0/2953025430 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.924+0000 7f7da4fe4740 10 client.0 _ll_register_callbacks cb 0x7f7d88004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.924+0000 7f7d96a00640 1 -- 172.21.15.79:0/2953025430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293a24d0 msgr2=0x55c32977a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.924+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293a24d0 0x55c32977a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.924+0000 7f7d96a00640 1 -- 172.21.15.79:0/2953025430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293c31b0 msgr2=0x55c329778ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.924+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293c31b0 0x55c329778ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.924+0000 7f7d96a00640 1 -- 172.21.15.79:0/2953025430 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c32977b010 con 0x55c32939a2f0 2024-09-21T02:40:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.925+0000 7f7d96a00640 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32977a2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7d88005f70 tx=0x7f7d88004370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39639dd690c29fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.929+0000 7f7d80c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:40:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.929+0000 7f7d80c00640 1 -- 172.21.15.79:0/2953025430 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88035070 con 0x55c32939a2f0 2024-09-21T02:40:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.929+0000 7f7d80c00640 1 -- 172.21.15.79:0/2953025430 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7d8803c640 con 0x55c32939a2f0 2024-09-21T02:40:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.929+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d880315a0 con 0x55c32939a2f0 2024-09-21T02:40:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.929+0000 7f7d80c00640 1 -- 172.21.15.79:0/2953025430 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7d88058040 con 0x55c32939a2f0 2024-09-21T02:40:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.929+0000 7f7da4fe4740 10 client.25819 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:17.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.929+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3297fce70 con 0x55c32939a2f0 2024-09-21T02:40:17.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7d80c00640 1 -- 172.21.15.79:0/2953025430 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d880315a0 con 0x55c32939a2f0 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7d80c00640 1 -- 172.21.15.79:0/2953025430 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7d8805b070 con 0x55c32939a2f0 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7da4fe4740 10 client.25819 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7da4fe4740 10 client.25819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7da4fe4740 20 client.25819 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c3293571c0 0x55c3297ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7da4fe4740 4 client.25819 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3296db0b0 con 0x55c3293571c0 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.932+0000 7f7d96000640 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c3293571c0 0x55c3297ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.933+0000 7f7d96000640 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c3293571c0 0x55c3297ff7e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9d6a812703dea6 server_cookie=5e469d9de312d0f9 in_seq=0 out_seq=0 2024-09-21T02:40:17.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:17.933+0000 7f7d80c00640 10 client.25819 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.097+0000 7f7d80c00640 1 -- 172.21.15.79:0/2953025430 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3296db0b0 con 0x55c3293571c0 2024-09-21T02:40:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.097+0000 7f7d80c00640 10 client.25819 handle_command_reply: tid=0 2024-09-21T02:40:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.097+0000 7f7da4fe4740 1 client.25819 shutdown 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 msgr2=0x55c32977a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32977a2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7d88005f70 tx=0x7f7d88004370 comp rx=0 tx=0).stop 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 shutdown_connections 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c3293571c0 0x55c3297ff7e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3293c31b0 0x55c329778ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3293a24d0 0x55c32977a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 --2- 172.21.15.79:0/2953025430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c32939a2f0 0x55c32977a2c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 >> 172.21.15.79:0/2953025430 conn(0x55c3293b7300 msgr2=0x55c329771d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7d80c00640 0 client.25819 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.098+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 shutdown_connections 2024-09-21T02:40:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.099+0000 7f7da4fe4740 1 -- 172.21.15.79:0/2953025430 wait complete. 2024-09-21T02:40:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.099+0000 7f7da4fe4740 20 client.25819 trim_cache size 0 max 16384 2024-09-21T02:40:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:40:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:40:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:40:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:40:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.101+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d7c0b64a0 msgr2=0x7f7d7c0b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.101+0000 7f7d9de00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d7c0b64a0 0x7f7d7c0b89b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d90006010 tx=0x7f7d90010fd0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.101+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 msgr2=0x7f7d981a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.101+0000 7f7d9de00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 0x7f7d981a0c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400b4a0 tx=0x7f7d8400b960 comp rx=0 tx=0).stop 2024-09-21T02:40:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.103+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 shutdown_connections 2024-09-21T02:40:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.103+0000 7f7d9de00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d7c0b64a0 0x7f7d7c0b89b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.103+0000 7f7d9de00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d9810b700 0x7f7d981a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.103+0000 7f7d9de00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9810ad60 0x7f7d981a0c00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.103+0000 7f7d9de00640 1 --2- 172.21.15.79:0/4159617659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d98109ce0 0x7f7d981a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.103+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 >> 172.21.15.79:0/4159617659 conn(0x7f7d98079060 msgr2=0x7f7d9810e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.104+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 shutdown_connections 2024-09-21T02:40:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:18.104+0000 7f7d9de00640 1 -- 172.21.15.79:0/4159617659 wait complete. 2024-09-21T02:40:18.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:18 smithi079 ceph-mon[30788]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-09-21T02:40:19.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:18 smithi148 ceph-mon[34626]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-09-21T02:40:19.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:18 smithi098 ceph-mon[34832]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-09-21T02:40:20.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:20 smithi079 ceph-mon[30788]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.2 MiB/s wr, 651 op/s 2024-09-21T02:40:21.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:20 smithi148 ceph-mon[34626]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.2 MiB/s wr, 651 op/s 2024-09-21T02:40:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:20 smithi098 ceph-mon[34832]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.2 MiB/s wr, 651 op/s 2024-09-21T02:40:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 265.0 s, 1247.4 tps, lat 80.853 ms stddev 92.001 2024-09-21T02:40:22.958 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:22 smithi098 ceph-mon[34832]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 701 op/s 2024-09-21T02:40:22.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:22 smithi079 ceph-mon[30788]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 701 op/s 2024-09-21T02:40:23.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:22 smithi148 ceph-mon[34626]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 701 op/s 2024-09-21T02:40:24.144 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T02:40:24.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:40:24.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:24 smithi079 ceph-mon[30788]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.4 MiB/s wr, 576 op/s 2024-09-21T02:40:24.788 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:24 smithi148 ceph-mon[34626]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.4 MiB/s wr, 576 op/s 2024-09-21T02:40:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:24 smithi098 ceph-mon[34832]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.4 MiB/s wr, 576 op/s 2024-09-21T02:40:25.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.779+0000 7f5fdec00640 1 -- 172.21.15.79:0/2796068330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd810a3c0 msgr2=0x7f5fd810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.779+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2796068330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd810a3c0 0x7f5fd810a7d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009900 tx=0x7f5fc802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.779+0000 7f5fdec00640 1 -- 172.21.15.79:0/2796068330 shutdown_connections 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.779+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2796068330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd8118900 0x7f5fd811ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.779+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2796068330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fd810ad10 0x7f5fd81183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.779+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2796068330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd810a3c0 0x7f5fd810a7d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.779+0000 7f5fdec00640 1 -- 172.21.15.79:0/2796068330 >> 172.21.15.79:0/2796068330 conn(0x7f5fd8070ec0 msgr2=0x7f5fd80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.780+0000 7f5fdec00640 1 -- 172.21.15.79:0/2796068330 shutdown_connections 2024-09-21T02:40:25.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.780+0000 7f5fdec00640 1 -- 172.21.15.79:0/2796068330 wait complete. 2024-09-21T02:40:25.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.782+0000 7f5fdec00640 1 Processor -- start 2024-09-21T02:40:25.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.782+0000 7f5fdec00640 1 -- start start 2024-09-21T02:40:25.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.784+0000 7f5fdec00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd810a3c0 0x7f5fd8117280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.784+0000 7f5fdec00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fd810ad10 0x7f5fd8117800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.784+0000 7f5fdec00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd8118900 0x7f5fd81ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.785+0000 7f5fd7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fd810ad10 0x7f5fd8117800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:25.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.785+0000 7f5fd7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd810a3c0 0x7f5fd8117280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:25.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.785+0000 7f5fd7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fd810ad10 0x7f5fd8117800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:37848/0 (socket says 172.21.15.79:37848) 2024-09-21T02:40:25.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.785+0000 7f5fd7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd810a3c0 0x7f5fd8117280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37290/0 (socket says 172.21.15.79:37290) 2024-09-21T02:40:25.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.786+0000 7f5fdcc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd8118900 0x7f5fd81ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.786+0000 7f5fdcc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd8118900 0x7f5fd81ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47588/0 (socket says 172.21.15.79:47588) 2024-09-21T02:40:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.787+0000 7f5fdec00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd810f020 con 0x7f5fd810a3c0 2024-09-21T02:40:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.787+0000 7f5fdec00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd810eea0 con 0x7f5fd8118900 2024-09-21T02:40:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.787+0000 7f5fdec00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd810f1a0 con 0x7f5fd810ad10 2024-09-21T02:40:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.787+0000 7f5fd7400640 1 -- 172.21.15.79:0/2318726650 learned_addr learned my addr 172.21.15.79:0/2318726650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.793+0000 7f5fdcc00640 1 -- 172.21.15.79:0/2318726650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fd810ad10 msgr2=0x7f5fd8117800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.793+0000 7f5fdcc00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fd810ad10 0x7f5fd8117800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.793+0000 7f5fdcc00640 1 -- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd810a3c0 msgr2=0x7f5fd8117280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.793+0000 7f5fdcc00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd810a3c0 0x7f5fd8117280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.793+0000 7f5fdcc00640 1 -- 172.21.15.79:0/2318726650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd81ae170 con 0x7f5fd8118900 2024-09-21T02:40:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.795+0000 7f5fd7e00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd810a3c0 0x7f5fd8117280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T02:40:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.795+0000 7f5fdcc00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd8118900 0x7f5fd81ada40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0005fd0 tx=0x7f5fd000edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.795+0000 7f5fd4c00640 1 -- 172.21.15.79:0/2318726650 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0004d20 con 0x7f5fd8118900 2024-09-21T02:40:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.795+0000 7f5fd4c00640 1 -- 172.21.15.79:0/2318726650 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fd0005020 con 0x7f5fd8118900 2024-09-21T02:40:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.795+0000 7f5fd4c00640 1 -- 172.21.15.79:0/2318726650 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00116d0 con 0x7f5fd8118900 2024-09-21T02:40:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.796+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd81ae460 con 0x7f5fd8118900 2024-09-21T02:40:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.796+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd81b5cf0 con 0x7f5fd8118900 2024-09-21T02:40:25.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.799+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd810a7d0 con 0x7f5fd8118900 2024-09-21T02:40:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.809+0000 7f5fd4c00640 1 -- 172.21.15.79:0/2318726650 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5fd00054d0 con 0x7f5fd8118900 2024-09-21T02:40:25.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.811+0000 7f5fd4c00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5fbc0b6590 0x7f5fbc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:25.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.812+0000 7f5fd4c00640 1 -- 172.21.15.79:0/2318726650 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f5fd00e77f0 con 0x7f5fd8118900 2024-09-21T02:40:25.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.812+0000 7f5fd7e00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5fbc0b6590 0x7f5fbc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:25.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.813+0000 7f5fd7e00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5fbc0b6590 0x7f5fbc0b8aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8005ab0 tx=0x7f5fc8005a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:25.815+0000 7f5fd4c00640 1 -- 172.21.15.79:0/2318726650 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fd0016030 con 0x7f5fd8118900 2024-09-21T02:40:26.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.228+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fd8110f20 con 0x7f5fd8118900 2024-09-21T02:40:26.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.229+0000 7f5fd4c00640 1 -- 172.21.15.79:0/2318726650 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f5fd00adcd0 con 0x7f5fd8118900 2024-09-21T02:40:26.232 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:40:26.232 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:40:26.233 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:40:26.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.232+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5fbc0b6590 msgr2=0x7f5fbc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:26.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.232+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5fbc0b6590 0x7f5fbc0b8aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8005ab0 tx=0x7f5fc8005a40 comp rx=0 tx=0).stop 2024-09-21T02:40:26.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.232+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd8118900 msgr2=0x7f5fd81ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:26.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.232+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd8118900 0x7f5fd81ada40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0005fd0 tx=0x7f5fd000edd0 comp rx=0 tx=0).stop 2024-09-21T02:40:26.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.233+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 shutdown_connections 2024-09-21T02:40:26.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.233+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5fbc0b6590 0x7f5fbc0b8aa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:26.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.233+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fd8118900 0x7f5fd81ada40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:26.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.233+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fd810ad10 0x7f5fd8117800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:26.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.233+0000 7f5fdec00640 1 --2- 172.21.15.79:0/2318726650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fd810a3c0 0x7f5fd8117280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:26.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.233+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 >> 172.21.15.79:0/2318726650 conn(0x7f5fd8070ec0 msgr2=0x7f5fd8118e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:26.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.234+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 shutdown_connections 2024-09-21T02:40:26.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:26.235+0000 7f5fdec00640 1 -- 172.21.15.79:0/2318726650 wait complete. 2024-09-21T02:40:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 270.0 s, 784.4 tps, lat 126.679 ms stddev 223.616 2024-09-21T02:40:26.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:26 smithi079 ceph-mon[30788]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 9.3 MiB/s wr, 815 op/s 2024-09-21T02:40:26.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:26 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2318726650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:26 smithi148 ceph-mon[34626]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 9.3 MiB/s wr, 815 op/s 2024-09-21T02:40:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:26 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2318726650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:26 smithi098 ceph-mon[34832]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 9.3 MiB/s wr, 815 op/s 2024-09-21T02:40:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:26 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2318726650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:27.962 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T02:40:27.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T02:40:28.622 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:28.862 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:28 smithi079 ceph-mon[30788]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 9.7 MiB/s wr, 806 op/s 2024-09-21T02:40:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:28 smithi148 ceph-mon[34626]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 9.7 MiB/s wr, 806 op/s 2024-09-21T02:40:29.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:28 smithi098 ceph-mon[34832]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 9.7 MiB/s wr, 806 op/s 2024-09-21T02:40:29.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b9000640 1 -- 172.21.15.79:0/739454633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b41092d0 msgr2=0x7f88b41096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b2000640 1 -- 172.21.15.79:0/739454633 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4030c00 con 0x7f88b41092d0 2024-09-21T02:40:29.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b9000640 1 --2- 172.21.15.79:0/739454633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b41092d0 0x7f88b41096e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009ca0 tx=0x7f88a402a8b0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b9000640 1 -- 172.21.15.79:0/739454633 shutdown_connections 2024-09-21T02:40:29.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b9000640 1 --2- 172.21.15.79:0/739454633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88b4109c20 0x7f88b4110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b9000640 1 --2- 172.21.15.79:0/739454633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b41092d0 0x7f88b41096e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b9000640 1 --2- 172.21.15.79:0/739454633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88b4103990 0x7f88b4103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.478+0000 7f88b9000640 1 -- 172.21.15.79:0/739454633 >> 172.21.15.79:0/739454633 conn(0x7f88b40ff3e0 msgr2=0x7f88b4101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:29.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.479+0000 7f88b9000640 1 -- 172.21.15.79:0/739454633 shutdown_connections 2024-09-21T02:40:29.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.479+0000 7f88b9000640 1 -- 172.21.15.79:0/739454633 wait complete. 2024-09-21T02:40:29.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.481+0000 7f88b9000640 1 Processor -- start 2024-09-21T02:40:29.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.481+0000 7f88b9000640 1 -- start start 2024-09-21T02:40:29.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.481+0000 7f88b9000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b4103990 0x7f88b419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.481+0000 7f88b9000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88b41092d0 0x7f88b419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b9000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88b4109c20 0x7f88b41a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88b41092d0 0x7f88b419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88b41092d0 0x7f88b419c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37308/0 (socket says 172.21.15.79:37308) 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b2a00640 1 -- 172.21.15.79:0/4186530088 learned_addr learned my addr 172.21.15.79:0/4186530088 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4076640 con 0x7f88b41092d0 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f88b40764c0 con 0x7f88b4103990 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f88b40767c0 con 0x7f88b4109c20 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.482+0000 7f88b3e00640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88b4109c20 0x7f88b41a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.483+0000 7f88b3400640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b4103990 0x7f88b419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.484+0000 7f88b3400640 1 -- 172.21.15.79:0/4186530088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88b4109c20 msgr2=0x7f88b41a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.484+0000 7f88b3400640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88b4109c20 0x7f88b41a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.484+0000 7f88b3400640 1 -- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88b41092d0 msgr2=0x7f88b419c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.484+0000 7f88b3400640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88b41092d0 0x7f88b419c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.484+0000 7f88b3400640 1 -- 172.21.15.79:0/4186530088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b41a22d0 con 0x7f88b4103990 2024-09-21T02:40:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.484+0000 7f88b3400640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b4103990 0x7f88b419c360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00e9f0 tx=0x7f88ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.485+0000 7f88abe00640 1 -- 172.21.15.79:0/4186530088 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00ccc0 con 0x7f88b4103990 2024-09-21T02:40:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.485+0000 7f88abe00640 1 -- 172.21.15.79:0/4186530088 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88ac005020 con 0x7f88b4103990 2024-09-21T02:40:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.485+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b41a25c0 con 0x7f88b4103990 2024-09-21T02:40:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.485+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b41a8d20 con 0x7f88b4103990 2024-09-21T02:40:29.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.486+0000 7f88abe00640 1 -- 172.21.15.79:0/4186530088 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac004a00 con 0x7f88b4103990 2024-09-21T02:40:29.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.493+0000 7f88c129e740 1 Processor -- start 2024-09-21T02:40:29.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.493+0000 7f88abe00640 1 -- 172.21.15.79:0/4186530088 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f88ac004ba0 con 0x7f88b4103990 2024-09-21T02:40:29.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.496+0000 7f88c129e740 1 -- start start 2024-09-21T02:40:29.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.496+0000 7f88abe00640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88980b6640 0x7f88980b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.496+0000 7f88abe00640 1 -- 172.21.15.79:0/4186530088 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f88ac0e75b0 con 0x7f88b4103990 2024-09-21T02:40:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88c129e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c8000840 0x55d0c83b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88c129e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c7fd7980 0x55d0c83b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88c129e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88c129e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0c831dca0 con 0x55d0c8000840 2024-09-21T02:40:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88c129e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0c830d0d0 con 0x55d0c7fd7980 2024-09-21T02:40:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88c129e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d0c8310ee0 con 0x55d0c7fdfb60 2024-09-21T02:40:29.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88b2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c7fd7980 0x55d0c83b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88b2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c7fd7980 0x55d0c83b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47614/0 (socket says 172.21.15.79:47614) 2024-09-21T02:40:29.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88b2a00640 1 -- 172.21.15.79:0/3221578721 learned_addr learned my addr 172.21.15.79:0/3221578721 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:29.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.497+0000 7f88b3400640 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c8000840 0x55d0c83b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.498+0000 7f88b2a00640 1 -- 172.21.15.79:0/3221578721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 msgr2=0x55d0c83b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.498+0000 7f88b2a00640 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.498+0000 7f88b2a00640 1 -- 172.21.15.79:0/3221578721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c8000840 msgr2=0x55d0c83b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.498+0000 7f88b2a00640 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c8000840 0x55d0c83b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.498+0000 7f88b2a00640 1 -- 172.21.15.79:0/3221578721 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c82bf400 con 0x55d0c7fd7980 2024-09-21T02:40:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.499+0000 7f88b3e00640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88980b6640 0x7f88980b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.499+0000 7f88b2a00640 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c7fd7980 0x55d0c83b1260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88a4004af0 tx=0x7f88a4009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c88e81b4e83147 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.500+0000 7f88a8c00640 1 -- 172.21.15.79:0/3221578721 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a40305a0 con 0x55d0c7fd7980 2024-09-21T02:40:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.500+0000 7f88a8c00640 1 -- 172.21.15.79:0/3221578721 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88a4036040 con 0x55d0c7fd7980 2024-09-21T02:40:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.500+0000 7f88a8c00640 1 -- 172.21.15.79:0/3221578721 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a40042a0 con 0x55d0c7fd7980 2024-09-21T02:40:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.501+0000 7f88c129e740 1 -- 172.21.15.79:0/3221578721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c7fd7980 msgr2=0x55d0c83b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.501+0000 7f88c129e740 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c7fd7980 0x55d0c83b1260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88a4004af0 tx=0x7f88a4009800 comp rx=0 tx=0).stop 2024-09-21T02:40:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88c129e740 1 -- 172.21.15.79:0/3221578721 shutdown_connections 2024-09-21T02:40:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88c129e740 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88c129e740 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c7fd7980 0x55d0c83b1260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88c129e740 1 --2- 172.21.15.79:0/3221578721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c8000840 0x55d0c83b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88c129e740 1 -- 172.21.15.79:0/3221578721 >> 172.21.15.79:0/3221578721 conn(0x55d0c7ff4990 msgr2=0x55d0c83aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88b3e00640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88980b6640 0x7f88980b8b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005fd0 tx=0x7f88a000b550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88c129e740 1 -- 172.21.15.79:0/3221578721 shutdown_connections 2024-09-21T02:40:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.502+0000 7f88c129e740 1 -- 172.21.15.79:0/3221578721 wait complete. 2024-09-21T02:40:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.503+0000 7f88c129e740 1 -- start start 2024-09-21T02:40:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.503+0000 7f88c129e740 1 Processor -- start 2024-09-21T02:40:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.507+0000 7f88c129e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 0x55d0c83bc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.507+0000 7f88c129e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88c129e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88c129e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d0c816e7a0 con 0x55d0c7fdfb60 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88c129e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0c82b2a10 con 0x55d0c8000840 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88b3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88b3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:37880/0 (socket says 172.21.15.79:37880) 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88b3e00640 1 -- 172.21.15.79:0/4084116260 learned_addr learned my addr 172.21.15.79:0/4084116260 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d0c83bf4a0 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.508+0000 7f88b3400640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 0x55d0c83bc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.509+0000 7f88c129e740 10 client.0 _ll_register_callbacks cb 0x55d0c82c2be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.510+0000 7f88b2a00640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.511+0000 7f88b3e00640 1 -- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 msgr2=0x55d0c83bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.511+0000 7f88b3e00640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.511+0000 7f88b3e00640 1 -- 172.21.15.79:0/4084116260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 msgr2=0x55d0c83bc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.511+0000 7f88b3e00640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 0x55d0c83bc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.511+0000 7f88b3e00640 1 -- 172.21.15.79:0/4084116260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c807ab90 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.511+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88a4036040 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.511+0000 7f88b2a00640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:40:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.513+0000 7f88b3e00640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83c8820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88a000fea0 tx=0x7f88a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=518fb30b9c29fe15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.513+0000 7f889d600640 10 client.25834 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:40:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.513+0000 7f889d600640 1 -- 172.21.15.79:0/4084116260 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a002c050 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.514+0000 7f889d600640 1 -- 172.21.15.79:0/4084116260 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f88a001e860 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.514+0000 7f889d600640 1 -- 172.21.15.79:0/4084116260 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f88a0022070 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.514+0000 7f88c129e740 10 client.25834 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.514+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55d0c83cb260 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.515+0000 7f889d600640 1 -- 172.21.15.79:0/4084116260 <== mon.1 v2:172.21.15.148:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f88a001eaa0 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.515+0000 7f88c129e740 10 client.25834 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.515+0000 7f88c129e740 10 client.25834 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:40:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.515+0000 7f88c129e740 20 client.25834 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.516+0000 7f88c129e740 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c7f94570 0x55d0c83cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.516+0000 7f88b3400640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c7f94570 0x55d0c83cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.517+0000 7f88c129e740 4 client.25834 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.517+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0c831fbf0 con 0x55d0c7f94570 2024-09-21T02:40:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.517+0000 7f88b3400640 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c7f94570 0x55d0c83cec00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5646086cc6bc347 server_cookie=505f5b1a072ffc8e in_seq=0 out_seq=0 2024-09-21T02:40:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.517+0000 7f889d600640 10 client.25834 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:29.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.518+0000 7f889d600640 1 -- 172.21.15.79:0/4084116260 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0c831fbf0 con 0x55d0c7f94570 2024-09-21T02:40:29.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.518+0000 7f889d600640 10 client.25834 handle_command_reply: tid=0 2024-09-21T02:40:29.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.518+0000 7f88c129e740 1 client.25834 shutdown 2024-09-21T02:40:29.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.519+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 msgr2=0x55d0c83c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.519+0000 7f88c129e740 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83c8820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88a000fea0 tx=0x7f88a00046c0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.520+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 shutdown_connections 2024-09-21T02:40:29.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.520+0000 7f88c129e740 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c7f94570 0x55d0c83cec00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.520+0000 7f88c129e740 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83c8820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.520+0000 7f88c129e740 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.520+0000 7f88c129e740 1 --2- 172.21.15.79:0/4084116260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 0x55d0c83bc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.520+0000 7f889d600640 0 client.25834 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:29.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.520+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 >> 172.21.15.79:0/4084116260 conn(0x55d0c7ff4990 msgr2=0x55d0c83b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:29.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.521+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 shutdown_connections 2024-09-21T02:40:29.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.523+0000 7f88c129e740 1 -- 172.21.15.79:0/4084116260 wait complete. 2024-09-21T02:40:29.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.523+0000 7f88c129e740 20 client.25834 trim_cache size 0 max 16384 2024-09-21T02:40:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.560+0000 7f88c129e740 1 Processor -- start 2024-09-21T02:40:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.561+0000 7f88c129e740 1 -- start start 2024-09-21T02:40:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.561+0000 7f88c129e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.561+0000 7f88c129e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 0x55d0c83b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.561+0000 7f88c129e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.561+0000 7f88c129e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f889400db90 con 0x55d0c7fdfb60 2024-09-21T02:40:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.561+0000 7f88c129e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8894010410 con 0x55d0c8000840 2024-09-21T02:40:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.561+0000 7f88c129e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f889400e200 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.562+0000 7f88b3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.562+0000 7f88b3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47626/0 (socket says 172.21.15.79:47626) 2024-09-21T02:40:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.562+0000 7f88b3e00640 1 -- 172.21.15.79:0/2689633350 learned_addr learned my addr 172.21.15.79:0/2689633350 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:29.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.562+0000 7f88b3400640 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.563+0000 7f88b3e00640 1 -- 172.21.15.79:0/2689633350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 msgr2=0x55d0c83bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.563+0000 7f88b3e00640 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83bc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.563+0000 7f88b3e00640 1 -- 172.21.15.79:0/2689633350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 msgr2=0x55d0c83b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.563+0000 7f88b3e00640 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 0x55d0c83b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.563+0000 7f88b3e00640 1 -- 172.21.15.79:0/2689633350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c83b3010 con 0x55d0c8000840 2024-09-21T02:40:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.564+0000 7f88b3e00640 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83aead0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005700 tx=0x7f88a001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ea2ed4e1abf375 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.564+0000 7f889fe00640 1 -- 172.21.15.79:0/2689633350 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a002c040 con 0x55d0c8000840 2024-09-21T02:40:29.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.568+0000 7f889fe00640 1 -- 172.21.15.79:0/2689633350 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88a4036040 con 0x55d0c8000840 2024-09-21T02:40:29.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.568+0000 7f889fe00640 1 -- 172.21.15.79:0/2689633350 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a00108f0 con 0x55d0c8000840 2024-09-21T02:40:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.569+0000 7f88c129e740 1 -- 172.21.15.79:0/2689633350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 msgr2=0x55d0c83aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.569+0000 7f88c129e740 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83aead0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005700 tx=0x7f88a001f000 comp rx=0 tx=0).stop 2024-09-21T02:40:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.570+0000 7f88c129e740 1 -- 172.21.15.79:0/2689633350 shutdown_connections 2024-09-21T02:40:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.570+0000 7f88c129e740 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83aead0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.570+0000 7f88c129e740 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fdfb60 0x55d0c83b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.570+0000 7f88c129e740 1 --2- 172.21.15.79:0/2689633350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83bc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.570+0000 7f88c129e740 1 -- 172.21.15.79:0/2689633350 >> 172.21.15.79:0/2689633350 conn(0x55d0c7ff4990 msgr2=0x55d0c83b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.570+0000 7f88c129e740 1 -- 172.21.15.79:0/2689633350 shutdown_connections 2024-09-21T02:40:29.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.570+0000 7f88c129e740 1 -- 172.21.15.79:0/2689633350 wait complete. 2024-09-21T02:40:29.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.571+0000 7f88c129e740 1 -- start start 2024-09-21T02:40:29.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.571+0000 7f88c129e740 1 Processor -- start 2024-09-21T02:40:29.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.576+0000 7f88c129e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88c129e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88b2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88c129e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88b2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83d2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:37896/0 (socket says 172.21.15.79:37896) 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88c129e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f889400e8d0 con 0x55d0c7fbf1c0 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88c129e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f889400fd40 con 0x55d0c8000840 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88c129e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f889400efa0 con 0x55d0c7fdfb60 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88c129e740 10 client.0 _ll_register_callbacks cb 0x7f88a0015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.577+0000 7f88b2a00640 1 -- 172.21.15.79:0/1078135430 learned_addr learned my addr 172.21.15.79:0/1078135430 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.578+0000 7f88b3e00640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.578+0000 7f88b3400640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.579+0000 7f88b3e00640 1 -- 172.21.15.79:0/1078135430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 msgr2=0x55d0c83d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.579+0000 7f88b3e00640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.579+0000 7f88b3e00640 1 -- 172.21.15.79:0/1078135430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fbf1c0 msgr2=0x55d0c83d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.579+0000 7f88b3e00640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83d4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.579+0000 7f88b3e00640 1 -- 172.21.15.79:0/1078135430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c83d3c10 con 0x55d0c8000840 2024-09-21T02:40:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.579+0000 7f88b3400640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83d4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.580+0000 7f88b3e00640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83d34a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88a003c040 tx=0x7f88a001eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6294df72ad61dbf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.580+0000 7f889d600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:40:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.580+0000 7f889d600640 1 -- 172.21.15.79:0/1078135430 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a0047060 con 0x55d0c8000840 2024-09-21T02:40:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.580+0000 7f889d600640 1 -- 172.21.15.79:0/1078135430 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f88a0010800 con 0x55d0c8000840 2024-09-21T02:40:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.580+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88a4036040 con 0x55d0c8000840 2024-09-21T02:40:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.580+0000 7f889d600640 1 -- 172.21.15.79:0/1078135430 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f88a004e050 con 0x55d0c8000840 2024-09-21T02:40:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.581+0000 7f88c129e740 10 client.25832 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.581+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d0c843a3a0 con 0x55d0c8000840 2024-09-21T02:40:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f889d600640 1 -- 172.21.15.79:0/1078135430 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88a4036040 con 0x55d0c8000840 2024-09-21T02:40:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f889d600640 1 -- 172.21.15.79:0/1078135430 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f88a0027a30 con 0x55d0c8000840 2024-09-21T02:40:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f88c129e740 10 client.25832 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f88c129e740 10 client.25832 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:40:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f88c129e740 20 client.25832 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f88c129e740 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c843aae0 0x55d0c843cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f88c129e740 4 client.25832 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T02:40:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.582+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55d0c831b6a0 con 0x55d0c843aae0 2024-09-21T02:40:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.583+0000 7f88b3400640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c843aae0 0x55d0c843cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:29.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.584+0000 7f88b3400640 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c843aae0 0x55d0c843cf00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=396e4cfb8b47b168 server_cookie=45bb28576dbfbdeb in_seq=0 out_seq=0 2024-09-21T02:40:29.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.584+0000 7f889d600640 10 client.25832 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.894+0000 7f889d600640 1 -- 172.21.15.79:0/1078135430 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d0c831b6a0 con 0x55d0c843aae0 2024-09-21T02:40:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.894+0000 7f889d600640 10 client.25832 handle_command_reply: tid=0 2024-09-21T02:40:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.894+0000 7f88c129e740 1 client.25832 shutdown 2024-09-21T02:40:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 msgr2=0x55d0c83d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83d34a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88a003c040 tx=0x7f88a001eae0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 shutdown_connections 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d0c843aae0 0x55d0c843cf00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0c8000840 0x55d0c83d34a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0c7fdfb60 0x55d0c83d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 --2- 172.21.15.79:0/1078135430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0c7fbf1c0 0x55d0c83d4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 >> 172.21.15.79:0/1078135430 conn(0x55d0c7ff4990 msgr2=0x55d0c83b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f889d600640 0 client.25832 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 shutdown_connections 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.895+0000 7f88c129e740 1 -- 172.21.15.79:0/1078135430 wait complete. 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.896+0000 7f88c129e740 20 client.25832 trim_cache size 0 max 16384 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 18, 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:40:29.898 INFO:teuthology.orchestra.run.smithi079.stdout: "a3e45020": { 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 18, 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 130.0, 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:40:29.899 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:40:29.900 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:40:29.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:29.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:29.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:29.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:29.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:29.900 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.896+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88980b6640 msgr2=0x7f88980b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.896+0000 7f88b9000640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88980b6640 0x7f88980b8b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005fd0 tx=0x7f88a000b550 comp rx=0 tx=0).stop 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b4103990 msgr2=0x7f88b419c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b4103990 0x7f88b419c360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00e9f0 tx=0x7f88ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 shutdown_connections 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f88980b6640 0x7f88980b8b50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88b4109c20 0x7f88b41a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88b41092d0 0x7f88b419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 --2- 172.21.15.79:0/4186530088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88b4103990 0x7f88b419c360 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 >> 172.21.15.79:0/4186530088 conn(0x7f88b40ff3e0 msgr2=0x7f88b4105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 shutdown_connections 2024-09-21T02:40:29.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:29.897+0000 7f88b9000640 1 -- 172.21.15.79:0/4186530088 wait complete. 2024-09-21T02:40:30.818 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a3e45020', quiesce took 6.7 seconds. Will release after: 3.3 2024-09-21T02:40:30.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:30 smithi079 ceph-mon[30788]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-09-21T02:40:31.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:30 smithi148 ceph-mon[34626]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-09-21T02:40:31.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:30 smithi098 ceph-mon[34832]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-09-21T02:40:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.304+0000 7f58e3e00640 1 -- 172.21.15.79:0/780511433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e41056f0 msgr2=0x7f58e4105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.304+0000 7f58e3e00640 1 --2- 172.21.15.79:0/780511433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e41056f0 0x7f58e4105b60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009900 tx=0x7f58d402a410 comp rx=0 tx=0).stop 2024-09-21T02:40:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.304+0000 7f58e3e00640 1 -- 172.21.15.79:0/780511433 shutdown_connections 2024-09-21T02:40:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.304+0000 7f58e3e00640 1 --2- 172.21.15.79:0/780511433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58e4107110 0x7f58e410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.304+0000 7f58e3e00640 1 --2- 172.21.15.79:0/780511433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e4106770 0x7f58e4106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.304+0000 7f58e3e00640 1 --2- 172.21.15.79:0/780511433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e41056f0 0x7f58e4105b60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.305+0000 7f58e3e00640 1 -- 172.21.15.79:0/780511433 >> 172.21.15.79:0/780511433 conn(0x7f58e4101050 msgr2=0x7f58e41034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.305+0000 7f58e3e00640 1 -- 172.21.15.79:0/780511433 shutdown_connections 2024-09-21T02:40:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.305+0000 7f58e3e00640 1 -- 172.21.15.79:0/780511433 wait complete. 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 Processor -- start 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 -- start start 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e41056f0 0x7f58e419c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58e4106770 0x7f58e419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e4107110 0x7f58e419d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4111380 con 0x7f58e4107110 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4111200 con 0x7f58e41056f0 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4111500 con 0x7f58e4106770 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e41056f0 0x7f58e419c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e4107110 0x7f58e419d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e41056f0 0x7f58e419c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47648/0 (socket says 172.21.15.79:47648) 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e2a00640 1 -- 172.21.15.79:0/4264908765 learned_addr learned my addr 172.21.15.79:0/4264908765 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.306+0000 7f58e2000640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58e4106770 0x7f58e419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e3400640 1 -- 172.21.15.79:0/4264908765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58e4106770 msgr2=0x7f58e419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e3400640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58e4106770 0x7f58e419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e3400640 1 -- 172.21.15.79:0/4264908765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e41056f0 msgr2=0x7f58e419c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e3400640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e41056f0 0x7f58e419c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e3400640 1 -- 172.21.15.79:0/4264908765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e419da70 con 0x7f58e4107110 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e2a00640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e41056f0 0x7f58e419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e3400640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e4107110 0x7f58e419d250 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009fd0 tx=0x7f58dc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58db400640 1 -- 172.21.15.79:0/4264908765 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00ce20 con 0x7f58e4107110 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e419dd60 con 0x7f58e4107110 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.307+0000 7f58db400640 1 -- 172.21.15.79:0/4264908765 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58dc005020 con 0x7f58e4107110 2024-09-21T02:40:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.308+0000 7f58db400640 1 -- 172.21.15.79:0/4264908765 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc010690 con 0x7f58e4107110 2024-09-21T02:40:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.308+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e41a4450 con 0x7f58e4107110 2024-09-21T02:40:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.311+0000 7f58f06ce740 1 Processor -- start 2024-09-21T02:40:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.311+0000 7f58db400640 1 -- 172.21.15.79:0/4264908765 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f58dc0054d0 con 0x7f58e4107110 2024-09-21T02:40:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.311+0000 7f58f06ce740 1 -- start start 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb77c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb77c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb77d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58f06ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556bdb6ef6b0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58f06ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556bdb6deae0 con 0x556bdb3d51b0 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58f06ce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556bdb6e28f0 con 0x556bdb3b44d0 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb77c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb77c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37394/0 (socket says 172.21.15.79:37394) 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58e2a00640 1 -- 172.21.15.79:0/1144736687 learned_addr learned my addr 172.21.15.79:0/1144736687 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.312+0000 7f58e2000640 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb77d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2000640 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb77c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2a00640 1 -- 172.21.15.79:0/1144736687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 msgr2=0x556bdb77d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb77d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2a00640 1 -- 172.21.15.79:0/1144736687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 msgr2=0x556bdb77c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb77c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2a00640 1 -- 172.21.15.79:0/1144736687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bdb6ab780 con 0x556bdb3ac2f0 2024-09-21T02:40:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58db400640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58c80b6510 0x7f58c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb77c920 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f58d4004520 tx=0x7f58d4004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa046a8b07cfbfc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58db400640 1 -- 172.21.15.79:0/4264908765 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f58dc0e7d60 con 0x7f58e4107110 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58e2000640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58c80b6510 0x7f58c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58cf400640 1 -- 172.21.15.79:0/1144736687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4035030 con 0x556bdb3ac2f0 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58cf400640 1 -- 172.21.15.79:0/1144736687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d4040070 con 0x556bdb3ac2f0 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.313+0000 7f58cf400640 1 -- 172.21.15.79:0/1144736687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d403c440 con 0x556bdb3ac2f0 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.314+0000 7f58f06ce740 1 -- 172.21.15.79:0/1144736687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 msgr2=0x556bdb77c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.314+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb77c920 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f58d4004520 tx=0x7f58d4004550 comp rx=0 tx=0).stop 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.314+0000 7f58e2000640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58c80b6510 0x7f58c80b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f58d0004620 tx=0x7f58d000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 -- 172.21.15.79:0/1144736687 shutdown_connections 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb77d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb77c920 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1144736687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb77c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 -- 172.21.15.79:0/1144736687 >> 172.21.15.79:0/1144736687 conn(0x556bdb3c9300 msgr2=0x556bdb777d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 -- 172.21.15.79:0/1144736687 shutdown_connections 2024-09-21T02:40:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 -- 172.21.15.79:0/1144736687 wait complete. 2024-09-21T02:40:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 -- start start 2024-09-21T02:40:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.315+0000 7f58f06ce740 1 Processor -- start 2024-09-21T02:40:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb7858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb785f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb786ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58f06ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556bdb616ab0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58f06ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556bdb685570 con 0x556bdb3d51b0 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58f06ce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556bdb77df30 con 0x556bdb3b44d0 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58f06ce740 10 client.0 _ll_register_callbacks cb 0x556bdb694100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb7858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb7858a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37402/0 (socket says 172.21.15.79:37402) 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2a00640 1 -- 172.21.15.79:0/2645301653 learned_addr learned my addr 172.21.15.79:0/2645301653 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2000640 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb785f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e3400640 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb786ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2a00640 1 -- 172.21.15.79:0/2645301653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 msgr2=0x556bdb785f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2a00640 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb785f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2a00640 1 -- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 msgr2=0x556bdb786ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.316+0000 7f58e2a00640 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb786ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58e2a00640 1 -- 172.21.15.79:0/2645301653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bdb440790 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58e2a00640 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb7858a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f58d4031920 tx=0x7f58d4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da53a8b86b889f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58c3e00640 1 -- 172.21.15.79:0/2645301653 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4035070 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58c3e00640 1 -- 172.21.15.79:0/2645301653 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f58d4003c40 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d4040070 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58c3e00640 1 -- 172.21.15.79:0/2645301653 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f58d4003e40 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58f06ce740 10 client.15738 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.317+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556bdb4b9620 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58c3e00640 1 -- 172.21.15.79:0/2645301653 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d4040070 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58c3e00640 1 -- 172.21.15.79:0/2645301653 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f58d403c5d0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58f06ce740 10 client.15738 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58f06ce740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58f06ce740 20 client.15738 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58f06ce740 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb393d80 0x556bdb792bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58f06ce740 4 client.15738 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bdb6f1600 con 0x556bdb393d80 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.318+0000 7f58e2000640 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb393d80 0x556bdb792bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.319+0000 7f58e2000640 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb393d80 0x556bdb792bb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2735ce07de26e38 server_cookie=f76c43d6ec067114 in_seq=0 out_seq=0 2024-09-21T02:40:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.319+0000 7f58c3e00640 10 client.15738 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58c3e00640 1 -- 172.21.15.79:0/2645301653 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bdb6f1600 con 0x556bdb393d80 2024-09-21T02:40:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58c3e00640 10 client.15738 handle_command_reply: tid=0 2024-09-21T02:40:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 client.15738 shutdown 2024-09-21T02:40:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 msgr2=0x556bdb7858a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb7858a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f58d4031920 tx=0x7f58d4009260 comp rx=0 tx=0).stop 2024-09-21T02:40:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 shutdown_connections 2024-09-21T02:40:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb393d80 0x556bdb792bb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb786ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3b44d0 0x556bdb785f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58c3e00640 0 client.15738 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 --2- 172.21.15.79:0/2645301653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb7858a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 >> 172.21.15.79:0/2645301653 conn(0x556bdb3c9300 msgr2=0x556bdb776360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 shutdown_connections 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.320+0000 7f58f06ce740 1 -- 172.21.15.79:0/2645301653 wait complete. 2024-09-21T02:40:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.321+0000 7f58f06ce740 20 client.15738 trim_cache size 0 max 16384 2024-09-21T02:40:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.335+0000 7f58f06ce740 1 Processor -- start 2024-09-21T02:40:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.335+0000 7f58f06ce740 1 -- start start 2024-09-21T02:40:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3ac2f0 0x556bdb784aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3b44d0 0x556bdb78d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb780310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58f06ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f58e41ac860 con 0x556bdb3b44d0 2024-09-21T02:40:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58f06ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f58e41af0e0 con 0x556bdb3d51b0 2024-09-21T02:40:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58f06ce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58e41aced0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3b44d0 0x556bdb78d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3b44d0 0x556bdb78d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37418/0 (socket says 172.21.15.79:37418) 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 -- 172.21.15.79:0/1183914217 learned_addr learned my addr 172.21.15.79:0/1183914217 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e3400640 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb780310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3ac2f0 0x556bdb784aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 -- 172.21.15.79:0/1183914217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3ac2f0 msgr2=0x556bdb784aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3ac2f0 0x556bdb784aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 -- 172.21.15.79:0/1183914217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 msgr2=0x556bdb780310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb780310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2000640 1 -- 172.21.15.79:0/1183914217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bdb792f20 con 0x556bdb3b44d0 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.336+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3ac2f0 0x556bdb784aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.337+0000 7f58e2000640 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3b44d0 0x556bdb78d9b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58d0004450 tx=0x7f58d0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362816e72b4fd045 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.337+0000 7f58cea00640 1 -- 172.21.15.79:0/1183914217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0031420 con 0x556bdb3b44d0 2024-09-21T02:40:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.337+0000 7f58cea00640 1 -- 172.21.15.79:0/1183914217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d002a8c0 con 0x556bdb3b44d0 2024-09-21T02:40:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.337+0000 7f58cea00640 1 -- 172.21.15.79:0/1183914217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d001f610 con 0x556bdb3b44d0 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 -- 172.21.15.79:0/1183914217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3b44d0 msgr2=0x556bdb78d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3b44d0 0x556bdb78d9b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58d0004450 tx=0x7f58d0014040 comp rx=0 tx=0).stop 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 -- 172.21.15.79:0/1183914217 shutdown_connections 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3d51b0 0x556bdb780310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3b44d0 0x556bdb78d9b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1183914217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3ac2f0 0x556bdb784aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 -- 172.21.15.79:0/1183914217 >> 172.21.15.79:0/1183914217 conn(0x556bdb3c9300 msgr2=0x556bdb783e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 -- 172.21.15.79:0/1183914217 shutdown_connections 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 -- 172.21.15.79:0/1183914217 wait complete. 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 -- start start 2024-09-21T02:40:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.338+0000 7f58f06ce740 1 Processor -- start 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb78d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3b44d0 0x556bdb78c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58f06ce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3d51b0 0x556bdb78ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58f06ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f58e41ad5a0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58f06ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f58e41aea10 con 0x556bdb3b44d0 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58f06ce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58e41adc70 con 0x556bdb3d51b0 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58f06ce740 10 client.0 _ll_register_callbacks cb 0x7f58d40043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb78d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb78d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37424/0 (socket says 172.21.15.79:37424) 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 -- 172.21.15.79:0/1881957690 learned_addr learned my addr 172.21.15.79:0/1881957690 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e3400640 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3d51b0 0x556bdb78ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2000640 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3b44d0 0x556bdb78c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 -- 172.21.15.79:0/1881957690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3d51b0 msgr2=0x556bdb78ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3d51b0 0x556bdb78ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 -- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3b44d0 msgr2=0x556bdb78c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3b44d0 0x556bdb78c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.339+0000 7f58e2a00640 1 -- 172.21.15.79:0/1881957690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bdb78d210 con 0x556bdb3ac2f0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58e2a00640 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb78d770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58d4031920 tx=0x7f58d4031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4c310c1520033b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58c3e00640 1 -- 172.21.15.79:0/1881957690 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4035070 con 0x556bdb3ac2f0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58c3e00640 1 -- 172.21.15.79:0/1881957690 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f58d4045470 con 0x556bdb3ac2f0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d002a8c0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58c3e00640 1 -- 172.21.15.79:0/1881957690 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f58d4067050 con 0x556bdb3ac2f0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58f06ce740 10 client.15744 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556bdb7fd5d0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.340+0000 7f58c3e00640 1 -- 172.21.15.79:0/1881957690 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d002a8c0 con 0x556bdb3ac2f0 2024-09-21T02:40:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58c3e00640 1 -- 172.21.15.79:0/1881957690 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f58d405c430 con 0x556bdb3ac2f0 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58f06ce740 10 client.15744 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58f06ce740 10 client.15744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58f06ce740 20 client.15744 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb3691c0 0x556bdb7fff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58f06ce740 4 client.15744 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556bdb6ed0b0 con 0x556bdb3691c0 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.341+0000 7f58e2000640 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb3691c0 0x556bdb7fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.342+0000 7f58c3e00640 10 client.15744 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.342+0000 7f58e2000640 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb3691c0 0x556bdb7fff80 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6228e1154b3d42b server_cookie=65f169b200e05444 in_seq=0 out_seq=0 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58c3e00640 1 -- 172.21.15.79:0/1881957690 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556bdb6ed0b0 con 0x556bdb3691c0 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58c3e00640 10 client.15744 handle_command_reply: tid=0 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 client.15744 shutdown 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 msgr2=0x556bdb78d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb78d770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58d4031920 tx=0x7f58d4031b80 comp rx=0 tx=0).stop 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 shutdown_connections 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x556bdb3691c0 0x556bdb7fff80 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556bdb3d51b0 0x556bdb78ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556bdb3b44d0 0x556bdb78c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 --2- 172.21.15.79:0/1881957690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556bdb3ac2f0 0x556bdb78d770 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58c3e00640 0 client.15744 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 >> 172.21.15.79:0/1881957690 conn(0x556bdb3c9300 msgr2=0x556bdb783a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 shutdown_connections 2024-09-21T02:40:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 1 -- 172.21.15.79:0/1881957690 wait complete. 2024-09-21T02:40:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.362+0000 7f58f06ce740 20 client.15744 trim_cache size 0 max 16384 2024-09-21T02:40:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:40:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:40:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:40:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58c80b6510 msgr2=0x7f58c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58c80b6510 0x7f58c80b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f58d0004620 tx=0x7f58d000b390 comp rx=0 tx=0).stop 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e4107110 msgr2=0x7f58e419d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e4107110 0x7f58e419d250 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009fd0 tx=0x7f58dc00ef10 comp rx=0 tx=0).stop 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 shutdown_connections 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58c80b6510 0x7f58c80b8a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58e4107110 0x7f58e419d250 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58e4106770 0x7f58e419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 --2- 172.21.15.79:0/4264908765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e41056f0 0x7f58e419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 >> 172.21.15.79:0/4264908765 conn(0x7f58e4101050 msgr2=0x7f58e4109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 shutdown_connections 2024-09-21T02:40:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:31.363+0000 7f58e3e00640 1 -- 172.21.15.79:0/4264908765 wait complete. 2024-09-21T02:40:31.494 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 275.0 s, 435.9 tps, lat 142.662 ms stddev 148.957 2024-09-21T02:40:32.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:32 smithi079 ceph-mon[30788]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-21T02:40:33.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:32 smithi148 ceph-mon[34626]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-21T02:40:33.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:32 smithi098 ceph-mon[34832]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-21T02:40:34.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:40:34.574 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:34.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:34 smithi079 ceph-mon[30788]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 MiB/s wr, 746 op/s 2024-09-21T02:40:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:34 smithi148 ceph-mon[34626]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 MiB/s wr, 746 op/s 2024-09-21T02:40:35.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:34 smithi098 ceph-mon[34832]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 MiB/s wr, 746 op/s 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 -- 172.21.15.79:0/2914684441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c105d80 msgr2=0x7f1d3c106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 --2- 172.21.15.79:0/2914684441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c105d80 0x7f1d3c106190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009900 tx=0x7f1d2c02a410 comp rx=0 tx=0).stop 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 -- 172.21.15.79:0/2914684441 shutdown_connections 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 --2- 172.21.15.79:0/2914684441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d3c10c010 0x7f1d3c112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 --2- 172.21.15.79:0/2914684441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c10b6c0 0x7f1d3c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 --2- 172.21.15.79:0/2914684441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c105d80 0x7f1d3c106190 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 -- 172.21.15.79:0/2914684441 >> 172.21.15.79:0/2914684441 conn(0x7f1d3c101810 msgr2=0x7f1d3c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 -- 172.21.15.79:0/2914684441 shutdown_connections 2024-09-21T02:40:35.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.252+0000 7f1d41600640 1 -- 172.21.15.79:0/2914684441 wait complete. 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 Processor -- start 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 -- start start 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c105d80 0x7f1d3c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c10b6c0 0x7f1d3c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d3c10c010 0x7f1d3c1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c115d20 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c115ba0 con 0x7f1d3c105d80 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.253+0000 7f1d41600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c115ea0 con 0x7f1d3c10c010 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c105d80 0x7f1d3c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c10b6c0 0x7f1d3c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c105d80 0x7f1d3c19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58928/0 (socket says 172.21.15.79:58928) 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3aa00640 1 -- 172.21.15.79:0/3971595051 learned_addr learned my addr 172.21.15.79:0/3971595051 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3b400640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d3c10c010 0x7f1d3c1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3a000640 1 -- 172.21.15.79:0/3971595051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d3c10c010 msgr2=0x7f1d3c1a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3a000640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d3c10c010 0x7f1d3c1a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3a000640 1 -- 172.21.15.79:0/3971595051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c105d80 msgr2=0x7f1d3c19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3a000640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c105d80 0x7f1d3c19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3a000640 1 -- 172.21.15.79:0/3971595051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c1a2640 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.254+0000 7f1d3aa00640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c105d80 0x7f1d3c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:35.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.255+0000 7f1d3a000640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c10b6c0 0x7f1d3c19cc70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c06caa0 tx=0x7f1d2800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.255+0000 7f1d33400640 1 -- 172.21.15.79:0/3971595051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800cc40 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.255+0000 7f1d33400640 1 -- 172.21.15.79:0/3971595051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d2800cde0 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.255+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c1a2930 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.255+0000 7f1d33400640 1 -- 172.21.15.79:0/3971595051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28018780 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.255+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c1a9090 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.256+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3c106190 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.259+0000 7f1d33400640 1 -- 172.21.15.79:0/3971595051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1d28010a90 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.260+0000 7f1d33400640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1d200b6510 0x7f1d200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.260+0000 7f1d33400640 1 -- 172.21.15.79:0/3971595051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1d280e7e40 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.260+0000 7f1d3aa00640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1d200b6510 0x7f1d200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.261+0000 7f1d3aa00640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1d200b6510 0x7f1d200b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0096c0 tx=0x7f1d2c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:35.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.262+0000 7f1d33400640 1 -- 172.21.15.79:0/3971595051 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d280b26a0 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.491+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d3c10de40 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.492+0000 7f1d33400640 1 -- 172.21.15.79:0/3971595051 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f1d280b75e0 con 0x7f1d3c10b6c0 2024-09-21T02:40:35.494 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:40:35.494 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:40:35.494 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1d200b6510 msgr2=0x7f1d200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1d200b6510 0x7f1d200b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0096c0 tx=0x7f1d2c005a20 comp rx=0 tx=0).stop 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c10b6c0 msgr2=0x7f1d3c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c10b6c0 0x7f1d3c19cc70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c06caa0 tx=0x7f1d2800ee50 comp rx=0 tx=0).stop 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 shutdown_connections 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1d200b6510 0x7f1d200b8a20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d3c10c010 0x7f1d3c1a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d3c10b6c0 0x7f1d3c19cc70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 --2- 172.21.15.79:0/3971595051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d3c105d80 0x7f1d3c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.494+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 >> 172.21.15.79:0/3971595051 conn(0x7f1d3c101810 msgr2=0x7f1d3c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:35.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.495+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 shutdown_connections 2024-09-21T02:40:35.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:35.495+0000 7f1d41600640 1 -- 172.21.15.79:0/3971595051 wait complete. 2024-09-21T02:40:35.890 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:35 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3971595051' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:35 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3971595051' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:35 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3971595051' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:36.343 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id a3e45020 --release --await' 2024-09-21T02:40:36.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id a3e45020 --release --await 2024-09-21T02:40:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:40:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:37.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:36 smithi148 ceph-mon[34626]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 715 op/s 2024-09-21T02:40:37.100 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:36 smithi079 ceph-mon[30788]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 715 op/s 2024-09-21T02:40:37.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:36 smithi098 ceph-mon[34832]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 715 op/s 2024-09-21T02:40:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 -- 172.21.15.79:0/2287462216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 msgr2=0x7f360c10bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 --2- 172.21.15.79:0/2287462216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c10bae0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009900 tx=0x7f35f802a410 comp rx=0 tx=0).stop 2024-09-21T02:40:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 -- 172.21.15.79:0/2287462216 shutdown_connections 2024-09-21T02:40:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 --2- 172.21.15.79:0/2287462216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c10c020 0x7f360c112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 --2- 172.21.15.79:0/2287462216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c10bae0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 --2- 172.21.15.79:0/2287462216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360c105d90 0x7f360c1061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 -- 172.21.15.79:0/2287462216 >> 172.21.15.79:0/2287462216 conn(0x7f360c101860 msgr2=0x7f360c103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:37.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 -- 172.21.15.79:0/2287462216 shutdown_connections 2024-09-21T02:40:37.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.688+0000 7f3611e00640 1 -- 172.21.15.79:0/2287462216 wait complete. 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.689+0000 7f3611e00640 1 Processor -- start 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f3611e00640 1 -- start start 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f3611e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360c105d90 0x7f360c19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f3611e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f3611e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c10c020 0x7f360c1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f3611e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f360c115d30 con 0x7f360c10b6d0 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f3611e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f360c115bb0 con 0x7f360c10c020 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f3611e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f360c115eb0 con 0x7f360c105d90 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f360a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f360a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49392/0 (socket says 172.21.15.79:49392) 2024-09-21T02:40:37.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f360a000640 1 -- 172.21.15.79:0/897618419 learned_addr learned my addr 172.21.15.79:0/897618419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:37.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f360aa00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360c105d90 0x7f360c19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.690+0000 7f360b400640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c10c020 0x7f360c1a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.691+0000 7f360a000640 1 -- 172.21.15.79:0/897618419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360c105d90 msgr2=0x7f360c19c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.691+0000 7f360a000640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360c105d90 0x7f360c19c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.691+0000 7f360a000640 1 -- 172.21.15.79:0/897618419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c10c020 msgr2=0x7f360c1a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.691+0000 7f360a000640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c10c020 0x7f360c1a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.691+0000 7f360a000640 1 -- 172.21.15.79:0/897618419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360c1a2650 con 0x7f360c10b6d0 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.691+0000 7f360a000640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c19cc80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005ab0 tx=0x7f35f8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.691+0000 7f3610a00640 1 -- 172.21.15.79:0/897618419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f803f070 con 0x7f360c10b6d0 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.692+0000 7f3610a00640 1 -- 172.21.15.79:0/897618419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f8031b50 con 0x7f360c10b6d0 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.692+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f360c1a28e0 con 0x7f360c10b6d0 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.692+0000 7f3610a00640 1 -- 172.21.15.79:0/897618419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8035030 con 0x7f360c10b6d0 2024-09-21T02:40:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.692+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f360c1a90a0 con 0x7f360c10b6d0 2024-09-21T02:40:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 Processor -- start 2024-09-21T02:40:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 -- start start 2024-09-21T02:40:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3610a00640 1 -- 172.21.15.79:0/897618419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f35f8042070 con 0x7f360c10b6d0 2024-09-21T02:40:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e1e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de19660 0x564c2e1e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564c2e160290 con 0x564c2de21840 2024-09-21T02:40:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564c2e14f6c0 con 0x564c2de42520 2024-09-21T02:40:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.695+0000 7f3618ad0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564c2e1534d0 con 0x564c2de19660 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de19660 0x564c2e1e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49398/0 (socket says 172.21.15.79:49398) 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 -- 172.21.15.79:0/2057329608 learned_addr learned my addr 172.21.15.79:0/2057329608 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e1e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 -- 172.21.15.79:0/2057329608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de19660 msgr2=0x564c2e1e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de19660 0x564c2e1e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 -- 172.21.15.79:0/2057329608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 msgr2=0x564c2e1e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e1e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360a000640 1 -- 172.21.15.79:0/2057329608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2e0dc460 con 0x564c2de21840 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.696+0000 7f360b400640 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e1e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.697+0000 7f360a000640 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1e9c40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f35f810bd30 tx=0x7f35f810be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d27f2861ea8b701 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:37.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.697+0000 7f35f7e00640 1 -- 172.21.15.79:0/2057329608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8117070 con 0x564c2de21840 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.697+0000 7f35f7e00640 1 -- 172.21.15.79:0/2057329608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f8110bb0 con 0x564c2de21840 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.697+0000 7f35f7e00640 1 -- 172.21.15.79:0/2057329608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f810c040 con 0x564c2de21840 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.697+0000 7f3610a00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35f00b6590 0x7f35f00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.697+0000 7f3610a00640 1 -- 172.21.15.79:0/897618419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f35f8107c00 con 0x7f360c10b6d0 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.697+0000 7f360b400640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35f00b6590 0x7f35f00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 -- 172.21.15.79:0/2057329608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 msgr2=0x564c2e1e9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1e9c40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f35f810bd30 tx=0x7f35f810be20 comp rx=0 tx=0).stop 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 -- 172.21.15.79:0/2057329608 shutdown_connections 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1e9c40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de19660 0x564c2e1e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2057329608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e1e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 -- 172.21.15.79:0/2057329608 >> 172.21.15.79:0/2057329608 conn(0x564c2de36910 msgr2=0x564c2e1e70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f360b400640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35f00b6590 0x7f35f00b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3604009fd0 tx=0x7f3604009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:37.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 -- 172.21.15.79:0/2057329608 shutdown_connections 2024-09-21T02:40:37.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.698+0000 7f3618ad0740 1 -- 172.21.15.79:0/2057329608 wait complete. 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 -- start start 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 Processor -- start 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de42520 0x564c2e2009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564c2dfb0bb0 con 0x564c2de42520 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564c2e0ea6c0 con 0x564c2de19660 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.699+0000 7f3618ad0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564c2e1f7760 con 0x564c2de21840 2024-09-21T02:40:37.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f3618ad0740 10 client.0 _ll_register_callbacks cb 0x564c2e105490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58962/0 (socket says 172.21.15.79:58962) 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 -- 172.21.15.79:0/2947955311 learned_addr learned my addr 172.21.15.79:0/2947955311 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360b400640 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de42520 0x564c2e2009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 -- 172.21.15.79:0/2947955311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 msgr2=0x564c2e1f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 -- 172.21.15.79:0/2947955311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de42520 msgr2=0x564c2e2009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de42520 0x564c2e2009c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 -- 172.21.15.79:0/2947955311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2deadb00 con 0x564c2de19660 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360a000640 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:37.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f360aa00640 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35fc012740 tx=0x7f35fc012c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0f39237cd3f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.700+0000 7f35f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f35f4c00640 1 -- 172.21.15.79:0/2947955311 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc012190 con 0x564c2de19660 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f8110bb0 con 0x564c2de19660 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f35f4c00640 1 -- 172.21.15.79:0/2947955311 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f35fc00f920 con 0x564c2de19660 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f35f4c00640 1 -- 172.21.15.79:0/2947955311 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f35fc00fb20 con 0x564c2de19660 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f3618ad0740 10 client.25868 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564c2df24960 con 0x564c2de19660 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f35f4c00640 1 -- 172.21.15.79:0/2947955311 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f8110bb0 con 0x564c2de19660 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.701+0000 7f35f4c00640 1 -- 172.21.15.79:0/2947955311 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f35fc01c420 con 0x564c2de19660 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.702+0000 7f3618ad0740 10 client.25868 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.702+0000 7f3618ad0740 10 client.25868 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.702+0000 7f3618ad0740 20 client.25868 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:37.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.702+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2de00ea0 0x564c2e206b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.702+0000 7f3618ad0740 4 client.25868 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:37.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.702+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c2e1621e0 con 0x564c2de00ea0 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.702+0000 7f360a000640 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2de00ea0 0x564c2e206b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.703+0000 7f360a000640 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2de00ea0 0x564c2e206b10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c88d9a0deec71041 server_cookie=a9b6b8118f04e4d5 in_seq=0 out_seq=0 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.703+0000 7f35f4c00640 10 client.25868 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.703+0000 7f35f4c00640 1 -- 172.21.15.79:0/2947955311 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c2e1621e0 con 0x564c2de00ea0 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.703+0000 7f35f4c00640 10 client.25868 handle_command_reply: tid=0 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.703+0000 7f3618ad0740 1 client.25868 shutdown 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.703+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 msgr2=0x564c2e1f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35fc012740 tx=0x7f35fc012c00 comp rx=0 tx=0).stop 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 shutdown_connections 2024-09-21T02:40:37.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2de00ea0 0x564c2e206b10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de42520 0x564c2e2009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f35f4c00640 0 client.25868 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2947955311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f4d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 >> 172.21.15.79:0/2947955311 conn(0x564c2de36910 msgr2=0x564c2e1ec350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 shutdown_connections 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 1 -- 172.21.15.79:0/2947955311 wait complete. 2024-09-21T02:40:37.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.704+0000 7f3618ad0740 20 client.25868 trim_cache size 0 max 16384 2024-09-21T02:40:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.721+0000 7f3618ad0740 1 Processor -- start 2024-09-21T02:40:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.721+0000 7f3618ad0740 1 -- start start 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de19660 0x564c2e1ea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e2008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f3618ad0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1b0d40 con 0x564c2de19660 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f3618ad0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1b35c0 con 0x564c2de42520 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f3618ad0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1b13b0 con 0x564c2de21840 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de19660 0x564c2e1ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de19660 0x564c2e1ea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49412/0 (socket says 172.21.15.79:49412) 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 -- 172.21.15.79:0/2257182372 learned_addr learned my addr 172.21.15.79:0/2257182372 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360b400640 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e2008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360a000640 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 -- 172.21.15.79:0/2257182372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 msgr2=0x564c2e1ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1ee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 -- 172.21.15.79:0/2257182372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 msgr2=0x564c2e2008c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e2008c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.722+0000 7f360aa00640 1 -- 172.21.15.79:0/2257182372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2e1eb4b0 con 0x564c2de19660 2024-09-21T02:40:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.723+0000 7f360aa00640 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de19660 0x564c2e1ea860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f35fc01dff0 tx=0x7f35fc00f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfb7a1990300cae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.723+0000 7f35f7400640 1 -- 172.21.15.79:0/2257182372 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc012190 con 0x564c2de19660 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.723+0000 7f35f7400640 1 -- 172.21.15.79:0/2257182372 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc00fcc0 con 0x564c2de19660 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.723+0000 7f35f7400640 1 -- 172.21.15.79:0/2257182372 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc005340 con 0x564c2de19660 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 -- 172.21.15.79:0/2257182372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de19660 msgr2=0x564c2e1ea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de19660 0x564c2e1ea860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f35fc01dff0 tx=0x7f35fc00f9a0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 -- 172.21.15.79:0/2257182372 shutdown_connections 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de42520 0x564c2e2008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de21840 0x564c2e1ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 --2- 172.21.15.79:0/2257182372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de19660 0x564c2e1ea860 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 -- 172.21.15.79:0/2257182372 >> 172.21.15.79:0/2257182372 conn(0x564c2de36910 msgr2=0x564c2e1f3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 -- 172.21.15.79:0/2257182372 shutdown_connections 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 -- 172.21.15.79:0/2257182372 wait complete. 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.724+0000 7f3618ad0740 1 -- start start 2024-09-21T02:40:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 1 Processor -- start 2024-09-21T02:40:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1f9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de42520 0x564c2e1fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1b1a80 con 0x564c2de21840 2024-09-21T02:40:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1b2ef0 con 0x564c2de19660 2024-09-21T02:40:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1b2150 con 0x564c2de42520 2024-09-21T02:40:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.725+0000 7f3618ad0740 10 client.0 _ll_register_callbacks cb 0x7f35fc009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1f9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58970/0 (socket says 172.21.15.79:58970) 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 -- 172.21.15.79:0/1007779379 learned_addr learned my addr 172.21.15.79:0/1007779379 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360b400640 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de42520 0x564c2e1fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 -- 172.21.15.79:0/1007779379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de42520 msgr2=0x564c2e1fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de42520 0x564c2e1fa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 -- 172.21.15.79:0/1007779379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 msgr2=0x564c2e1f9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1f9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 -- 172.21.15.79:0/1007779379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2e271680 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f360aa00640 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f9a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0120a0 tx=0x7f35fc0096b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b92a66ac38ea2ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.726+0000 7f35f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f35f4c00640 1 -- 172.21.15.79:0/1007779379 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc01cc10 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f35f4c00640 1 -- 172.21.15.79:0/1007779379 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f35fc01cdb0 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35fc00fcc0 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f35f4c00640 1 -- 172.21.15.79:0/1007779379 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f35fc03c050 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 10 client.25874 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564c2e272940 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f35f4c00640 1 -- 172.21.15.79:0/1007779379 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc00fcc0 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f35f4c00640 1 -- 172.21.15.79:0/1007779379 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f35fc031020 con 0x564c2de19660 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 10 client.25874 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:37.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 10 client.25874 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:40:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 20 client.25874 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2ddd6250 0x564c2e275040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 4 client.25874 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a3e45020", "release": true, "await": true}] 2024-09-21T02:40:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.727+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a3e45020", "release": true, "await": true}) -- 0x564c2e15dc90 con 0x564c2ddd6250 2024-09-21T02:40:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.728+0000 7f360a000640 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2ddd6250 0x564c2e275040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.728+0000 7f360a000640 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2ddd6250 0x564c2e275040 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340e8a5bfd01cb4a server_cookie=df4fd354663ac97a in_seq=0 out_seq=0 2024-09-21T02:40:37.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.728+0000 7f35f4c00640 10 client.25874 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:37.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.779+0000 7f35f4c00640 1 -- 172.21.15.79:0/1007779379 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564c2e15dc90 con 0x564c2ddd6250 2024-09-21T02:40:37.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.779+0000 7f35f4c00640 10 client.25874 handle_command_reply: tid=0 2024-09-21T02:40:37.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.779+0000 7f3618ad0740 1 client.25874 shutdown 2024-09-21T02:40:37.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 msgr2=0x564c2e1f9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f9a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0120a0 tx=0x7f35fc0096b0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 shutdown_connections 2024-09-21T02:40:37.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564c2ddd6250 0x564c2e275040 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c2de42520 0x564c2e1fa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c2de21840 0x564c2e1f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 --2- 172.21.15.79:0/1007779379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564c2de19660 0x564c2e1f9a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 >> 172.21.15.79:0/1007779379 conn(0x564c2de36910 msgr2=0x564c2e1ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:37.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.780+0000 7f35f4c00640 0 client.25874 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.781+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 shutdown_connections 2024-09-21T02:40:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.783+0000 7f3618ad0740 1 -- 172.21.15.79:0/1007779379 wait complete. 2024-09-21T02:40:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.783+0000 7f3618ad0740 20 client.25874 trim_cache size 0 max 16384 2024-09-21T02:40:37.788 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:40:37.788 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:40:37.788 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:40:37.788 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 20, 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "a3e45020": { 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 20, 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 130.0, 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:40:37.789 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:40:37.790 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:40:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35f00b6590 msgr2=0x7f35f00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35f00b6590 0x7f35f00b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3604009fd0 tx=0x7f3604009500 comp rx=0 tx=0).stop 2024-09-21T02:40:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 msgr2=0x7f360c19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c19cc80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005ab0 tx=0x7f35f8003b90 comp rx=0 tx=0).stop 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 shutdown_connections 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f35f00b6590 0x7f35f00b8aa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c10c020 0x7f360c1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f360c10b6d0 0x7f360c19cc80 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005ab0 tx=0x7f35f8003b90 comp rx=0 tx=0).stop 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 --2- 172.21.15.79:0/897618419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f360c105d90 0x7f360c19c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.791+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 >> 172.21.15.79:0/897618419 conn(0x7f360c101860 msgr2=0x7f360c108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.792+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 shutdown_connections 2024-09-21T02:40:37.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:37.792+0000 7f3611e00640 1 -- 172.21.15.79:0/897618419 wait complete. 2024-09-21T02:40:39.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:38 smithi148 ceph-mon[34626]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.2 MiB/s wr, 359 op/s 2024-09-21T02:40:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:38 smithi098 ceph-mon[34832]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.2 MiB/s wr, 359 op/s 2024-09-21T02:40:39.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:38 smithi079 ceph-mon[30788]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.2 MiB/s wr, 359 op/s 2024-09-21T02:40:39.624 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a3e45020', total seconds elapsed: 15.5 2024-09-21T02:40:41.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:40 smithi148 ceph-mon[34626]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.1 MiB/s wr, 284 op/s 2024-09-21T02:40:41.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:40 smithi098 ceph-mon[34832]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.1 MiB/s wr, 284 op/s 2024-09-21T02:40:41.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:40 smithi079 ceph-mon[30788]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.1 MiB/s wr, 284 op/s 2024-09-21T02:40:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 285.0 s, 549.7 tps, lat 430.916 ms stddev 1582.480 2024-09-21T02:40:43.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:42 smithi148 ceph-mon[34626]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.6 MiB/s wr, 210 op/s 2024-09-21T02:40:43.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:42 smithi098 ceph-mon[34832]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.6 MiB/s wr, 210 op/s 2024-09-21T02:40:43.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:42 smithi079 ceph-mon[30788]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.6 MiB/s wr, 210 op/s 2024-09-21T02:40:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.651+0000 7fdcfde00640 1 -- 172.21.15.79:0/2936257209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 msgr2=0x7fdcf810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.651+0000 7fdcfde00640 1 --2- 172.21.15.79:0/2936257209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 0x7fdcf810daf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0009c90 tx=0x7fdcf002a860 comp rx=0 tx=0).stop 2024-09-21T02:40:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.651+0000 7fdcfde00640 1 -- 172.21.15.79:0/2936257209 shutdown_connections 2024-09-21T02:40:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.651+0000 7fdcfde00640 1 --2- 172.21.15.79:0/2936257209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 0x7fdcf810daf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.651+0000 7fdcfde00640 1 --2- 172.21.15.79:0/2936257209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf8108c20 0x7fdcf810b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.651+0000 7fdcfde00640 1 --2- 172.21.15.79:0/2936257209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf806b540 0x7fdcf81086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.651+0000 7fdcfde00640 1 -- 172.21.15.79:0/2936257209 >> 172.21.15.79:0/2936257209 conn(0x7fdcf80fdee0 msgr2=0x7fdcf8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.652+0000 7fdcfde00640 1 -- 172.21.15.79:0/2936257209 shutdown_connections 2024-09-21T02:40:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.652+0000 7fdcfde00640 1 -- 172.21.15.79:0/2936257209 wait complete. 2024-09-21T02:40:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 Processor -- start 2024-09-21T02:40:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 -- start start 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf806b540 0x7fdcf819c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf8108c20 0x7fdcf819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 0x7fdcf819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf8111540 con 0x7fdcf806b540 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81113c0 con 0x7fdcf810b600 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.653+0000 7fdcfde00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81116c0 con 0x7fdcf8108c20 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf8108c20 0x7fdcf819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 0x7fdcf819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf8108c20 0x7fdcf819c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55350/0 (socket says 172.21.15.79:55350) 2024-09-21T02:40:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 -- 172.21.15.79:0/401832960 learned_addr learned my addr 172.21.15.79:0/401832960 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf806b540 0x7fdcf819c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 -- 172.21.15.79:0/401832960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 msgr2=0x7fdcf819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 0x7fdcf819d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 -- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf806b540 msgr2=0x7fdcf819c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf806b540 0x7fdcf819c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 -- 172.21.15.79:0/401832960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf819db80 con 0x7fdcf8108c20 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.654+0000 7fdcf6000640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf8108c20 0x7fdcf819c7b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdce400d950 tx=0x7fdce400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.655+0000 7fdcfca00640 1 -- 172.21.15.79:0/401832960 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4017030 con 0x7fdcf8108c20 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.655+0000 7fdcfca00640 1 -- 172.21.15.79:0/401832960 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce4004020 con 0x7fdcf8108c20 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.655+0000 7fdcfca00640 1 -- 172.21.15.79:0/401832960 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce40047a0 con 0x7fdcf8108c20 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.655+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf819de70 con 0x7fdcf8108c20 2024-09-21T02:40:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.655+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf81a4560 con 0x7fdcf8108c20 2024-09-21T02:40:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.659+0000 7fdd04e86740 1 Processor -- start 2024-09-21T02:40:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.660+0000 7fdd04e86740 1 -- start start 2024-09-21T02:40:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.660+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a59f1b0 0x55c31a9460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.660+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a946740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.660+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a947290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.660+0000 7fdd04e86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c31a8b96b0 con 0x55c31a5762f0 2024-09-21T02:40:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.660+0000 7fdd04e86740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c31a8a8ae0 con 0x55c31a59f1b0 2024-09-21T02:40:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.660+0000 7fdd04e86740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c31a8ac8f0 con 0x55c31a57e4d0 2024-09-21T02:40:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.661+0000 7fdcf6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a946740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.661+0000 7fdcf6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a946740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53530/0 (socket says 172.21.15.79:53530) 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.661+0000 7fdcf6a00640 1 -- 172.21.15.79:0/3525128139 learned_addr learned my addr 172.21.15.79:0/3525128139 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.661+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a59f1b0 0x55c31a9460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.661+0000 7fdcfca00640 1 -- 172.21.15.79:0/401832960 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdce4009a30 con 0x7fdcf8108c20 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.662+0000 7fdcf7400640 1 -- 172.21.15.79:0/3525128139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 msgr2=0x55c31a947290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.662+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a947290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.662+0000 7fdcf7400640 1 -- 172.21.15.79:0/3525128139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 msgr2=0x55c31a946740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.662+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a946740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.662+0000 7fdcf7400640 1 -- 172.21.15.79:0/3525128139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31a875780 con 0x55c31a59f1b0 2024-09-21T02:40:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.663+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a59f1b0 0x55c31a9460d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdcf002ae50 tx=0x7fdcf0009940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42cb0194b07ebd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.663+0000 7fdce3e00640 1 -- 172.21.15.79:0/3525128139 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0031e30 con 0x55c31a59f1b0 2024-09-21T02:40:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.663+0000 7fdce3e00640 1 -- 172.21.15.79:0/3525128139 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf0036030 con 0x55c31a59f1b0 2024-09-21T02:40:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.663+0000 7fdce3e00640 1 -- 172.21.15.79:0/3525128139 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0030a30 con 0x55c31a59f1b0 2024-09-21T02:40:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.663+0000 7fdcfca00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcdc0b6610 0x7fdcdc0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.664+0000 7fdcfca00640 1 -- 172.21.15.79:0/401832960 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdce40e70e0 con 0x7fdcf8108c20 2024-09-21T02:40:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.664+0000 7fdd04e86740 1 -- 172.21.15.79:0/3525128139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a59f1b0 msgr2=0x55c31a9460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.664+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a59f1b0 0x55c31a9460d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdcf002ae50 tx=0x7fdcf0009940 comp rx=0 tx=0).stop 2024-09-21T02:40:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdd04e86740 1 -- 172.21.15.79:0/3525128139 shutdown_connections 2024-09-21T02:40:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a947290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a946740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3525128139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a59f1b0 0x55c31a9460d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdd04e86740 1 -- 172.21.15.79:0/3525128139 >> 172.21.15.79:0/3525128139 conn(0x55c31a593300 msgr2=0x55c31a941b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcdc0b6610 0x7fdcdc0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdd04e86740 1 -- 172.21.15.79:0/3525128139 shutdown_connections 2024-09-21T02:40:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.665+0000 7fdd04e86740 1 -- 172.21.15.79:0/3525128139 wait complete. 2024-09-21T02:40:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.666+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcdc0b6610 0x7fdcdc0b8b20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009b40 tx=0x7fdce8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.666+0000 7fdd04e86740 1 -- start start 2024-09-21T02:40:44.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.666+0000 7fdd04e86740 1 Processor -- start 2024-09-21T02:40:44.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a5762f0 0x55c31a94f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a94fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a950990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdd04e86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c31a7e0ab0 con 0x55c31a59f1b0 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdd04e86740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c31a84f570 con 0x55c31a5762f0 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdd04e86740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c31a947d50 con 0x55c31a57e4d0 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdd04e86740 10 client.0 _ll_register_callbacks cb 0x55c31a85e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdcf6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a5762f0 0x55c31a94f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdcf6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a5762f0 0x55c31a94f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57558/0 (socket says 172.21.15.79:57558) 2024-09-21T02:40:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.667+0000 7fdcf6a00640 1 -- 172.21.15.79:0/1882899420 learned_addr learned my addr 172.21.15.79:0/1882899420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf6000640 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a94fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf7400640 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a950990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf6000640 1 -- 172.21.15.79:0/1882899420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a5762f0 msgr2=0x55c31a94f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf6000640 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a5762f0 0x55c31a94f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf6000640 1 -- 172.21.15.79:0/1882899420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 msgr2=0x55c31a950990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf6000640 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a950990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf6000640 1 -- 172.21.15.79:0/1882899420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31a60a790 con 0x55c31a57e4d0 2024-09-21T02:40:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdcf6000640 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a94fe20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdce40acb60 tx=0x7fdce4009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9e637b30b0f7e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.668+0000 7fdce0c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:40:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.669+0000 7fdce0c00640 1 -- 172.21.15.79:0/1882899420 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ad560 con 0x55c31a57e4d0 2024-09-21T02:40:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.669+0000 7fdce0c00640 1 -- 172.21.15.79:0/1882899420 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdce40ac0c0 con 0x55c31a57e4d0 2024-09-21T02:40:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.669+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf0036030 con 0x55c31a57e4d0 2024-09-21T02:40:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.669+0000 7fdce0c00640 1 -- 172.21.15.79:0/1882899420 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdce40b1940 con 0x55c31a57e4d0 2024-09-21T02:40:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.669+0000 7fdd04e86740 10 client.25891 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.669+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c31a683620 con 0x55c31a57e4d0 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdce0c00640 1 -- 172.21.15.79:0/1882899420 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf0036030 con 0x55c31a57e4d0 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdce0c00640 1 -- 172.21.15.79:0/1882899420 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdce40a87b0 con 0x55c31a57e4d0 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdd04e86740 10 client.25891 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdd04e86740 10 client.25891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdd04e86740 20 client.25891 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdd04e86740 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a55dd80 0x55c31a95ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdd04e86740 4 client.25891 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.670+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c31a8bb600 con 0x55c31a55dd80 2024-09-21T02:40:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.671+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a55dd80 0x55c31a95ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.673+0000 7fdce0c00640 10 client.25891 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.673+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a55dd80 0x55c31a95ce60 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af8ad9c8cb97905b server_cookie=fa6119088fe468eb in_seq=0 out_seq=0 2024-09-21T02:40:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.674+0000 7fdce0c00640 1 -- 172.21.15.79:0/1882899420 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c31a8bb600 con 0x55c31a55dd80 2024-09-21T02:40:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.674+0000 7fdce0c00640 10 client.25891 handle_command_reply: tid=0 2024-09-21T02:40:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 client.25891 shutdown 2024-09-21T02:40:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 msgr2=0x55c31a94fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a94fe20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdce40acb60 tx=0x7fdce4009f50 comp rx=0 tx=0).stop 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 shutdown_connections 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a55dd80 0x55c31a95ce60 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a950990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a57e4d0 0x55c31a94fe20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 --2- 172.21.15.79:0/1882899420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a5762f0 0x55c31a94f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 >> 172.21.15.79:0/1882899420 conn(0x55c31a593300 msgr2=0x55c31a941b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdce0c00640 0 client.25891 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 shutdown_connections 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 1 -- 172.21.15.79:0/1882899420 wait complete. 2024-09-21T02:40:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.675+0000 7fdd04e86740 20 client.25891 trim_cache size 0 max 16384 2024-09-21T02:40:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.695+0000 7fdd04e86740 1 Processor -- start 2024-09-21T02:40:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.695+0000 7fdd04e86740 1 -- start start 2024-09-21T02:40:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a5762f0 0x55c31a94a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a957870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a94c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdd04e86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81ac7c0 con 0x55c31a59f1b0 2024-09-21T02:40:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdd04e86740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81af040 con 0x55c31a57e4d0 2024-09-21T02:40:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdd04e86740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81ace30 con 0x55c31a5762f0 2024-09-21T02:40:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a957870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a5762f0 0x55c31a94a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a957870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57560/0 (socket says 172.21.15.79:57560) 2024-09-21T02:40:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 -- 172.21.15.79:0/3384136503 learned_addr learned my addr 172.21.15.79:0/3384136503 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a94c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 -- 172.21.15.79:0/3384136503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a5762f0 msgr2=0x55c31a94a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a5762f0 0x55c31a94a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 -- 172.21.15.79:0/3384136503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 msgr2=0x55c31a94c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a94c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.696+0000 7fdcf6000640 1 -- 172.21.15.79:0/3384136503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31a95d1d0 con 0x55c31a57e4d0 2024-09-21T02:40:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.697+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a5762f0 0x55c31a94a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.697+0000 7fdcf6000640 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a957870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdce4005fd0 tx=0x7fdce4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=824badad63c20c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.697+0000 7fdce3400640 1 -- 172.21.15.79:0/3384136503 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ac5d0 con 0x55c31a57e4d0 2024-09-21T02:40:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.697+0000 7fdce3400640 1 -- 172.21.15.79:0/3384136503 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce40ad560 con 0x55c31a57e4d0 2024-09-21T02:40:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.698+0000 7fdce3400640 1 -- 172.21.15.79:0/3384136503 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce40abe10 con 0x55c31a57e4d0 2024-09-21T02:40:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.698+0000 7fdd04e86740 1 -- 172.21.15.79:0/3384136503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 msgr2=0x55c31a957870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.698+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a957870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdce4005fd0 tx=0x7fdce4004730 comp rx=0 tx=0).stop 2024-09-21T02:40:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 -- 172.21.15.79:0/3384136503 shutdown_connections 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a59f1b0 0x55c31a94c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a957870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3384136503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a5762f0 0x55c31a94a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 -- 172.21.15.79:0/3384136503 >> 172.21.15.79:0/3384136503 conn(0x55c31a593300 msgr2=0x55c31a94a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 -- 172.21.15.79:0/3384136503 shutdown_connections 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 -- 172.21.15.79:0/3384136503 wait complete. 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.699+0000 7fdd04e86740 1 -- start start 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.700+0000 7fdd04e86740 1 Processor -- start 2024-09-21T02:40:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.700+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a957680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.700+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a9cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.700+0000 7fdd04e86740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a59f1b0 0x55c31a9ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdd04e86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81ad500 con 0x55c31a5762f0 2024-09-21T02:40:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdd04e86740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81ae970 con 0x55c31a57e4d0 2024-09-21T02:40:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdd04e86740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf81adbd0 con 0x55c31a59f1b0 2024-09-21T02:40:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdd04e86740 10 client.0 _ll_register_callbacks cb 0x7fdce40acc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a59f1b0 0x55c31a9ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a59f1b0 0x55c31a9ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55376/0 (socket says 172.21.15.79:55376) 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 -- 172.21.15.79:0/3557189535 learned_addr learned my addr 172.21.15.79:0/3557189535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a957680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 -- 172.21.15.79:0/3557189535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 msgr2=0x55c31a9cbfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a9cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 -- 172.21.15.79:0/3557189535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 msgr2=0x55c31a957680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a957680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf7400640 1 -- 172.21.15.79:0/3557189535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31a9cee20 con 0x55c31a59f1b0 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.701+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a957680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.702+0000 7fdcf7400640 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a59f1b0 0x55c31a9ce690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0031040 tx=0x7fdcf0031e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1072474bbb8490d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.702+0000 7fdce0c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:40:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.702+0000 7fdce0c00640 1 -- 172.21.15.79:0/3557189535 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00316c0 con 0x55c31a59f1b0 2024-09-21T02:40:44.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.702+0000 7fdce0c00640 1 -- 172.21.15.79:0/3557189535 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdcf0004a90 con 0x55c31a59f1b0 2024-09-21T02:40:44.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.702+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce40ad560 con 0x55c31a59f1b0 2024-09-21T02:40:44.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdce0c00640 1 -- 172.21.15.79:0/3557189535 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdcf005a050 con 0x55c31a59f1b0 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 10 client.25897 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c31a9d00e0 con 0x55c31a59f1b0 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdce0c00640 1 -- 172.21.15.79:0/3557189535 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce40ad560 con 0x55c31a59f1b0 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdce0c00640 1 -- 172.21.15.79:0/3557189535 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdcf0055030 con 0x55c31a59f1b0 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 10 client.25897 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 10 client.25897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 20 client.25897 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a5331c0 0x55c31a9d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 4 client.25897 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.703+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c31a8b70b0 con 0x55c31a5331c0 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.704+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a5331c0 0x55c31a9d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.704+0000 7fdcf6a00640 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a5331c0 0x55c31a9d26e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf308053b5b337a6 server_cookie=df55c08ff056cf33 in_seq=0 out_seq=0 2024-09-21T02:40:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.704+0000 7fdce0c00640 10 client.25897 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdce0c00640 1 -- 172.21.15.79:0/3557189535 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c31a8b70b0 con 0x55c31a5331c0 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdce0c00640 10 client.25897 handle_command_reply: tid=0 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 client.25897 shutdown 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a59f1b0 msgr2=0x55c31a9ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a59f1b0 0x55c31a9ce690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0031040 tx=0x7fdcf0031e60 comp rx=0 tx=0).stop 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 shutdown_connections 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c31a5331c0 0x55c31a9d26e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c31a59f1b0 0x55c31a9ce690 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c31a57e4d0 0x55c31a9cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdce0c00640 0 client.25897 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 --2- 172.21.15.79:0/3557189535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c31a5762f0 0x55c31a957680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.774+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 >> 172.21.15.79:0/3557189535 conn(0x55c31a593300 msgr2=0x55c31a9615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.776+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 shutdown_connections 2024-09-21T02:40:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.776+0000 7fdd04e86740 1 -- 172.21.15.79:0/3557189535 wait complete. 2024-09-21T02:40:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.776+0000 7fdd04e86740 20 client.25897 trim_cache size 0 max 16384 2024-09-21T02:40:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:40:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:40:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:40:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:40:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.777+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcdc0b6610 msgr2=0x7fdcdc0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.777+0000 7fdcfde00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcdc0b6610 0x7fdcdc0b8b20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009b40 tx=0x7fdce8005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.777+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf8108c20 msgr2=0x7fdcf819c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.777+0000 7fdcfde00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf8108c20 0x7fdcf819c7b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdce400d950 tx=0x7fdce400de10 comp rx=0 tx=0).stop 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.777+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 shutdown_connections 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.778+0000 7fdcfde00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdcdc0b6610 0x7fdcdc0b8b20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.778+0000 7fdcfde00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcf810b600 0x7fdcf819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.778+0000 7fdcfde00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcf8108c20 0x7fdcf819c7b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.778+0000 7fdcfde00640 1 --2- 172.21.15.79:0/401832960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcf806b540 0x7fdcf819c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.778+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 >> 172.21.15.79:0/401832960 conn(0x7fdcf80fdee0 msgr2=0x7fdcf8109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.778+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 shutdown_connections 2024-09-21T02:40:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:44.779+0000 7fdcfde00640 1 -- 172.21.15.79:0/401832960 wait complete. 2024-09-21T02:40:45.040 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:44 smithi079 ceph-mon[30788]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-09-21T02:40:45.062 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:44 smithi148 ceph-mon[34626]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-09-21T02:40:45.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:44 smithi098 ceph-mon[34832]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-09-21T02:40:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 290.0 s, 865.6 tps, lat 115.356 ms stddev 138.588 2024-09-21T02:40:47.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:46 smithi148 ceph-mon[34626]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 316 op/s 2024-09-21T02:40:47.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:46 smithi098 ceph-mon[34832]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 316 op/s 2024-09-21T02:40:47.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:46 smithi079 ceph-mon[30788]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 316 op/s 2024-09-21T02:40:49.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:48 smithi148 ceph-mon[34626]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-21T02:40:49.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:48 smithi098 ceph-mon[34832]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-21T02:40:49.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:48 smithi079 ceph-mon[30788]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-21T02:40:51.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:50 smithi148 ceph-mon[34626]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 450 op/s 2024-09-21T02:40:51.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:50 smithi098 ceph-mon[34832]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 450 op/s 2024-09-21T02:40:51.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:50 smithi079 ceph-mon[30788]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 450 op/s 2024-09-21T02:40:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 295.0 s, 715.2 tps, lat 137.926 ms stddev 160.557 2024-09-21T02:40:53.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:52 smithi148 ceph-mon[34626]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.6 MiB/s wr, 591 op/s 2024-09-21T02:40:53.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:52 smithi098 ceph-mon[34832]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.6 MiB/s wr, 591 op/s 2024-09-21T02:40:53.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:52 smithi079 ceph-mon[30788]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.6 MiB/s wr, 591 op/s 2024-09-21T02:40:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:54 smithi148 ceph-mon[34626]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 607 op/s 2024-09-21T02:40:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:54 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:40:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:54 smithi098 ceph-mon[34832]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 607 op/s 2024-09-21T02:40:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:54 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:40:55.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:54 smithi079 ceph-mon[30788]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 607 op/s 2024-09-21T02:40:55.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:54 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:40:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 300.0 s, 726.4 tps, lat 138.872 ms stddev 183.211 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 754 op/s 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi079 to 176.4M 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: Unable to set osd_memory_target on smithi079 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:40:57.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:40:57.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:40:57.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 754 op/s 2024-09-21T02:40:57.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi079 to 176.4M 2024-09-21T02:40:57.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: Unable to set osd_memory_target on smithi079 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T02:40:57.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:40:57.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:40:57.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:40:57.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 754 op/s 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi079 to 176.4M 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: Unable to set osd_memory_target on smithi079 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:40:57.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:40:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.074+0000 7f7a87000640 1 -- 172.21.15.79:0/2588440571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a800782a0 msgr2=0x7f7a8007a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.074+0000 7f7a87000640 1 --2- 172.21.15.79:0/2588440571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a800782a0 0x7f7a8007a6c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009860 tx=0x7f7a6c02a380 comp rx=0 tx=0).stop 2024-09-21T02:40:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.075+0000 7f7a87000640 1 -- 172.21.15.79:0/2588440571 shutdown_connections 2024-09-21T02:40:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.075+0000 7f7a87000640 1 --2- 172.21.15.79:0/2588440571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a8007ac00 0x7f7a8007d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.075+0000 7f7a87000640 1 --2- 172.21.15.79:0/2588440571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a800782a0 0x7f7a8007a6c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.075+0000 7f7a87000640 1 --2- 172.21.15.79:0/2588440571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a800754e0 0x7f7a80075950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.075+0000 7f7a87000640 1 -- 172.21.15.79:0/2588440571 >> 172.21.15.79:0/2588440571 conn(0x7f7a80070810 msgr2=0x7f7a80072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.075+0000 7f7a87000640 1 -- 172.21.15.79:0/2588440571 shutdown_connections 2024-09-21T02:40:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.075+0000 7f7a87000640 1 -- 172.21.15.79:0/2588440571 wait complete. 2024-09-21T02:40:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.077+0000 7f7a87000640 1 Processor -- start 2024-09-21T02:40:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.077+0000 7f7a87000640 1 -- start start 2024-09-21T02:40:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a87000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a800754e0 0x7f7a801b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a87000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a800782a0 0x7f7a801b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a87000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8007ac00 0x7f7a801b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a87000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80080bd0 con 0x7f7a800782a0 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a87000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80080a50 con 0x7f7a800754e0 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a87000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80080d50 con 0x7f7a8007ac00 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a85000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8007ac00 0x7f7a801b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a800754e0 0x7f7a801b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a85000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8007ac00 0x7f7a801b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47096/0 (socket says 172.21.15.79:47096) 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.078+0000 7f7a85000640 1 -- 172.21.15.79:0/2934181675 learned_addr learned my addr 172.21.15.79:0/2934181675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.079+0000 7f7a85000640 1 -- 172.21.15.79:0/2934181675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a800754e0 msgr2=0x7f7a801b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.079+0000 7f7a85000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a800754e0 0x7f7a801b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.079+0000 7f7a85000640 1 -- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a800782a0 msgr2=0x7f7a801b60d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T02:40:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.079+0000 7f7a7f400640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a800782a0 0x7f7a801b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.079+0000 7f7a85000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a800782a0 0x7f7a801b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.079+0000 7f7a85000640 1 -- 172.21.15.79:0/2934181675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a801b74a0 con 0x7f7a8007ac00 2024-09-21T02:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.079+0000 7f7a85000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8007ac00 0x7f7a801b6c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800ef50 tx=0x7f7a7800c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.080+0000 7f7a7cc00640 1 -- 172.21.15.79:0/2934181675 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78007d20 con 0x7f7a8007ac00 2024-09-21T02:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.080+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a801b7730 con 0x7f7a8007ac00 2024-09-21T02:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.080+0000 7f7a7cc00640 1 -- 172.21.15.79:0/2934181675 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a78003970 con 0x7f7a8007ac00 2024-09-21T02:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.080+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a801bde80 con 0x7f7a8007ac00 2024-09-21T02:40:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.080+0000 7f7a7cc00640 1 -- 172.21.15.79:0/2934181675 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78004480 con 0x7f7a8007ac00 2024-09-21T02:40:58.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.084+0000 7f7a8e07d740 1 Processor -- start 2024-09-21T02:40:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.087+0000 7f7a7cc00640 1 -- 172.21.15.79:0/2934181675 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7a7801b030 con 0x7f7a8007ac00 2024-09-21T02:40:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.088+0000 7f7a8e07d740 1 -- start start 2024-09-21T02:40:58.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ef41b0 0x56437929b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ecb2f0 0x56437929b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ed34d0 0x56437929c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56437920e6b0 con 0x564378ecb2f0 2024-09-21T02:40:58.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5643791fdae0 con 0x564378ed34d0 2024-09-21T02:40:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5643792018f0 con 0x564378ef41b0 2024-09-21T02:40:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ef41b0 0x56437929b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ef41b0 0x56437929b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47112/0 (socket says 172.21.15.79:47112) 2024-09-21T02:40:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 -- 172.21.15.79:0/2932865447 learned_addr learned my addr 172.21.15.79:0/2932865447 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7cc00640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7a640bee60 0x7f7a640c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ed34d0 0x56437929c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ecb2f0 0x56437929b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7cc00640 1 -- 172.21.15.79:0/2934181675 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7a780e6c60 con 0x7f7a8007ac00 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 -- 172.21.15.79:0/2932865447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ed34d0 msgr2=0x56437929c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ed34d0 0x56437929c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 -- 172.21.15.79:0/2932865447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ecb2f0 msgr2=0x56437929b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ecb2f0 0x56437929b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.090+0000 7f7a7f400640 1 -- 172.21.15.79:0/2932865447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643791ca780 con 0x564378ef41b0 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.091+0000 7f7a7f400640 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ef41b0 0x56437929b0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c030550 tx=0x7f7a6c030340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405b52fe55df4008 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.091+0000 7f7a85000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7a640bee60 0x7f7a640c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.091+0000 7f7a75600640 1 -- 172.21.15.79:0/2932865447 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c047070 con 0x564378ef41b0 2024-09-21T02:40:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.091+0000 7f7a75600640 1 -- 172.21.15.79:0/2932865447 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a6c0307f0 con 0x564378ef41b0 2024-09-21T02:40:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.091+0000 7f7a75600640 1 -- 172.21.15.79:0/2932865447 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c037070 con 0x564378ef41b0 2024-09-21T02:40:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a8e07d740 1 -- 172.21.15.79:0/2932865447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ef41b0 msgr2=0x56437929b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ef41b0 0x56437929b0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c030550 tx=0x7f7a6c030340 comp rx=0 tx=0).stop 2024-09-21T02:40:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a85000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7a640bee60 0x7f7a640c1370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a780a9040 tx=0x7f7a78009be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a8e07d740 1 -- 172.21.15.79:0/2932865447 shutdown_connections 2024-09-21T02:40:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ed34d0 0x56437929c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ecb2f0 0x56437929b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/2932865447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ef41b0 0x56437929b0d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.093+0000 7f7a8e07d740 1 -- 172.21.15.79:0/2932865447 >> 172.21.15.79:0/2932865447 conn(0x564378ee8300 msgr2=0x564379296b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:58.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.096+0000 7f7a8e07d740 1 -- 172.21.15.79:0/2932865447 shutdown_connections 2024-09-21T02:40:58.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.096+0000 7f7a8e07d740 1 -- 172.21.15.79:0/2932865447 wait complete. 2024-09-21T02:40:58.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.097+0000 7f7a8e07d740 1 -- start start 2024-09-21T02:40:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.097+0000 7f7a8e07d740 1 Processor -- start 2024-09-21T02:40:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.098+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ecb2f0 0x5643792a4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.098+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.098+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ef41b0 0x5643792a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.098+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564379135ab0 con 0x564378ef41b0 2024-09-21T02:40:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.098+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5643791a4570 con 0x564378ecb2f0 2024-09-21T02:40:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.099+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.099+0000 7f7a7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ecb2f0 0x5643792a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.099+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792a4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47118/0 (socket says 172.21.15.79:47118) 2024-09-21T02:40:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a7fe00640 1 -- 172.21.15.79:0/3798314152 learned_addr learned my addr 172.21.15.79:0/3798314152 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56437929cd50 con 0x564378ed34d0 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a8e07d740 10 client.0 _ll_register_callbacks cb 0x5643791b3100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a7f400640 1 -- 172.21.15.79:0/3798314152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 msgr2=0x5643792a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a7f400640 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a7f400640 1 -- 172.21.15.79:0/3798314152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ef41b0 msgr2=0x5643792a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a7f400640 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ef41b0 0x5643792a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.100+0000 7f7a7f400640 1 -- 172.21.15.79:0/3798314152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564378f5f790 con 0x564378ecb2f0 2024-09-21T02:40:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.101+0000 7f7a7f400640 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ecb2f0 0x5643792a4820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c005eb0 tx=0x7f7a6c030f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b37de2934d73b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.101+0000 7f7a6a000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:40:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.102+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:40:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.103+0000 7f7a6a000640 1 -- 172.21.15.79:0/3798314152 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c037070 con 0x564378ecb2f0 2024-09-21T02:40:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.104+0000 7f7a6a000640 1 -- 172.21.15.79:0/3798314152 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7a6c0046c0 con 0x564378ecb2f0 2024-09-21T02:40:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.104+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a6c0307f0 con 0x564378ecb2f0 2024-09-21T02:40:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.107+0000 7f7a6a000640 1 -- 172.21.15.79:0/3798314152 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7a6c05a050 con 0x564378ecb2f0 2024-09-21T02:40:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.107+0000 7f7a8e07d740 10 client.25898 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.107+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564378fd8620 con 0x564378ecb2f0 2024-09-21T02:40:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.109+0000 7f7a6a000640 1 -- 172.21.15.79:0/3798314152 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a6c0307f0 con 0x564378ecb2f0 2024-09-21T02:40:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.109+0000 7f7a6a000640 1 -- 172.21.15.79:0/3798314152 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7a6c032600 con 0x564378ecb2f0 2024-09-21T02:40:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.110+0000 7f7a8e07d740 10 client.25898 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.110+0000 7f7a8e07d740 10 client.25898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.110+0000 7f7a8e07d740 20 client.25898 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.110+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564378eb2d80 0x5643792b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.110+0000 7f7a8e07d740 4 client.25898 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.110+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564379210600 con 0x564378eb2d80 2024-09-21T02:40:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.111+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564378eb2d80 0x5643792b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.111+0000 7f7a6a000640 10 client.25898 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.113+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564378eb2d80 0x5643792b1af0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d67578641aa34ba server_cookie=605824ea746014b5 in_seq=0 out_seq=0 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.113+0000 7f7a6a000640 1 -- 172.21.15.79:0/3798314152 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564379210600 con 0x564378eb2d80 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.113+0000 7f7a6a000640 10 client.25898 handle_command_reply: tid=0 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 client.25898 shutdown 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ecb2f0 msgr2=0x5643792a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ecb2f0 0x5643792a4820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c005eb0 tx=0x7f7a6c030f90 comp rx=0 tx=0).stop 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 shutdown_connections 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564378eb2d80 0x5643792b1af0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378ef41b0 0x5643792a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/3798314152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ecb2f0 0x5643792a4820 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a6a000640 0 client.25898 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.114+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 >> 172.21.15.79:0/3798314152 conn(0x564378ee8300 msgr2=0x5643792950e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.115+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 shutdown_connections 2024-09-21T02:40:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.116+0000 7f7a8e07d740 1 -- 172.21.15.79:0/3798314152 wait complete. 2024-09-21T02:40:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.117+0000 7f7a8e07d740 20 client.25898 trim_cache size 0 max 16384 2024-09-21T02:40:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.163+0000 7f7a8e07d740 1 Processor -- start 2024-09-21T02:40:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a8e07d740 1 -- start start 2024-09-21T02:40:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x564379295850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x564379295d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801d2e50 con 0x564378e881c0 2024-09-21T02:40:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801d56b0 con 0x564378ef41b0 2024-09-21T02:40:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801d34a0 con 0x564378ed34d0 2024-09-21T02:40:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x564379295850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x564379295850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:43898/0 (socket says 172.21.15.79:43898) 2024-09-21T02:40:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.164+0000 7f7a7fe00640 1 -- 172.21.15.79:0/1234957365 learned_addr learned my addr 172.21.15.79:0/1234957365 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7f400640 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x564379295d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7f400640 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7fe00640 1 -- 172.21.15.79:0/1234957365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 msgr2=0x5643792964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7fe00640 1 -- 172.21.15.79:0/1234957365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 msgr2=0x564379295d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x564379295d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7fe00640 1 -- 172.21.15.79:0/1234957365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643792a5740 con 0x564378ef41b0 2024-09-21T02:40:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x564379295850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009a40 tx=0x7f7a70008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd090ac6c5279a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.165+0000 7f7a74c00640 1 -- 172.21.15.79:0/1234957365 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70024420 con 0x564378ef41b0 2024-09-21T02:40:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.166+0000 7f7a74c00640 1 -- 172.21.15.79:0/1234957365 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a7001f030 con 0x564378ef41b0 2024-09-21T02:40:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.166+0000 7f7a74c00640 1 -- 172.21.15.79:0/1234957365 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70014730 con 0x564378ef41b0 2024-09-21T02:40:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.166+0000 7f7a8e07d740 1 -- 172.21.15.79:0/1234957365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 msgr2=0x564379295850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x564379295850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009a40 tx=0x7f7a70008040 comp rx=0 tx=0).stop 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 -- 172.21.15.79:0/1234957365 shutdown_connections 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x564379295d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x564379295850 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/1234957365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 -- 172.21.15.79:0/1234957365 >> 172.21.15.79:0/1234957365 conn(0x564378ee8300 msgr2=0x5643792a2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 -- 172.21.15.79:0/1234957365 shutdown_connections 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 -- 172.21.15.79:0/1234957365 wait complete. 2024-09-21T02:40:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.167+0000 7f7a8e07d740 1 -- start start 2024-09-21T02:40:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.168+0000 7f7a8e07d740 1 Processor -- start 2024-09-21T02:40:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x5643792ab570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a8e07d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x5643792abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801d3b70 con 0x564378e881c0 2024-09-21T02:40:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801d4fe0 con 0x564378ef41b0 2024-09-21T02:40:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a8e07d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801d4240 con 0x564378ed34d0 2024-09-21T02:40:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a8e07d740 10 client.0 _ll_register_callbacks cb 0x7f7a6c045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792abab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47142/0 (socket says 172.21.15.79:47142) 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a7fe00640 1 -- 172.21.15.79:0/4173615697 learned_addr learned my addr 172.21.15.79:0/4173615697 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.169+0000 7f7a7f400640 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x5643792ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a7fe00640 1 -- 172.21.15.79:0/4173615697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 msgr2=0x5643792abff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x5643792abff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a7fe00640 1 -- 172.21.15.79:0/4173615697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 msgr2=0x5643792ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x5643792ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a7fe00640 1 -- 172.21.15.79:0/4173615697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643792aa260 con 0x564378ed34d0 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a7f400640 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x5643792ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a7fe00640 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792abab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a70000c00 tx=0x7f7a70023530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c45faf72ba73a884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a6a000640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a6a000640 1 -- 172.21.15.79:0/4173615697 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7002a020 con 0x564378ed34d0 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a6a000640 1 -- 172.21.15.79:0/4173615697 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7a70005990 con 0x564378ed34d0 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.170+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a7001f030 con 0x564378ed34d0 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a6a000640 1 -- 172.21.15.79:0/4173615697 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7a70035050 con 0x564378ed34d0 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 10 client.25909 fetch_fsmap learned FSMap version 21 2024-09-21T02:40:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56437931c750 con 0x564378ed34d0 2024-09-21T02:40:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a6a000640 1 -- 172.21.15.79:0/4173615697 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a7001f030 con 0x564378ed34d0 2024-09-21T02:40:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a6a000640 1 -- 172.21.15.79:0/4173615697 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7a700062d0 con 0x564378ed34d0 2024-09-21T02:40:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 10 client.25909 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:40:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 10 client.25909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:40:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 20 client.25909 populate_metadata read hostname 'smithi079' 2024-09-21T02:40:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56437931d160 0x56437931f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 4 client.25909 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:40:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.171+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5643792accf0 con 0x56437931d160 2024-09-21T02:40:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.172+0000 7f7a7f400640 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56437931d160 0x56437931f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.172+0000 7f7a7f400640 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56437931d160 0x56437931f5b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea2f9a2a0da9d07e server_cookie=81620e4493a77d8f in_seq=0 out_seq=0 2024-09-21T02:40:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.172+0000 7f7a6a000640 10 client.25909 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:58.196 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T02:40:58.196 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T02:40:58.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:40:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.297+0000 7f7a6a000640 1 -- 172.21.15.79:0/4173615697 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5643792accf0 con 0x56437931d160 2024-09-21T02:40:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.297+0000 7f7a6a000640 10 client.25909 handle_command_reply: tid=0 2024-09-21T02:40:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.298+0000 7f7a8e07d740 1 client.25909 shutdown 2024-09-21T02:40:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.298+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 msgr2=0x5643792abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.298+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792abab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a70000c00 tx=0x7f7a70023530 comp rx=0 tx=0).stop 2024-09-21T02:40:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 shutdown_connections 2024-09-21T02:40:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56437931d160 0x56437931f5b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564378ef41b0 0x5643792abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564378ed34d0 0x5643792abab0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a6a000640 0 client.25909 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 --2- 172.21.15.79:0/4173615697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564378e881c0 0x5643792ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 >> 172.21.15.79:0/4173615697 conn(0x564378ee8300 msgr2=0x56437929acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 shutdown_connections 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.299+0000 7f7a8e07d740 1 -- 172.21.15.79:0/4173615697 wait complete. 2024-09-21T02:40:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.300+0000 7f7a8e07d740 20 client.25909 trim_cache size 0 max 16384 2024-09-21T02:40:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:40:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:40:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:40:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:40:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7a640bee60 msgr2=0x7f7a640c1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7a640bee60 0x7f7a640c1370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a780a9040 tx=0x7f7a78009be0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8007ac00 msgr2=0x7f7a801b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8007ac00 0x7f7a801b6c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800ef50 tx=0x7f7a7800c480 comp rx=0 tx=0).stop 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 shutdown_connections 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7a640bee60 0x7f7a640c1370 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8007ac00 0x7f7a801b6c80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a800782a0 0x7f7a801b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 --2- 172.21.15.79:0/2934181675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a800754e0 0x7f7a801b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.301+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 >> 172.21.15.79:0/2934181675 conn(0x7f7a80070810 msgr2=0x7f7a80077b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.303+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 shutdown_connections 2024-09-21T02:40:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:40:58.303+0000 7f7a87000640 1 -- 172.21.15.79:0/2934181675 wait complete. 2024-09-21T02:40:58.901 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:59.080 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:40:58 smithi079 ceph-mon[30788]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 599 op/s 2024-09-21T02:40:59.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:40:58 smithi098 ceph-mon[34832]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 599 op/s 2024-09-21T02:40:59.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:40:58 smithi148 ceph-mon[34626]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 599 op/s 2024-09-21T02:40:59.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.760+0000 7f12dae00640 1 -- 172.21.15.79:0/4015395719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 msgr2=0x7f12d410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.760+0000 7f12dae00640 1 --2- 172.21.15.79:0/4015395719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 0x7f12d410f520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009ca0 tx=0x7f12cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.760+0000 7f12dae00640 1 -- 172.21.15.79:0/4015395719 shutdown_connections 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.760+0000 7f12dae00640 1 --2- 172.21.15.79:0/4015395719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 0x7f12d410f520 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.760+0000 7f12dae00640 1 --2- 172.21.15.79:0/4015395719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12d41083a0 0x7f12d41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.760+0000 7f12dae00640 1 --2- 172.21.15.79:0/4015395719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 0x7f12d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.760+0000 7f12dae00640 1 -- 172.21.15.79:0/4015395719 >> 172.21.15.79:0/4015395719 conn(0x7f12d4079730 msgr2=0x7f12d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.761+0000 7f12dae00640 1 -- 172.21.15.79:0/4015395719 shutdown_connections 2024-09-21T02:40:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.761+0000 7f12dae00640 1 -- 172.21.15.79:0/4015395719 wait complete. 2024-09-21T02:40:59.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.764+0000 7f12dae00640 1 Processor -- start 2024-09-21T02:40:59.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12dae00640 1 -- start start 2024-09-21T02:40:59.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12dae00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 0x7f12d410bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12dae00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12d41083a0 0x7f12d410c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12dae00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 0x7f12d41ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12dae00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12d41118a0 con 0x7f12d41083a0 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12dae00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f12d4111720 con 0x7f12d4108cf0 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12dae00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12d4111a20 con 0x7f12d4102a60 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 0x7f12d410bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12d3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 0x7f12d410bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47152/0 (socket says 172.21.15.79:47152) 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.765+0000 7f12d3e00640 1 -- 172.21.15.79:0/4140967459 learned_addr learned my addr 172.21.15.79:0/4140967459 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d8e00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 0x7f12d41ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d3e00640 1 -- 172.21.15.79:0/4140967459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 msgr2=0x7f12d41ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d3e00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 0x7f12d41ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d3e00640 1 -- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12d41083a0 msgr2=0x7f12d410c490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d3400640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12d41083a0 0x7f12d410c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d3e00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12d41083a0 0x7f12d410c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d3e00640 1 -- 172.21.15.79:0/4140967459 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d41acb70 con 0x7f12d4102a60 2024-09-21T02:40:59.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.766+0000 7f12d3e00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 0x7f12d410bf50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c920 tx=0x7f12c400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:59.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.768+0000 7f12d0c00640 1 -- 172.21.15.79:0/4140967459 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4007c70 con 0x7f12d4102a60 2024-09-21T02:40:59.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.768+0000 7f12d0c00640 1 -- 172.21.15.79:0/4140967459 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12c4007e10 con 0x7f12d4102a60 2024-09-21T02:40:59.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.768+0000 7f12d0c00640 1 -- 172.21.15.79:0/4140967459 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4018820 con 0x7f12d4102a60 2024-09-21T02:40:59.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.768+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d41acda0 con 0x7f12d4102a60 2024-09-21T02:40:59.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.769+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d41ad200 con 0x7f12d4102a60 2024-09-21T02:40:59.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.772+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d4102e70 con 0x7f12d4102a60 2024-09-21T02:40:59.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.774+0000 7f12d0c00640 1 -- 172.21.15.79:0/4140967459 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f12c400f450 con 0x7f12d4102a60 2024-09-21T02:40:59.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.775+0000 7f12d0c00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f12b80b66e0 0x7f12b80b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.775+0000 7f12d0c00640 1 -- 172.21.15.79:0/4140967459 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f12c40e7830 con 0x7f12d4102a60 2024-09-21T02:40:59.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.776+0000 7f12d3400640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f12b80b66e0 0x7f12b80b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.777+0000 7f12d3400640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f12b80b66e0 0x7f12b80b8bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f12c00095f0 tx=0x7f12c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:59.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:40:59.780+0000 7f12d0c00640 1 -- 172.21.15.79:0/4140967459 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12c4014030 con 0x7f12d4102a60 2024-09-21T02:41:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.217+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12d402e640 con 0x7f12d4102a60 2024-09-21T02:41:00.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:41:00.221 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:41:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:41:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.218+0000 7f12d0c00640 1 -- 172.21.15.79:0/4140967459 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f12c40adcb0 con 0x7f12d4102a60 2024-09-21T02:41:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f12b80b66e0 msgr2=0x7f12b80b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f12b80b66e0 0x7f12b80b8bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f12c00095f0 tx=0x7f12c0005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 msgr2=0x7f12d410bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 0x7f12d410bf50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c920 tx=0x7f12c400cde0 comp rx=0 tx=0).stop 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 shutdown_connections 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f12b80b66e0 0x7f12b80b8bf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12d4108cf0 0x7f12d41ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12d41083a0 0x7f12d410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 --2- 172.21.15.79:0/4140967459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12d4102a60 0x7f12d410bf50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 >> 172.21.15.79:0/4140967459 conn(0x7f12d4079730 msgr2=0x7f12d41043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 shutdown_connections 2024-09-21T02:41:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:00.222+0000 7f12dae00640 1 -- 172.21.15.79:0/4140967459 wait complete. 2024-09-21T02:41:01.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:00 smithi098 ceph-mon[34832]: pgmap v573: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 670 op/s 2024-09-21T02:41:01.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:00 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4140967459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:01.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:00 smithi079 ceph-mon[30788]: pgmap v573: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 670 op/s 2024-09-21T02:41:01.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:00 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4140967459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:01.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:00 smithi148 ceph-mon[34626]: pgmap v573: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 670 op/s 2024-09-21T02:41:01.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:00 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4140967459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:01.384 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T02:41:01.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T02:41:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 305.0 s, 745.6 tps, lat 133.324 ms stddev 150.949 2024-09-21T02:41:02.066 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:03.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.040+0000 7fdc47200640 1 -- 172.21.15.79:0/1502207292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48109c20 msgr2=0x7fdc48110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.040+0000 7fdc47200640 1 --2- 172.21.15.79:0/1502207292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48109c20 0x7fdc48110450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009be0 tx=0x7fdc4002a6e0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.041+0000 7fdc47200640 1 -- 172.21.15.79:0/1502207292 shutdown_connections 2024-09-21T02:41:03.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.041+0000 7fdc47200640 1 --2- 172.21.15.79:0/1502207292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48109c20 0x7fdc48110450 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.041+0000 7fdc47200640 1 --2- 172.21.15.79:0/1502207292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc481092d0 0x7fdc481096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.041+0000 7fdc47200640 1 --2- 172.21.15.79:0/1502207292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc48103990 0x7fdc48103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.041+0000 7fdc47200640 1 -- 172.21.15.79:0/1502207292 >> 172.21.15.79:0/1502207292 conn(0x7fdc480ff3e0 msgr2=0x7fdc48101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.041+0000 7fdc47200640 1 -- 172.21.15.79:0/1502207292 shutdown_connections 2024-09-21T02:41:03.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.041+0000 7fdc47200640 1 -- 172.21.15.79:0/1502207292 wait complete. 2024-09-21T02:41:03.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.043+0000 7fdc47200640 1 Processor -- start 2024-09-21T02:41:03.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.045+0000 7fdc47200640 1 -- start start 2024-09-21T02:41:03.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.046+0000 7fdc47200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48103990 0x7fdc4810df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc47200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc481092d0 0x7fdc4810e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc45e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48103990 0x7fdc4810df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc47200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc48109c20 0x7fdc48073e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc47200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48077540 con 0x7fdc48109c20 2024-09-21T02:41:03.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc47200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc480773c0 con 0x7fdc48103990 2024-09-21T02:41:03.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc47200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481119d0 con 0x7fdc481092d0 2024-09-21T02:41:03.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc45e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48103990 0x7fdc4810df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:43960/0 (socket says 172.21.15.79:43960) 2024-09-21T02:41:03.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.047+0000 7fdc45e00640 1 -- 172.21.15.79:0/1306899277 learned_addr learned my addr 172.21.15.79:0/1306899277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:03.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.048+0000 7fdc3d400640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc481092d0 0x7fdc4810e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.048+0000 7fdc45e00640 1 -- 172.21.15.79:0/1306899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc481092d0 msgr2=0x7fdc4810e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.048+0000 7fdc45e00640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc481092d0 0x7fdc4810e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.049+0000 7fdc45e00640 1 -- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc48109c20 msgr2=0x7fdc48073e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T02:41:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.050+0000 7fdc46800640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc48109c20 0x7fdc48073e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.050+0000 7fdc45e00640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc48109c20 0x7fdc48073e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.050+0000 7fdc45e00640 1 -- 172.21.15.79:0/1306899277 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc48074420 con 0x7fdc48103990 2024-09-21T02:41:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.051+0000 7fdc45e00640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48103990 0x7fdc4810df10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800e9c0 tx=0x7fdc3800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.051+0000 7fdc3f400640 1 -- 172.21.15.79:0/1306899277 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800ccc0 con 0x7fdc48103990 2024-09-21T02:41:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.051+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc48074710 con 0x7fdc48103990 2024-09-21T02:41:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.051+0000 7fdc3f400640 1 -- 172.21.15.79:0/1306899277 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc380054d0 con 0x7fdc48103990 2024-09-21T02:41:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.051+0000 7fdc3f400640 1 -- 172.21.15.79:0/1306899277 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38010430 con 0x7fdc48103990 2024-09-21T02:41:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.051+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc48074d20 con 0x7fdc48103990 2024-09-21T02:41:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.060+0000 7fdc53ff5740 1 Processor -- start 2024-09-21T02:41:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.060+0000 7fdc3f400640 1 -- 172.21.15.79:0/1306899277 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdc380105d0 con 0x7fdc48103990 2024-09-21T02:41:03.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.063+0000 7fdc3f400640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc2c0b6600 0x7fdc2c0b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc53ff5740 1 -- start start 2024-09-21T02:41:03.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc46800640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc2c0b6600 0x7fdc2c0b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe2abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe2b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 0x56194fe2b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56194fda0a90 con 0x56194fa62b70 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56194fd8fec0 con 0x56194fa5a990 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.064+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56194fd93cd0 con 0x56194fa83850 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc45e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe2abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe2b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe2b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:43966/0 (socket says 172.21.15.79:43966) 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 -- 172.21.15.79:0/968267731 learned_addr learned my addr 172.21.15.79:0/968267731 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 -- 172.21.15.79:0/968267731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 msgr2=0x56194fe2abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 --2- 172.21.15.79:0/968267731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe2abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 -- 172.21.15.79:0/968267731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 msgr2=0x56194fe2b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 --2- 172.21.15.79:0/968267731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 0x56194fe2b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.065+0000 7fdc3d400640 1 -- 172.21.15.79:0/968267731 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56194fd359d0 con 0x56194fa5a990 2024-09-21T02:41:03.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.066+0000 7fdc3f400640 1 -- 172.21.15.79:0/1306899277 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdc380e7960 con 0x7fdc48103990 2024-09-21T02:41:03.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.066+0000 7fdc46800640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc2c0b6600 0x7fdc2c0b8b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009420 tx=0x7fdc40030a10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.066+0000 7fdc3d400640 1 --2- 172.21.15.79:0/968267731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe2b0f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000b790 tx=0x7fdc3000bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42262eb628f1ed0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.070+0000 7fdc37400640 1 -- 172.21.15.79:0/968267731 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30027020 con 0x56194fa5a990 2024-09-21T02:41:03.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.070+0000 7fdc37400640 1 -- 172.21.15.79:0/968267731 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc3000ddf0 con 0x56194fa5a990 2024-09-21T02:41:03.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.070+0000 7fdc37400640 1 -- 172.21.15.79:0/968267731 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30022350 con 0x56194fa5a990 2024-09-21T02:41:03.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.071+0000 7fdc53ff5740 1 -- 172.21.15.79:0/968267731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 msgr2=0x56194fe2b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.071+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/968267731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe2b0f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000b790 tx=0x7fdc3000bc50 comp rx=0 tx=0).stop 2024-09-21T02:41:03.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.074+0000 7fdc53ff5740 1 -- 172.21.15.79:0/968267731 shutdown_connections 2024-09-21T02:41:03.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.074+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/968267731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 0x56194fe2b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.074+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/968267731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe2b0f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.074+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/968267731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe2abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.074+0000 7fdc53ff5740 1 -- 172.21.15.79:0/968267731 >> 172.21.15.79:0/968267731 conn(0x56194fa77c40 msgr2=0x56194fe28aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.074+0000 7fdc53ff5740 1 -- 172.21.15.79:0/968267731 shutdown_connections 2024-09-21T02:41:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.074+0000 7fdc53ff5740 1 -- 172.21.15.79:0/968267731 wait complete. 2024-09-21T02:41:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.075+0000 7fdc53ff5740 1 -- start start 2024-09-21T02:41:03.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.075+0000 7fdc53ff5740 1 Processor -- start 2024-09-21T02:41:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.076+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa5a990 0x56194fe36460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.078 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:02 smithi079 ceph-mon[30788]: pgmap v574: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 715 op/s 2024-09-21T02:41:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.076+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.076+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa83850 0x56194fe42760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.076+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56194fbf17b0 con 0x56194fa5a990 2024-09-21T02:41:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.076+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56194fd34650 con 0x56194fa83850 2024-09-21T02:41:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.076+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56194fe393e0 con 0x56194fa62b70 2024-09-21T02:41:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.076+0000 7fdc53ff5740 10 client.0 _ll_register_callbacks cb 0x56194fa9b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.077+0000 7fdc45e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa5a990 0x56194fe36460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.077+0000 7fdc3d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.077+0000 7fdc3d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47178/0 (socket says 172.21.15.79:47178) 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.077+0000 7fdc3d400640 1 -- 172.21.15.79:0/1115035645 learned_addr learned my addr 172.21.15.79:0/1115035645 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.077+0000 7fdc46800640 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa83850 0x56194fe42760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.078+0000 7fdc46800640 1 -- 172.21.15.79:0/1115035645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 msgr2=0x56194fe369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.078+0000 7fdc46800640 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.078+0000 7fdc46800640 1 -- 172.21.15.79:0/1115035645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa5a990 msgr2=0x56194fe36460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.078+0000 7fdc46800640 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa5a990 0x56194fe36460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.078+0000 7fdc46800640 1 -- 172.21.15.79:0/1115035645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56194fafdba0 con 0x56194fa83850 2024-09-21T02:41:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.079+0000 7fdc46800640 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa83850 0x56194fe42760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc40034040 tx=0x7fdc40009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bbc5f7aa98394e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.079+0000 7fdc2be00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:41:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.080+0000 7fdc2be00640 1 -- 172.21.15.79:0/1115035645 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40036050 con 0x56194fa83850 2024-09-21T02:41:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.080+0000 7fdc2be00640 1 -- 172.21.15.79:0/1115035645 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdc40003d00 con 0x56194fa83850 2024-09-21T02:41:03.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.080+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc3000ddf0 con 0x56194fa83850 2024-09-21T02:41:03.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.081+0000 7fdc2be00640 1 -- 172.21.15.79:0/1115035645 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdc40004040 con 0x56194fa83850 2024-09-21T02:41:03.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.081+0000 7fdc53ff5740 10 client.25919 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:03.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.081+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56194fe452a0 con 0x56194fa83850 2024-09-21T02:41:03.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.081+0000 7fdc2be00640 1 -- 172.21.15.79:0/1115035645 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc3000ddf0 con 0x56194fa83850 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc2be00640 1 -- 172.21.15.79:0/1115035645 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdc40051030 con 0x56194fa83850 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc53ff5740 10 client.25919 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc53ff5740 10 client.25919 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc53ff5740 20 client.25919 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa421d0 0x56194fe48cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc53ff5740 4 client.25919 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56194fda29e0 con 0x56194fa421d0 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.082+0000 7fdc45e00640 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa421d0 0x56194fe48cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.083+0000 7fdc45e00640 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa421d0 0x56194fe48cc0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f82f6d8a02cc7b4 server_cookie=24f1aea55a3b93e3 in_seq=0 out_seq=0 2024-09-21T02:41:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.083+0000 7fdc2be00640 10 client.25919 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:03.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.084+0000 7fdc2be00640 1 -- 172.21.15.79:0/1115035645 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56194fda29e0 con 0x56194fa421d0 2024-09-21T02:41:03.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.084+0000 7fdc2be00640 10 client.25919 handle_command_reply: tid=0 2024-09-21T02:41:03.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.084+0000 7fdc53ff5740 1 client.25919 shutdown 2024-09-21T02:41:03.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.084+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa83850 msgr2=0x56194fe42760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.084+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa83850 0x56194fe42760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc40034040 tx=0x7fdc40009500 comp rx=0 tx=0).stop 2024-09-21T02:41:03.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 shutdown_connections 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa421d0 0x56194fe48cc0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa83850 0x56194fe42760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc2be00640 0 client.25919 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1115035645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa5a990 0x56194fe36460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 >> 172.21.15.79:0/1115035645 conn(0x56194fa77c40 msgr2=0x56194fe2dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.085+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 shutdown_connections 2024-09-21T02:41:03.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.087+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1115035645 wait complete. 2024-09-21T02:41:03.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.087+0000 7fdc53ff5740 20 client.25919 trim_cache size 0 max 16384 2024-09-21T02:41:03.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.116+0000 7fdc53ff5740 1 Processor -- start 2024-09-21T02:41:03.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.116+0000 7fdc53ff5740 1 -- start start 2024-09-21T02:41:03.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe38090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe42660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa83850 0x56194fe42ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc3d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe42660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc3d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe42660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47192/0 (socket says 172.21.15.79:47192) 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2400dc30 con 0x56194fa83850 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc53ff5740 1 -- 172.21.15.79:0/522092941 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc240104f0 con 0x56194fa5a990 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc53ff5740 1 -- 172.21.15.79:0/522092941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2400e2e0 con 0x56194fa62b70 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc3d400640 1 -- 172.21.15.79:0/522092941 learned_addr learned my addr 172.21.15.79:0/522092941 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:03.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc46800640 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa83850 0x56194fe42ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc45e00640 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe38090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.117+0000 7fdc3d400640 1 -- 172.21.15.79:0/522092941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 msgr2=0x56194fe38090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.118+0000 7fdc3d400640 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe38090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.118+0000 7fdc3d400640 1 -- 172.21.15.79:0/522092941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa83850 msgr2=0x56194fe42ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.118+0000 7fdc3d400640 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa83850 0x56194fe42ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.118+0000 7fdc3d400640 1 -- 172.21.15.79:0/522092941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56194fe37720 con 0x56194fa62b70 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.118+0000 7fdc45e00640 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe38090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.118+0000 7fdc3d400640 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe42660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc30004700 tx=0x7fdc30023cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2829567443310606 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.119+0000 7fdc36a00640 1 -- 172.21.15.79:0/522092941 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3003c070 con 0x56194fa62b70 2024-09-21T02:41:03.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.119+0000 7fdc36a00640 1 -- 172.21.15.79:0/522092941 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc30023dd0 con 0x56194fa62b70 2024-09-21T02:41:03.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.119+0000 7fdc36a00640 1 -- 172.21.15.79:0/522092941 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30027040 con 0x56194fa62b70 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.120+0000 7fdc53ff5740 1 -- 172.21.15.79:0/522092941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 msgr2=0x56194fe42660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.120+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe42660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc30004700 tx=0x7fdc30023cb0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.120+0000 7fdc53ff5740 1 -- 172.21.15.79:0/522092941 shutdown_connections 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.120+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa83850 0x56194fe42ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.120+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa62b70 0x56194fe42660 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.120+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/522092941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe38090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.120+0000 7fdc53ff5740 1 -- 172.21.15.79:0/522092941 >> 172.21.15.79:0/522092941 conn(0x56194fa77c40 msgr2=0x56194fe37980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.121+0000 7fdc53ff5740 1 -- 172.21.15.79:0/522092941 shutdown_connections 2024-09-21T02:41:03.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.121+0000 7fdc53ff5740 1 -- 172.21.15.79:0/522092941 wait complete. 2024-09-21T02:41:03.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.121+0000 7fdc53ff5740 1 -- start start 2024-09-21T02:41:03.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.122+0000 7fdc53ff5740 1 Processor -- start 2024-09-21T02:41:03.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.122+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe3e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.122+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 0x56194fe3ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc53ff5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe39680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2400e9b0 con 0x56194fa62b70 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2400fe20 con 0x56194fa5a990 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc53ff5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2400f080 con 0x56194fa83850 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc53ff5740 10 client.0 _ll_register_callbacks cb 0x7fdc40034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc45e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe3e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc45e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe3e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:43982/0 (socket says 172.21.15.79:43982) 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc45e00640 1 -- 172.21.15.79:0/1400935090 learned_addr learned my addr 172.21.15.79:0/1400935090 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc3d400640 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 0x56194fe3ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc46800640 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe39680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc46800640 1 -- 172.21.15.79:0/1400935090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 msgr2=0x56194fe3e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc46800640 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe3e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc46800640 1 -- 172.21.15.79:0/1400935090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 msgr2=0x56194fe3ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:03.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc46800640 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 0x56194fe3ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.123+0000 7fdc46800640 1 -- 172.21.15.79:0/1400935090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56194fe39bc0 con 0x56194fa83850 2024-09-21T02:41:03.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.124+0000 7fdc46800640 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe39680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc40047af0 tx=0x7fdc40047fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9afc59d1eeead739 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.124+0000 7fdc2be00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:41:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.126+0000 7fdc2be00640 1 -- 172.21.15.79:0/1400935090 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40004040 con 0x56194fa83850 2024-09-21T02:41:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.126+0000 7fdc2be00640 1 -- 172.21.15.79:0/1400935090 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdc40047310 con 0x56194fa83850 2024-09-21T02:41:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.126+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc30023dd0 con 0x56194fa83850 2024-09-21T02:41:03.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.127+0000 7fdc2be00640 1 -- 172.21.15.79:0/1400935090 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdc4002ad60 con 0x56194fa83850 2024-09-21T02:41:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.127+0000 7fdc53ff5740 10 client.25930 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:03.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.128+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56194feb3b30 con 0x56194fa83850 2024-09-21T02:41:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.128+0000 7fdc2be00640 1 -- 172.21.15.79:0/1400935090 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc30023dd0 con 0x56194fa83850 2024-09-21T02:41:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.129+0000 7fdc2be00640 1 -- 172.21.15.79:0/1400935090 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdc40051030 con 0x56194fa83850 2024-09-21T02:41:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.129+0000 7fdc53ff5740 10 client.25930 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.129+0000 7fdc53ff5740 10 client.25930 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.129+0000 7fdc53ff5740 20 client.25930 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.129+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa17580 0x56194feb6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.129+0000 7fdc53ff5740 4 client.25930 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T02:41:03.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.129+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x56194fd9e490 con 0x56194fa17580 2024-09-21T02:41:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.131+0000 7fdc45e00640 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa17580 0x56194feb6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.132+0000 7fdc45e00640 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa17580 0x56194feb6330 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d59271e3aca00378 server_cookie=e6c8d9167d2902de in_seq=0 out_seq=0 2024-09-21T02:41:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.132+0000 7fdc2be00640 10 client.25930 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:03.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:02 smithi098 ceph-mon[34832]: pgmap v574: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 715 op/s 2024-09-21T02:41:03.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:02 smithi148 ceph-mon[34626]: pgmap v574: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 715 op/s 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.455+0000 7fdc2be00640 1 -- 172.21.15.79:0/1400935090 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56194fd9e490 con 0x56194fa17580 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.455+0000 7fdc2be00640 10 client.25930 handle_command_reply: tid=0 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.455+0000 7fdc53ff5740 1 client.25930 shutdown 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.455+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 msgr2=0x56194fe39680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.455+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe39680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc40047af0 tx=0x7fdc40047fe0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 shutdown_connections 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56194fa17580 0x56194feb6330 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56194fa83850 0x56194fe39680 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56194fa62b70 0x56194fe3ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 --2- 172.21.15.79:0/1400935090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56194fa5a990 0x56194fe3e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 >> 172.21.15.79:0/1400935090 conn(0x56194fa77c40 msgr2=0x56194fe369a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc2be00640 0 client.25930 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 shutdown_connections 2024-09-21T02:41:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 1 -- 172.21.15.79:0/1400935090 wait complete. 2024-09-21T02:41:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.456+0000 7fdc53ff5740 20 client.25930 trim_cache size 0 max 16384 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 22, 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "2e41686": { 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 22, 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:03.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 139.2, 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:03.460 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc2c0b6600 msgr2=0x7fdc2c0b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc2c0b6600 0x7fdc2c0b8b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009420 tx=0x7fdc40030a10 comp rx=0 tx=0).stop 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48103990 msgr2=0x7fdc4810df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48103990 0x7fdc4810df10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800e9c0 tx=0x7fdc3800ee80 comp rx=0 tx=0).stop 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 shutdown_connections 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc2c0b6600 0x7fdc2c0b8b10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc48109c20 0x7fdc48073e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc481092d0 0x7fdc4810e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 --2- 172.21.15.79:0/1306899277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc48103990 0x7fdc4810df10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.457+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 >> 172.21.15.79:0/1306899277 conn(0x7fdc480ff3e0 msgr2=0x7fdc48108800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.458+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 shutdown_connections 2024-09-21T02:41:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:03.458+0000 7fdc47200640 1 -- 172.21.15.79:0/1306899277 wait complete. 2024-09-21T02:41:05.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:04 smithi098 ceph-mon[34832]: pgmap v575: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 604 op/s 2024-09-21T02:41:05.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:04 smithi079 ceph-mon[30788]: pgmap v575: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 604 op/s 2024-09-21T02:41:05.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:04 smithi148 ceph-mon[34626]: pgmap v575: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 604 op/s 2024-09-21T02:41:06.365 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2e41686', quiesce took 8.2 seconds. Will release after: 11.05 2024-09-21T02:41:06.496 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 310.0 s, 153.9 tps, lat 185.866 ms stddev 190.481 2024-09-21T02:41:07.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:06 smithi098 ceph-mon[34832]: pgmap v576: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 649 op/s 2024-09-21T02:41:07.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:06 smithi079 ceph-mon[30788]: pgmap v576: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 649 op/s 2024-09-21T02:41:07.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:06 smithi148 ceph-mon[34626]: pgmap v576: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 649 op/s 2024-09-21T02:41:09.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:08 smithi098 ceph-mon[34832]: pgmap v577: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 468 op/s 2024-09-21T02:41:09.167 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:08 smithi079 ceph-mon[30788]: pgmap v577: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 468 op/s 2024-09-21T02:41:09.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:08 smithi148 ceph-mon[34626]: pgmap v577: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 468 op/s 2024-09-21T02:41:11.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:10 smithi098 ceph-mon[34832]: pgmap v578: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 459 op/s 2024-09-21T02:41:11.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:10 smithi079 ceph-mon[30788]: pgmap v578: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 459 op/s 2024-09-21T02:41:11.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:10 smithi148 ceph-mon[34626]: pgmap v578: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 459 op/s 2024-09-21T02:41:11.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:41:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 -- 172.21.15.79:0/1196245790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 msgr2=0x7fb640103b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 --2- 172.21.15.79:0/1196245790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 0x7fb640103b20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb630009900 tx=0x7fb63002a410 comp rx=0 tx=0).stop 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 -- 172.21.15.79:0/1196245790 shutdown_connections 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 --2- 172.21.15.79:0/1196245790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6401050d0 0x7fb64010ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 --2- 172.21.15.79:0/1196245790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb640104730 0x7fb640104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 --2- 172.21.15.79:0/1196245790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 0x7fb640103b20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 -- 172.21.15.79:0/1196245790 >> 172.21.15.79:0/1196245790 conn(0x7fb6400feff0 msgr2=0x7fb6401014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 -- 172.21.15.79:0/1196245790 shutdown_connections 2024-09-21T02:41:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.510+0000 7fb645000640 1 -- 172.21.15.79:0/1196245790 wait complete. 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.511+0000 7fb645000640 1 Processor -- start 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.511+0000 7fb645000640 1 -- start start 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb645000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 0x7fb64019c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb645000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb640104730 0x7fb64019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb645000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6401050d0 0x7fb64019d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb645000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb64010f2d0 con 0x7fb6401036b0 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb645000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb64010f150 con 0x7fb640104730 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb645000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb64010f450 con 0x7fb6401050d0 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 0x7fb64019c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 0x7fb64019c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57216/0 (socket says 172.21.15.79:57216) 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6401050d0 0x7fb64019d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63de00640 1 -- 172.21.15.79:0/2241479283 learned_addr learned my addr 172.21.15.79:0/2241479283 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb635400640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb640104730 0x7fb64019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63e800640 1 -- 172.21.15.79:0/2241479283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb640104730 msgr2=0x7fb64019c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63e800640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb640104730 0x7fb64019c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63e800640 1 -- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 msgr2=0x7fb64019c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63e800640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 0x7fb64019c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.512+0000 7fb63e800640 1 -- 172.21.15.79:0/2241479283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64019db80 con 0x7fb6401050d0 2024-09-21T02:41:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.513+0000 7fb63e800640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6401050d0 0x7fb64019d360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb638009fd0 tx=0x7fb63800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.513+0000 7fb637400640 1 -- 172.21.15.79:0/2241479283 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63800ce20 con 0x7fb6401050d0 2024-09-21T02:41:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.513+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64019de70 con 0x7fb6401050d0 2024-09-21T02:41:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.513+0000 7fb637400640 1 -- 172.21.15.79:0/2241479283 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb638005020 con 0x7fb6401050d0 2024-09-21T02:41:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.513+0000 7fb637400640 1 -- 172.21.15.79:0/2241479283 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638010690 con 0x7fb6401050d0 2024-09-21T02:41:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.513+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6401a4560 con 0x7fb6401050d0 2024-09-21T02:41:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.516+0000 7fb64c018740 1 Processor -- start 2024-09-21T02:41:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb637400640 1 -- 172.21.15.79:0/2241479283 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb6380054d0 con 0x7fb6401050d0 2024-09-21T02:41:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb64c018740 1 -- start start 2024-09-21T02:41:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb64c018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a5320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb64c018740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a532740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb64c018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a533290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb64c018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e55a4a56b0 con 0x55e55a18b1b0 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb64c018740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e55a494ae0 con 0x55e55a1622f0 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.517+0000 7fb64c018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e55a4988f0 con 0x55e55a16a4d0 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a5320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb63de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a532740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a5320d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57218/0 (socket says 172.21.15.79:57218) 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 -- 172.21.15.79:0/775899724 learned_addr learned my addr 172.21.15.79:0/775899724 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a533290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 -- 172.21.15.79:0/775899724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 msgr2=0x55e55a533290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a533290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 -- 172.21.15.79:0/775899724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 msgr2=0x55e55a532740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a532740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 -- 172.21.15.79:0/775899724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e55a461780 con 0x55e55a18b1b0 2024-09-21T02:41:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb63de00640 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a532740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.518+0000 7fb635400640 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a5320d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb628013610 tx=0x7fb628009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3155c7ef29ec79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.519+0000 7fb62f400640 1 -- 172.21.15.79:0/775899724 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62800f600 con 0x55e55a18b1b0 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.519+0000 7fb62f400640 1 -- 172.21.15.79:0/775899724 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb62800fc50 con 0x55e55a18b1b0 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.519+0000 7fb637400640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb6240b6510 0x7fb6240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.519+0000 7fb62f400640 1 -- 172.21.15.79:0/775899724 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628010b80 con 0x55e55a18b1b0 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.519+0000 7fb63de00640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb6240b6510 0x7fb6240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.519+0000 7fb637400640 1 -- 172.21.15.79:0/2241479283 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb6380e7d90 con 0x7fb6401050d0 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 -- 172.21.15.79:0/775899724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 msgr2=0x55e55a5320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a5320d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb628013610 tx=0x7fb628009890 comp rx=0 tx=0).stop 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb63de00640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb6240b6510 0x7fb6240b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb630031440 tx=0x7fb6300314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 -- 172.21.15.79:0/775899724 shutdown_connections 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a533290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a532740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 --2- 172.21.15.79:0/775899724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a5320d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 -- 172.21.15.79:0/775899724 >> 172.21.15.79:0/775899724 conn(0x55e55a17f300 msgr2=0x55e55a52db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 -- 172.21.15.79:0/775899724 shutdown_connections 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 -- 172.21.15.79:0/775899724 wait complete. 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.520+0000 7fb64c018740 1 -- start start 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 1 Processor -- start 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a1622f0 0x55e55a53b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a16a4d0 0x55e55a53be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a53ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e55a3ccab0 con 0x55e55a18b1b0 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e55a43b570 con 0x55e55a16a4d0 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e55a533db0 con 0x55e55a1622f0 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb64c018740 10 client.0 _ll_register_callbacks cb 0x55e55a44a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb63e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a53ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb63de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a1622f0 0x55e55a53b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb63e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a53ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57230/0 (socket says 172.21.15.79:57230) 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb63e800640 1 -- 172.21.15.79:0/881381883 learned_addr learned my addr 172.21.15.79:0/881381883 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.521+0000 7fb635400640 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a16a4d0 0x55e55a53be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb63e800640 1 -- 172.21.15.79:0/881381883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a1622f0 msgr2=0x55e55a53b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb63e800640 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a1622f0 0x55e55a53b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb63e800640 1 -- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a16a4d0 msgr2=0x55e55a53be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb63e800640 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a16a4d0 0x55e55a53be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb63e800640 1 -- 172.21.15.79:0/881381883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e55a1f6790 con 0x55e55a18b1b0 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb635400640 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a16a4d0 0x55e55a53be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb63e800640 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a53ca00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb6380adaa0 tx=0x7fb6380ad6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f563fc551b934a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb623e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb623e00640 1 -- 172.21.15.79:0/881381883 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6380b2020 con 0x55e55a18b1b0 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb623e00640 1 -- 172.21.15.79:0/881381883 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb6380acd70 con 0x55e55a18b1b0 2024-09-21T02:41:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb62800fc50 con 0x55e55a18b1b0 2024-09-21T02:41:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb623e00640 1 -- 172.21.15.79:0/881381883 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb6380b23c0 con 0x55e55a18b1b0 2024-09-21T02:41:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb64c018740 10 client.15810 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.522+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e55a26f620 con 0x55e55a18b1b0 2024-09-21T02:41:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb623e00640 1 -- 172.21.15.79:0/881381883 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb62800fc50 con 0x55e55a18b1b0 2024-09-21T02:41:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb623e00640 1 -- 172.21.15.79:0/881381883 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb6380a9460 con 0x55e55a18b1b0 2024-09-21T02:41:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb64c018740 10 client.15810 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb64c018740 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb64c018740 20 client.15810 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb64c018740 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a149d80 0x55e55a548ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb64c018740 4 client.15810 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e55a4a7600 con 0x55e55a149d80 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.523+0000 7fb63de00640 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a149d80 0x55e55a548ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.524+0000 7fb623e00640 10 client.15810 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.524+0000 7fb63de00640 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a149d80 0x55e55a548ef0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b1fc8177a9ff63 server_cookie=b384a658457a246a in_seq=0 out_seq=0 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb623e00640 1 -- 172.21.15.79:0/881381883 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e55a4a7600 con 0x55e55a149d80 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb623e00640 10 client.15810 handle_command_reply: tid=0 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 client.15810 shutdown 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 msgr2=0x55e55a53ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a53ca00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb6380adaa0 tx=0x7fb6380ad6e0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 shutdown_connections 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a149d80 0x55e55a548ef0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a53ca00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a16a4d0 0x55e55a53be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 --2- 172.21.15.79:0/881381883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a1622f0 0x55e55a53b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb623e00640 0 client.15810 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 >> 172.21.15.79:0/881381883 conn(0x55e55a17f300 msgr2=0x55e55a532630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 shutdown_connections 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 1 -- 172.21.15.79:0/881381883 wait complete. 2024-09-21T02:41:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.525+0000 7fb64c018740 20 client.15810 trim_cache size 0 max 16384 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.540+0000 7fb64c018740 1 Processor -- start 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.540+0000 7fb64c018740 1 -- start start 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.540+0000 7fb64c018740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a52dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.540+0000 7fb64c018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a535b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb64c018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a536060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb64c018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401ac950 con 0x55e55a18b1b0 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb64c018740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401af1d0 con 0x55e55a1622f0 2024-09-21T02:41:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb64c018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401acfc0 con 0x55e55a16a4d0 2024-09-21T02:41:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a536060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a52dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a52dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51332/0 (socket says 172.21.15.79:51332) 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 -- 172.21.15.79:0/3461977777 learned_addr learned my addr 172.21.15.79:0/3461977777 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb635400640 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a535b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 -- 172.21.15.79:0/3461977777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 msgr2=0x55e55a535b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a535b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 -- 172.21.15.79:0/3461977777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 msgr2=0x55e55a536060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a536060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63de00640 1 -- 172.21.15.79:0/3461977777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e55a539960 con 0x55e55a1622f0 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.541+0000 7fb63e800640 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a536060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.542+0000 7fb63de00640 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a52dc20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb630005f70 tx=0x7fb630040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60b2a87adfdd0e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.542+0000 7fb62ea00640 1 -- 172.21.15.79:0/3461977777 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630035040 con 0x55e55a1622f0 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.542+0000 7fb62ea00640 1 -- 172.21.15.79:0/3461977777 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb630003aa0 con 0x55e55a1622f0 2024-09-21T02:41:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.542+0000 7fb62ea00640 1 -- 172.21.15.79:0/3461977777 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300529f0 con 0x55e55a1622f0 2024-09-21T02:41:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 -- 172.21.15.79:0/3461977777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 msgr2=0x55e55a52dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a52dc20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb630005f70 tx=0x7fb630040000 comp rx=0 tx=0).stop 2024-09-21T02:41:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 -- 172.21.15.79:0/3461977777 shutdown_connections 2024-09-21T02:41:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a536060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a535b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 --2- 172.21.15.79:0/3461977777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a52dc20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 -- 172.21.15.79:0/3461977777 >> 172.21.15.79:0/3461977777 conn(0x55e55a17f300 msgr2=0x55e55a52d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 -- 172.21.15.79:0/3461977777 shutdown_connections 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 -- 172.21.15.79:0/3461977777 wait complete. 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 -- start start 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.543+0000 7fb64c018740 1 Processor -- start 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb64c018740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a53ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb64c018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a540620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb64c018740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a541190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb64c018740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401ad690 con 0x55e55a18b1b0 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb64c018740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401aeb00 con 0x55e55a1622f0 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb64c018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb6401add60 con 0x55e55a16a4d0 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb64c018740 10 client.0 _ll_register_callbacks cb 0x7fb6380ad460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a541190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a541190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57254/0 (socket says 172.21.15.79:57254) 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 -- 172.21.15.79:0/3339049371 learned_addr learned my addr 172.21.15.79:0/3339049371 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63de00640 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a53ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb635400640 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a540620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 -- 172.21.15.79:0/3339049371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 msgr2=0x55e55a540620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a540620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 -- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 msgr2=0x55e55a53ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a53ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.544+0000 7fb63e800640 1 -- 172.21.15.79:0/3339049371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e55a5418f0 con 0x55e55a18b1b0 2024-09-21T02:41:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb63e800640 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a541190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb6380a9880 tx=0x7fb6380a9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3951f24c80adedb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb623e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb623e00640 1 -- 172.21.15.79:0/3339049371 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6380b2040 con 0x55e55a18b1b0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb623e00640 1 -- 172.21.15.79:0/3339049371 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb6380cfb20 con 0x55e55a18b1b0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb630003aa0 con 0x55e55a18b1b0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb623e00640 1 -- 172.21.15.79:0/3339049371 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb6380a99b0 con 0x55e55a18b1b0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb64c018740 10 client.15816 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e55a542c50 con 0x55e55a18b1b0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.545+0000 7fb623e00640 1 -- 172.21.15.79:0/3339049371 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb630003aa0 con 0x55e55a18b1b0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb623e00640 1 -- 172.21.15.79:0/3339049371 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb638004a40 con 0x55e55a18b1b0 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb64c018740 10 client.15816 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb64c018740 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb64c018740 20 client.15816 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb64c018740 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a11f1c0 0x55e55a5434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb64c018740 4 client.15816 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:41:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e55a4a30b0 con 0x55e55a11f1c0 2024-09-21T02:41:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb63de00640 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a11f1c0 0x55e55a5434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb63de00640 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a11f1c0 0x55e55a5434d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a5a160d1791205 server_cookie=45a14cfe2b078971 in_seq=0 out_seq=0 2024-09-21T02:41:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.546+0000 7fb623e00640 10 client.15816 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.572+0000 7fb623e00640 1 -- 172.21.15.79:0/3339049371 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e55a4a30b0 con 0x55e55a11f1c0 2024-09-21T02:41:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.572+0000 7fb623e00640 10 client.15816 handle_command_reply: tid=0 2024-09-21T02:41:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.572+0000 7fb64c018740 1 client.15816 shutdown 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.572+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 msgr2=0x55e55a541190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.572+0000 7fb64c018740 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a541190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb6380a9880 tx=0x7fb6380a9fb0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 shutdown_connections 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e55a11f1c0 0x55e55a5434d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55a18b1b0 0x55e55a541190 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55a16a4d0 0x55e55a540620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb623e00640 0 client.15816 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 --2- 172.21.15.79:0/3339049371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55a1622f0 0x55e55a53ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 >> 172.21.15.79:0/3339049371 conn(0x55e55a17f300 msgr2=0x55e55a52c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 shutdown_connections 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 1 -- 172.21.15.79:0/3339049371 wait complete. 2024-09-21T02:41:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb64c018740 20 client.15816 trim_cache size 0 max 16384 2024-09-21T02:41:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:41:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:41:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:41:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb6240b6510 msgr2=0x7fb6240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.573+0000 7fb645000640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb6240b6510 0x7fb6240b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb630031440 tx=0x7fb6300314a0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6401050d0 msgr2=0x7fb64019d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6401050d0 0x7fb64019d360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb638009fd0 tx=0x7fb63800ef10 comp rx=0 tx=0).stop 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 shutdown_connections 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb6240b6510 0x7fb6240b8a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6401050d0 0x7fb64019d360 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb640104730 0x7fb64019c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 --2- 172.21.15.79:0/2241479283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6401036b0 0x7fb64019c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 >> 172.21.15.79:0/2241479283 conn(0x7fb6400feff0 msgr2=0x7fb6400755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 shutdown_connections 2024-09-21T02:41:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:11.574+0000 7fb645000640 1 -- 172.21.15.79:0/2241479283 wait complete. 2024-09-21T02:41:13.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:12 smithi098 ceph-mon[34832]: pgmap v579: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.0 MiB/s wr, 379 op/s 2024-09-21T02:41:13.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:12 smithi079 ceph-mon[30788]: pgmap v579: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.0 MiB/s wr, 379 op/s 2024-09-21T02:41:13.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:12 smithi148 ceph-mon[34626]: pgmap v579: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.0 MiB/s wr, 379 op/s 2024-09-21T02:41:15.113 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:14 smithi079 ceph-mon[30788]: pgmap v580: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 255 op/s 2024-09-21T02:41:15.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:14 smithi098 ceph-mon[34832]: pgmap v580: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 255 op/s 2024-09-21T02:41:15.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:14 smithi148 ceph-mon[34626]: pgmap v580: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 255 op/s 2024-09-21T02:41:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:41:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:16 smithi098 ceph-mon[34832]: pgmap v581: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2024-09-21T02:41:17.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:16 smithi079 ceph-mon[30788]: pgmap v581: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2024-09-21T02:41:17.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:16 smithi148 ceph-mon[34626]: pgmap v581: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2024-09-21T02:41:17.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:41:17.797 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:18.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.444+0000 7f2a0e400640 1 -- 172.21.15.79:0/3231380648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08076080 msgr2=0x7f2a0810fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.444+0000 7f2a0e400640 1 --2- 172.21.15.79:0/3231380648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08076080 0x7f2a0810fc20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009900 tx=0x7f29f402a410 comp rx=0 tx=0).stop 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.445+0000 7f2a0e400640 1 -- 172.21.15.79:0/3231380648 shutdown_connections 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.445+0000 7f2a0e400640 1 --2- 172.21.15.79:0/3231380648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a08110160 0x7f2a08112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.445+0000 7f2a0e400640 1 --2- 172.21.15.79:0/3231380648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08076080 0x7f2a0810fc20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.445+0000 7f2a0e400640 1 --2- 172.21.15.79:0/3231380648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a08075730 0x7f2a08075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.445+0000 7f2a0e400640 1 -- 172.21.15.79:0/3231380648 >> 172.21.15.79:0/3231380648 conn(0x7f2a080ff5d0 msgr2=0x7f2a08101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.445+0000 7f2a0e400640 1 -- 172.21.15.79:0/3231380648 shutdown_connections 2024-09-21T02:41:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.445+0000 7f2a0e400640 1 -- 172.21.15.79:0/3231380648 wait complete. 2024-09-21T02:41:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.446+0000 7f2a0e400640 1 Processor -- start 2024-09-21T02:41:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.446+0000 7f2a0e400640 1 -- start start 2024-09-21T02:41:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a0e400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a08075730 0x7f2a0819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a0e400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a08076080 0x7f2a0819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a0e400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08110160 0x7f2a081a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a0e400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08115cb0 con 0x7f2a08110160 2024-09-21T02:41:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a0e400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08115b30 con 0x7f2a08075730 2024-09-21T02:41:18.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a0e400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08115e30 con 0x7f2a08076080 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08110160 0x7f2a081a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a07400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a08075730 0x7f2a0819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08110160 0x7f2a081a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44544/0 (socket says 172.21.15.79:44544) 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a07e00640 1 -- 172.21.15.79:0/714586827 learned_addr learned my addr 172.21.15.79:0/714586827 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.447+0000 7f2a06a00640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a08076080 0x7f2a0819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a07e00640 1 -- 172.21.15.79:0/714586827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a08076080 msgr2=0x7f2a0819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a07e00640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a08076080 0x7f2a0819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a07e00640 1 -- 172.21.15.79:0/714586827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a08075730 msgr2=0x7f2a0819c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a07e00640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a08075730 0x7f2a0819c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a07e00640 1 -- 172.21.15.79:0/714586827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081a25f0 con 0x7f2a08110160 2024-09-21T02:41:18.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a07400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a08075730 0x7f2a0819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a07e00640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08110160 0x7f2a081a1ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000eb10 tx=0x7f2a0000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f29ffe00640 1 -- 172.21.15.79:0/714586827 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00004b20 con 0x7f2a08110160 2024-09-21T02:41:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f29ffe00640 1 -- 172.21.15.79:0/714586827 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a00004cc0 con 0x7f2a08110160 2024-09-21T02:41:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f29ffe00640 1 -- 172.21.15.79:0/714586827 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00010670 con 0x7f2a08110160 2024-09-21T02:41:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.448+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a081a28e0 con 0x7f2a08110160 2024-09-21T02:41:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.449+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a081a9040 con 0x7f2a08110160 2024-09-21T02:41:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.450+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a08075b40 con 0x7f2a08110160 2024-09-21T02:41:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.452+0000 7f29ffe00640 1 -- 172.21.15.79:0/714586827 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2a00005000 con 0x7f2a08110160 2024-09-21T02:41:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.454+0000 7f29ffe00640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f29ec0b6590 0x7f29ec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.454+0000 7f29ffe00640 1 -- 172.21.15.79:0/714586827 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2a000e7de0 con 0x7f2a08110160 2024-09-21T02:41:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.454+0000 7f2a07400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f29ec0b6590 0x7f29ec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.455+0000 7f2a07400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f29ec0b6590 0x7f29ec0b8aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f29f80095f0 tx=0x7f29f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.456+0000 7f29ffe00640 1 -- 172.21.15.79:0/714586827 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a00056710 con 0x7f2a08110160 2024-09-21T02:41:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.684+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a0819d7b0 con 0x7f2a08110160 2024-09-21T02:41:18.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.685+0000 7f29ffe00640 1 -- 172.21.15.79:0/714586827 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f2a0819d7b0 con 0x7f2a08110160 2024-09-21T02:41:18.686 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:41:18.687 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:41:18.687 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:41:18.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f29ec0b6590 msgr2=0x7f29ec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f29ec0b6590 0x7f29ec0b8aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f29f80095f0 tx=0x7f29f8005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:18.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08110160 msgr2=0x7f2a081a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08110160 0x7f2a081a1ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000eb10 tx=0x7f2a0000c2d0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 shutdown_connections 2024-09-21T02:41:18.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f29ec0b6590 0x7f29ec0b8aa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08110160 0x7f2a081a1ec0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a08076080 0x7f2a0819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 --2- 172.21.15.79:0/714586827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a08075730 0x7f2a0819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.687+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 >> 172.21.15.79:0/714586827 conn(0x7f2a080ff5d0 msgr2=0x7f2a081021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:18.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.688+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 shutdown_connections 2024-09-21T02:41:18.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:18.688+0000 7f2a0e400640 1 -- 172.21.15.79:0/714586827 wait complete. 2024-09-21T02:41:18.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:18 smithi079 ceph-mon[30788]: pgmap v582: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 MiB/s wr, 196 op/s 2024-09-21T02:41:18.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:18 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/714586827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:19.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:18 smithi098 ceph-mon[34832]: pgmap v582: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 MiB/s wr, 196 op/s 2024-09-21T02:41:19.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:18 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/714586827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:19.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:18 smithi148 ceph-mon[34626]: pgmap v582: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 MiB/s wr, 196 op/s 2024-09-21T02:41:19.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:18 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/714586827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:19.663 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 2e41686 --release --await' 2024-09-21T02:41:19.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 2e41686 --release --await 2024-09-21T02:41:20.394 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:20 smithi098 ceph-mon[34832]: pgmap v583: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 259 op/s 2024-09-21T02:41:21.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:20 smithi079 ceph-mon[30788]: pgmap v583: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 259 op/s 2024-09-21T02:41:21.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec03e00640 1 -- 172.21.15.79:0/1422233807 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40318a0 con 0x7fec04111f40 2024-09-21T02:41:21.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec0bc00640 1 -- 172.21.15.79:0/1422233807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec04111f40 msgr2=0x7fec0410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec0bc00640 1 --2- 172.21.15.79:0/1422233807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec04111f40 0x7fec0410a3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7febf4009900 tx=0x7febf402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec0bc00640 1 -- 172.21.15.79:0/1422233807 shutdown_connections 2024-09-21T02:41:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec0bc00640 1 --2- 172.21.15.79:0/1422233807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec0411cc30 0x7fec0411f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec0bc00640 1 --2- 172.21.15.79:0/1422233807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec0410a9e0 0x7fec0410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec0bc00640 1 --2- 172.21.15.79:0/1422233807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec04111f40 0x7fec0410a3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.229+0000 7fec0bc00640 1 -- 172.21.15.79:0/1422233807 >> 172.21.15.79:0/1422233807 conn(0x7fec04070ec0 msgr2=0x7fec040712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.230+0000 7fec0bc00640 1 -- 172.21.15.79:0/1422233807 shutdown_connections 2024-09-21T02:41:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.230+0000 7fec0bc00640 1 -- 172.21.15.79:0/1422233807 wait complete. 2024-09-21T02:41:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.231+0000 7fec0bc00640 1 Processor -- start 2024-09-21T02:41:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.232+0000 7fec0bc00640 1 -- start start 2024-09-21T02:41:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.232+0000 7fec0bc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec0410a9e0 0x7fec041a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7fec0bc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec04111f40 0x7fec041a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7fec0bc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0411cc30 0x7fec041aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7fec0bc00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec04122900 con 0x7fec0410a9e0 2024-09-21T02:41:21.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7fec0bc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec04122780 con 0x7fec04111f40 2024-09-21T02:41:21.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7fec0bc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec04122a80 con 0x7fec0411cc30 2024-09-21T02:41:21.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7fec09200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec0410a9e0 0x7fec041a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7febfbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec04111f40 0x7fec041a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7febfbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec04111f40 0x7fec041a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36060/0 (socket says 172.21.15.79:36060) 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7febfbe00640 1 -- 172.21.15.79:0/2618423344 learned_addr learned my addr 172.21.15.79:0/2618423344 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.233+0000 7fec09c00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0411cc30 0x7fec041aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.234+0000 7febfbe00640 1 -- 172.21.15.79:0/2618423344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0411cc30 msgr2=0x7fec041aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.234+0000 7febfbe00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0411cc30 0x7fec041aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.234+0000 7febfbe00640 1 -- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec0410a9e0 msgr2=0x7fec041a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.234+0000 7febfbe00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec0410a9e0 0x7fec041a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.234+0000 7febfbe00640 1 -- 172.21.15.79:0/2618423344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec041af200 con 0x7fec04111f40 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.234+0000 7fec09200640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec0410a9e0 0x7fec041a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.235+0000 7febfbe00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec04111f40 0x7fec041a98f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9f0 tx=0x7febec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.235+0000 7fec02000640 1 -- 172.21.15.79:0/2618423344 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec00ccc0 con 0x7fec04111f40 2024-09-21T02:41:21.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.235+0000 7fec02000640 1 -- 172.21.15.79:0/2618423344 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec0035f0 con 0x7fec04111f40 2024-09-21T02:41:21.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.235+0000 7fec02000640 1 -- 172.21.15.79:0/2618423344 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec00ce60 con 0x7fec04111f40 2024-09-21T02:41:21.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.236+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec041af4f0 con 0x7fec04111f40 2024-09-21T02:41:21.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.236+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041b5d10 con 0x7fec04111f40 2024-09-21T02:41:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.243+0000 7fec12a0e740 1 Processor -- start 2024-09-21T02:41:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.243+0000 7fec12a0e740 1 -- start start 2024-09-21T02:41:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.245+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abe41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.245+0000 7fec02000640 1 -- 172.21.15.79:0/2618423344 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7febec003aa0 con 0x7fec04111f40 2024-09-21T02:41:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.245+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abe4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.246+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abe4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.246+0000 7fec09200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abe4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.246+0000 7fec09200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abe4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36074/0 (socket says 172.21.15.79:36074) 2024-09-21T02:41:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.247+0000 7fec12a0e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55840ab5b290 con 0x55840a83d520 2024-09-21T02:41:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.247+0000 7fec09c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abe41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.247+0000 7fec09c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abe41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44574/0 (socket says 172.21.15.79:44574) 2024-09-21T02:41:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.247+0000 7fec09c00640 1 -- 172.21.15.79:0/1244471577 learned_addr learned my addr 172.21.15.79:0/1244471577 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.248+0000 7fec12a0e740 1 -- 172.21.15.79:0/1244471577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55840ab4a6c0 con 0x55840a814660 2024-09-21T02:41:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.248+0000 7fec12a0e740 1 -- 172.21.15.79:0/1244471577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55840ab4e4d0 con 0x55840a81c840 2024-09-21T02:41:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.248+0000 7febfbe00640 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abe4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.249+0000 7fec09200640 1 -- 172.21.15.79:0/1244471577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 msgr2=0x55840abe4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.249+0000 7fec09200640 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abe4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.249+0000 7fec09200640 1 -- 172.21.15.79:0/1244471577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 msgr2=0x55840abe41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.249+0000 7fec02000640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7febe80b6710 0x7febe80b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.250+0000 7fec09200640 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abe41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.250+0000 7fec09200640 1 -- 172.21.15.79:0/1244471577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840aad7460 con 0x55840a814660 2024-09-21T02:41:21.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.250+0000 7fec02000640 1 -- 172.21.15.79:0/2618423344 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7febec0e79f0 con 0x7fec04111f40 2024-09-21T02:41:21.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.250+0000 7fec09c00640 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abe41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:21.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.251+0000 7febfbe00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7febe80b6710 0x7febe80b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.251+0000 7fec09200640 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abe4700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7febf402a9e0 tx=0x7febf40042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c86ec26e9d8e93f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.251+0000 7febfa000640 1 -- 172.21.15.79:0/1244471577 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4035030 con 0x55840a814660 2024-09-21T02:41:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.251+0000 7febfa000640 1 -- 172.21.15.79:0/1244471577 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febf40044d0 con 0x55840a814660 2024-09-21T02:41:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.251+0000 7febfa000640 1 -- 172.21.15.79:0/1244471577 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4035030 con 0x55840a814660 2024-09-21T02:41:21.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.252+0000 7fec12a0e740 1 -- 172.21.15.79:0/1244471577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 msgr2=0x55840abe4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.252+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abe4700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7febf402a9e0 tx=0x7febf40042e0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7febfbe00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7febe80b6710 0x7febe80b8c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7febec0ad700 tx=0x7febec0ed530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7fec12a0e740 1 -- 172.21.15.79:0/1244471577 shutdown_connections 2024-09-21T02:41:21.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abe4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abe4700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1244471577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abe41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7fec12a0e740 1 -- 172.21.15.79:0/1244471577 >> 172.21.15.79:0/1244471577 conn(0x55840a831910 msgr2=0x55840abe20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7fec12a0e740 1 -- 172.21.15.79:0/1244471577 shutdown_connections 2024-09-21T02:41:21.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.253+0000 7fec12a0e740 1 -- 172.21.15.79:0/1244471577 wait complete. 2024-09-21T02:41:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.254+0000 7fec12a0e740 1 -- start start 2024-09-21T02:41:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.254+0000 7fec12a0e740 1 Processor -- start 2024-09-21T02:41:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.255+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abefdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.255+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abf02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.255+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abfbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.255+0000 7fec12a0e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55840a9abbb0 con 0x55840a83d520 2024-09-21T02:41:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.255+0000 7fec12a0e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55840aae56c0 con 0x55840a814660 2024-09-21T02:41:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.255+0000 7fec12a0e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55840abf2940 con 0x55840a81c840 2024-09-21T02:41:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.255+0000 7fec12a0e740 10 client.0 _ll_register_callbacks cb 0x55840ab00490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abf02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abf02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38752/0 (socket says 172.21.15.79:38752) 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abefdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 -- 172.21.15.79:0/217321498 learned_addr learned my addr 172.21.15.79:0/217321498 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09c00640 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abfbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 -- 172.21.15.79:0/217321498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 msgr2=0x55840abefdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abefdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 -- 172.21.15.79:0/217321498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 msgr2=0x55840abfbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abfbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.256+0000 7fec09200640 1 -- 172.21.15.79:0/217321498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840a8a8b00 con 0x55840a81c840 2024-09-21T02:41:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.257+0000 7fec09c00640 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abfbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.257+0000 7fec09200640 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abf02f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7febf4005ab0 tx=0x7febf4005020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b8425ee739e5d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.257+0000 7febf2a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:41:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.258+0000 7febf2a00640 1 -- 172.21.15.79:0/217321498 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4051060 con 0x55840a81c840 2024-09-21T02:41:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.258+0000 7febf2a00640 1 -- 172.21.15.79:0/217321498 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7febf4005420 con 0x55840a81c840 2024-09-21T02:41:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.258+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf40044d0 con 0x55840a81c840 2024-09-21T02:41:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.259+0000 7febf2a00640 1 -- 172.21.15.79:0/217321498 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7febf4058050 con 0x55840a81c840 2024-09-21T02:41:21.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.260+0000 7fec12a0e740 10 client.25966 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.260+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55840a91f960 con 0x55840a81c840 2024-09-21T02:41:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.260+0000 7febf2a00640 1 -- 172.21.15.79:0/217321498 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febf40044d0 con 0x55840a81c840 2024-09-21T02:41:21.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.261+0000 7febf2a00640 1 -- 172.21.15.79:0/217321498 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7febf404b030 con 0x55840a81c840 2024-09-21T02:41:21.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.262+0000 7fec12a0e740 10 client.25966 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:21.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.262+0000 7fec12a0e740 10 client.25966 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:21.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.262+0000 7fec12a0e740 20 client.25966 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.262+0000 7fec12a0e740 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7fbea0 0x55840ac01ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.262+0000 7fec12a0e740 4 client.25966 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.262+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55840ab5d1e0 con 0x55840a7fbea0 2024-09-21T02:41:21.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.266+0000 7fec09c00640 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7fbea0 0x55840ac01ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.266+0000 7fec09c00640 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7fbea0 0x55840ac01ab0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9993886ae3a89a8 server_cookie=4c0cd6788d76fcf0 in_seq=0 out_seq=0 2024-09-21T02:41:21.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.266+0000 7febf2a00640 10 client.25966 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:21.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.268+0000 7febf2a00640 1 -- 172.21.15.79:0/217321498 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55840ab5d1e0 con 0x55840a7fbea0 2024-09-21T02:41:21.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.268+0000 7febf2a00640 10 client.25966 handle_command_reply: tid=0 2024-09-21T02:41:21.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.268+0000 7fec12a0e740 1 client.25966 shutdown 2024-09-21T02:41:21.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 msgr2=0x55840abf02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abf02f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7febf4005ab0 tx=0x7febf4005020 comp rx=0 tx=0).stop 2024-09-21T02:41:21.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 shutdown_connections 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7fbea0 0x55840ac01ab0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abfbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a81c840 0x55840abf02f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 --2- 172.21.15.79:0/217321498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840abefdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7febf2a00640 0 client.25966 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.269+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 >> 172.21.15.79:0/217321498 conn(0x55840a831910 msgr2=0x55840abe73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.270+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 shutdown_connections 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.270+0000 7fec12a0e740 1 -- 172.21.15.79:0/217321498 wait complete. 2024-09-21T02:41:21.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.270+0000 7fec12a0e740 20 client.25966 trim_cache size 0 max 16384 2024-09-21T02:41:21.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.299+0000 7fec12a0e740 1 Processor -- start 2024-09-21T02:41:21.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.299+0000 7fec12a0e740 1 -- start start 2024-09-21T02:41:21.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a814660 0x55840abe7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a81c840 0x55840abe5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec12a0e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec041bd990 con 0x55840a83d520 2024-09-21T02:41:21.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec12a0e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec041c0210 con 0x55840a81c840 2024-09-21T02:41:21.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec12a0e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec041be000 con 0x55840a814660 2024-09-21T02:41:21.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec09c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a814660 0x55840abe7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec09c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a814660 0x55840abe7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38768/0 (socket says 172.21.15.79:38768) 2024-09-21T02:41:21.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.300+0000 7fec09c00640 1 -- 172.21.15.79:0/1739338471 learned_addr learned my addr 172.21.15.79:0/1739338471 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.301+0000 7fec09200640 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a81c840 0x55840abe5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.301+0000 7fec09c00640 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.301+0000 7fec09c00640 1 -- 172.21.15.79:0/1739338471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a81c840 msgr2=0x55840abe5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.301+0000 7fec09c00640 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a81c840 0x55840abe5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.301+0000 7fec09c00640 1 -- 172.21.15.79:0/1739338471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 msgr2=0x55840abecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.301+0000 7fec09c00640 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.301+0000 7fec09c00640 1 -- 172.21.15.79:0/1739338471 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840abe64b0 con 0x55840a814660 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.302+0000 7fec09c00640 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a814660 0x55840abe7c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7febfc000f80 tx=0x7febfc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c6924ee044ad597 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.302+0000 7febf9600640 1 -- 172.21.15.79:0/1739338471 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc011e60 con 0x55840a814660 2024-09-21T02:41:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.302+0000 7febf9600640 1 -- 172.21.15.79:0/1739338471 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc00fdb0 con 0x55840a814660 2024-09-21T02:41:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.302+0000 7febf9600640 1 -- 172.21.15.79:0/1739338471 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc0058d0 con 0x55840a814660 2024-09-21T02:41:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.303+0000 7fec12a0e740 1 -- 172.21.15.79:0/1739338471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a814660 msgr2=0x55840abe7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.303+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a814660 0x55840abe7c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7febfc000f80 tx=0x7febfc004a40 comp rx=0 tx=0).stop 2024-09-21T02:41:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.303+0000 7fec12a0e740 1 -- 172.21.15.79:0/1739338471 shutdown_connections 2024-09-21T02:41:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.303+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a83d520 0x55840abecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.303+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a81c840 0x55840abe5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.303+0000 7fec12a0e740 1 --2- 172.21.15.79:0/1739338471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a814660 0x55840abe7c80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.303+0000 7fec12a0e740 1 -- 172.21.15.79:0/1739338471 >> 172.21.15.79:0/1739338471 conn(0x55840a831910 msgr2=0x55840abe51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.304+0000 7fec12a0e740 1 -- 172.21.15.79:0/1739338471 shutdown_connections 2024-09-21T02:41:21.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.304+0000 7fec12a0e740 1 -- 172.21.15.79:0/1739338471 wait complete. 2024-09-21T02:41:21.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.304+0000 7fec12a0e740 1 -- start start 2024-09-21T02:41:21.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.304+0000 7fec12a0e740 1 Processor -- start 2024-09-21T02:41:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.305+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840ac05150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.305+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a81c840 0x55840ac03630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.305+0000 7fec12a0e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a83d520 0x55840ac03b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.305+0000 7fec12a0e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fec041be6d0 con 0x55840a81c840 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.305+0000 7fec12a0e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec041bfb40 con 0x55840a814660 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.305+0000 7fec12a0e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec041beda0 con 0x55840a83d520 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.305+0000 7fec12a0e740 10 client.0 _ll_register_callbacks cb 0x7febfc0078e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840ac05150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a81c840 0x55840ac03630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840ac05150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36108/0 (socket says 172.21.15.79:36108) 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09c00640 1 -- 172.21.15.79:0/494175161 learned_addr learned my addr 172.21.15.79:0/494175161 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:21.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09c00640 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a83d520 0x55840ac03b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09200640 1 -- 172.21.15.79:0/494175161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a83d520 msgr2=0x55840ac03b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09200640 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a83d520 0x55840ac03b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09200640 1 -- 172.21.15.79:0/494175161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 msgr2=0x55840ac05150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09200640 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840ac05150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.306+0000 7fec09200640 1 -- 172.21.15.79:0/494175161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840ac04180 con 0x55840a81c840 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.307+0000 7fec09c00640 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a83d520 0x55840ac03b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.307+0000 7fec09200640 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a81c840 0x55840ac03630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7febf403b730 tx=0x7febf4004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c61a01e2949997 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.307+0000 7febf2a00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:41:21.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.307+0000 7febf2a00640 1 -- 172.21.15.79:0/494175161 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4051070 con 0x55840a81c840 2024-09-21T02:41:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.307+0000 7febf2a00640 1 -- 172.21.15.79:0/494175161 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7febf4004460 con 0x55840a81c840 2024-09-21T02:41:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.308+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febfc00fdb0 con 0x55840a81c840 2024-09-21T02:41:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.308+0000 7febf2a00640 1 -- 172.21.15.79:0/494175161 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7febf4035040 con 0x55840a81c840 2024-09-21T02:41:21.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.308+0000 7fec12a0e740 10 client.15837 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.308+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55840ac7e060 con 0x55840a81c840 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7febf2a00640 1 -- 172.21.15.79:0/494175161 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc00fdb0 con 0x55840a81c840 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7febf2a00640 1 -- 172.21.15.79:0/494175161 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7febf404b040 con 0x55840a81c840 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7fec12a0e740 10 client.15837 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7fec12a0e740 10 client.15837 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7fec12a0e740 20 client.15837 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7fec12a0e740 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7d1250 0x55840ac80790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7fec12a0e740 4 client.15837 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2e41686", "release": true, "await": true}] 2024-09-21T02:41:21.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.309+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2e41686", "release": true, "await": true}) -- 0x55840ab58c90 con 0x55840a7d1250 2024-09-21T02:41:21.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.310+0000 7fec09c00640 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7d1250 0x55840ac80790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.310+0000 7febf2a00640 10 client.15837 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:21.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.310+0000 7fec09c00640 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7d1250 0x55840ac80790 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e5ac887bb07051 server_cookie=8bcd57937d2e2615 in_seq=0 out_seq=0 2024-09-21T02:41:21.312 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:20 smithi148 ceph-mon[34626]: pgmap v583: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 259 op/s 2024-09-21T02:41:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.387+0000 7febf2a00640 1 -- 172.21.15.79:0/494175161 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55840ab58c90 con 0x55840a7d1250 2024-09-21T02:41:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.387+0000 7febf2a00640 10 client.15837 handle_command_reply: tid=0 2024-09-21T02:41:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.388+0000 7fec12a0e740 1 client.15837 shutdown 2024-09-21T02:41:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a81c840 msgr2=0x55840ac03630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a81c840 0x55840ac03630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7febf403b730 tx=0x7febf4004ce0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 shutdown_connections 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55840a7d1250 0x55840ac80790 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55840a83d520 0x55840ac03b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55840a81c840 0x55840ac03630 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 --2- 172.21.15.79:0/494175161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55840a814660 0x55840ac05150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 >> 172.21.15.79:0/494175161 conn(0x55840a831910 msgr2=0x55840abe7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.389+0000 7febf2a00640 0 client.15837 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.390+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 shutdown_connections 2024-09-21T02:41:21.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.390+0000 7fec12a0e740 1 -- 172.21.15.79:0/494175161 wait complete. 2024-09-21T02:41:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.393+0000 7fec12a0e740 20 client.15837 trim_cache size 0 max 16384 2024-09-21T02:41:21.395 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:41:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:41:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 24, 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "2e41686": { 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 24, 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 139.2, 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:41:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:21.397 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7febe80b6710 msgr2=0x7febe80b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7febe80b6710 0x7febe80b8c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7febec0ad700 tx=0x7febec0ed530 comp rx=0 tx=0).stop 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec04111f40 msgr2=0x7fec041a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec04111f40 0x7fec041a98f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9f0 tx=0x7febec00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 shutdown_connections 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7febe80b6710 0x7febe80b8c20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0411cc30 0x7fec041aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec04111f40 0x7fec041a98f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 --2- 172.21.15.79:0/2618423344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec0410a9e0 0x7fec041a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.395+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 >> 172.21.15.79:0/2618423344 conn(0x7fec04070ec0 msgr2=0x7fec04071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.397+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 shutdown_connections 2024-09-21T02:41:21.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:21.397+0000 7fec0bc00640 1 -- 172.21.15.79:0/2618423344 wait complete. 2024-09-21T02:41:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 325.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:41:22.333 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2e41686', total seconds elapsed: 24.1 2024-09-21T02:41:22.333 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T02:41:22.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:41:22.988 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:23.148 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:22 smithi079 ceph-mon[30788]: pgmap v584: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 599 op/s 2024-09-21T02:41:23.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:22 smithi098 ceph-mon[34832]: pgmap v584: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 599 op/s 2024-09-21T02:41:23.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:22 smithi148 ceph-mon[34626]: pgmap v584: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 599 op/s 2024-09-21T02:41:23.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.822+0000 7fbe14200640 1 -- 172.21.15.79:0/3014005565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 msgr2=0x7fbe0c106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.822+0000 7fbe14200640 1 --2- 172.21.15.79:0/3014005565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 0x7fbe0c106690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009890 tx=0x7fbdf802a370 comp rx=0 tx=0).stop 2024-09-21T02:41:23.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.823+0000 7fbe14200640 1 -- 172.21.15.79:0/3014005565 shutdown_connections 2024-09-21T02:41:23.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.823+0000 7fbe14200640 1 --2- 172.21.15.79:0/3014005565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe0c106bd0 0x7fbe0c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.823+0000 7fbe14200640 1 --2- 172.21.15.79:0/3014005565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 0x7fbe0c106690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.823+0000 7fbe14200640 1 --2- 172.21.15.79:0/3014005565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 0x7fbe0c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.823+0000 7fbe14200640 1 -- 172.21.15.79:0/3014005565 >> 172.21.15.79:0/3014005565 conn(0x7fbe0c077c60 msgr2=0x7fbe0c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:23.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.824+0000 7fbe14200640 1 -- 172.21.15.79:0/3014005565 shutdown_connections 2024-09-21T02:41:23.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.824+0000 7fbe14200640 1 -- 172.21.15.79:0/3014005565 wait complete. 2024-09-21T02:41:23.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.826+0000 7fbe14200640 1 Processor -- start 2024-09-21T02:41:23.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.826+0000 7fbe14200640 1 -- start start 2024-09-21T02:41:23.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe14200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 0x7fbe0c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe14200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 0x7fbe0c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe14200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe0c106bd0 0x7fbe0c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe14200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c113aa0 con 0x7fbe0c106bd0 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe14200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c113920 con 0x7fbe0c102030 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe14200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c113c20 con 0x7fbe0c106280 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe11800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 0x7fbe0c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe10e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 0x7fbe0c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe11800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 0x7fbe0c19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52324/0 (socket says 172.21.15.79:52324) 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.827+0000 7fbe11800640 1 -- 172.21.15.79:0/3662250611 learned_addr learned my addr 172.21.15.79:0/3662250611 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.828+0000 7fbe12200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe0c106bd0 0x7fbe0c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.828+0000 7fbe11800640 1 -- 172.21.15.79:0/3662250611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 msgr2=0x7fbe0c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.828+0000 7fbe11800640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 0x7fbe0c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.828+0000 7fbe11800640 1 -- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe0c106bd0 msgr2=0x7fbe0c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.828+0000 7fbe11800640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe0c106bd0 0x7fbe0c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.828+0000 7fbe11800640 1 -- 172.21.15.79:0/3662250611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c1a04c0 con 0x7fbe0c102030 2024-09-21T02:41:23.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.829+0000 7fbe12200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe0c106bd0 0x7fbe0c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:41:23.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.829+0000 7fbe11800640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 0x7fbe0c19a550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000e9f0 tx=0x7fbe0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:23.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.829+0000 7fbe0a000640 1 -- 172.21.15.79:0/3662250611 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000ccc0 con 0x7fbe0c102030 2024-09-21T02:41:23.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.829+0000 7fbe0a000640 1 -- 172.21.15.79:0/3662250611 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe000035f0 con 0x7fbe0c102030 2024-09-21T02:41:23.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.829+0000 7fbe0a000640 1 -- 172.21.15.79:0/3662250611 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000ce60 con 0x7fbe0c102030 2024-09-21T02:41:23.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.830+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c1a07b0 con 0x7fbe0c102030 2024-09-21T02:41:23.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.830+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c1a6f10 con 0x7fbe0c102030 2024-09-21T02:41:23.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.832+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c06ab90 con 0x7fbe0c102030 2024-09-21T02:41:23.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.834+0000 7fbe0a000640 1 -- 172.21.15.79:0/3662250611 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbe00003fb0 con 0x7fbe0c102030 2024-09-21T02:41:23.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.836+0000 7fbe0a000640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbdf40b6510 0x7fbdf40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.836+0000 7fbe0a000640 1 -- 172.21.15.79:0/3662250611 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbe000e79c0 con 0x7fbe0c102030 2024-09-21T02:41:23.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.837+0000 7fbe10e00640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbdf40b6510 0x7fbdf40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.839+0000 7fbe10e00640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbdf40b6510 0x7fbdf40b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80303f0 tx=0x7fbdf8030340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:23.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:23.840+0000 7fbe0a000640 1 -- 172.21.15.79:0/3662250611 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe000ade40 con 0x7fbe0c102030 2024-09-21T02:41:24.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.285+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe0c102440 con 0x7fbe0c102030 2024-09-21T02:41:24.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.287+0000 7fbe0a000640 1 -- 172.21.15.79:0/3662250611 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fbe000b2220 con 0x7fbe0c102030 2024-09-21T02:41:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:41:24.289 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:41:24.289 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:41:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbdf40b6510 msgr2=0x7fbdf40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbdf40b6510 0x7fbdf40b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80303f0 tx=0x7fbdf8030340 comp rx=0 tx=0).stop 2024-09-21T02:41:24.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 msgr2=0x7fbe0c19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 0x7fbe0c19a550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000e9f0 tx=0x7fbe0000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 shutdown_connections 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbdf40b6510 0x7fbdf40b8a20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe0c106bd0 0x7fbe0c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe0c106280 0x7fbe0c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 --2- 172.21.15.79:0/3662250611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe0c102030 0x7fbe0c19a550 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 >> 172.21.15.79:0/3662250611 conn(0x7fbe0c077c60 msgr2=0x7fbe0c107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.291+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 shutdown_connections 2024-09-21T02:41:24.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:24.292+0000 7fbe14200640 1 -- 172.21.15.79:0/3662250611 wait complete. 2024-09-21T02:41:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.881+0000 7f7f0e000640 1 -- 172.21.15.79:0/1146345689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f080770f0 msgr2=0x7f7f080757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.881+0000 7f7f0e000640 1 --2- 172.21.15.79:0/1146345689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f080770f0 0x7f7f080757b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009900 tx=0x7f7ef802a410 comp rx=0 tx=0).stop 2024-09-21T02:41:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.881+0000 7f7f0e000640 1 -- 172.21.15.79:0/1146345689 shutdown_connections 2024-09-21T02:41:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.881+0000 7f7f0e000640 1 --2- 172.21.15.79:0/1146345689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f0810b650 0x7f7f0810db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.881+0000 7f7f0e000640 1 --2- 172.21.15.79:0/1146345689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f08075cf0 0x7f7f08076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.881+0000 7f7f0e000640 1 --2- 172.21.15.79:0/1146345689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f080770f0 0x7f7f080757b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.881+0000 7f7f0e000640 1 -- 172.21.15.79:0/1146345689 >> 172.21.15.79:0/1146345689 conn(0x7f7f080ff020 msgr2=0x7f7f081014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.882+0000 7f7f0e000640 1 -- 172.21.15.79:0/1146345689 shutdown_connections 2024-09-21T02:41:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.882+0000 7f7f0e000640 1 -- 172.21.15.79:0/1146345689 wait complete. 2024-09-21T02:41:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.883+0000 7f7f0e000640 1 Processor -- start 2024-09-21T02:41:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.883+0000 7f7f0e000640 1 -- start start 2024-09-21T02:41:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.883+0000 7f7f0e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f08075cf0 0x7f7f0819c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f0e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f080770f0 0x7f7f0819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f0e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f0810b650 0x7f7f0819d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f0e000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08111550 con 0x7f7f0810b650 2024-09-21T02:41:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f0e000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081113d0 con 0x7f7f080770f0 2024-09-21T02:41:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f0e000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081116d0 con 0x7f7f08075cf0 2024-09-21T02:41:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f080770f0 0x7f7f0819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f080770f0 0x7f7f0819c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52340/0 (socket says 172.21.15.79:52340) 2024-09-21T02:41:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 -- 172.21.15.79:0/322338211 learned_addr learned my addr 172.21.15.79:0/322338211 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f07400640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f08075cf0 0x7f7f0819c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f07e00640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f0810b650 0x7f7f0819d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 -- 172.21.15.79:0/322338211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f08075cf0 msgr2=0x7f7f0819c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f08075cf0 0x7f7f0819c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 -- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f0810b650 msgr2=0x7f7f0819d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f0810b650 0x7f7f0819d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f06a00640 1 -- 172.21.15.79:0/322338211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0819dbb0 con 0x7f7f080770f0 2024-09-21T02:41:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.884+0000 7f7f07e00640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f0810b650 0x7f7f0819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:41:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.885+0000 7f7f06a00640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f080770f0 0x7f7f0819c7e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9f0 tx=0x7f7ef400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.886+0000 7f7effe00640 1 -- 172.21.15.79:0/322338211 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400cd80 con 0x7f7f080770f0 2024-09-21T02:41:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.886+0000 7f7effe00640 1 -- 172.21.15.79:0/322338211 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ef40054d0 con 0x7f7f080770f0 2024-09-21T02:41:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.886+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0819dea0 con 0x7f7f080770f0 2024-09-21T02:41:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.886+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f081a4590 con 0x7f7f080770f0 2024-09-21T02:41:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.886+0000 7f7effe00640 1 -- 172.21.15.79:0/322338211 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4010690 con 0x7f7f080770f0 2024-09-21T02:41:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.893+0000 7f7effe00640 1 -- 172.21.15.79:0/322338211 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7ef4010830 con 0x7f7f080770f0 2024-09-21T02:41:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.893+0000 7f7f15088740 1 Processor -- start 2024-09-21T02:41:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f15088740 1 -- start start 2024-09-21T02:41:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f15088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f15088740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 0x5574cb03df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f15088740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb03eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f15088740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5574cafa86b0 con 0x5574cac652f0 2024-09-21T02:41:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f15088740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5574caf97ae0 con 0x5574cac6d4d0 2024-09-21T02:41:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f15088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5574caf9b8f0 con 0x5574cac8e1b0 2024-09-21T02:41:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f07e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f07e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39136/0 (socket says 172.21.15.79:39136) 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f07e00640 1 -- 172.21.15.79:0/3274962631 learned_addr learned my addr 172.21.15.79:0/3274962631 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.894+0000 7f7f06a00640 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb03eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.895+0000 7f7f07400640 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 0x5574cb03df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.895+0000 7f7f07e00640 1 -- 172.21.15.79:0/3274962631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 msgr2=0x5574cb03eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.895+0000 7f7f07e00640 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb03eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.895+0000 7f7f07e00640 1 -- 172.21.15.79:0/3274962631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 msgr2=0x5574cb03df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.895+0000 7f7f07e00640 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 0x5574cb03df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.895+0000 7f7f07e00640 1 -- 172.21.15.79:0/3274962631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574caf64780 con 0x5574cac8e1b0 2024-09-21T02:41:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.896+0000 7f7f07e00640 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03d8e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009f90 tx=0x7f7f0000f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e8b58d1c2bc9ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.896+0000 7f7effe00640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6660 0x7f7eec0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.896+0000 7f7ef3e00640 1 -- 172.21.15.79:0/3274962631 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00003b70 con 0x5574cac8e1b0 2024-09-21T02:41:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.896+0000 7f7effe00640 1 -- 172.21.15.79:0/322338211 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7ef40e7a90 con 0x7f7f080770f0 2024-09-21T02:41:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.896+0000 7f7ef3e00640 1 -- 172.21.15.79:0/3274962631 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f00003d10 con 0x5574cac8e1b0 2024-09-21T02:41:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.896+0000 7f7ef3e00640 1 -- 172.21.15.79:0/3274962631 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011900 con 0x5574cac8e1b0 2024-09-21T02:41:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.896+0000 7f7f07400640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6660 0x7f7eec0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.897+0000 7f7f15088740 1 -- 172.21.15.79:0/3274962631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 msgr2=0x5574cb03d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.897+0000 7f7f15088740 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03d8e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009f90 tx=0x7f7f0000f7f0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.898+0000 7f7f07400640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6660 0x7f7eec0b8b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8004770 tx=0x7f7ef80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.898+0000 7f7f15088740 1 -- 172.21.15.79:0/3274962631 shutdown_connections 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.898+0000 7f7f15088740 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb03eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.898+0000 7f7f15088740 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 0x5574cb03df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.898+0000 7f7f15088740 1 --2- 172.21.15.79:0/3274962631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03d8e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.898+0000 7f7f15088740 1 -- 172.21.15.79:0/3274962631 >> 172.21.15.79:0/3274962631 conn(0x5574cac82300 msgr2=0x5574cb039370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.898+0000 7f7f15088740 1 -- 172.21.15.79:0/3274962631 shutdown_connections 2024-09-21T02:41:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.899+0000 7f7f15088740 1 -- 172.21.15.79:0/3274962631 wait complete. 2024-09-21T02:41:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.900+0000 7f7f15088740 1 -- start start 2024-09-21T02:41:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.900+0000 7f7f15088740 1 Processor -- start 2024-09-21T02:41:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f15088740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac652f0 0x5574cb047040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f15088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac6d4d0 0x5574cb047700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f15088740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac8e1b0 0x5574cb048200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f15088740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5574caecfab0 con 0x5574cac8e1b0 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f15088740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5574caf3e570 con 0x5574cac652f0 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f15088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5574cb03f5c0 con 0x5574cac6d4d0 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f15088740 10 client.0 _ll_register_callbacks cb 0x5574caf4d100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f07400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac652f0 0x5574cb047040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac6d4d0 0x5574cb047700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f07e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac8e1b0 0x5574cb048200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f07400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac652f0 0x5574cb047040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52352/0 (socket says 172.21.15.79:52352) 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac6d4d0 0x5574cb047700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39148/0 (socket says 172.21.15.79:39148) 2024-09-21T02:41:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.901+0000 7f7f07400640 1 -- 172.21.15.79:0/3568667215 learned_addr learned my addr 172.21.15.79:0/3568667215 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7f06a00640 1 -- 172.21.15.79:0/3568667215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac652f0 msgr2=0x5574cb047040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7f06a00640 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac652f0 0x5574cb047040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7f06a00640 1 -- 172.21.15.79:0/3568667215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac8e1b0 msgr2=0x5574cb048200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7f06a00640 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac8e1b0 0x5574cb048200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7f06a00640 1 -- 172.21.15.79:0/3568667215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574cacf9790 con 0x5574cac6d4d0 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7f06a00640 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac6d4d0 0x5574cb047700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40e5230 tx=0x7f7ef40eb160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f40b7d9e6cb7dca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7ef0c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7ef0c00640 1 -- 172.21.15.79:0/3568667215 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40ad640 con 0x5574cac6d4d0 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7ef0c00640 1 -- 172.21.15.79:0/3568667215 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7ef4010b20 con 0x5574cac6d4d0 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.902+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f00003d10 con 0x5574cac6d4d0 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.903+0000 7f7ef0c00640 1 -- 172.21.15.79:0/3568667215 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7ef40acfe0 con 0x5574cac6d4d0 2024-09-21T02:41:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.903+0000 7f7f15088740 10 client.25987 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.903+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5574cad72620 con 0x5574cac6d4d0 2024-09-21T02:41:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7ef0c00640 1 -- 172.21.15.79:0/3568667215 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f00003d10 con 0x5574cac6d4d0 2024-09-21T02:41:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7ef0c00640 1 -- 172.21.15.79:0/3568667215 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7ef40aeba0 con 0x5574cac6d4d0 2024-09-21T02:41:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7f15088740 10 client.25987 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7f15088740 10 client.25987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7f15088740 20 client.25987 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7f15088740 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cac4cd80 0x5574cb065680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7f15088740 4 client.25987 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574cafaa600 con 0x5574cac4cd80 2024-09-21T02:41:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.904+0000 7f7f07400640 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cac4cd80 0x5574cb065680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.906+0000 7f7f07400640 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cac4cd80 0x5574cb065680 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d2c9c97830b652 server_cookie=9e7c51086d693411 in_seq=0 out_seq=0 2024-09-21T02:41:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.906+0000 7f7ef0c00640 10 client.25987 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.907+0000 7f7ef0c00640 1 -- 172.21.15.79:0/3568667215 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5574cafaa600 con 0x5574cac4cd80 2024-09-21T02:41:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.907+0000 7f7ef0c00640 10 client.25987 handle_command_reply: tid=0 2024-09-21T02:41:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.907+0000 7f7f15088740 1 client.25987 shutdown 2024-09-21T02:41:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac6d4d0 msgr2=0x5574cb047700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac6d4d0 0x5574cb047700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40e5230 tx=0x7f7ef40eb160 comp rx=0 tx=0).stop 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 shutdown_connections 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cac4cd80 0x5574cb065680 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac8e1b0 0x5574cb048200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac6d4d0 0x5574cb047700 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 --2- 172.21.15.79:0/3568667215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac652f0 0x5574cb047040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 >> 172.21.15.79:0/3568667215 conn(0x5574cac82300 msgr2=0x5574cb02f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7ef0c00640 0 client.25987 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 shutdown_connections 2024-09-21T02:41:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.908+0000 7f7f15088740 1 -- 172.21.15.79:0/3568667215 wait complete. 2024-09-21T02:41:24.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.909+0000 7f7f15088740 20 client.25987 trim_cache size 0 max 16384 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.932+0000 7f7f15088740 1 Processor -- start 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.932+0000 7f7f15088740 1 -- start start 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.932+0000 7f7f15088740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 0x5574cb02b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f15088740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb039e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f15088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f15088740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08070b40 con 0x5574cac652f0 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f15088740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f080733c0 con 0x5574cac6d4d0 2024-09-21T02:41:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f15088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f080711b0 con 0x5574cac8e1b0 2024-09-21T02:41:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb039e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f07e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f06a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb039e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52356/0 (socket says 172.21.15.79:52356) 2024-09-21T02:41:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.933+0000 7f7f06a00640 1 -- 172.21.15.79:0/1138404603 learned_addr learned my addr 172.21.15.79:0/1138404603 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.934+0000 7f7f06a00640 1 -- 172.21.15.79:0/1138404603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 msgr2=0x5574cb03a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.934+0000 7f7f06a00640 1 --2- 172.21.15.79:0/1138404603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.934+0000 7f7f06a00640 1 -- 172.21.15.79:0/1138404603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 msgr2=0x5574cb02b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.934+0000 7f7f06a00640 1 --2- 172.21.15.79:0/1138404603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 0x5574cb02b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.934+0000 7f7f06a00640 1 -- 172.21.15.79:0/1138404603 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574cb046dc0 con 0x5574cac6d4d0 2024-09-21T02:41:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.934+0000 7f7f06a00640 1 --2- 172.21.15.79:0/1138404603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb039e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40ad570 tx=0x7f7ef4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02961ff591f785e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.935+0000 7f7ef3400640 1 -- 172.21.15.79:0/1138404603 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40ad1c0 con 0x5574cac6d4d0 2024-09-21T02:41:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.935+0000 7f7ef3400640 1 -- 172.21.15.79:0/1138404603 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ef40f0070 con 0x5574cac6d4d0 2024-09-21T02:41:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.935+0000 7f7ef3400640 1 -- 172.21.15.79:0/1138404603 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40ad1c0 con 0x5574cac6d4d0 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.937+0000 7f7f15088740 1 -- 172.21.15.79:0/1138404603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 msgr2=0x5574cb039e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.937+0000 7f7f15088740 1 --2- 172.21.15.79:0/1138404603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb039e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40ad570 tx=0x7f7ef4014000 comp rx=0 tx=0).stop 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.937+0000 7f7f15088740 1 -- 172.21.15.79:0/1138404603 shutdown_connections 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.937+0000 7f7f15088740 1 --2- 172.21.15.79:0/1138404603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac8e1b0 0x5574cb03a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.937+0000 7f7f15088740 1 --2- 172.21.15.79:0/1138404603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac6d4d0 0x5574cb039e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.937+0000 7f7f15088740 1 --2- 172.21.15.79:0/1138404603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac652f0 0x5574cb02b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.937+0000 7f7f15088740 1 -- 172.21.15.79:0/1138404603 >> 172.21.15.79:0/1138404603 conn(0x5574cac82300 msgr2=0x5574cb046260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.938+0000 7f7f15088740 1 -- 172.21.15.79:0/1138404603 shutdown_connections 2024-09-21T02:41:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.938+0000 7f7f15088740 1 -- 172.21.15.79:0/1138404603 wait complete. 2024-09-21T02:41:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.938+0000 7f7f15088740 1 -- start start 2024-09-21T02:41:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.939+0000 7f7f15088740 1 Processor -- start 2024-09-21T02:41:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.939+0000 7f7f15088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac652f0 0x5574cb04eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.939+0000 7f7f15088740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac8e1b0 0x5574cb04d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.939+0000 7f7f15088740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac221c0 0x5574cb04e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.939+0000 7f7f15088740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08071880 con 0x5574cac221c0 2024-09-21T02:41:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.939+0000 7f7f15088740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08072cf0 con 0x5574cac8e1b0 2024-09-21T02:41:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.939+0000 7f7f15088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08071f50 con 0x5574cac652f0 2024-09-21T02:41:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.940+0000 7f7f15088740 10 client.0 _ll_register_callbacks cb 0x7f7ef40eb260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.940+0000 7f7f07400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac652f0 0x5574cb04eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.940+0000 7f7f07400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac652f0 0x5574cb04eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39160/0 (socket says 172.21.15.79:39160) 2024-09-21T02:41:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.940+0000 7f7f07400640 1 -- 172.21.15.79:0/1012824511 learned_addr learned my addr 172.21.15.79:0/1012824511 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.940+0000 7f7f06a00640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac8e1b0 0x5574cb04d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.941+0000 7f7f06a00640 1 -- 172.21.15.79:0/1012824511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac652f0 msgr2=0x5574cb04eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.941+0000 7f7f07e00640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac221c0 0x5574cb04e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.943+0000 7f7f06a00640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac652f0 0x5574cb04eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.943+0000 7f7f06a00640 1 -- 172.21.15.79:0/1012824511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac221c0 msgr2=0x5574cb04e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.943+0000 7f7f06a00640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac221c0 0x5574cb04e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.943+0000 7f7f06a00640 1 -- 172.21.15.79:0/1012824511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574cb04c3f0 con 0x5574cac8e1b0 2024-09-21T02:41:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.943+0000 7f7f07e00640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac221c0 0x5574cb04e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:41:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.944+0000 7f7f07400640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac652f0 0x5574cb04eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.944+0000 7f7f06a00640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac8e1b0 0x5574cb04d8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40a8000 tx=0x7f7ef40e5250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57b9baaf666ebe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.944+0000 7f7ef0c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:41:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.944+0000 7f7ef0c00640 1 -- 172.21.15.79:0/1012824511 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40ad1c0 con 0x5574cac8e1b0 2024-09-21T02:41:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.944+0000 7f7ef0c00640 1 -- 172.21.15.79:0/1012824511 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7ef4010d20 con 0x5574cac8e1b0 2024-09-21T02:41:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.945+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef40f0070 con 0x5574cac8e1b0 2024-09-21T02:41:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.951+0000 7f7ef0c00640 1 -- 172.21.15.79:0/1012824511 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7ef40ad380 con 0x5574cac8e1b0 2024-09-21T02:41:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.952+0000 7f7f15088740 10 client.25991 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.952+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5574cb0d0260 con 0x5574cac8e1b0 2024-09-21T02:41:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7ef0c00640 1 -- 172.21.15.79:0/1012824511 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ef40f0070 con 0x5574cac8e1b0 2024-09-21T02:41:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7ef0c00640 1 -- 172.21.15.79:0/1012824511 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7ef40ac540 con 0x5574cac8e1b0 2024-09-21T02:41:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7f15088740 10 client.25991 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7f15088740 10 client.25991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7f15088740 20 client.25991 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7f15088740 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cb0d08f0 0x5574cb0d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7f15088740 4 client.25991 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:41:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.953+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5574cafa60b0 con 0x5574cb0d08f0 2024-09-21T02:41:24.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.955+0000 7f7f07400640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cb0d08f0 0x5574cb0d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.957+0000 7f7f07400640 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cb0d08f0 0x5574cb0d2d10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d015fa57e578cb5f server_cookie=c5296baf30170850 in_seq=0 out_seq=0 2024-09-21T02:41:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:24.957+0000 7f7ef0c00640 10 client.25991 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.074+0000 7f7ef0c00640 1 -- 172.21.15.79:0/1012824511 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5574cafa60b0 con 0x5574cb0d08f0 2024-09-21T02:41:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.075+0000 7f7ef0c00640 10 client.25991 handle_command_reply: tid=0 2024-09-21T02:41:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.075+0000 7f7f15088740 1 client.25991 shutdown 2024-09-21T02:41:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac8e1b0 msgr2=0x5574cb04d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac8e1b0 0x5574cb04d8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40a8000 tx=0x7f7ef40e5250 comp rx=0 tx=0).stop 2024-09-21T02:41:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 shutdown_connections 2024-09-21T02:41:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5574cb0d08f0 0x5574cb0d2d10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7ef0c00640 0 client.25991 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574cac221c0 0x5574cb04e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574cac8e1b0 0x5574cb04d8f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 --2- 172.21.15.79:0/1012824511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5574cac652f0 0x5574cb04eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.076+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 >> 172.21.15.79:0/1012824511 conn(0x5574cac82300 msgr2=0x5574cb039e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.077+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 shutdown_connections 2024-09-21T02:41:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.077+0000 7f7f15088740 1 -- 172.21.15.79:0/1012824511 wait complete. 2024-09-21T02:41:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.077+0000 7f7f15088740 20 client.25991 trim_cache size 0 max 16384 2024-09-21T02:41:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:41:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:41:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:41:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6660 msgr2=0x7f7eec0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6660 0x7f7eec0b8b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8004770 tx=0x7f7ef80314a0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f080770f0 msgr2=0x7f7f0819c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f080770f0 0x7f7f0819c7e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9f0 tx=0x7f7ef400edf0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 shutdown_connections 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7eec0b6660 0x7f7eec0b8b70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f0810b650 0x7f7f0819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f080770f0 0x7f7f0819c7e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 --2- 172.21.15.79:0/322338211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f08075cf0 0x7f7f0819c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 >> 172.21.15.79:0/322338211 conn(0x7f7f080ff020 msgr2=0x7f7f081014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 shutdown_connections 2024-09-21T02:41:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:25.079+0000 7f7f0e000640 1 -- 172.21.15.79:0/322338211 wait complete. 2024-09-21T02:41:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:24 smithi098 ceph-mon[34832]: pgmap v585: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 735 op/s 2024-09-21T02:41:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:24 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3662250611' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:25.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:24 smithi079 ceph-mon[30788]: pgmap v585: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 735 op/s 2024-09-21T02:41:25.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:24 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3662250611' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:25.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:24 smithi148 ceph-mon[34626]: pgmap v585: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 735 op/s 2024-09-21T02:41:25.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:24 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3662250611' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 330.0 s, 795.3 tps, lat 589.546 ms stddev 2957.648 2024-09-21T02:41:27.147 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T02:41:27.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T02:41:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:26 smithi098 ceph-mon[34832]: pgmap v586: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 22 MiB/s wr, 1.10k op/s 2024-09-21T02:41:27.223 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:26 smithi079 ceph-mon[30788]: pgmap v586: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 22 MiB/s wr, 1.10k op/s 2024-09-21T02:41:27.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:26 smithi148 ceph-mon[34626]: pgmap v586: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 22 MiB/s wr, 1.10k op/s 2024-09-21T02:41:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:28.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.657+0000 7fbd80c00640 1 -- 172.21.15.79:0/3823951458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd7c107c00 msgr2=0x7fbd7c1080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:28.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.657+0000 7fbd80c00640 1 --2- 172.21.15.79:0/3823951458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd7c107c00 0x7fbd7c1080e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009cd0 tx=0x7fbd7402a8f0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.657+0000 7fbd80c00640 1 -- 172.21.15.79:0/3823951458 shutdown_connections 2024-09-21T02:41:28.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.657+0000 7fbd80c00640 1 --2- 172.21.15.79:0/3823951458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd7c107c00 0x7fbd7c1080e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.657+0000 7fbd80c00640 1 --2- 172.21.15.79:0/3823951458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c103110 0x7fbd7c107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.657+0000 7fbd80c00640 1 --2- 172.21.15.79:0/3823951458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd7c1027c0 0x7fbd7c102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.657+0000 7fbd80c00640 1 -- 172.21.15.79:0/3823951458 >> 172.21.15.79:0/3823951458 conn(0x7fbd7c079760 msgr2=0x7fbd7c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.658+0000 7fbd80c00640 1 -- 172.21.15.79:0/3823951458 shutdown_connections 2024-09-21T02:41:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.659+0000 7fbd80c00640 1 -- 172.21.15.79:0/3823951458 wait complete. 2024-09-21T02:41:28.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.660+0000 7fbd80c00640 1 Processor -- start 2024-09-21T02:41:28.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.660+0000 7fbd80c00640 1 -- start start 2024-09-21T02:41:28.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd80c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c1027c0 0x7fbd7c1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd80c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd7c103110 0x7fbd7c1a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd80c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd7c107c00 0x7fbd7c1a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd80c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c11a0f0 con 0x7fbd7c107c00 2024-09-21T02:41:28.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd80c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c119f70 con 0x7fbd7c1027c0 2024-09-21T02:41:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd80c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c11a270 con 0x7fbd7c103110 2024-09-21T02:41:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd79400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd7c103110 0x7fbd7c1a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd79e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c1027c0 0x7fbd7c1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd79e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c1027c0 0x7fbd7c1a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52378/0 (socket says 172.21.15.79:52378) 2024-09-21T02:41:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.662+0000 7fbd79e00640 1 -- 172.21.15.79:0/2557695578 learned_addr learned my addr 172.21.15.79:0/2557695578 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.661+0000 7fbd79400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd7c103110 0x7fbd7c1a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39178/0 (socket says 172.21.15.79:39178) 2024-09-21T02:41:28.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.662+0000 7fbd79e00640 1 -- 172.21.15.79:0/2557695578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd7c103110 msgr2=0x7fbd7c1a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:28.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.662+0000 7fbd79e00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd7c103110 0x7fbd7c1a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.662+0000 7fbd79e00640 1 -- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd7c107c00 msgr2=0x7fbd7c1a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:28.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.662+0000 7fbd79e00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd7c107c00 0x7fbd7c1a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.662+0000 7fbd79e00640 1 -- 172.21.15.79:0/2557695578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7c1a68f0 con 0x7fbd7c1027c0 2024-09-21T02:41:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.663+0000 7fbd79e00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c1027c0 0x7fbd7c1a0a40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00c970 tx=0x7fbd6c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.663+0000 7fbd72a00640 1 -- 172.21.15.79:0/2557695578 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c007c10 con 0x7fbd7c1027c0 2024-09-21T02:41:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.663+0000 7fbd72a00640 1 -- 172.21.15.79:0/2557695578 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd6c007db0 con 0x7fbd7c1027c0 2024-09-21T02:41:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.663+0000 7fbd72a00640 1 -- 172.21.15.79:0/2557695578 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00f840 con 0x7fbd7c1027c0 2024-09-21T02:41:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.664+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7c1a6be0 con 0x7fbd7c1027c0 2024-09-21T02:41:28.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.664+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7c1ad400 con 0x7fbd7c1027c0 2024-09-21T02:41:28.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.668+0000 7fbd72a00640 1 -- 172.21.15.79:0/2557695578 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbd6c0213f0 con 0x7fbd7c1027c0 2024-09-21T02:41:28.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.670+0000 7fbd8788b740 1 Processor -- start 2024-09-21T02:41:28.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.670+0000 7fbd8788b740 1 -- start start 2024-09-21T02:41:28.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.671+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02e4850 0x55daf068b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.671+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf068bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.671+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf068c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.671+0000 7fbd8788b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55daf0601a90 con 0x55daf02c3b70 2024-09-21T02:41:28.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.671+0000 7fbd8788b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55daf05f0ec0 con 0x55daf02e4850 2024-09-21T02:41:28.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.671+0000 7fbd8788b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55daf05f4cd0 con 0x55daf02bb990 2024-09-21T02:41:28.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd79e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf068bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd79e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf068bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39192/0 (socket says 172.21.15.79:39192) 2024-09-21T02:41:28.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd79e00640 1 -- 172.21.15.79:0/3817581738 learned_addr learned my addr 172.21.15.79:0/3817581738 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:28.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd7a800640 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02e4850 0x55daf068b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd79400640 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf068c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd7a800640 1 -- 172.21.15.79:0/3817581738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 msgr2=0x55daf068bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd7a800640 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf068bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd7a800640 1 -- 172.21.15.79:0/3817581738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 msgr2=0x55daf068c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd7a800640 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf068c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.672+0000 7fbd7a800640 1 -- 172.21.15.79:0/3817581738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf05969d0 con 0x55daf02e4850 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.673+0000 7fbd72a00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbd600b6690 0x7fbd600b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.673+0000 7fbd72a00640 1 -- 172.21.15.79:0/2557695578 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbd6c0e7930 con 0x7fbd7c1027c0 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.673+0000 7fbd7a800640 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02e4850 0x55daf068b9b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402ae10 tx=0x7fbd74031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58c340e512a752d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:28.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.673+0000 7fbd79e00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbd600b6690 0x7fbd600b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.674+0000 7fbd67000640 1 -- 172.21.15.79:0/3817581738 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740305a0 con 0x55daf02e4850 2024-09-21T02:41:28.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.674+0000 7fbd67000640 1 -- 172.21.15.79:0/3817581738 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd7403f070 con 0x55daf02e4850 2024-09-21T02:41:28.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.674+0000 7fbd67000640 1 -- 172.21.15.79:0/3817581738 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74004280 con 0x55daf02e4850 2024-09-21T02:41:28.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.675+0000 7fbd8788b740 1 -- 172.21.15.79:0/3817581738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02e4850 msgr2=0x55daf068b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:28.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.675+0000 7fbd79e00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbd600b6690 0x7fbd600b8ba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c018b00 tx=0x7fbd6c0ed550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:28.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.675+0000 7fbd8788b740 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02e4850 0x55daf068b9b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402ae10 tx=0x7fbd74031000 comp rx=0 tx=0).stop 2024-09-21T02:41:28.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.675+0000 7fbd8788b740 1 -- 172.21.15.79:0/3817581738 shutdown_connections 2024-09-21T02:41:28.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.675+0000 7fbd8788b740 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf068c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.675+0000 7fbd8788b740 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf068bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.675+0000 7fbd8788b740 1 --2- 172.21.15.79:0/3817581738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02e4850 0x55daf068b9b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.676+0000 7fbd8788b740 1 -- 172.21.15.79:0/3817581738 >> 172.21.15.79:0/3817581738 conn(0x55daf02d8c40 msgr2=0x55daf06898a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:28.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.676+0000 7fbd8788b740 1 -- 172.21.15.79:0/3817581738 shutdown_connections 2024-09-21T02:41:28.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.677+0000 7fbd8788b740 1 -- 172.21.15.79:0/3817581738 wait complete. 2024-09-21T02:41:28.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.677+0000 7fbd8788b740 1 -- start start 2024-09-21T02:41:28.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.678+0000 7fbd8788b740 1 Processor -- start 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.678+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02c3b70 0x55daf0697a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf06a3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd8788b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55daf04527b0 con 0x55daf02e4850 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd8788b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55daf0595650 con 0x55daf02bb990 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd8788b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55daf069a130 con 0x55daf02c3b70 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd8788b740 10 client.0 _ll_register_callbacks cb 0x55daf02fc0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd79400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02c3b70 0x55daf0697a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd79400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02c3b70 0x55daf0697a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39206/0 (socket says 172.21.15.79:39206) 2024-09-21T02:41:28.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.679+0000 7fbd79400640 1 -- 172.21.15.79:0/2607367593 learned_addr learned my addr 172.21.15.79:0/2607367593 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:28.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.680+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf06a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.680+0000 7fbd79400640 1 -- 172.21.15.79:0/2607367593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 msgr2=0x55daf06974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.680+0000 7fbd79400640 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.680+0000 7fbd79400640 1 -- 172.21.15.79:0/2607367593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 msgr2=0x55daf06a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.680+0000 7fbd79400640 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf06a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.680+0000 7fbd79400640 1 -- 172.21.15.79:0/2607367593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf035eba0 con 0x55daf02c3b70 2024-09-21T02:41:28.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.680+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf06a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:28.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd79400640 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02c3b70 0x55daf0697a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd680126e0 tx=0x7fbd68012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=737e4d9f843ccd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:28.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd5b400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:41:28.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd5b400640 1 -- 172.21.15.79:0/2607367593 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680120d0 con 0x55daf02c3b70 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd5b400640 1 -- 172.21.15.79:0/2607367593 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbd6800f920 con 0x55daf02c3b70 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7403f070 con 0x55daf02c3b70 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd5b400640 1 -- 172.21.15.79:0/2607367593 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbd68012270 con 0x55daf02c3b70 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd8788b740 10 client.26002 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.681+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55daf06a6120 con 0x55daf02c3b70 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd5b400640 1 -- 172.21.15.79:0/2607367593 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd7403f070 con 0x55daf02c3b70 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd5b400640 1 -- 172.21.15.79:0/2607367593 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbd6801c420 con 0x55daf02c3b70 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd8788b740 10 client.26002 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd8788b740 10 client.26002 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd8788b740 20 client.26002 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf02a31d0 0x55daf06a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd8788b740 4 client.26002 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:28.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.682+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daf06039e0 con 0x55daf02a31d0 2024-09-21T02:41:28.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.683+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf02a31d0 0x55daf06a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.684+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf02a31d0 0x55daf06a9760 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3550077edcf8e1b2 server_cookie=871f37cd8896a00c in_seq=0 out_seq=0 2024-09-21T02:41:28.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.684+0000 7fbd5b400640 10 client.26002 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.685+0000 7fbd5b400640 1 -- 172.21.15.79:0/2607367593 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55daf06039e0 con 0x55daf02a31d0 2024-09-21T02:41:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.685+0000 7fbd5b400640 10 client.26002 handle_command_reply: tid=0 2024-09-21T02:41:28.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 client.26002 shutdown 2024-09-21T02:41:28.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02c3b70 msgr2=0x55daf0697a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:28.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02c3b70 0x55daf0697a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd680126e0 tx=0x7fbd68012ba0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 shutdown_connections 2024-09-21T02:41:28.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf02a31d0 0x55daf06a9760 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf06a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02c3b70 0x55daf0697a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2607367593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.686+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 >> 172.21.15.79:0/2607367593 conn(0x55daf02d8c40 msgr2=0x55daf068eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:28.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.687+0000 7fbd5b400640 0 client.26002 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:28.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.687+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 shutdown_connections 2024-09-21T02:41:28.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.687+0000 7fbd8788b740 1 -- 172.21.15.79:0/2607367593 wait complete. 2024-09-21T02:41:28.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.688+0000 7fbd8788b740 20 client.26002 trim_cache size 0 max 16384 2024-09-21T02:41:28.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 Processor -- start 2024-09-21T02:41:28.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 -- start start 2024-09-21T02:41:28.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf06991c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02e4850 0x55daf06a3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1b5140 con 0x55daf02c3b70 2024-09-21T02:41:28.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1b79c0 con 0x55daf02bb990 2024-09-21T02:41:28.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.724+0000 7fbd8788b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1b57b0 con 0x55daf02e4850 2024-09-21T02:41:28.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd7a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd7a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06896f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52402/0 (socket says 172.21.15.79:52402) 2024-09-21T02:41:28.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd7a800640 1 -- 172.21.15.79:0/1933628657 learned_addr learned my addr 172.21.15.79:0/1933628657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd7a800640 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02e4850 0x55daf06a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd79400640 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf06991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd7a800640 1 -- 172.21.15.79:0/1933628657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02e4850 msgr2=0x55daf06a3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd7a800640 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02e4850 0x55daf06a3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.725+0000 7fbd7a800640 1 -- 172.21.15.79:0/1933628657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 msgr2=0x55daf06991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.726+0000 7fbd7a800640 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf06991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.726+0000 7fbd7a800640 1 -- 172.21.15.79:0/1933628657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf068e810 con 0x55daf02bb990 2024-09-21T02:41:28.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.726+0000 7fbd7a800640 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06896f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbd740094e0 tx=0x7fbd74003e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6809852471e3dd03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:28.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.728+0000 7fbd66600640 1 -- 172.21.15.79:0/1933628657 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7405e070 con 0x55daf02bb990 2024-09-21T02:41:28.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.728+0000 7fbd66600640 1 -- 172.21.15.79:0/1933628657 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd7403f030 con 0x55daf02bb990 2024-09-21T02:41:28.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.728+0000 7fbd66600640 1 -- 172.21.15.79:0/1933628657 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74053a40 con 0x55daf02bb990 2024-09-21T02:41:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.731+0000 7fbd8788b740 1 -- 172.21.15.79:0/1933628657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 msgr2=0x55daf06896f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.731+0000 7fbd8788b740 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06896f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbd740094e0 tx=0x7fbd74003e30 comp rx=0 tx=0).stop 2024-09-21T02:41:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.732+0000 7fbd8788b740 1 -- 172.21.15.79:0/1933628657 shutdown_connections 2024-09-21T02:41:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.732+0000 7fbd8788b740 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02e4850 0x55daf06a3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.732+0000 7fbd8788b740 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02c3b70 0x55daf06991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.732+0000 7fbd8788b740 1 --2- 172.21.15.79:0/1933628657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02bb990 0x55daf06896f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.732+0000 7fbd8788b740 1 -- 172.21.15.79:0/1933628657 >> 172.21.15.79:0/1933628657 conn(0x55daf02d8c40 msgr2=0x55daf0688570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:28.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.732+0000 7fbd8788b740 1 -- 172.21.15.79:0/1933628657 shutdown_connections 2024-09-21T02:41:28.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.732+0000 7fbd8788b740 1 -- 172.21.15.79:0/1933628657 wait complete. 2024-09-21T02:41:28.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.733+0000 7fbd8788b740 1 -- start start 2024-09-21T02:41:28.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.734+0000 7fbd8788b740 1 Processor -- start 2024-09-21T02:41:28.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.735+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf069f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.735+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02c3b70 0x55daf069bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd8788b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf069c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd7a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf069f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd79400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02c3b70 0x55daf069bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd79400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02c3b70 0x55daf069bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52406/0 (socket says 172.21.15.79:52406) 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd79400640 1 -- 172.21.15.79:0/2236652035 learned_addr learned my addr 172.21.15.79:0/2236652035 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd8788b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1b5e80 con 0x55daf02e4850 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1b72f0 con 0x55daf02c3b70 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1b6550 con 0x55daf02bb990 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.736+0000 7fbd8788b740 10 client.0 _ll_register_callbacks cb 0x7fbd68009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:28.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.737+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf069c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.738+0000 7fbd7a800640 1 -- 172.21.15.79:0/2236652035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02c3b70 msgr2=0x55daf069bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.738+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02c3b70 0x55daf069bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.738+0000 7fbd7a800640 1 -- 172.21.15.79:0/2236652035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 msgr2=0x55daf069c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:28.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.738+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf069c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:28.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.738+0000 7fbd7a800640 1 -- 172.21.15.79:0/2236652035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf069c7f0 con 0x55daf02bb990 2024-09-21T02:41:28.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.739+0000 7fbd7a800640 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf069f8b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd74003e00 tx=0x7fbd74053620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea1102685d363d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:28.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.739+0000 7fbd5b400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:41:28.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.741+0000 7fbd5b400640 1 -- 172.21.15.79:0/2236652035 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7405e040 con 0x55daf02bb990 2024-09-21T02:41:28.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.743+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7403f030 con 0x55daf02bb990 2024-09-21T02:41:28.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.743+0000 7fbd5b400640 1 -- 172.21.15.79:0/2236652035 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbd74030c10 con 0x55daf02bb990 2024-09-21T02:41:28.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.743+0000 7fbd5b400640 1 -- 172.21.15.79:0/2236652035 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbd740536c0 con 0x55daf02bb990 2024-09-21T02:41:28.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.744+0000 7fbd8788b740 10 client.26008 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:28.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.744+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55daf0714de0 con 0x55daf02bb990 2024-09-21T02:41:28.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.745+0000 7fbd5b400640 1 -- 172.21.15.79:0/2236652035 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd7403f030 con 0x55daf02bb990 2024-09-21T02:41:28.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.745+0000 7fbd5b400640 1 -- 172.21.15.79:0/2236652035 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbd74064040 con 0x55daf02bb990 2024-09-21T02:41:28.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.745+0000 7fbd8788b740 10 client.26008 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:28.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.745+0000 7fbd8788b740 10 client.26008 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:28.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.745+0000 7fbd8788b740 20 client.26008 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:28.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.745+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf0278580 0x55daf0717050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:28.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.748+0000 7fbd8788b740 4 client.26008 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T02:41:28.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.748+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x55daf05ff490 con 0x55daf0278580 2024-09-21T02:41:28.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.749+0000 7fbd79400640 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf0278580 0x55daf0717050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:28.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.749+0000 7fbd79400640 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf0278580 0x55daf0717050 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d84b1b0df4916a66 server_cookie=6f770b1c231a44ac in_seq=0 out_seq=0 2024-09-21T02:41:28.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:28.750+0000 7fbd5b400640 10 client.26008 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:28.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:28 smithi079 ceph-mon[30788]: pgmap v587: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 21 MiB/s wr, 1.04k op/s 2024-09-21T02:41:29.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd5b400640 1 -- 172.21.15.79:0/2236652035 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55daf05ff490 con 0x55daf0278580 2024-09-21T02:41:29.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd5b400640 10 client.26008 handle_command_reply: tid=0 2024-09-21T02:41:29.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 client.26008 shutdown 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 msgr2=0x55daf069f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf069f8b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd74003e00 tx=0x7fbd74053620 comp rx=0 tx=0).stop 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 shutdown_connections 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55daf0278580 0x55daf0717050 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55daf02e4850 0x55daf069c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55daf02c3b70 0x55daf069bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 --2- 172.21.15.79:0/2236652035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55daf02bb990 0x55daf069f8b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd5b400640 0 client.26008 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 >> 172.21.15.79:0/2236652035 conn(0x55daf02d8c40 msgr2=0x55daf068c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.027+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 shutdown_connections 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.028+0000 7fbd8788b740 1 -- 172.21.15.79:0/2236652035 wait complete. 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.028+0000 7fbd8788b740 20 client.26008 trim_cache size 0 max 16384 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:41:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 26, 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "6270da00": { 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 26, 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 139.2, 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:41:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:29.032 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.028+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbd600b6690 msgr2=0x7fbd600b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.028+0000 7fbd80c00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbd600b6690 0x7fbd600b8ba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c018b00 tx=0x7fbd6c0ed550 comp rx=0 tx=0).stop 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.028+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c1027c0 msgr2=0x7fbd7c1a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.028+0000 7fbd80c00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c1027c0 0x7fbd7c1a0a40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00c970 tx=0x7fbd6c00ce30 comp rx=0 tx=0).stop 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 shutdown_connections 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbd600b6690 0x7fbd600b8ba0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd7c107c00 0x7fbd7c1a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd7c103110 0x7fbd7c1a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 --2- 172.21.15.79:0/2557695578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd7c1027c0 0x7fbd7c1a0a40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:29.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 >> 172.21.15.79:0/2557695578 conn(0x7fbd7c079760 msgr2=0x7fbd7c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:29.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 shutdown_connections 2024-09-21T02:41:29.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:29.029+0000 7fbd80c00640 1 -- 172.21.15.79:0/2557695578 wait complete. 2024-09-21T02:41:29.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:28 smithi148 ceph-mon[34626]: pgmap v587: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 21 MiB/s wr, 1.04k op/s 2024-09-21T02:41:29.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:28 smithi098 ceph-mon[34832]: pgmap v587: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 21 MiB/s wr, 1.04k op/s 2024-09-21T02:41:30.190 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6270da00', quiesce took 7.9 seconds. Will release after: 11.35 2024-09-21T02:41:31.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:30 smithi079 ceph-mon[30788]: pgmap v588: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-09-21T02:41:31.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:30 smithi148 ceph-mon[34626]: pgmap v588: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-09-21T02:41:31.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:30 smithi098 ceph-mon[34832]: pgmap v588: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-09-21T02:41:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 335.0 s, 369.8 tps, lat 135.546 ms stddev 199.907 2024-09-21T02:41:33.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:32 smithi079 ceph-mon[30788]: pgmap v589: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 MiB/s wr, 1.14k op/s 2024-09-21T02:41:33.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:32 smithi148 ceph-mon[34626]: pgmap v589: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 MiB/s wr, 1.14k op/s 2024-09-21T02:41:33.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:32 smithi098 ceph-mon[34832]: pgmap v589: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 MiB/s wr, 1.14k op/s 2024-09-21T02:41:35.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:34 smithi079 ceph-mon[30788]: pgmap v590: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 796 op/s 2024-09-21T02:41:35.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:34 smithi148 ceph-mon[34626]: pgmap v590: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 796 op/s 2024-09-21T02:41:35.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:34 smithi098 ceph-mon[34832]: pgmap v590: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 796 op/s 2024-09-21T02:41:36.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:41:37.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:36 smithi079 ceph-mon[30788]: pgmap v591: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-09-21T02:41:37.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:36 smithi148 ceph-mon[34626]: pgmap v591: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-09-21T02:41:37.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:36 smithi098 ceph-mon[34832]: pgmap v591: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-09-21T02:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 -- 172.21.15.79:0/1145717257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf80104f00 msgr2=0x7fcf8010b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 --2- 172.21.15.79:0/1145717257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf80104f00 0x7fcf8010b8a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ca0 tx=0x7fcf7802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 -- 172.21.15.79:0/1145717257 shutdown_connections 2024-09-21T02:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 --2- 172.21.15.79:0/1145717257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf80104f00 0x7fcf8010b8a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 --2- 172.21.15.79:0/1145717257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104560 0x7fcf80104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 --2- 172.21.15.79:0/1145717257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf801034e0 0x7fcf80103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 -- 172.21.15.79:0/1145717257 >> 172.21.15.79:0/1145717257 conn(0x7fcf800fee20 msgr2=0x7fcf801012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 -- 172.21.15.79:0/1145717257 shutdown_connections 2024-09-21T02:41:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.285+0000 7fcf7f200640 1 -- 172.21.15.79:0/1145717257 wait complete. 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.286+0000 7fcf7f200640 1 Processor -- start 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7f200640 1 -- start start 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf801034e0 0x7fcf8019bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7f200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf80104560 0x7fcf8019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7f200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104f00 0x7fcf8019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7f200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8010f180 con 0x7fcf80104f00 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7f200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8010f000 con 0x7fcf801034e0 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7f200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8010f300 con 0x7fcf80104560 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104f00 0x7fcf8019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104f00 0x7fcf8019d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41062/0 (socket says 172.21.15.79:41062) 2024-09-21T02:41:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7e800640 1 -- 172.21.15.79:0/734156119 learned_addr learned my addr 172.21.15.79:0/734156119 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf7de00640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf801034e0 0x7fcf8019bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.287+0000 7fcf75400640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf80104560 0x7fcf8019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7e800640 1 -- 172.21.15.79:0/734156119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf80104560 msgr2=0x7fcf8019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7e800640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf80104560 0x7fcf8019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7e800640 1 -- 172.21.15.79:0/734156119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf801034e0 msgr2=0x7fcf8019bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7e800640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf801034e0 0x7fcf8019bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7e800640 1 -- 172.21.15.79:0/734156119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8019d980 con 0x7fcf80104f00 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7e800640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104f00 0x7fcf8019d160 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009430 tx=0x7fcf780316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf77400640 1 -- 172.21.15.79:0/734156119 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf78003b70 con 0x7fcf80104f00 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8019dc10 con 0x7fcf80104f00 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf77400640 1 -- 172.21.15.79:0/734156119 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf78003d10 con 0x7fcf80104f00 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf77400640 1 -- 172.21.15.79:0/734156119 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802fb40 con 0x7fcf80104f00 2024-09-21T02:41:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.288+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf801a4360 con 0x7fcf80104f00 2024-09-21T02:41:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.291+0000 7fcf8bed5740 1 Processor -- start 2024-09-21T02:41:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf77400640 1 -- 172.21.15.79:0/734156119 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fcf78004610 con 0x7fcf80104f00 2024-09-21T02:41:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf8bed5740 1 -- start start 2024-09-21T02:41:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445e9f7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445e9f8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56445e96a6b0 con 0x56445e62f4d0 2024-09-21T02:41:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56445e959ae0 con 0x56445e6501b0 2024-09-21T02:41:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.292+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56445e95d8f0 con 0x56445e6272f0 2024-09-21T02:41:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445e9f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445e9f8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41074/0 (socket says 172.21.15.79:41074) 2024-09-21T02:41:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf7de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445e9f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 -- 172.21.15.79:0/1989233188 learned_addr learned my addr 172.21.15.79:0/1989233188 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 -- 172.21.15.79:0/1989233188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 msgr2=0x56445e9f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445e9f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 -- 172.21.15.79:0/1989233188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 msgr2=0x56445e9f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.293+0000 7fcf75400640 1 -- 172.21.15.79:0/1989233188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445e926780 con 0x56445e62f4d0 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.294+0000 7fcf77400640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcf640b6510 0x7fcf640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.294+0000 7fcf75400640 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445e9f8470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcf680093e0 tx=0x7fcf68009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d543495b178d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.294+0000 7fcf77400640 1 -- 172.21.15.79:0/734156119 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcf78108ac0 con 0x7fcf80104f00 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.294+0000 7fcf7de00640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcf640b6510 0x7fcf640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.294+0000 7fcf6f400640 1 -- 172.21.15.79:0/1989233188 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68004030 con 0x56445e62f4d0 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.294+0000 7fcf6f400640 1 -- 172.21.15.79:0/1989233188 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf6800f7c0 con 0x56445e62f4d0 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.294+0000 7fcf6f400640 1 -- 172.21.15.79:0/1989233188 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68003880 con 0x56445e62f4d0 2024-09-21T02:41:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1989233188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 msgr2=0x56445e9f8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf7de00640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcf640b6510 0x7fcf640b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009da0 tx=0x7fcf70005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445e9f8470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcf680093e0 tx=0x7fcf68009370 comp rx=0 tx=0).stop 2024-09-21T02:41:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1989233188 shutdown_connections 2024-09-21T02:41:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445e9f8470 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445e9f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1989233188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1989233188 >> 172.21.15.79:0/1989233188 conn(0x56445e644300 msgr2=0x56445e9f2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1989233188 shutdown_connections 2024-09-21T02:41:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.295+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1989233188 wait complete. 2024-09-21T02:41:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 -- start start 2024-09-21T02:41:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 Processor -- start 2024-09-21T02:41:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445ea00980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445ea01040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea01bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56445e891ab0 con 0x56445e62f4d0 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56445e900570 con 0x56445e6501b0 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56445e9f8f90 con 0x56445e6272f0 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf8bed5740 10 client.0 _ll_register_callbacks cb 0x56445e90f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.296+0000 7fcf75400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445ea01040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445ea00980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea01bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf75400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445ea01040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41078/0 (socket says 172.21.15.79:41078) 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf75400640 1 -- 172.21.15.79:0/3019708134 learned_addr learned my addr 172.21.15.79:0/3019708134 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7e800640 1 -- 172.21.15.79:0/3019708134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 msgr2=0x56445ea00980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7e800640 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445ea00980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7e800640 1 -- 172.21.15.79:0/3019708134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 msgr2=0x56445ea01040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7e800640 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445ea01040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7e800640 1 -- 172.21.15.79:0/3019708134 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445e6bb790 con 0x56445e6501b0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf75400640 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445ea01040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf7e800640 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea01bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcf780cbab0 tx=0x7fcf780ce610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=591a6c5bc717c897 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf63e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf63e00640 1 -- 172.21.15.79:0/3019708134 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf780d7fd0 con 0x56445e6501b0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf6800f7c0 con 0x56445e6501b0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.297+0000 7fcf63e00640 1 -- 172.21.15.79:0/3019708134 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcf780cfb70 con 0x56445e6501b0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf63e00640 1 -- 172.21.15.79:0/3019708134 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcf780e9050 con 0x56445e6501b0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 10 client.26018 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56445e734620 con 0x56445e6501b0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf63e00640 1 -- 172.21.15.79:0/3019708134 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf6800f7c0 con 0x56445e6501b0 2024-09-21T02:41:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf63e00640 1 -- 172.21.15.79:0/3019708134 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcf780ca190 con 0x56445e6501b0 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 10 client.26018 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 10 client.26018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 20 client.26018 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e60ed80 0x56445ea0e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 4 client.26018 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.298+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56445e96c600 con 0x56445e60ed80 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.299+0000 7fcf7de00640 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e60ed80 0x56445ea0e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.299+0000 7fcf7de00640 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e60ed80 0x56445ea0e0a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f64253981ff6c0ac server_cookie=ee67a5e173dc1e5d in_seq=0 out_seq=0 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.299+0000 7fcf63e00640 10 client.26018 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf63e00640 1 -- 172.21.15.79:0/3019708134 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56445e96c600 con 0x56445e60ed80 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf63e00640 10 client.26018 handle_command_reply: tid=0 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 client.26018 shutdown 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 msgr2=0x56445ea01bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea01bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcf780cbab0 tx=0x7fcf780ce610 comp rx=0 tx=0).stop 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 shutdown_connections 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e60ed80 0x56445ea0e0a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea01bb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e62f4d0 0x56445ea01040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/3019708134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e6272f0 0x56445ea00980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf63e00640 0 client.26018 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 >> 172.21.15.79:0/3019708134 conn(0x56445e644300 msgr2=0x56445e9f1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.300+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 shutdown_connections 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.301+0000 7fcf8bed5740 1 -- 172.21.15.79:0/3019708134 wait complete. 2024-09-21T02:41:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.301+0000 7fcf8bed5740 20 client.26018 trim_cache size 0 max 16384 2024-09-21T02:41:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.315+0000 7fcf8bed5740 1 Processor -- start 2024-09-21T02:41:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.315+0000 7fcf8bed5740 1 -- start start 2024-09-21T02:41:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445e9f4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445e9fb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf801ac690 con 0x56445e6272f0 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf801aef10 con 0x56445e6501b0 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcf801acd00 con 0x56445e62f4d0 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445e9f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445e9f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41086/0 (socket says 172.21.15.79:41086) 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7de00640 1 -- 172.21.15.79:0/4182349088 learned_addr learned my addr 172.21.15.79:0/4182349088 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf75400640 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445e9fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7e800640 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7de00640 1 -- 172.21.15.79:0/4182349088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 msgr2=0x56445e9fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7de00640 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445e9fb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7de00640 1 -- 172.21.15.79:0/4182349088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 msgr2=0x56445e9fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.316+0000 7fcf7de00640 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9fb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.317+0000 7fcf7de00640 1 -- 172.21.15.79:0/4182349088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445e9feb10 con 0x56445e6272f0 2024-09-21T02:41:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.317+0000 7fcf7de00640 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445e9f4190 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009b80 tx=0x7fcf7001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d035d083bc9c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.317+0000 7fcf6ea00640 1 -- 172.21.15.79:0/4182349088 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7001d910 con 0x56445e6272f0 2024-09-21T02:41:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.317+0000 7fcf6ea00640 1 -- 172.21.15.79:0/4182349088 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf70005020 con 0x56445e6272f0 2024-09-21T02:41:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.317+0000 7fcf6ea00640 1 -- 172.21.15.79:0/4182349088 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70004c00 con 0x56445e6272f0 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 -- 172.21.15.79:0/4182349088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 msgr2=0x56445e9f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445e9f4190 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009b80 tx=0x7fcf7001b000 comp rx=0 tx=0).stop 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 -- 172.21.15.79:0/4182349088 shutdown_connections 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445e9fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445e9fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/4182349088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445e9f4190 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 -- 172.21.15.79:0/4182349088 >> 172.21.15.79:0/4182349088 conn(0x56445e644300 msgr2=0x56445e9f6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 -- 172.21.15.79:0/4182349088 shutdown_connections 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 -- 172.21.15.79:0/4182349088 wait complete. 2024-09-21T02:41:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.318+0000 7fcf8bed5740 1 -- start start 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 1 Processor -- start 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445ea08a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445ea07860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea07f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf801ad3d0 con 0x56445e6272f0 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf801ae840 con 0x56445e6501b0 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcf801adaa0 con 0x56445e62f4d0 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf8bed5740 10 client.0 _ll_register_callbacks cb 0x7fcf78009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf7de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445ea08a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf7de00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445ea08a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41094/0 (socket says 172.21.15.79:41094) 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf7de00640 1 -- 172.21.15.79:0/1940310337 learned_addr learned my addr 172.21.15.79:0/1940310337 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf7e800640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea07f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.319+0000 7fcf75400640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445ea07860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf7de00640 1 -- 172.21.15.79:0/1940310337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 msgr2=0x56445ea07860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf7de00640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445ea07860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf7de00640 1 -- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 msgr2=0x56445ea07f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf7de00640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea07f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf7de00640 1 -- 172.21.15.79:0/1940310337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445ea06350 con 0x56445e6272f0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf7e800640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea07f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf7de00640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445ea08a60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcf70005450 tx=0x7fcf70005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6d0f8346788e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf63e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf63e00640 1 -- 172.21.15.79:0/1940310337 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70004b80 con 0x56445e6272f0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf63e00640 1 -- 172.21.15.79:0/1940310337 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcf70004d20 con 0x56445e6272f0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf70005020 con 0x56445e6272f0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf63e00640 1 -- 172.21.15.79:0/1940310337 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcf7001d910 con 0x56445e6272f0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf8bed5740 10 client.15879 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.320+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56445ea78d30 con 0x56445e6272f0 2024-09-21T02:41:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf63e00640 1 -- 172.21.15.79:0/1940310337 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf70005020 con 0x56445e6272f0 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf63e00640 1 -- 172.21.15.79:0/1940310337 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcf70003ca0 con 0x56445e6272f0 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf8bed5740 10 client.15879 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf8bed5740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf8bed5740 20 client.15879 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e5e41c0 0x56445ea7b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf8bed5740 4 client.15879 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56445e9680b0 con 0x56445e5e41c0 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.321+0000 7fcf75400640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e5e41c0 0x56445ea7b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.322+0000 7fcf75400640 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e5e41c0 0x56445ea7b720 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23dbeb8be74e290 server_cookie=e597ab54fa87c336 in_seq=0 out_seq=0 2024-09-21T02:41:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.322+0000 7fcf63e00640 10 client.15879 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf63e00640 1 -- 172.21.15.79:0/1940310337 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56445e9680b0 con 0x56445e5e41c0 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf63e00640 10 client.15879 handle_command_reply: tid=0 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 client.15879 shutdown 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 msgr2=0x56445ea08a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445ea08a60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcf70005450 tx=0x7fcf70005480 comp rx=0 tx=0).stop 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 shutdown_connections 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56445e5e41c0 0x56445ea7b720 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56445e6501b0 0x56445ea07f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf63e00640 0 client.15879 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56445e62f4d0 0x56445ea07860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 --2- 172.21.15.79:0/1940310337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56445e6272f0 0x56445ea08a60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 >> 172.21.15.79:0/1940310337 conn(0x56445e644300 msgr2=0x56445e9f6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 shutdown_connections 2024-09-21T02:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 1 -- 172.21.15.79:0/1940310337 wait complete. 2024-09-21T02:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.344+0000 7fcf8bed5740 20 client.15879 trim_cache size 0 max 16384 2024-09-21T02:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:41:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcf640b6510 msgr2=0x7fcf640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcf640b6510 0x7fcf640b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009da0 tx=0x7fcf70005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104f00 msgr2=0x7fcf8019d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104f00 0x7fcf8019d160 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009430 tx=0x7fcf780316f0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 shutdown_connections 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcf640b6510 0x7fcf640b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf80104f00 0x7fcf8019d160 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf80104560 0x7fcf8019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 --2- 172.21.15.79:0/734156119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf801034e0 0x7fcf8019bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 >> 172.21.15.79:0/734156119 conn(0x7fcf800fee20 msgr2=0x7fcf800755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 shutdown_connections 2024-09-21T02:41:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:38.345+0000 7fcf7f200640 1 -- 172.21.15.79:0/734156119 wait complete. 2024-09-21T02:41:39.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:38 smithi079 ceph-mon[30788]: pgmap v592: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.9 MiB/s wr, 221 op/s 2024-09-21T02:41:39.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:38 smithi148 ceph-mon[34626]: pgmap v592: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.9 MiB/s wr, 221 op/s 2024-09-21T02:41:39.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:38 smithi098 ceph-mon[34832]: pgmap v592: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.9 MiB/s wr, 221 op/s 2024-09-21T02:41:41.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:40 smithi079 ceph-mon[30788]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-09-21T02:41:41.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:40 smithi148 ceph-mon[34626]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-09-21T02:41:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:40 smithi098 ceph-mon[34832]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-09-21T02:41:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:41:41.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:41:41.922 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 -- 172.21.15.79:0/1781119502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc105d80 msgr2=0x7fc8cc106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/1781119502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc105d80 0x7fc8cc106190 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009900 tx=0x7fc8bc02a410 comp rx=0 tx=0).stop 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 -- 172.21.15.79:0/1781119502 shutdown_connections 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/1781119502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8cc10c010 0x7fc8cc112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/1781119502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc10b6c0 0x7fc8cc10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/1781119502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc105d80 0x7fc8cc106190 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 -- 172.21.15.79:0/1781119502 >> 172.21.15.79:0/1781119502 conn(0x7fc8cc101810 msgr2=0x7fc8cc103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 -- 172.21.15.79:0/1781119502 shutdown_connections 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.611+0000 7fc8d0a00640 1 -- 172.21.15.79:0/1781119502 wait complete. 2024-09-21T02:41:42.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.612+0000 7fc8d0a00640 1 Processor -- start 2024-09-21T02:41:42.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.613+0000 7fc8d0a00640 1 -- start start 2024-09-21T02:41:42.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.613+0000 7fc8d0a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc105d80 0x7fc8cc19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:42.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.613+0000 7fc8d0a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8cc10b6c0 0x7fc8cc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:42.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.613+0000 7fc8d0a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc10c010 0x7fc8cc1a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:42.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.613+0000 7fc8d0a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc115cd0 con 0x7fc8cc10c010 2024-09-21T02:41:42.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.613+0000 7fc8d0a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc115b50 con 0x7fc8cc10b6c0 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.613+0000 7fc8d0a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc115e50 con 0x7fc8cc105d80 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc10c010 0x7fc8cc1a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc10c010 0x7fc8cc1a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41108/0 (socket says 172.21.15.79:41108) 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 -- 172.21.15.79:0/3431877778 learned_addr learned my addr 172.21.15.79:0/3431877778 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8c1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8cc10b6c0 0x7fc8cc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8c9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc105d80 0x7fc8cc19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 -- 172.21.15.79:0/3431877778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc105d80 msgr2=0x7fc8cc19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc105d80 0x7fc8cc19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 -- 172.21.15.79:0/3431877778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8cc10b6c0 msgr2=0x7fc8cc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8cc10b6c0 0x7fc8cc19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 -- 172.21.15.79:0/3431877778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc1a26f0 con 0x7fc8cc10c010 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8c9e00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc105d80 0x7fc8cc19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.614+0000 7fc8ca800640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc10c010 0x7fc8cc1a1fc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009fd0 tx=0x7fc8c400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:42.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.615+0000 7fc8c3400640 1 -- 172.21.15.79:0/3431877778 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4017070 con 0x7fc8cc10c010 2024-09-21T02:41:42.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.615+0000 7fc8c3400640 1 -- 172.21.15.79:0/3431877778 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c4003e20 con 0x7fc8cc10c010 2024-09-21T02:41:42.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.615+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc1a29e0 con 0x7fc8cc10c010 2024-09-21T02:41:42.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.615+0000 7fc8c3400640 1 -- 172.21.15.79:0/3431877778 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4010460 con 0x7fc8cc10c010 2024-09-21T02:41:42.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.615+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc1a9140 con 0x7fc8cc10c010 2024-09-21T02:41:42.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.616+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8cc106190 con 0x7fc8cc10c010 2024-09-21T02:41:42.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.618+0000 7fc8c3400640 1 -- 172.21.15.79:0/3431877778 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc8c4003970 con 0x7fc8cc10c010 2024-09-21T02:41:42.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.620+0000 7fc8c3400640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8b00b6510 0x7fc8b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:42.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.620+0000 7fc8c3400640 1 -- 172.21.15.79:0/3431877778 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fc8c40e7330 con 0x7fc8cc10c010 2024-09-21T02:41:42.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.620+0000 7fc8c9e00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8b00b6510 0x7fc8b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:42.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.621+0000 7fc8c9e00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8b00b6510 0x7fc8b00b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc031440 tx=0x7fc8bc032ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:42.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.622+0000 7fc8c3400640 1 -- 172.21.15.79:0/3431877778 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8c40b1b90 con 0x7fc8cc10c010 2024-09-21T02:41:42.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.849+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8cc19d8b0 con 0x7fc8cc10c010 2024-09-21T02:41:42.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.849+0000 7fc8c3400640 1 -- 172.21.15.79:0/3431877778 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fc8cc19d8b0 con 0x7fc8cc10c010 2024-09-21T02:41:42.851 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:41:42.851 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:41:42.852 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:41:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8b00b6510 msgr2=0x7fc8b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:42.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8b00b6510 0x7fc8b00b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc031440 tx=0x7fc8bc032ed0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc10c010 msgr2=0x7fc8cc1a1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc10c010 0x7fc8cc1a1fc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009fd0 tx=0x7fc8c400b260 comp rx=0 tx=0).stop 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 shutdown_connections 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8b00b6510 0x7fc8b00b8a20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8cc10c010 0x7fc8cc1a1fc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8cc10b6c0 0x7fc8cc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 --2- 172.21.15.79:0/3431877778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8cc105d80 0x7fc8cc19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 >> 172.21.15.79:0/3431877778 conn(0x7fc8cc101810 msgr2=0x7fc8cc103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 shutdown_connections 2024-09-21T02:41:42.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:42.852+0000 7fc8d0a00640 1 -- 172.21.15.79:0/3431877778 wait complete. 2024-09-21T02:41:43.198 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:42 smithi079 ceph-mon[30788]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.1 MiB/s wr, 120 op/s 2024-09-21T02:41:43.198 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:42 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3431877778' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:43.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:42 smithi148 ceph-mon[34626]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.1 MiB/s wr, 120 op/s 2024-09-21T02:41:43.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:42 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3431877778' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:43.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:42 smithi098 ceph-mon[34832]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.1 MiB/s wr, 120 op/s 2024-09-21T02:41:43.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:42 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3431877778' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:43.594 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 6270da00 --release --await' 2024-09-21T02:41:43.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 6270da00 --release --await 2024-09-21T02:41:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.575+0000 7f9d41200640 1 -- 172.21.15.79:0/2724877023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 msgr2=0x7f9d3c116990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.575+0000 7f9d41200640 1 --2- 172.21.15.79:0/2724877023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 0x7f9d3c116990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009ca0 tx=0x7f9d3402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.575+0000 7f9d41200640 1 -- 172.21.15.79:0/2724877023 shutdown_connections 2024-09-21T02:41:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.575+0000 7f9d41200640 1 --2- 172.21.15.79:0/2724877023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 0x7f9d3c116990 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.575+0000 7f9d41200640 1 --2- 172.21.15.79:0/2724877023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 0x7f9d3c114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.575+0000 7f9d41200640 1 --2- 172.21.15.79:0/2724877023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d3c077940 0x7f9d3c077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.576+0000 7f9d41200640 1 -- 172.21.15.79:0/2724877023 >> 172.21.15.79:0/2724877023 conn(0x7f9d3c101680 msgr2=0x7f9d3c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.576+0000 7f9d41200640 1 -- 172.21.15.79:0/2724877023 shutdown_connections 2024-09-21T02:41:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.576+0000 7f9d41200640 1 -- 172.21.15.79:0/2724877023 wait complete. 2024-09-21T02:41:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 Processor -- start 2024-09-21T02:41:44.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 -- start start 2024-09-21T02:41:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d3c077940 0x7f9d3c1a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 0x7f9d3c1a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 0x7f9d3c1a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c119f40 con 0x7f9d3c114570 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c119dc0 con 0x7f9d3c078290 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.577+0000 7f9d41200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c11a0c0 con 0x7f9d3c077940 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 0x7f9d3c1a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d3b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d3c077940 0x7f9d3c1a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 0x7f9d3c1a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59756/0 (socket says 172.21.15.79:59756) 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 -- 172.21.15.79:0/1372117496 learned_addr learned my addr 172.21.15.79:0/1372117496 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d3be00640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 0x7f9d3c1a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 -- 172.21.15.79:0/1372117496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d3c077940 msgr2=0x7f9d3c1a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d3c077940 0x7f9d3c1a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 -- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 msgr2=0x7f9d3c1a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 0x7f9d3c1a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 -- 172.21.15.79:0/1372117496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3c1a67e0 con 0x7f9d3c078290 2024-09-21T02:41:44.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.578+0000 7f9d32a00640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 0x7f9d3c1a0e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400e9f0 tx=0x7f9d2400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:44.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.579+0000 7f9d38c00640 1 -- 172.21.15.79:0/1372117496 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400ccc0 con 0x7f9d3c078290 2024-09-21T02:41:44.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.579+0000 7f9d38c00640 1 -- 172.21.15.79:0/1372117496 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d240108e0 con 0x7f9d3c078290 2024-09-21T02:41:44.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.579+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3c1a6ad0 con 0x7f9d3c078290 2024-09-21T02:41:44.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.579+0000 7f9d38c00640 1 -- 172.21.15.79:0/1372117496 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24018860 con 0x7f9d3c078290 2024-09-21T02:41:44.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.579+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3c1ad230 con 0x7f9d3c078290 2024-09-21T02:41:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 Processor -- start 2024-09-21T02:41:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 -- start start 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708b8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55557082f290 con 0x5555704f0840 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55557081e6c0 con 0x555570511520 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d49431740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5555708224d0 con 0x5555704e8660 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.582+0000 7f9d38c00640 1 -- 172.21.15.79:0/1372117496 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9d24010430 con 0x7f9d3c078290 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:56550/0 (socket says 172.21.15.79:56550) 2024-09-21T02:41:44.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3b400640 1 -- 172.21.15.79:0/4203758851 learned_addr learned my addr 172.21.15.79:0/4203758851 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:44.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708b8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59762/0 (socket says 172.21.15.79:59762) 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d32a00640 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 -- 172.21.15.79:0/4203758851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 msgr2=0x5555708b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 -- 172.21.15.79:0/4203758851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 msgr2=0x5555708b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708b8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 -- 172.21.15.79:0/4203758851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555707ab460 con 0x555570511520 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d32a00640 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708b8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.583+0000 7f9d3be00640 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708b8340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d34005e30 tx=0x7f9d34009430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c882755037c13749 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.584+0000 7f9d30c00640 1 -- 172.21.15.79:0/4203758851 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34031cf0 con 0x555570511520 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.584+0000 7f9d30c00640 1 -- 172.21.15.79:0/4203758851 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d34036030 con 0x555570511520 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.584+0000 7f9d30c00640 1 -- 172.21.15.79:0/4203758851 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34004240 con 0x555570511520 2024-09-21T02:41:44.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.584+0000 7f9d38c00640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d200b6590 0x7f9d200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d38c00640 1 -- 172.21.15.79:0/1372117496 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9d240e78a0 con 0x7f9d3c078290 2024-09-21T02:41:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 -- 172.21.15.79:0/4203758851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 msgr2=0x5555708b8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708b8340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d34005e30 tx=0x7f9d34009430 comp rx=0 tx=0).stop 2024-09-21T02:41:44.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d3b400640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d200b6590 0x7f9d200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 -- 172.21.15.79:0/4203758851 shutdown_connections 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708b8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 --2- 172.21.15.79:0/4203758851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708b8340 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 -- 172.21.15.79:0/4203758851 >> 172.21.15.79:0/4203758851 conn(0x555570505910 msgr2=0x5555708b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 -- 172.21.15.79:0/4203758851 shutdown_connections 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d49431740 1 -- 172.21.15.79:0/4203758851 wait complete. 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.585+0000 7f9d3b400640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d200b6590 0x7f9d200b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5555708b6fc0 tx=0x7f9d2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 -- start start 2024-09-21T02:41:44.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 Processor -- start 2024-09-21T02:41:44.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704e8660 0x5555708c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55557067fbb0 con 0x5555704f0840 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5555707b96c0 con 0x5555704e8660 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.586+0000 7f9d49431740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5555708c6940 con 0x555570511520 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d49431740 10 client.0 _ll_register_callbacks cb 0x5555707d4490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704e8660 0x5555708c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704e8660 0x5555708c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59774/0 (socket says 172.21.15.79:59774) 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 -- 172.21.15.79:0/37916815 learned_addr learned my addr 172.21.15.79:0/37916815 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d32a00640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3be00640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 -- 172.21.15.79:0/37916815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 msgr2=0x5555708cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 -- 172.21.15.79:0/37916815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 msgr2=0x5555708c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 -- 172.21.15.79:0/37916815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557057cb00 con 0x5555704e8660 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3be00640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d3b400640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704e8660 0x5555708c3eb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c01e9d0 tx=0x7f9d2c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77c08e9ba6a4d02d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.587+0000 7f9d29600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.588+0000 7f9d29600640 1 -- 172.21.15.79:0/37916815 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c012ea0 con 0x5555704e8660 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.588+0000 7f9d29600640 1 -- 172.21.15.79:0/37916815 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9d2c018030 con 0x5555704e8660 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.588+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d34036030 con 0x5555704e8660 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.588+0000 7f9d29600640 1 -- 172.21.15.79:0/37916815 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9d2c034050 con 0x5555704e8660 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.588+0000 7f9d49431740 10 client.26042 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:44.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.588+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5555705f3960 con 0x5555704e8660 2024-09-21T02:41:44.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.588+0000 7f9d29600640 1 -- 172.21.15.79:0/37916815 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d34036030 con 0x5555704e8660 2024-09-21T02:41:44.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d29600640 1 -- 172.21.15.79:0/37916815 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9d2c01c560 con 0x5555704e8660 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d49431740 10 client.26042 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d49431740 10 client.26042 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d49431740 20 client.26042 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d49431740 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704cfea0 0x5555708d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d49431740 4 client.26042 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555708311e0 con 0x5555704cfea0 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d32a00640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704cfea0 0x5555708d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d32a00640 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704cfea0 0x5555708d5c60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e8112cbddef3a81 server_cookie=1fddc31ab0f19925 in_seq=0 out_seq=0 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.589+0000 7f9d29600640 10 client.26042 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.590+0000 7f9d29600640 1 -- 172.21.15.79:0/37916815 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555708311e0 con 0x5555704cfea0 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.590+0000 7f9d29600640 10 client.26042 handle_command_reply: tid=0 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.590+0000 7f9d49431740 1 client.26042 shutdown 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704e8660 msgr2=0x5555708c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704e8660 0x5555708c3eb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c01e9d0 tx=0x7f9d2c004730 comp rx=0 tx=0).stop 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 shutdown_connections 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704cfea0 0x5555708d5c60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 --2- 172.21.15.79:0/37916815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704e8660 0x5555708c3eb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 >> 172.21.15.79:0/37916815 conn(0x555570505910 msgr2=0x5555708bb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d29600640 0 client.26042 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 shutdown_connections 2024-09-21T02:41:44.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 1 -- 172.21.15.79:0/37916815 wait complete. 2024-09-21T02:41:44.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.591+0000 7f9d49431740 20 client.26042 trim_cache size 0 max 16384 2024-09-21T02:41:44.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 Processor -- start 2024-09-21T02:41:44.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 -- start start 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708db460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1b4f90 con 0x5555704f0840 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1b7810 con 0x555570511520 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d49431740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1b5600 con 0x5555704e8660 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d32a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d32a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34178/0 (socket says 172.21.15.79:34178) 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d32a00640 1 -- 172.21.15.79:0/1414399835 learned_addr learned my addr 172.21.15.79:0/1414399835 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.609+0000 7f9d3b400640 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d3be00640 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708db460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d32a00640 1 -- 172.21.15.79:0/1414399835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 msgr2=0x5555708b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d32a00640 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d32a00640 1 -- 172.21.15.79:0/1414399835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 msgr2=0x5555708db460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d32a00640 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708db460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d32a00640 1 -- 172.21.15.79:0/1414399835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555708bf540 con 0x5555704f0840 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d32a00640 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c2530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d240ad6a0 tx=0x7f9d2400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f68a0e61eefe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d2be00640 1 -- 172.21.15.79:0/1414399835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d240b7080 con 0x5555704f0840 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d2be00640 1 -- 172.21.15.79:0/1414399835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d240eae50 con 0x5555704f0840 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.610+0000 7f9d2be00640 1 -- 172.21.15.79:0/1414399835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d240a9260 con 0x5555704f0840 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 -- 172.21.15.79:0/1414399835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 msgr2=0x5555708c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c2530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d240ad6a0 tx=0x7f9d2400ce60 comp rx=0 tx=0).stop 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 -- 172.21.15.79:0/1414399835 shutdown_connections 2024-09-21T02:41:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555570511520 0x5555708db460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704f0840 0x5555708c2530 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 --2- 172.21.15.79:0/1414399835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5555704e8660 0x5555708b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 -- 172.21.15.79:0/1414399835 >> 172.21.15.79:0/1414399835 conn(0x555570505910 msgr2=0x5555708c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.611+0000 7f9d49431740 1 -- 172.21.15.79:0/1414399835 shutdown_connections 2024-09-21T02:41:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.612+0000 7f9d49431740 1 -- 172.21.15.79:0/1414399835 wait complete. 2024-09-21T02:41:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.612+0000 7f9d49431740 1 -- start start 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.612+0000 7f9d49431740 1 Processor -- start 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d49431740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704e8660 0x5555708cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d49431740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704f0840 0x5555708c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d49431740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d49431740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1b5cd0 con 0x5555704e8660 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d49431740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1b7140 con 0x5555704f0840 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d49431740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1b63a0 con 0x555570511520 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d49431740 10 client.0 _ll_register_callbacks cb 0x7f9d2c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704e8660 0x5555708cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704e8660 0x5555708cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34186/0 (socket says 172.21.15.79:34186) 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 -- 172.21.15.79:0/3803109519 learned_addr learned my addr 172.21.15.79:0/3803109519 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d32a00640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704f0840 0x5555708c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3be00640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 -- 172.21.15.79:0/3803109519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 msgr2=0x5555708c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 -- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704f0840 msgr2=0x5555708c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704f0840 0x5555708c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3b400640 1 -- 172.21.15.79:0/3803109519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555708c9630 con 0x5555704e8660 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d32a00640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704f0840 0x5555708c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.613+0000 7f9d3be00640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d3b400640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704e8660 0x5555708cc410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c012cb0 tx=0x7f9d2c01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350ea48ed471780f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d29600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d29600640 1 -- 172.21.15.79:0/3803109519 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c03c070 con 0x5555704e8660 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d240eae50 con 0x5555704e8660 2024-09-21T02:41:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d29600640 1 -- 172.21.15.79:0/3803109519 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9d2c01c5b0 con 0x5555704e8660 2024-09-21T02:41:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d29600640 1 -- 172.21.15.79:0/3803109519 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9d2c048050 con 0x5555704e8660 2024-09-21T02:41:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d49431740 10 client.15900 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.614+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555570941680 con 0x5555704e8660 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d29600640 1 -- 172.21.15.79:0/3803109519 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d240eae50 con 0x5555704e8660 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d29600640 1 -- 172.21.15.79:0/3803109519 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9d2c038410 con 0x5555704e8660 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d49431740 10 client.15900 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d49431740 10 client.15900 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d49431740 20 client.15900 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d49431740 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704a5250 0x555570943de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d49431740 4 client.15900 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6270da00", "release": true, "await": true}] 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6270da00", "release": true, "await": true}) -- 0x55557082cc90 con 0x5555704a5250 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.615+0000 7f9d32a00640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704a5250 0x555570943de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.616+0000 7f9d32a00640 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704a5250 0x555570943de0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca21cda7ba0588be server_cookie=62cd68b62bf71433 in_seq=0 out_seq=0 2024-09-21T02:41:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.616+0000 7f9d29600640 10 client.15900 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:44.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.661+0000 7f9d29600640 1 -- 172.21.15.79:0/3803109519 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55557082cc90 con 0x5555704a5250 2024-09-21T02:41:44.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.661+0000 7f9d29600640 10 client.15900 handle_command_reply: tid=0 2024-09-21T02:41:44.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.661+0000 7f9d49431740 1 client.15900 shutdown 2024-09-21T02:41:44.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704e8660 msgr2=0x5555708cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704e8660 0x5555708cc410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c012cb0 tx=0x7f9d2c01ce20 comp rx=0 tx=0).stop 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 shutdown_connections 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5555704a5250 0x555570943de0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555570511520 0x5555708c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555704f0840 0x5555708c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 --2- 172.21.15.79:0/3803109519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555704e8660 0x5555708cc410 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d29600640 0 client.15900 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 >> 172.21.15.79:0/3803109519 conn(0x555570505910 msgr2=0x5555708c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:44.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 shutdown_connections 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 1 -- 172.21.15.79:0/3803109519 wait complete. 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.662+0000 7f9d49431740 20 client.15900 trim_cache size 0 max 16384 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 28, 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "6270da00": { 2024-09-21T02:41:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 28, 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 139.2, 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:41:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:41:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:41:44.667 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:41:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.663+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d200b6590 msgr2=0x7f9d200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.663+0000 7f9d41200640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d200b6590 0x7f9d200b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5555708b6fc0 tx=0x7f9d2c005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.663+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 msgr2=0x7f9d3c1a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.663+0000 7f9d41200640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 0x7f9d3c1a0e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400e9f0 tx=0x7f9d2400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 shutdown_connections 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d200b6590 0x7f9d200b8aa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d3c114570 0x7f9d3c1a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d3c078290 0x7f9d3c1a0e10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 --2- 172.21.15.79:0/1372117496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d3c077940 0x7f9d3c1a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 >> 172.21.15.79:0/1372117496 conn(0x7f9d3c101680 msgr2=0x7f9d3c1165e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 shutdown_connections 2024-09-21T02:41:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:41:44.664+0000 7f9d41200640 1 -- 172.21.15.79:0/1372117496 wait complete. 2024-09-21T02:41:45.714 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6270da00', total seconds elapsed: 23.4 2024-09-21T02:41:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:45 smithi148 ceph-mon[34626]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 464 KiB/s wr, 22 op/s 2024-09-21T02:41:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:45 smithi098 ceph-mon[34832]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 464 KiB/s wr, 22 op/s 2024-09-21T02:41:45.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:45 smithi079 ceph-mon[30788]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 464 KiB/s wr, 22 op/s 2024-09-21T02:41:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 350.0 s, 304.7 tps, lat 1161.639 ms stddev 3993.011 2024-09-21T02:41:47.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:47 smithi148 ceph-mon[34626]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2024-09-21T02:41:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:47 smithi098 ceph-mon[34832]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2024-09-21T02:41:47.986 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:47 smithi079 ceph-mon[30788]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2024-09-21T02:41:49.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:49 smithi148 ceph-mon[34626]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 32 op/s 2024-09-21T02:41:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:49 smithi098 ceph-mon[34832]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 32 op/s 2024-09-21T02:41:49.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:49 smithi079 ceph-mon[30788]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.3 MiB/s wr, 32 op/s 2024-09-21T02:41:51.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 355.0 s, 908.2 tps, lat 109.461 ms stddev 133.681 2024-09-21T02:41:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.634+0000 7f9f37e00640 1 -- 172.21.15.79:0/270078983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f30108c80 msgr2=0x7f9f3010b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.634+0000 7f9f37e00640 1 --2- 172.21.15.79:0/270078983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f30108c80 0x7f9f3010b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009900 tx=0x7f9f1c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.635+0000 7f9f37e00640 1 -- 172.21.15.79:0/270078983 shutdown_connections 2024-09-21T02:41:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.635+0000 7f9f37e00640 1 --2- 172.21.15.79:0/270078983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 0x7f9f3010daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.635+0000 7f9f37e00640 1 --2- 172.21.15.79:0/270078983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f30108c80 0x7f9f3010b0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.635+0000 7f9f37e00640 1 --2- 172.21.15.79:0/270078983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f3006b4e0 0x7f9f30108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.635+0000 7f9f37e00640 1 -- 172.21.15.79:0/270078983 >> 172.21.15.79:0/270078983 conn(0x7f9f300fdee0 msgr2=0x7f9f30100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.635+0000 7f9f37e00640 1 -- 172.21.15.79:0/270078983 shutdown_connections 2024-09-21T02:41:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.635+0000 7f9f37e00640 1 -- 172.21.15.79:0/270078983 wait complete. 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.636+0000 7f9f37e00640 1 Processor -- start 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.637+0000 7f9f37e00640 1 -- start start 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.637+0000 7f9f37e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f3006b4e0 0x7f9f301a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.637+0000 7f9f37e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f30108c80 0x7f9f301a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.637+0000 7f9f37e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 0x7f9f301a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.637+0000 7f9f37e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30111520 con 0x7f9f3006b4e0 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.637+0000 7f9f37e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301113a0 con 0x7f9f30108c80 2024-09-21T02:41:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.637+0000 7f9f37e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301116a0 con 0x7f9f3010b5e0 2024-09-21T02:41:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.638+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 0x7f9f301a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.638+0000 7f9f35e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 0x7f9f301a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:56602/0 (socket says 172.21.15.79:56602) 2024-09-21T02:41:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.638+0000 7f9f35e00640 1 -- 172.21.15.79:0/3079899519 learned_addr learned my addr 172.21.15.79:0/3079899519 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f35400640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f3006b4e0 0x7f9f301a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f34a00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f30108c80 0x7f9f301a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f35e00640 1 -- 172.21.15.79:0/3079899519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f30108c80 msgr2=0x7f9f301a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f35e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f30108c80 0x7f9f301a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f35e00640 1 -- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f3006b4e0 msgr2=0x7f9f301a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f35e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f3006b4e0 0x7f9f301a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f35e00640 1 -- 172.21.15.79:0/3079899519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f301a1f60 con 0x7f9f3010b5e0 2024-09-21T02:41:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.639+0000 7f9f34a00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f30108c80 0x7f9f301a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.640+0000 7f9f35e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 0x7f9f301a1740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800eb40 tx=0x7f9f2800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.641+0000 7f9f2e000640 1 -- 172.21.15.79:0/3079899519 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28010430 con 0x7f9f3010b5e0 2024-09-21T02:41:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.641+0000 7f9f2e000640 1 -- 172.21.15.79:0/3079899519 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f28010a80 con 0x7f9f3010b5e0 2024-09-21T02:41:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.641+0000 7f9f2e000640 1 -- 172.21.15.79:0/3079899519 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28018b60 con 0x7f9f3010b5e0 2024-09-21T02:41:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.641+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f301a21f0 con 0x7f9f3010b5e0 2024-09-21T02:41:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.641+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f301a8940 con 0x7f9f3010b5e0 2024-09-21T02:41:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.645+0000 7f9f3ee6d740 1 Processor -- start 2024-09-21T02:41:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.646+0000 7f9f2e000640 1 -- 172.21.15.79:0/3079899519 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9f28018d00 con 0x7f9f3010b5e0 2024-09-21T02:41:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.646+0000 7f9f3ee6d740 1 -- start start 2024-09-21T02:41:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec3620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec362740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec363290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5609ec2d56b0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5609ec2c4ae0 con 0x5609ebfbb1b0 2024-09-21T02:41:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5609ec2c88f0 con 0x5609ebf922f0 2024-09-21T02:41:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f35400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec362740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f35400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec362740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:56614/0 (socket says 172.21.15.79:56614) 2024-09-21T02:41:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.647+0000 7f9f35400640 1 -- 172.21.15.79:0/318147899 learned_addr learned my addr 172.21.15.79:0/318147899 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.648+0000 7f9f35400640 1 -- 172.21.15.79:0/318147899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 msgr2=0x5609ec3620d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:41:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.648+0000 7f9f35400640 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec3620d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.648+0000 7f9f35400640 1 -- 172.21.15.79:0/318147899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 msgr2=0x5609ec363290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.648+0000 7f9f34a00640 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec363290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.648+0000 7f9f35400640 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec363290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.648+0000 7f9f35400640 1 -- 172.21.15.79:0/318147899 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ec291780 con 0x5609ebf922f0 2024-09-21T02:41:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.649+0000 7f9f34a00640 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec363290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:41:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.649+0000 7f9f2e000640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9f180b65d0 0x7f9f180b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.649+0000 7f9f35400640 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec362740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009c50 tx=0x7f9f24010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ecb4912ad3112a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.650+0000 7f9f2e000640 1 -- 172.21.15.79:0/3079899519 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9f280e7d70 con 0x7f9f3010b5e0 2024-09-21T02:41:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.650+0000 7f9f22600640 1 -- 172.21.15.79:0/318147899 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24004020 con 0x5609ebf922f0 2024-09-21T02:41:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.651+0000 7f9f22600640 1 -- 172.21.15.79:0/318147899 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f240041c0 con 0x5609ebf922f0 2024-09-21T02:41:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.651+0000 7f9f34a00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9f180b65d0 0x7f9f180b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.651+0000 7f9f22600640 1 -- 172.21.15.79:0/318147899 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240126b0 con 0x5609ebf922f0 2024-09-21T02:41:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.652+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/318147899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 msgr2=0x5609ec362740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.652+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec362740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009c50 tx=0x7f9f24010740 comp rx=0 tx=0).stop 2024-09-21T02:41:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/318147899 shutdown_connections 2024-09-21T02:41:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec363290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec362740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/318147899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec3620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/318147899 >> 172.21.15.79:0/318147899 conn(0x5609ebfaf300 msgr2=0x5609ec35db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f34a00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9f180b65d0 0x7f9f180b8ae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000c00 tx=0x7f9f1c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/318147899 shutdown_connections 2024-09-21T02:41:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.653+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/318147899 wait complete. 2024-09-21T02:41:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.654+0000 7f9f3ee6d740 1 -- start start 2024-09-21T02:41:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.654+0000 7f9f3ee6d740 1 Processor -- start 2024-09-21T02:41:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec36b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec36be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec36c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5609ec1fcab0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5609ec26b570 con 0x5609ebfbb1b0 2024-09-21T02:41:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5609ec363db0 con 0x5609ebf922f0 2024-09-21T02:41:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f3ee6d740 10 client.0 _ll_register_callbacks cb 0x5609ec27a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f35400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec36b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f35400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec36b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:56628/0 (socket says 172.21.15.79:56628) 2024-09-21T02:41:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f35400640 1 -- 172.21.15.79:0/2616402266 learned_addr learned my addr 172.21.15.79:0/2616402266 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f35e00640 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec36c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.655+0000 7f9f34a00640 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec36be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.656+0000 7f9f35400640 1 -- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 msgr2=0x5609ec36c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.656+0000 7f9f35400640 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec36c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.656+0000 7f9f35400640 1 -- 172.21.15.79:0/2616402266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 msgr2=0x5609ec36be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.656+0000 7f9f35400640 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec36be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.656+0000 7f9f35400640 1 -- 172.21.15.79:0/2616402266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ec026790 con 0x5609ebf922f0 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.656+0000 7f9f35400640 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec36b7c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009c20 tx=0x7f9f24003bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fedb50de65cb135f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.656+0000 7f9f16a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:41:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.657+0000 7f9f16a00640 1 -- 172.21.15.79:0/2616402266 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24005030 con 0x5609ebf922f0 2024-09-21T02:41:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.657+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f240041c0 con 0x5609ebf922f0 2024-09-21T02:41:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.657+0000 7f9f16a00640 1 -- 172.21.15.79:0/2616402266 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9f240051d0 con 0x5609ebf922f0 2024-09-21T02:41:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.657+0000 7f9f16a00640 1 -- 172.21.15.79:0/2616402266 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9f24030050 con 0x5609ebf922f0 2024-09-21T02:41:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.657+0000 7f9f3ee6d740 10 client.26062 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.657+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5609ec09f620 con 0x5609ebf922f0 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.657+0000 7f9f16a00640 1 -- 172.21.15.79:0/2616402266 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f240041c0 con 0x5609ebf922f0 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.658+0000 7f9f16a00640 1 -- 172.21.15.79:0/2616402266 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9f2400f040 con 0x5609ebf922f0 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.658+0000 7f9f3ee6d740 10 client.26062 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.658+0000 7f9f3ee6d740 10 client.26062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.658+0000 7f9f3ee6d740 20 client.26062 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.658+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf79d80 0x5609ec378cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.658+0000 7f9f3ee6d740 4 client.26062 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:41:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.658+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609ec2d7600 con 0x5609ebf79d80 2024-09-21T02:41:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.659+0000 7f9f34a00640 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf79d80 0x5609ec378cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.661+0000 7f9f16a00640 10 client.26062 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.661+0000 7f9f34a00640 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf79d80 0x5609ec378cc0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2511380a86dbc74 server_cookie=d9050fffd2aa0f19 in_seq=0 out_seq=0 2024-09-21T02:41:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.662+0000 7f9f16a00640 1 -- 172.21.15.79:0/2616402266 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609ec2d7600 con 0x5609ebf79d80 2024-09-21T02:41:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.662+0000 7f9f16a00640 10 client.26062 handle_command_reply: tid=0 2024-09-21T02:41:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.662+0000 7f9f3ee6d740 1 client.26062 shutdown 2024-09-21T02:41:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.662+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 msgr2=0x5609ec36b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.662+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec36b7c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009c20 tx=0x7f9f24003bb0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 shutdown_connections 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf79d80 0x5609ec378cc0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec36c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec36be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2616402266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec36b7c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 >> 172.21.15.79:0/2616402266 conn(0x5609ebfaf300 msgr2=0x5609ec35c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f16a00640 0 client.26062 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 shutdown_connections 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2616402266 wait complete. 2024-09-21T02:41:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.663+0000 7f9f3ee6d740 20 client.26062 trim_cache size 0 max 16384 2024-09-21T02:41:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.685+0000 7f9f3ee6d740 1 Processor -- start 2024-09-21T02:41:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.685+0000 7f9f3ee6d740 1 -- start start 2024-09-21T02:41:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec366b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec3738d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec358980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301b0ca0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301b3520 con 0x5609ebfbb1b0 2024-09-21T02:41:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301b1310 con 0x5609ebf922f0 2024-09-21T02:41:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f34a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec3738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f34a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec3738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34226/0 (socket says 172.21.15.79:34226) 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f34a00640 1 -- 172.21.15.79:0/1415434605 learned_addr learned my addr 172.21.15.79:0/1415434605 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.686+0000 7f9f35e00640 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec358980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.687+0000 7f9f35400640 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec366b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.687+0000 7f9f35e00640 1 -- 172.21.15.79:0/1415434605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 msgr2=0x5609ec366b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.687+0000 7f9f35e00640 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec366b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.687+0000 7f9f35e00640 1 -- 172.21.15.79:0/1415434605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 msgr2=0x5609ec3738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.687+0000 7f9f35e00640 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec3738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.687+0000 7f9f35e00640 1 -- 172.21.15.79:0/1415434605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ec36b9d0 con 0x5609ebfbb1b0 2024-09-21T02:41:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.687+0000 7f9f35e00640 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec358980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f280e5460 tx=0x7f9f28095040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a6977d43af7529 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.688+0000 7f9f21c00640 1 -- 172.21.15.79:0/1415434605 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f280ad600 con 0x5609ebfbb1b0 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.688+0000 7f9f21c00640 1 -- 172.21.15.79:0/1415434605 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f280ae1f0 con 0x5609ebfbb1b0 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.688+0000 7f9f21c00640 1 -- 172.21.15.79:0/1415434605 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f280105d0 con 0x5609ebfbb1b0 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.688+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/1415434605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 msgr2=0x5609ec358980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.688+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec358980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f280e5460 tx=0x7f9f28095040 comp rx=0 tx=0).stop 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/1415434605 shutdown_connections 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebfbb1b0 0x5609ec358980 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebf9a4d0 0x5609ec3738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/1415434605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf922f0 0x5609ec366b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/1415434605 >> 172.21.15.79:0/1415434605 conn(0x5609ebfaf300 msgr2=0x5609ec35d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/1415434605 shutdown_connections 2024-09-21T02:41:51.691 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/1415434605 wait complete. 2024-09-21T02:41:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.689+0000 7f9f3ee6d740 1 -- start start 2024-09-21T02:41:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.690+0000 7f9f3ee6d740 1 Processor -- start 2024-09-21T02:41:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.691+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebf922f0 0x5609ec3735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.691+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf9a4d0 0x5609ec372270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.691+0000 7f9f3ee6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebfbb1b0 0x5609ec3727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.691+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301b19e0 con 0x5609ebfbb1b0 2024-09-21T02:41:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.691+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301b2e50 con 0x5609ebf922f0 2024-09-21T02:41:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.691+0000 7f9f3ee6d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9f301b20b0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.692+0000 7f9f3ee6d740 10 client.0 _ll_register_callbacks cb 0x7f9f24009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:41:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.692+0000 7f9f34a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf9a4d0 0x5609ec372270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.692+0000 7f9f34a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf9a4d0 0x5609ec372270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:56652/0 (socket says 172.21.15.79:56652) 2024-09-21T02:41:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.692+0000 7f9f34a00640 1 -- 172.21.15.79:0/2054232799 learned_addr learned my addr 172.21.15.79:0/2054232799 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:41:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.692+0000 7f9f35e00640 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebfbb1b0 0x5609ec3727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.693+0000 7f9f34a00640 1 -- 172.21.15.79:0/2054232799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebf922f0 msgr2=0x5609ec3735b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:41:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.693+0000 7f9f34a00640 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebf922f0 0x5609ec3735b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.693+0000 7f9f34a00640 1 -- 172.21.15.79:0/2054232799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebfbb1b0 msgr2=0x5609ec3727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:41:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.693+0000 7f9f34a00640 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebfbb1b0 0x5609ec3727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.693+0000 7f9f34a00640 1 -- 172.21.15.79:0/2054232799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ec372f80 con 0x5609ebf9a4d0 2024-09-21T02:41:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.694+0000 7f9f34a00640 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf9a4d0 0x5609ec372270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02a9e0 tx=0x7f9f1c03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37adff3c21e87967 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.694+0000 7f9f16a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:41:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.695+0000 7f9f16a00640 1 -- 172.21.15.79:0/2054232799 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c004780 con 0x5609ebf9a4d0 2024-09-21T02:41:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.696+0000 7f9f16a00640 1 -- 172.21.15.79:0/2054232799 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9f1c004920 con 0x5609ebf9a4d0 2024-09-21T02:41:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.697+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f280ae1f0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.704+0000 7f9f16a00640 1 -- 172.21.15.79:0/2054232799 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9f1c004b20 con 0x5609ebf9a4d0 2024-09-21T02:41:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.705+0000 7f9f3ee6d740 10 client.26068 fetch_fsmap learned FSMap version 21 2024-09-21T02:41:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.705+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5609ec3e36e0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.706+0000 7f9f16a00640 1 -- 172.21.15.79:0/2054232799 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f280ae1f0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.706+0000 7f9f16a00640 1 -- 172.21.15.79:0/2054232799 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9f1c0035f0 con 0x5609ebf9a4d0 2024-09-21T02:41:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.706+0000 7f9f3ee6d740 10 client.26068 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:41:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.706+0000 7f9f3ee6d740 10 client.26068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:41:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.706+0000 7f9f3ee6d740 20 client.26068 populate_metadata read hostname 'smithi079' 2024-09-21T02:41:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.706+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf4f1c0 0x5609ec3e60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.706+0000 7f9f3ee6d740 4 client.26068 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:41:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.707+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5609ec2d30b0 con 0x5609ebf4f1c0 2024-09-21T02:41:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.709+0000 7f9f35400640 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf4f1c0 0x5609ec3e60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.711+0000 7f9f16a00640 10 client.26068 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.711+0000 7f9f35400640 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf4f1c0 0x5609ec3e60e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b5ef9b4a33c3b76 server_cookie=139c268d12dda186 in_seq=0 out_seq=0 2024-09-21T02:41:51.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:51 smithi148 ceph-mon[34626]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.1 MiB/s wr, 99 op/s 2024-09-21T02:41:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.861+0000 7f9f16a00640 1 -- 172.21.15.79:0/2054232799 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5609ec2d30b0 con 0x5609ebf4f1c0 2024-09-21T02:41:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.861+0000 7f9f16a00640 10 client.26068 handle_command_reply: tid=0 2024-09-21T02:41:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.861+0000 7f9f3ee6d740 1 client.26068 shutdown 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf9a4d0 msgr2=0x5609ec372270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf9a4d0 0x5609ec372270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02a9e0 tx=0x7f9f1c03d000 comp rx=0 tx=0).stop 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 shutdown_connections 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5609ebf4f1c0 0x5609ec3e60e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5609ebfbb1b0 0x5609ec3727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5609ebf9a4d0 0x5609ec372270 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c02a9e0 tx=0x7f9f1c03d000 comp rx=0 tx=0).stop 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 --2- 172.21.15.79:0/2054232799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5609ebf922f0 0x5609ec3735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 >> 172.21.15.79:0/2054232799 conn(0x5609ebfaf300 msgr2=0x5609ec36a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f16a00640 0 client.26068 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.862+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 shutdown_connections 2024-09-21T02:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.863+0000 7f9f3ee6d740 1 -- 172.21.15.79:0/2054232799 wait complete. 2024-09-21T02:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.863+0000 7f9f3ee6d740 20 client.26068 trim_cache size 0 max 16384 2024-09-21T02:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:41:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.864+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9f180b65d0 msgr2=0x7f9f180b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.864+0000 7f9f37e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9f180b65d0 0x7f9f180b8ae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000c00 tx=0x7f9f1c031400 comp rx=0 tx=0).stop 2024-09-21T02:41:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 msgr2=0x7f9f301a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 0x7f9f301a1740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800eb40 tx=0x7f9f2800c2d0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 shutdown_connections 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9f180b65d0 0x7f9f180b8ae0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f3010b5e0 0x7f9f301a1740 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f30108c80 0x7f9f301a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 --2- 172.21.15.79:0/3079899519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f3006b4e0 0x7f9f301a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.865+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 >> 172.21.15.79:0/3079899519 conn(0x7f9f300fdee0 msgr2=0x7f9f30109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.866+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 shutdown_connections 2024-09-21T02:41:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:41:51.866+0000 7f9f37e00640 1 -- 172.21.15.79:0/3079899519 wait complete. 2024-09-21T02:41:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:51 smithi098 ceph-mon[34832]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.1 MiB/s wr, 99 op/s 2024-09-21T02:41:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:51 smithi079 ceph-mon[30788]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.1 MiB/s wr, 99 op/s 2024-09-21T02:41:53.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:53 smithi148 ceph-mon[34626]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.8 MiB/s wr, 243 op/s 2024-09-21T02:41:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:53 smithi098 ceph-mon[34832]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.8 MiB/s wr, 243 op/s 2024-09-21T02:41:53.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:53 smithi079 ceph-mon[30788]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.8 MiB/s wr, 243 op/s 2024-09-21T02:41:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:55 smithi148 ceph-mon[34626]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 305 op/s 2024-09-21T02:41:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:55 smithi098 ceph-mon[34832]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 305 op/s 2024-09-21T02:41:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:55 smithi079 ceph-mon[30788]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 305 op/s 2024-09-21T02:41:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 360.0 s, 793.3 tps, lat 126.598 ms stddev 191.810 2024-09-21T02:41:56.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:56 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:41:56.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:56 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:41:56.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:56 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:41:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-21T02:41:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: Unable to set osd_memory_target on smithi098 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: Unable to set osd_memory_target on smithi148 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:41:57.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:41:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-21T02:41:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: Unable to set osd_memory_target on smithi098 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: Unable to set osd_memory_target on smithi148 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-21T02:41:57.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:41:57.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:41:57.907 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-21T02:41:57.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-21T02:41:57.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: Unable to set osd_memory_target on smithi098 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-21T02:41:57.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: Unable to set osd_memory_target on smithi148 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-21T02:41:57.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:41:57.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:41:57.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:41:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:41:59 smithi148 ceph-mon[34626]: pgmap v602: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 10 MiB/s wr, 539 op/s 2024-09-21T02:41:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:41:59 smithi098 ceph-mon[34832]: pgmap v602: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 10 MiB/s wr, 539 op/s 2024-09-21T02:41:59.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:41:59 smithi079 ceph-mon[30788]: pgmap v602: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 10 MiB/s wr, 539 op/s 2024-09-21T02:42:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 365.0 s, 827.2 tps, lat 120.015 ms stddev 167.173 2024-09-21T02:42:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:01 smithi098 ceph-mon[34832]: pgmap v603: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 636 op/s 2024-09-21T02:42:01.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:01 smithi079 ceph-mon[30788]: pgmap v603: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 636 op/s 2024-09-21T02:42:02.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:01 smithi148 ceph-mon[34626]: pgmap v603: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 636 op/s 2024-09-21T02:42:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:03 smithi098 ceph-mon[34832]: pgmap v604: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 700 op/s 2024-09-21T02:42:03.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:03 smithi079 ceph-mon[30788]: pgmap v604: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 700 op/s 2024-09-21T02:42:04.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:03 smithi148 ceph-mon[34626]: pgmap v604: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 700 op/s 2024-09-21T02:42:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.145+0000 7f6ab6600640 1 -- 172.21.15.79:0/4184314485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab0109410 msgr2=0x7f6ab010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.145+0000 7f6ab6600640 1 --2- 172.21.15.79:0/4184314485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab0109410 0x7f6ab010b920 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009860 tx=0x7f6aa002a340 comp rx=0 tx=0).stop 2024-09-21T02:42:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.146+0000 7f6ab6600640 1 -- 172.21.15.79:0/4184314485 shutdown_connections 2024-09-21T02:42:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.146+0000 7f6ab6600640 1 --2- 172.21.15.79:0/4184314485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab0109410 0x7f6ab010b920 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.146+0000 7f6ab6600640 1 --2- 172.21.15.79:0/4184314485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab0106850 0x7f6ab0108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.146+0000 7f6ab6600640 1 --2- 172.21.15.79:0/4184314485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 0x7f6ab0106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.146+0000 7f6ab6600640 1 -- 172.21.15.79:0/4184314485 >> 172.21.15.79:0/4184314485 conn(0x7f6ab00fdf30 msgr2=0x7f6ab01003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.146+0000 7f6ab6600640 1 -- 172.21.15.79:0/4184314485 shutdown_connections 2024-09-21T02:42:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.147+0000 7f6ab6600640 1 -- 172.21.15.79:0/4184314485 wait complete. 2024-09-21T02:42:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.149+0000 7f6ab6600640 1 Processor -- start 2024-09-21T02:42:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.151+0000 7f6ab6600640 1 -- start start 2024-09-21T02:42:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.151+0000 7f6ab6600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 0x7f6ab0197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.151+0000 7f6ab6600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab0106850 0x7f6ab01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.151+0000 7f6ab6600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab0109410 0x7f6ab01a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.151+0000 7f6ab6600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab010f330 con 0x7f6ab0109410 2024-09-21T02:42:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.151+0000 7f6ab6600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab010f1b0 con 0x7f6ab0106850 2024-09-21T02:42:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.151+0000 7f6ab6600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab010f4b0 con 0x7f6ab006c4b0 2024-09-21T02:42:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.152+0000 7f6aaf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 0x7f6ab0197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.152+0000 7f6aaf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 0x7f6ab0197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57078/0 (socket says 172.21.15.79:57078) 2024-09-21T02:42:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.152+0000 7f6aaf400640 1 -- 172.21.15.79:0/3251471433 learned_addr learned my addr 172.21.15.79:0/3251471433 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.154+0000 7f6aaf400640 1 -- 172.21.15.79:0/3251471433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab0106850 msgr2=0x7f6ab01983c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:42:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.154+0000 7f6aaf400640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab0106850 0x7f6ab01983c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.154+0000 7f6aaf400640 1 -- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab0109410 msgr2=0x7f6ab01a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.154+0000 7f6aaf400640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab0109410 0x7f6ab01a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.154+0000 7f6aaf400640 1 -- 172.21.15.79:0/3251471433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab01a1fa0 con 0x7f6ab006c4b0 2024-09-21T02:42:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.155+0000 7f6aaf400640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 0x7f6ab0197d50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00d950 tx=0x7f6a9c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.156+0000 7f6aa7e00640 1 -- 172.21.15.79:0/3251471433 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c017070 con 0x7f6ab006c4b0 2024-09-21T02:42:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.156+0000 7f6aa7e00640 1 -- 172.21.15.79:0/3251471433 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a9c009c30 con 0x7f6ab006c4b0 2024-09-21T02:42:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.156+0000 7f6aa7e00640 1 -- 172.21.15.79:0/3251471433 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00f620 con 0x7f6ab006c4b0 2024-09-21T02:42:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.156+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab01a2290 con 0x7f6ab006c4b0 2024-09-21T02:42:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.156+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab01a8980 con 0x7f6ab006c4b0 2024-09-21T02:42:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.164+0000 7f6abd851740 1 Processor -- start 2024-09-21T02:42:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.168+0000 7f6abd851740 1 -- start start 2024-09-21T02:42:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.168+0000 7f6abd851740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 0x562682ab10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.168+0000 7f6abd851740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682ab1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.168+0000 7f6abd851740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.168+0000 7f6abd851740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562682a246b0 con 0x56268270a1b0 2024-09-21T02:42:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.168+0000 7f6abd851740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562682a13ae0 con 0x5626826e94d0 2024-09-21T02:42:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.168+0000 7f6abd851740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562682a178f0 con 0x5626826e12f0 2024-09-21T02:42:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:41760/0 (socket says 172.21.15.79:41760) 2024-09-21T02:42:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 -- 172.21.15.79:0/3664936870 learned_addr learned my addr 172.21.15.79:0/3664936870 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 -- 172.21.15.79:0/3664936870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 msgr2=0x562682ab1740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:42:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 --2- 172.21.15.79:0/3664936870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682ab1740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 -- 172.21.15.79:0/3664936870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 msgr2=0x562682ab10d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:42:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 --2- 172.21.15.79:0/3664936870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 0x562682ab10d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.169+0000 7f6aaea00640 1 -- 172.21.15.79:0/3664936870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626829e0780 con 0x5626826e94d0 2024-09-21T02:42:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.170+0000 7f6aaea00640 1 --2- 172.21.15.79:0/3664936870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab2290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009ef0 tx=0x7f6aa800e7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22459bcf06da9d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.170+0000 7f6aa4c00640 1 -- 172.21.15.79:0/3664936870 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa801b070 con 0x5626826e94d0 2024-09-21T02:42:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.170+0000 7f6aa4c00640 1 -- 172.21.15.79:0/3664936870 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa8003e20 con 0x5626826e94d0 2024-09-21T02:42:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.170+0000 7f6aa4c00640 1 -- 172.21.15.79:0/3664936870 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800c7e0 con 0x5626826e94d0 2024-09-21T02:42:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6abd851740 1 -- 172.21.15.79:0/3664936870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 msgr2=0x562682ab2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6abd851740 1 --2- 172.21.15.79:0/3664936870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab2290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009ef0 tx=0x7f6aa800e7c0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6aa7e00640 1 -- 172.21.15.79:0/3251471433 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6a9c010460 con 0x7f6ab006c4b0 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6abd851740 1 -- 172.21.15.79:0/3664936870 shutdown_connections 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6abd851740 1 --2- 172.21.15.79:0/3664936870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab2290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6abd851740 1 --2- 172.21.15.79:0/3664936870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682ab1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6abd851740 1 --2- 172.21.15.79:0/3664936870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 0x562682ab10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.172+0000 7f6abd851740 1 -- 172.21.15.79:0/3664936870 >> 172.21.15.79:0/3664936870 conn(0x5626826fe300 msgr2=0x562682aacb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.173+0000 7f6abd851740 1 -- 172.21.15.79:0/3664936870 shutdown_connections 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.173+0000 7f6abd851740 1 -- 172.21.15.79:0/3664936870 wait complete. 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.174+0000 7f6abd851740 1 -- start start 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.174+0000 7f6abd851740 1 Processor -- start 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.175+0000 7f6aa7e00640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6a940c74b0 0x7f6a940c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.175+0000 7f6aa7e00640 1 -- 172.21.15.79:0/3251471433 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f6a9c0e7380 con 0x7f6ab006c4b0 2024-09-21T02:42:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.176+0000 7f6abd851740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682aba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6abd851740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682abae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6aaf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682aba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6aaf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682aba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57088/0 (socket says 172.21.15.79:57088) 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6abd851740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 0x562682abba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6abd851740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56268294bab0 con 0x56268270a1b0 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6abd851740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5626829ba570 con 0x5626826e94d0 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6abd851740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562682ab2db0 con 0x5626826e12f0 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6abd851740 10 client.0 _ll_register_callbacks cb 0x5626829c9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6aaea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682abae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6aaea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682abae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:41770/0 (socket says 172.21.15.79:41770) 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.177+0000 7f6aaea00640 1 -- 172.21.15.79:0/1937743420 learned_addr learned my addr 172.21.15.79:0/1937743420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aaf400640 1 -- 172.21.15.79:0/1937743420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 msgr2=0x562682abae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aaf400640 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682abae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aafe00640 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 0x562682abba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aaf400640 1 -- 172.21.15.79:0/1937743420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 msgr2=0x562682abba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aaf400640 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 0x562682abba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aaf400640 1 -- 172.21.15.79:0/1937743420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562682775790 con 0x5626826e12f0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aafe00640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6a940c74b0 0x7f6a940c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6aaf400640 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682aba7d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0aa370 tx=0x7f6a9c0a9620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90a1c9c41905fe8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6a99600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6a99600640 1 -- 172.21.15.79:0/1937743420 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c020070 con 0x5626826e12f0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.178+0000 7f6a99600640 1 -- 172.21.15.79:0/1937743420 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f6a9c010750 con 0x5626826e12f0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.179+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa8003e20 con 0x5626826e12f0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.179+0000 7f6a99600640 1 -- 172.21.15.79:0/1937743420 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6a9c0ad800 con 0x5626826e12f0 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.179+0000 7f6abd851740 10 client.26077 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.179+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5626827ee620 con 0x5626826e12f0 2024-09-21T02:42:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.180+0000 7f6a99600640 1 -- 172.21.15.79:0/1937743420 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa8003e20 con 0x5626826e12f0 2024-09-21T02:42:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.180+0000 7f6a99600640 1 -- 172.21.15.79:0/1937743420 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6a9c098120 con 0x5626826e12f0 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.181+0000 7f6abd851740 10 client.26077 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.181+0000 7f6abd851740 10 client.26077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.181+0000 7f6abd851740 20 client.26077 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.181+0000 7f6abd851740 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5626826c8d80 0x562682ac7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.182+0000 7f6aafe00640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6a940c74b0 0x7f6a940c99c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6aa002a860 tx=0x7f6aa0009760 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.182+0000 7f6aaea00640 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5626826c8d80 0x562682ac7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.182+0000 7f6abd851740 4 client.26077 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.183+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562682a26600 con 0x5626826c8d80 2024-09-21T02:42:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.185+0000 7f6a99600640 10 client.26077 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.185+0000 7f6aaea00640 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5626826c8d80 0x562682ac7f10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b71ea6979e385dd server_cookie=f73b808e69ffe46d in_seq=0 out_seq=0 2024-09-21T02:42:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.187+0000 7f6a99600640 1 -- 172.21.15.79:0/1937743420 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562682a26600 con 0x5626826c8d80 2024-09-21T02:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.187+0000 7f6a99600640 10 client.26077 handle_command_reply: tid=0 2024-09-21T02:42:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.187+0000 7f6abd851740 1 client.26077 shutdown 2024-09-21T02:42:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 msgr2=0x562682aba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682aba7d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0aa370 tx=0x7f6a9c0a9620 comp rx=0 tx=0).stop 2024-09-21T02:42:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 shutdown_connections 2024-09-21T02:42:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5626826c8d80 0x562682ac7f10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56268270a1b0 0x562682abba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682abae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 --2- 172.21.15.79:0/1937743420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5626826e12f0 0x562682aba7d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6a99600640 0 client.26077 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 >> 172.21.15.79:0/1937743420 conn(0x5626826fe300 msgr2=0x562682aab0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.189+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 shutdown_connections 2024-09-21T02:42:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.190+0000 7f6abd851740 1 -- 172.21.15.79:0/1937743420 wait complete. 2024-09-21T02:42:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.190+0000 7f6abd851740 20 client.26077 trim_cache size 0 max 16384 2024-09-21T02:42:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.227+0000 7f6abd851740 1 Processor -- start 2024-09-21T02:42:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.227+0000 7f6abd851740 1 -- start start 2024-09-21T02:42:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6abd851740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ab93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6abd851740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6abd851740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682aac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6abd851740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab00750a0 con 0x5626826e12f0 2024-09-21T02:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6abd851740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab01aaed0 con 0x5626826e94d0 2024-09-21T02:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6abd851740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab01a8cc0 con 0x56268270a1b0 2024-09-21T02:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6aafe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682aac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6aafe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682aac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:57100/0 (socket says 172.21.15.79:57100) 2024-09-21T02:42:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.228+0000 7f6aafe00640 1 -- 172.21.15.79:0/2004868470 learned_addr learned my addr 172.21.15.79:0/2004868470 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.229+0000 7f6aaea00640 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.230+0000 7f6aaf400640 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ab93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.231+0000 7f6aaf400640 1 -- 172.21.15.79:0/2004868470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 msgr2=0x562682aac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.231+0000 7f6aaf400640 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682aac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.231+0000 7f6aaf400640 1 -- 172.21.15.79:0/2004868470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 msgr2=0x562682ab1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.231+0000 7f6aaf400640 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.231+0000 7f6aaf400640 1 -- 172.21.15.79:0/2004868470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562682ac29a0 con 0x5626826e12f0 2024-09-21T02:42:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.234+0000 7f6aaf400640 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ab93f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ad090 tx=0x7f6a9c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3091a9c993fde5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.234+0000 7f6a9be00640 1 -- 172.21.15.79:0/2004868470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0ad800 con 0x5626826e12f0 2024-09-21T02:42:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.234+0000 7f6a9be00640 1 -- 172.21.15.79:0/2004868470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a9c009de0 con 0x5626826e12f0 2024-09-21T02:42:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.234+0000 7f6a9be00640 1 -- 172.21.15.79:0/2004868470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0abdd0 con 0x5626826e12f0 2024-09-21T02:42:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 -- 172.21.15.79:0/2004868470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 msgr2=0x562682ab93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ab93f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ad090 tx=0x7f6a9c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 -- 172.21.15.79:0/2004868470 shutdown_connections 2024-09-21T02:42:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682aac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ab1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 --2- 172.21.15.79:0/2004868470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ab93f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 -- 172.21.15.79:0/2004868470 >> 172.21.15.79:0/2004868470 conn(0x5626826fe300 msgr2=0x562682ab8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 -- 172.21.15.79:0/2004868470 shutdown_connections 2024-09-21T02:42:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.236+0000 7f6abd851740 1 -- 172.21.15.79:0/2004868470 wait complete. 2024-09-21T02:42:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.237+0000 7f6abd851740 1 -- start start 2024-09-21T02:42:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.237+0000 7f6abd851740 1 Processor -- start 2024-09-21T02:42:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.238+0000 7f6abd851740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ac2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.238+0000 7f6abd851740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ac10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.238+0000 7f6abd851740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682ac1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.239+0000 7f6aaea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ac10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.239+0000 7f6aaea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ac10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:41784/0 (socket says 172.21.15.79:41784) 2024-09-21T02:42:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.239+0000 7f6aaea00640 1 -- 172.21.15.79:0/4077928587 learned_addr learned my addr 172.21.15.79:0/4077928587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.239+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab01a9390 con 0x5626826e12f0 2024-09-21T02:42:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.239+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab01aa800 con 0x5626826e94d0 2024-09-21T02:42:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.239+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab01a9a60 con 0x56268270a1b0 2024-09-21T02:42:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.240+0000 7f6abd851740 10 client.0 _ll_register_callbacks cb 0x7f6a9c0aca50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.240+0000 7f6aafe00640 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682ac1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.241+0000 7f6aaea00640 1 -- 172.21.15.79:0/4077928587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 msgr2=0x562682ac1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.241+0000 7f6aaea00640 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682ac1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.241+0000 7f6aaea00640 1 -- 172.21.15.79:0/4077928587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 msgr2=0x562682ac2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.241+0000 7f6aaea00640 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ac2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.241+0000 7f6aaea00640 1 -- 172.21.15.79:0/4077928587 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562682abfbf0 con 0x5626826e94d0 2024-09-21T02:42:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.243+0000 7f6aaea00640 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ac10f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8000f80 tx=0x7f6aa8004a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2ea3f703663cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.243+0000 7f6a99600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:42:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.245+0000 7f6a99600640 1 -- 172.21.15.79:0/4077928587 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa801b040 con 0x5626826e94d0 2024-09-21T02:42:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.245+0000 7f6a99600640 1 -- 172.21.15.79:0/4077928587 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f6aa8013040 con 0x5626826e94d0 2024-09-21T02:42:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.245+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a9c009de0 con 0x5626826e94d0 2024-09-21T02:42:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.245+0000 7f6a99600640 1 -- 172.21.15.79:0/4077928587 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6aa8033050 con 0x5626826e94d0 2024-09-21T02:42:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.246+0000 7f6abd851740 10 client.26075 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.246+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562682b32b10 con 0x5626826e94d0 2024-09-21T02:42:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.246+0000 7f6a99600640 1 -- 172.21.15.79:0/4077928587 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa8004c40 con 0x5626826e94d0 2024-09-21T02:42:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.246+0000 7f6a99600640 1 -- 172.21.15.79:0/4077928587 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6aa800b040 con 0x5626826e94d0 2024-09-21T02:42:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.247+0000 7f6abd851740 10 client.26075 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.247+0000 7f6abd851740 10 client.26075 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.247+0000 7f6abd851740 20 client.26075 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.247+0000 7f6abd851740 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56268269e1c0 0x562682b353c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.247+0000 7f6abd851740 4 client.26075 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:42:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.247+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f6a9c009de0 con 0x56268269e1c0 2024-09-21T02:42:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.248+0000 7f6aaf400640 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56268269e1c0 0x562682b353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.249+0000 7f6aaf400640 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56268269e1c0 0x562682b353c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e016bd1a6976a33 server_cookie=706ed2ce35ea151e in_seq=0 out_seq=0 2024-09-21T02:42:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.249+0000 7f6a99600640 10 client.26075 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.395+0000 7f6a99600640 1 -- 172.21.15.79:0/4077928587 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f6a9c009de0 con 0x56268269e1c0 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.395+0000 7f6a99600640 10 client.26075 handle_command_reply: tid=0 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.395+0000 7f6abd851740 1 client.26075 shutdown 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 msgr2=0x562682ac10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ac10f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8000f80 tx=0x7f6aa8004a90 comp rx=0 tx=0).stop 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 shutdown_connections 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56268269e1c0 0x562682b353c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56268270a1b0 0x562682ac1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5626826e94d0 0x562682ac10f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 --2- 172.21.15.79:0/4077928587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626826e12f0 0x562682ac2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 >> 172.21.15.79:0/4077928587 conn(0x5626826fe300 msgr2=0x562682ab5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6a99600640 0 client.26075 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 shutdown_connections 2024-09-21T02:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.396+0000 7f6abd851740 1 -- 172.21.15.79:0/4077928587 wait complete. 2024-09-21T02:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.397+0000 7f6abd851740 20 client.26075 trim_cache size 0 max 16384 2024-09-21T02:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:42:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.397+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6a940c74b0 msgr2=0x7f6a940c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.397+0000 7f6ab6600640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6a940c74b0 0x7f6a940c99c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6aa002a860 tx=0x7f6aa0009760 comp rx=0 tx=0).stop 2024-09-21T02:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.397+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 msgr2=0x7f6ab0197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.397+0000 7f6ab6600640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 0x7f6ab0197d50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00d950 tx=0x7f6a9c00de10 comp rx=0 tx=0).stop 2024-09-21T02:42:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 shutdown_connections 2024-09-21T02:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f6a940c74b0 0x7f6a940c99c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab0109410 0x7f6ab01a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab0106850 0x7f6ab01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 --2- 172.21.15.79:0/3251471433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ab006c4b0 0x7f6ab0197d50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 >> 172.21.15.79:0/3251471433 conn(0x7f6ab00fdf30 msgr2=0x7f6ab0104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 shutdown_connections 2024-09-21T02:42:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:05.398+0000 7f6ab6600640 1 -- 172.21.15.79:0/3251471433 wait complete. 2024-09-21T02:42:05.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:05 smithi098 ceph-mon[34832]: pgmap v605: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-09-21T02:42:05.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:05 smithi079 ceph-mon[30788]: pgmap v605: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-09-21T02:42:06.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:05 smithi148 ceph-mon[34626]: pgmap v605: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-09-21T02:42:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 370.0 s, 731.1 tps, lat 138.699 ms stddev 191.533 2024-09-21T02:42:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:07 smithi098 ceph-mon[34832]: pgmap v606: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 661 op/s 2024-09-21T02:42:07.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:07 smithi079 ceph-mon[30788]: pgmap v606: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 661 op/s 2024-09-21T02:42:08.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:07 smithi148 ceph-mon[34626]: pgmap v606: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 661 op/s 2024-09-21T02:42:09.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:09 smithi098 ceph-mon[34832]: pgmap v607: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 459 op/s 2024-09-21T02:42:09.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:09 smithi079 ceph-mon[30788]: pgmap v607: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 459 op/s 2024-09-21T02:42:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:09 smithi148 ceph-mon[34626]: pgmap v607: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 459 op/s 2024-09-21T02:42:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 375.0 s, 945.6 tps, lat 103.256 ms stddev 133.122 2024-09-21T02:42:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:11 smithi098 ceph-mon[34832]: pgmap v608: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 559 op/s 2024-09-21T02:42:11.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:11 smithi079 ceph-mon[30788]: pgmap v608: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 559 op/s 2024-09-21T02:42:12.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:11 smithi148 ceph-mon[34626]: pgmap v608: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 559 op/s 2024-09-21T02:42:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:13 smithi098 ceph-mon[34832]: pgmap v609: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-09-21T02:42:13.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:13 smithi079 ceph-mon[30788]: pgmap v609: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-09-21T02:42:14.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:13 smithi148 ceph-mon[34626]: pgmap v609: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-09-21T02:42:14.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:14 smithi079 ceph-mon[30788]: pgmap v610: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 520 op/s 2024-09-21T02:42:15.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:14 smithi148 ceph-mon[34626]: pgmap v610: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 520 op/s 2024-09-21T02:42:15.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:14 smithi098 ceph-mon[34832]: pgmap v610: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 520 op/s 2024-09-21T02:42:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 380.0 s, 877.6 tps, lat 115.879 ms stddev 144.776 2024-09-21T02:42:16.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:16 smithi079 ceph-mon[30788]: pgmap v611: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 592 op/s 2024-09-21T02:42:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:16 smithi148 ceph-mon[34626]: pgmap v611: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 592 op/s 2024-09-21T02:42:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:16 smithi098 ceph-mon[34832]: pgmap v611: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 592 op/s 2024-09-21T02:42:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.716+0000 7f1cf6600640 1 -- 172.21.15.79:0/1400377593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf01034e0 msgr2=0x7f1cf0103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.716+0000 7f1cf6600640 1 --2- 172.21.15.79:0/1400377593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf01034e0 0x7f1cf0103950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009900 tx=0x7f1ce402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.716+0000 7f1cf6600640 1 -- 172.21.15.79:0/1400377593 shutdown_connections 2024-09-21T02:42:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.716+0000 7f1cf6600640 1 --2- 172.21.15.79:0/1400377593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf0104f00 0x7f1cf010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.716+0000 7f1cf6600640 1 --2- 172.21.15.79:0/1400377593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf0104560 0x7f1cf0104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.716+0000 7f1cf6600640 1 --2- 172.21.15.79:0/1400377593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf01034e0 0x7f1cf0103950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.716+0000 7f1cf6600640 1 -- 172.21.15.79:0/1400377593 >> 172.21.15.79:0/1400377593 conn(0x7f1cf00fee20 msgr2=0x7f1cf01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.717+0000 7f1cf6600640 1 -- 172.21.15.79:0/1400377593 shutdown_connections 2024-09-21T02:42:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.717+0000 7f1cf6600640 1 -- 172.21.15.79:0/1400377593 wait complete. 2024-09-21T02:42:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.718+0000 7f1cf6600640 1 Processor -- start 2024-09-21T02:42:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.721+0000 7f1cf6600640 1 -- start start 2024-09-21T02:42:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.721+0000 7f1cf6600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf01034e0 0x7f1cf0199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.721+0000 7f1cf6600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf0104560 0x7f1cf019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.721+0000 7f1cf6600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf0104f00 0x7f1cf019afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.721+0000 7f1cf6600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf010f1a0 con 0x7f1cf01034e0 2024-09-21T02:42:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.721+0000 7f1cf6600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf010f020 con 0x7f1cf0104560 2024-09-21T02:42:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.721+0000 7f1cf6600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf010f320 con 0x7f1cf0104f00 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf0104560 0x7f1cf019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cf5c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf0104f00 0x7f1cf019afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf0104560 0x7f1cf019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35978/0 (socket says 172.21.15.79:35978) 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 -- 172.21.15.79:0/3286940459 learned_addr learned my addr 172.21.15.79:0/3286940459 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 -- 172.21.15.79:0/3286940459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf0104f00 msgr2=0x7f1cf019afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf0104f00 0x7f1cf019afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 -- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf01034e0 msgr2=0x7f1cf0199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf01034e0 0x7f1cf0199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cefe00640 1 -- 172.21.15.79:0/3286940459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf019b800 con 0x7f1cf0104560 2024-09-21T02:42:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.722+0000 7f1cf5c00640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf0104f00 0x7f1cf019afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.723+0000 7f1cefe00640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf0104560 0x7f1cf019a430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e9f0 tx=0x7f1cdc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.723+0000 7f1ced600640 1 -- 172.21.15.79:0/3286940459 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00cd80 con 0x7f1cf0104560 2024-09-21T02:42:18.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.723+0000 7f1ced600640 1 -- 172.21.15.79:0/3286940459 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cdc0054d0 con 0x7f1cf0104560 2024-09-21T02:42:18.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.723+0000 7f1ced600640 1 -- 172.21.15.79:0/3286940459 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc010690 con 0x7f1cf0104560 2024-09-21T02:42:18.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.723+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf019baf0 con 0x7f1cf0104560 2024-09-21T02:42:18.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.723+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf0075850 con 0x7f1cf0104560 2024-09-21T02:42:18.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.729+0000 7f1ced600640 1 -- 172.21.15.79:0/3286940459 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1cdc004e90 con 0x7f1cf0104560 2024-09-21T02:42:18.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.729+0000 7f1cfee4e740 1 Processor -- start 2024-09-21T02:42:18.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.730+0000 7f1cfee4e740 1 -- start start 2024-09-21T02:42:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.730+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 0x56403963fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x564039640130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039640c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5640395aa6b0 con 0x5640392672f0 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564039599ae0 con 0x5640392901b0 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56403959d8f0 con 0x56403926f4d0 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039640c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cf5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x564039640130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039640c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:35132/0 (socket says 172.21.15.79:35132) 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.731+0000 7f1cefe00640 1 -- 172.21.15.79:0/2204182294 learned_addr learned my addr 172.21.15.79:0/2204182294 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1ced600640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd80b6590 0x7f1cd80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1ced600640 1 -- 172.21.15.79:0/3286940459 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1cdc0e7b90 con 0x7f1cf0104560 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1cefe00640 1 -- 172.21.15.79:0/2204182294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 msgr2=0x56403963fac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:42:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1cefe00640 1 --2- 172.21.15.79:0/2204182294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 0x56403963fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1cefe00640 1 -- 172.21.15.79:0/2204182294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 msgr2=0x564039640130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1cefe00640 1 --2- 172.21.15.79:0/2204182294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x564039640130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1cefe00640 1 -- 172.21.15.79:0/2204182294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564039566780 con 0x56403926f4d0 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.732+0000 7f1cefe00640 1 --2- 172.21.15.79:0/2204182294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039640c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0a9f40 tx=0x7f1cdc004a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c7f0ed8e15406ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.733+0000 7f1ce2000640 1 -- 172.21.15.79:0/2204182294 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0ad0e0 con 0x56403926f4d0 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.733+0000 7f1ce2000640 1 -- 172.21.15.79:0/2204182294 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cdc0ec040 con 0x56403926f4d0 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.734+0000 7f1ce2000640 1 -- 172.21.15.79:0/2204182294 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc005180 con 0x56403926f4d0 2024-09-21T02:42:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.735+0000 7f1cfee4e740 1 -- 172.21.15.79:0/2204182294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 msgr2=0x564039640c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.735+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/2204182294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039640c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0a9f40 tx=0x7f1cdc004a90 comp rx=0 tx=0).stop 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.735+0000 7f1cf5c00640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd80b6590 0x7f1cd80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cf5c00640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd80b6590 0x7f1cd80b8aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800d850 tx=0x7f1ce800d7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cfee4e740 1 -- 172.21.15.79:0/2204182294 shutdown_connections 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/2204182294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039640c80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/2204182294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x564039640130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/2204182294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 0x56403963fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cfee4e740 1 -- 172.21.15.79:0/2204182294 >> 172.21.15.79:0/2204182294 conn(0x564039284300 msgr2=0x56403963b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cfee4e740 1 -- 172.21.15.79:0/2204182294 shutdown_connections 2024-09-21T02:42:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.736+0000 7f1cfee4e740 1 -- 172.21.15.79:0/2204182294 wait complete. 2024-09-21T02:42:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.737+0000 7f1cfee4e740 1 -- start start 2024-09-21T02:42:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.737+0000 7f1cfee4e740 1 Processor -- start 2024-09-21T02:42:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.738+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x5640396491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.738+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039649860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.738+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x56403964a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.738+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5640394d1ab0 con 0x5640392901b0 2024-09-21T02:42:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.738+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564039540570 con 0x5640392672f0 2024-09-21T02:42:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.738+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564039641740 con 0x56403926f4d0 2024-09-21T02:42:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.738+0000 7f1cfee4e740 10 client.0 _ll_register_callbacks cb 0x56403954f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.739+0000 7f1cf5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x5640396491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.739+0000 7f1cf5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x5640396491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35994/0 (socket says 172.21.15.79:35994) 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.739+0000 7f1cf5200640 1 -- 172.21.15.79:0/4081991729 learned_addr learned my addr 172.21.15.79:0/4081991729 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.739+0000 7f1cefe00640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039649860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.740+0000 7f1cf5200640 1 -- 172.21.15.79:0/4081991729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 msgr2=0x564039649860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.740+0000 7f1cf5200640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039649860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.740+0000 7f1cf5c00640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x56403964a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.740+0000 7f1cf5200640 1 -- 172.21.15.79:0/4081991729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 msgr2=0x56403964a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.741+0000 7f1cf5200640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x56403964a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.741+0000 7f1cf5200640 1 -- 172.21.15.79:0/4081991729 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640392fb790 con 0x5640392672f0 2024-09-21T02:42:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.741+0000 7f1cf5c00640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x56403964a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:42:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.741+0000 7f1cf5200640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x5640396491a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4033000 tx=0x7f1ce4031820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98cd71974c85c493 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.741+0000 7f1cd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:42:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.742+0000 7f1cd6a00640 1 -- 172.21.15.79:0/4081991729 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4035040 con 0x5640392672f0 2024-09-21T02:42:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.742+0000 7f1cd6a00640 1 -- 172.21.15.79:0/4081991729 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1ce4004040 con 0x5640392672f0 2024-09-21T02:42:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.742+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cdc0ec040 con 0x5640392672f0 2024-09-21T02:42:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.742+0000 7f1cd6a00640 1 -- 172.21.15.79:0/4081991729 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1ce404c050 con 0x5640392672f0 2024-09-21T02:42:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.743+0000 7f1cfee4e740 10 client.26084 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.743+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564039374620 con 0x5640392672f0 2024-09-21T02:42:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.743+0000 7f1cd6a00640 1 -- 172.21.15.79:0/4081991729 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cdc0ec040 con 0x5640392672f0 2024-09-21T02:42:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.744+0000 7f1cd6a00640 1 -- 172.21.15.79:0/4081991729 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1ce40035f0 con 0x5640392672f0 2024-09-21T02:42:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.745+0000 7f1cfee4e740 10 client.26084 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.745+0000 7f1cfee4e740 10 client.26084 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.745+0000 7f1cfee4e740 20 client.26084 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.745+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56403924ed80 0x5640396568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.745+0000 7f1cfee4e740 4 client.26084 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.745+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640395ac600 con 0x56403924ed80 2024-09-21T02:42:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.748+0000 7f1cefe00640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56403924ed80 0x5640396568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.748+0000 7f1cefe00640 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56403924ed80 0x5640396568c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edcb57394a6d692d server_cookie=3b94bd1cd5c541cc in_seq=0 out_seq=0 2024-09-21T02:42:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.748+0000 7f1cd6a00640 10 client.26084 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.750+0000 7f1cd6a00640 1 -- 172.21.15.79:0/4081991729 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640395ac600 con 0x56403924ed80 2024-09-21T02:42:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.750+0000 7f1cd6a00640 10 client.26084 handle_command_reply: tid=0 2024-09-21T02:42:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.750+0000 7f1cfee4e740 1 client.26084 shutdown 2024-09-21T02:42:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 msgr2=0x5640396491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x5640396491a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4033000 tx=0x7f1ce4031820 comp rx=0 tx=0).stop 2024-09-21T02:42:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 shutdown_connections 2024-09-21T02:42:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56403924ed80 0x5640396568c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x56403964a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039649860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4081991729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x5640396491a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cd6a00640 0 client.26084 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.751+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 >> 172.21.15.79:0/4081991729 conn(0x564039284300 msgr2=0x564039631360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.753+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 shutdown_connections 2024-09-21T02:42:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.753+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4081991729 wait complete. 2024-09-21T02:42:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.753+0000 7f1cfee4e740 20 client.26084 trim_cache size 0 max 16384 2024-09-21T02:42:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.786+0000 7f1cfee4e740 1 Processor -- start 2024-09-21T02:42:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.786+0000 7f1cfee4e740 1 -- start start 2024-09-21T02:42:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x56403963fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x56403963ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 0x56403963b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01a85b0 con 0x5640392672f0 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01aae30 con 0x5640392901b0 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01a8c20 con 0x56403926f4d0 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cf5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x56403963fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cf5200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x56403963fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42144/0 (socket says 172.21.15.79:42144) 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cf5200640 1 -- 172.21.15.79:0/4014255675 learned_addr learned my addr 172.21.15.79:0/4014255675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.787+0000 7f1cefe00640 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x56403963ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.788+0000 7f1cf5c00640 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 0x56403963b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.788+0000 7f1cf5200640 1 -- 172.21.15.79:0/4014255675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 msgr2=0x56403963ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.788+0000 7f1cf5200640 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x56403963ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.788+0000 7f1cf5200640 1 -- 172.21.15.79:0/4014255675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 msgr2=0x56403963b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.788+0000 7f1cf5200640 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 0x56403963b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.788+0000 7f1cf5200640 1 -- 172.21.15.79:0/4014255675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640396473b0 con 0x5640392672f0 2024-09-21T02:42:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.788+0000 7f1cf5200640 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x56403963fcd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009850 tx=0x7f1ce40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d255deb93dceb65d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:18.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.789+0000 7f1ce1600640 1 -- 172.21.15.79:0/4014255675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4055070 con 0x5640392672f0 2024-09-21T02:42:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.789+0000 7f1ce1600640 1 -- 172.21.15.79:0/4014255675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce40044b0 con 0x5640392672f0 2024-09-21T02:42:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.789+0000 7f1ce1600640 1 -- 172.21.15.79:0/4014255675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4035030 con 0x5640392672f0 2024-09-21T02:42:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4014255675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 msgr2=0x56403963fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x56403963fcd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009850 tx=0x7f1ce40056d0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4014255675 shutdown_connections 2024-09-21T02:42:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392901b0 0x56403963b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x56403963ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/4014255675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392672f0 0x56403963fcd0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4014255675 >> 172.21.15.79:0/4014255675 conn(0x564039284300 msgr2=0x564039647730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4014255675 shutdown_connections 2024-09-21T02:42:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.790+0000 7f1cfee4e740 1 -- 172.21.15.79:0/4014255675 wait complete. 2024-09-21T02:42:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.791+0000 7f1cfee4e740 1 -- start start 2024-09-21T02:42:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.791+0000 7f1cfee4e740 1 Processor -- start 2024-09-21T02:42:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.792+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x56403964fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.792+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039650370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.792+0000 7f1cfee4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x5640396508b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.792+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01a92f0 con 0x5640392901b0 2024-09-21T02:42:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.792+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01aa760 con 0x5640392672f0 2024-09-21T02:42:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.792+0000 7f1cfee4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01a99c0 con 0x56403926f4d0 2024-09-21T02:42:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.792+0000 7f1cfee4e740 10 client.0 _ll_register_callbacks cb 0x7f1ce4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.793+0000 7f1cf5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x56403964fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.793+0000 7f1cf5200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x56403964fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36008/0 (socket says 172.21.15.79:36008) 2024-09-21T02:42:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.793+0000 7f1cf5200640 1 -- 172.21.15.79:0/3466793940 learned_addr learned my addr 172.21.15.79:0/3466793940 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.793+0000 7f1cefe00640 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039650370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.793+0000 7f1cf5200640 1 -- 172.21.15.79:0/3466793940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 msgr2=0x564039650370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.793+0000 7f1cf5200640 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039650370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.793+0000 7f1cf5200640 1 -- 172.21.15.79:0/3466793940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 msgr2=0x5640396508b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:42:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.794+0000 7f1cf5200640 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x5640396508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.794+0000 7f1cf5200640 1 -- 172.21.15.79:0/3466793940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403964eb90 con 0x5640392672f0 2024-09-21T02:42:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.797+0000 7f1cf5200640 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x56403964fe30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4033000 tx=0x7f1ce4003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af494a122c196031 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.797+0000 7f1cd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:42:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.797+0000 7f1cd6a00640 1 -- 172.21.15.79:0/3466793940 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4035050 con 0x5640392672f0 2024-09-21T02:42:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.798+0000 7f1cd6a00640 1 -- 172.21.15.79:0/3466793940 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1ce4003db0 con 0x5640392672f0 2024-09-21T02:42:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.798+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ce40044b0 con 0x5640392672f0 2024-09-21T02:42:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.798+0000 7f1cd6a00640 1 -- 172.21.15.79:0/3466793940 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1ce4066050 con 0x5640392672f0 2024-09-21T02:42:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.798+0000 7f1cfee4e740 10 client.26090 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.798+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5640396387c0 con 0x5640392672f0 2024-09-21T02:42:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.798+0000 7f1cd6a00640 1 -- 172.21.15.79:0/3466793940 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce40044b0 con 0x5640392672f0 2024-09-21T02:42:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.799+0000 7f1cd6a00640 1 -- 172.21.15.79:0/3466793940 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1ce4061030 con 0x5640392672f0 2024-09-21T02:42:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.800+0000 7f1cfee4e740 10 client.26090 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.800+0000 7f1cfee4e740 10 client.26090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.800+0000 7f1cfee4e740 20 client.26090 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.801+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5640392241c0 0x564039639140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.801+0000 7f1cfee4e740 4 client.26090 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:42:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.801+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5640395a80b0 con 0x5640392241c0 2024-09-21T02:42:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.802+0000 7f1cefe00640 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5640392241c0 0x564039639140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.802+0000 7f1cd6a00640 10 client.26090 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.802+0000 7f1cefe00640 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5640392241c0 0x564039639140 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed91ccea4804bf76 server_cookie=d9b835f832e27b7 in_seq=0 out_seq=0 2024-09-21T02:42:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.825+0000 7f1cd6a00640 1 -- 172.21.15.79:0/3466793940 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5640395a80b0 con 0x5640392241c0 2024-09-21T02:42:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.825+0000 7f1cd6a00640 10 client.26090 handle_command_reply: tid=0 2024-09-21T02:42:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.825+0000 7f1cfee4e740 1 client.26090 shutdown 2024-09-21T02:42:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 msgr2=0x56403964fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x56403964fe30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4033000 tx=0x7f1ce4003820 comp rx=0 tx=0).stop 2024-09-21T02:42:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 shutdown_connections 2024-09-21T02:42:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5640392241c0 0x564039639140 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cd6a00640 0 client.26090 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640392901b0 0x5640396508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56403926f4d0 0x564039650370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 --2- 172.21.15.79:0/3466793940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640392672f0 0x56403964fe30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.826+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 >> 172.21.15.79:0/3466793940 conn(0x564039284300 msgr2=0x56403963ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.827+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 shutdown_connections 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.827+0000 7f1cfee4e740 1 -- 172.21.15.79:0/3466793940 wait complete. 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.827+0000 7f1cfee4e740 20 client.26090 trim_cache size 0 max 16384 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:42:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:42:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd80b6590 msgr2=0x7f1cd80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd80b6590 0x7f1cd80b8aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800d850 tx=0x7f1ce800d7e0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf0104560 msgr2=0x7f1cf019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf0104560 0x7f1cf019a430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e9f0 tx=0x7f1cdc00edf0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 shutdown_connections 2024-09-21T02:42:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd80b6590 0x7f1cd80b8aa0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf0104f00 0x7f1cf019afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cf0104560 0x7f1cf019a430 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 --2- 172.21.15.79:0/3286940459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf01034e0 0x7f1cf0199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 >> 172.21.15.79:0/3286940459 conn(0x7f1cf00fee20 msgr2=0x7f1cf0107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 shutdown_connections 2024-09-21T02:42:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:18.828+0000 7f1cf6600640 1 -- 172.21.15.79:0/3286940459 wait complete. 2024-09-21T02:42:18.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:18 smithi079 ceph-mon[30788]: pgmap v612: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 542 op/s 2024-09-21T02:42:19.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:18 smithi148 ceph-mon[34626]: pgmap v612: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 542 op/s 2024-09-21T02:42:19.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:18 smithi098 ceph-mon[34832]: pgmap v612: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 542 op/s 2024-09-21T02:42:20.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:20 smithi079 ceph-mon[30788]: pgmap v613: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-21T02:42:21.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:20 smithi148 ceph-mon[34626]: pgmap v613: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-21T02:42:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:20 smithi098 ceph-mon[34832]: pgmap v613: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 562 op/s 2024-09-21T02:42:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 385.0 s, 835.0 tps, lat 118.446 ms stddev 150.238 2024-09-21T02:42:22.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:22 smithi079 ceph-mon[30788]: pgmap v614: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 620 op/s 2024-09-21T02:42:23.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:22 smithi148 ceph-mon[34626]: pgmap v614: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 620 op/s 2024-09-21T02:42:23.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:22 smithi098 ceph-mon[34832]: pgmap v614: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 620 op/s 2024-09-21T02:42:24.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:24 smithi079 ceph-mon[30788]: pgmap v615: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 529 op/s 2024-09-21T02:42:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:24 smithi148 ceph-mon[34626]: pgmap v615: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 529 op/s 2024-09-21T02:42:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:24 smithi098 ceph-mon[34832]: pgmap v615: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 529 op/s 2024-09-21T02:42:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 390.0 s, 564.0 tps, lat 181.893 ms stddev 211.425 2024-09-21T02:42:26.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:26 smithi079 ceph-mon[30788]: pgmap v616: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 661 op/s 2024-09-21T02:42:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:26 smithi148 ceph-mon[34626]: pgmap v616: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 661 op/s 2024-09-21T02:42:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:26 smithi098 ceph-mon[34832]: pgmap v616: 129 pgs: 129 active+clean; 1.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 661 op/s 2024-09-21T02:42:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:28 smithi079 ceph-mon[30788]: pgmap v617: 129 pgs: 129 active+clean; 1.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 601 op/s 2024-09-21T02:42:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:28 smithi148 ceph-mon[34626]: pgmap v617: 129 pgs: 129 active+clean; 1.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 601 op/s 2024-09-21T02:42:29.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:28 smithi098 ceph-mon[34832]: pgmap v617: 129 pgs: 129 active+clean; 1.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 601 op/s 2024-09-21T02:42:31.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:30 smithi148 ceph-mon[34626]: pgmap v618: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 643 op/s 2024-09-21T02:42:31.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:30 smithi098 ceph-mon[34832]: pgmap v618: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 643 op/s 2024-09-21T02:42:31.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:30 smithi079 ceph-mon[30788]: pgmap v618: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 643 op/s 2024-09-21T02:42:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 395.0 s, 1009.4 tps, lat 98.032 ms stddev 120.610 2024-09-21T02:42:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.157+0000 7fbc88a00640 1 -- 172.21.15.79:0/2482042828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 msgr2=0x7fbc84104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.157+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2482042828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 0x7fbc84104970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009900 tx=0x7fbc7402a420 comp rx=0 tx=0).stop 2024-09-21T02:42:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.158+0000 7fbc88a00640 1 -- 172.21.15.79:0/2482042828 shutdown_connections 2024-09-21T02:42:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.158+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2482042828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc84104f00 0x7fbc8410b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.158+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2482042828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 0x7fbc84104970 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.158+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2482042828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 0x7fbc84103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.158+0000 7fbc88a00640 1 -- 172.21.15.79:0/2482042828 >> 172.21.15.79:0/2482042828 conn(0x7fbc840fee20 msgr2=0x7fbc841012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.158+0000 7fbc88a00640 1 -- 172.21.15.79:0/2482042828 shutdown_connections 2024-09-21T02:42:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.158+0000 7fbc88a00640 1 -- 172.21.15.79:0/2482042828 wait complete. 2024-09-21T02:42:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.159+0000 7fbc88a00640 1 Processor -- start 2024-09-21T02:42:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.160+0000 7fbc88a00640 1 -- start start 2024-09-21T02:42:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.160+0000 7fbc88a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 0x7fbc8419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.160+0000 7fbc88a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 0x7fbc8419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.160+0000 7fbc88a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc84104f00 0x7fbc8419d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.160+0000 7fbc88a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8410f200 con 0x7fbc84104f00 2024-09-21T02:42:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.160+0000 7fbc88a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8410f080 con 0x7fbc841034e0 2024-09-21T02:42:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.160+0000 7fbc88a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8410f380 con 0x7fbc84104560 2024-09-21T02:42:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.161+0000 7fbc83400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 0x7fbc8419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.161+0000 7fbc83400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 0x7fbc8419c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35648/0 (socket says 172.21.15.79:35648) 2024-09-21T02:42:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.161+0000 7fbc83400640 1 -- 172.21.15.79:0/2570018708 learned_addr learned my addr 172.21.15.79:0/2570018708 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.161+0000 7fbc83e00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc84104f00 0x7fbc8419d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.162+0000 7fbc82a00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 0x7fbc8419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.162+0000 7fbc83400640 1 -- 172.21.15.79:0/2570018708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 msgr2=0x7fbc8419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.162+0000 7fbc83400640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 0x7fbc8419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.162+0000 7fbc83400640 1 -- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc84104f00 msgr2=0x7fbc8419d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.162+0000 7fbc83400640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc84104f00 0x7fbc8419d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.162+0000 7fbc83400640 1 -- 172.21.15.79:0/2570018708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8419d9d0 con 0x7fbc841034e0 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.162+0000 7fbc83400640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 0x7fbc8419c020 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00b450 tx=0x7fbc6c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.163+0000 7fbc7be00640 1 -- 172.21.15.79:0/2570018708 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c015020 con 0x7fbc841034e0 2024-09-21T02:42:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.163+0000 7fbc7be00640 1 -- 172.21.15.79:0/2570018708 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c011d40 con 0x7fbc841034e0 2024-09-21T02:42:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.163+0000 7fbc7be00640 1 -- 172.21.15.79:0/2570018708 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00f340 con 0x7fbc841034e0 2024-09-21T02:42:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.163+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8419dcc0 con 0x7fbc841034e0 2024-09-21T02:42:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.163+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc84105850 con 0x7fbc841034e0 2024-09-21T02:42:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.168+0000 7fbc910a1740 1 Processor -- start 2024-09-21T02:42:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.168+0000 7fbc910a1740 1 -- start start 2024-09-21T02:42:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.169+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.169+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.169+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.169+0000 7fbc910a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630b38196b0 con 0x5630b34ff1b0 2024-09-21T02:42:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.169+0000 7fbc910a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5630b3808ae0 con 0x5630b34d62f0 2024-09-21T02:42:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.169+0000 7fbc910a1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5630b380c8f0 con 0x5630b34de4d0 2024-09-21T02:42:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.170+0000 7fbc7be00640 1 -- 172.21.15.79:0/2570018708 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbc6c018020 con 0x7fbc841034e0 2024-09-21T02:42:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.170+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.170+0000 7fbc83400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.170+0000 7fbc83400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35664/0 (socket says 172.21.15.79:35664) 2024-09-21T02:42:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.170+0000 7fbc83400640 1 -- 172.21.15.79:0/3038826026 learned_addr learned my addr 172.21.15.79:0/3038826026 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.170+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45994/0 (socket says 172.21.15.79:45994) 2024-09-21T02:42:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.171+0000 7fbc82a00640 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.171+0000 7fbc82a00640 1 -- 172.21.15.79:0/3038826026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 msgr2=0x5630b38a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.171+0000 7fbc82a00640 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.171+0000 7fbc82a00640 1 -- 172.21.15.79:0/3038826026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 msgr2=0x5630b38a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.171+0000 7fbc82a00640 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.171+0000 7fbc82a00640 1 -- 172.21.15.79:0/3038826026 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b37d5780 con 0x5630b34de4d0 2024-09-21T02:42:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.173+0000 7fbc82a00640 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a7470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc7402aa10 tx=0x7fbc740043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31cc66ddfdba0c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.174+0000 7fbc73e00640 1 -- 172.21.15.79:0/3038826026 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74035030 con 0x5630b34de4d0 2024-09-21T02:42:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.175+0000 7fbc73e00640 1 -- 172.21.15.79:0/3038826026 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc74040070 con 0x5630b34de4d0 2024-09-21T02:42:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.175+0000 7fbc73e00640 1 -- 172.21.15.79:0/3038826026 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74031c10 con 0x5630b34de4d0 2024-09-21T02:42:32.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.176+0000 7fbc910a1740 1 -- 172.21.15.79:0/3038826026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 msgr2=0x5630b38a7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.176+0000 7fbc910a1740 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a7470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc7402aa10 tx=0x7fbc740043d0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.176+0000 7fbc910a1740 1 -- 172.21.15.79:0/3038826026 shutdown_connections 2024-09-21T02:42:32.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.176+0000 7fbc910a1740 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a7470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.176+0000 7fbc910a1740 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.177+0000 7fbc7be00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbc680b6610 0x7fbc680b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.177+0000 7fbc7be00640 1 -- 172.21.15.79:0/2570018708 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbc6c0e7090 con 0x7fbc841034e0 2024-09-21T02:42:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.177+0000 7fbc910a1740 1 --2- 172.21.15.79:0/3038826026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.178+0000 7fbc910a1740 1 -- 172.21.15.79:0/3038826026 >> 172.21.15.79:0/3038826026 conn(0x5630b34f3300 msgr2=0x5630b38a1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.178+0000 7fbc83e00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbc680b6610 0x7fbc680b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.179+0000 7fbc910a1740 1 -- 172.21.15.79:0/3038826026 shutdown_connections 2024-09-21T02:42:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.181+0000 7fbc910a1740 1 -- 172.21.15.79:0/3038826026 wait complete. 2024-09-21T02:42:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.182+0000 7fbc910a1740 1 -- start start 2024-09-21T02:42:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.183+0000 7fbc910a1740 1 Processor -- start 2024-09-21T02:42:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.183+0000 7fbc83e00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbc680b6610 0x7fbc680b8b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c007e10 tx=0x7fbc7c007680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.186+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38af960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.186+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34de4d0 0x5630b38b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.186+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34ff1b0 0x5630b38b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.186+0000 7fbc82a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34de4d0 0x5630b38b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.187+0000 7fbc910a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630b3740ab0 con 0x5630b34d62f0 2024-09-21T02:42:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.187+0000 7fbc910a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5630b37af570 con 0x5630b34de4d0 2024-09-21T02:42:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.187+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34ff1b0 0x5630b38b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.187+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34ff1b0 0x5630b38b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58664/0 (socket says 172.21.15.79:58664) 2024-09-21T02:42:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.187+0000 7fbc83e00640 1 -- 172.21.15.79:0/437155629 learned_addr learned my addr 172.21.15.79:0/437155629 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.187+0000 7fbc83400640 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.188+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5630b38a7f30 con 0x5630b34ff1b0 2024-09-21T02:42:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.188+0000 7fbc910a1740 10 client.0 _ll_register_callbacks cb 0x5630b37be100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.188+0000 7fbc83e00640 1 -- 172.21.15.79:0/437155629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34de4d0 msgr2=0x5630b38b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.188+0000 7fbc83e00640 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34de4d0 0x5630b38b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.188+0000 7fbc83e00640 1 -- 172.21.15.79:0/437155629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 msgr2=0x5630b38af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.188+0000 7fbc83e00640 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.188+0000 7fbc83e00640 1 -- 172.21.15.79:0/437155629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b356a790 con 0x5630b34ff1b0 2024-09-21T02:42:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.189+0000 7fbc83e00640 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34ff1b0 0x5630b38b0b90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00ed30 tx=0x7fbc7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a145d2e5d91d1974 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.189+0000 7fbc70c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:42:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.190+0000 7fbc70c00640 1 -- 172.21.15.79:0/437155629 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c01cd30 con 0x5630b34ff1b0 2024-09-21T02:42:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.190+0000 7fbc70c00640 1 -- 172.21.15.79:0/437155629 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbc7c027430 con 0x5630b34ff1b0 2024-09-21T02:42:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.191+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc74040070 con 0x5630b34ff1b0 2024-09-21T02:42:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.194+0000 7fbc70c00640 1 -- 172.21.15.79:0/437155629 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc7c00ee20 con 0x5630b34ff1b0 2024-09-21T02:42:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.194+0000 7fbc910a1740 10 client.26113 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.194+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5630b35e3620 con 0x5630b34ff1b0 2024-09-21T02:42:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.195+0000 7fbc70c00640 1 -- 172.21.15.79:0/437155629 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc74040070 con 0x5630b34ff1b0 2024-09-21T02:42:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.196+0000 7fbc70c00640 1 -- 172.21.15.79:0/437155629 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc7c01d510 con 0x5630b34ff1b0 2024-09-21T02:42:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.197+0000 7fbc910a1740 10 client.26113 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.197+0000 7fbc910a1740 10 client.26113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.197+0000 7fbc910a1740 20 client.26113 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.197+0000 7fbc910a1740 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34bdd80 0x5630b38bd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.197+0000 7fbc910a1740 4 client.26113 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.197+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630b381b600 con 0x5630b34bdd80 2024-09-21T02:42:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.197+0000 7fbc83400640 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34bdd80 0x5630b38bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.198+0000 7fbc70c00640 10 client.26113 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.199+0000 7fbc83400640 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34bdd80 0x5630b38bd230 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc1f18aeeac90d server_cookie=b8ff059879977288 in_seq=0 out_seq=0 2024-09-21T02:42:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.200+0000 7fbc70c00640 1 -- 172.21.15.79:0/437155629 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630b381b600 con 0x5630b34bdd80 2024-09-21T02:42:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.200+0000 7fbc70c00640 10 client.26113 handle_command_reply: tid=0 2024-09-21T02:42:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.201+0000 7fbc910a1740 1 client.26113 shutdown 2024-09-21T02:42:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.201+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34ff1b0 msgr2=0x5630b38b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.201+0000 7fbc910a1740 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34ff1b0 0x5630b38b0b90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00ed30 tx=0x7fbc7c004a40 comp rx=0 tx=0).stop 2024-09-21T02:42:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.201+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 shutdown_connections 2024-09-21T02:42:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.202+0000 7fbc910a1740 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34bdd80 0x5630b38bd230 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.202+0000 7fbc70c00640 0 client.26113 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.202+0000 7fbc910a1740 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34ff1b0 0x5630b38b0b90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.202+0000 7fbc910a1740 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34de4d0 0x5630b38b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.202+0000 7fbc910a1740 1 --2- 172.21.15.79:0/437155629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.202+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 >> 172.21.15.79:0/437155629 conn(0x5630b34f3300 msgr2=0x5630b38a0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.203+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 shutdown_connections 2024-09-21T02:42:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.206+0000 7fbc910a1740 1 -- 172.21.15.79:0/437155629 wait complete. 2024-09-21T02:42:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.207+0000 7fbc910a1740 20 client.26113 trim_cache size 0 max 16384 2024-09-21T02:42:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.242+0000 7fbc910a1740 1 Processor -- start 2024-09-21T02:42:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.242+0000 7fbc910a1740 1 -- start start 2024-09-21T02:42:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.243+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.243+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.243+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34ff1b0 0x5630b38adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.243+0000 7fbc910a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b0af0 con 0x5630b34d62f0 2024-09-21T02:42:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.243+0000 7fbc910a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b3370 con 0x5630b34ff1b0 2024-09-21T02:42:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.243+0000 7fbc910a1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b1160 con 0x5630b34de4d0 2024-09-21T02:42:32.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.244+0000 7fbc82a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.244+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34ff1b0 0x5630b38adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.244+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34ff1b0 0x5630b38adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35682/0 (socket says 172.21.15.79:35682) 2024-09-21T02:42:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.244+0000 7fbc83e00640 1 -- 172.21.15.79:0/2982225079 learned_addr learned my addr 172.21.15.79:0/2982225079 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.244+0000 7fbc83400640 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.245+0000 7fbc82a00640 1 -- 172.21.15.79:0/2982225079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34ff1b0 msgr2=0x5630b38adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.245+0000 7fbc82a00640 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34ff1b0 0x5630b38adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.245+0000 7fbc82a00640 1 -- 172.21.15.79:0/2982225079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 msgr2=0x5630b38aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.245+0000 7fbc82a00640 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.245+0000 7fbc82a00640 1 -- 172.21.15.79:0/2982225079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b38a65b0 con 0x5630b34de4d0 2024-09-21T02:42:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.245+0000 7fbc83e00640 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34ff1b0 0x5630b38adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.246+0000 7fbc82a00640 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a1680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc74006010 tx=0x7fbc74031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e2cee351714cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:32.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.246+0000 7fbc73400640 1 -- 172.21.15.79:0/2982225079 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74035040 con 0x5630b34de4d0 2024-09-21T02:42:32.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.247+0000 7fbc73400640 1 -- 172.21.15.79:0/2982225079 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc74040070 con 0x5630b34de4d0 2024-09-21T02:42:32.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.247+0000 7fbc73400640 1 -- 172.21.15.79:0/2982225079 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74045470 con 0x5630b34de4d0 2024-09-21T02:42:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.248+0000 7fbc910a1740 1 -- 172.21.15.79:0/2982225079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 msgr2=0x5630b38a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.248+0000 7fbc910a1740 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a1680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc74006010 tx=0x7fbc74031400 comp rx=0 tx=0).stop 2024-09-21T02:42:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.249+0000 7fbc910a1740 1 -- 172.21.15.79:0/2982225079 shutdown_connections 2024-09-21T02:42:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.249+0000 7fbc910a1740 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34ff1b0 0x5630b38adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.249+0000 7fbc910a1740 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38a1680 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.249+0000 7fbc910a1740 1 --2- 172.21.15.79:0/2982225079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34d62f0 0x5630b38aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.249+0000 7fbc910a1740 1 -- 172.21.15.79:0/2982225079 >> 172.21.15.79:0/2982225079 conn(0x5630b34f3300 msgr2=0x5630b38a5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.249+0000 7fbc910a1740 1 -- 172.21.15.79:0/2982225079 shutdown_connections 2024-09-21T02:42:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.250+0000 7fbc910a1740 1 -- 172.21.15.79:0/2982225079 wait complete. 2024-09-21T02:42:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.250+0000 7fbc910a1740 1 -- start start 2024-09-21T02:42:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.251+0000 7fbc910a1740 1 Processor -- start 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.252+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.252+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.252+0000 7fbc910a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.252+0000 7fbc910a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b1830 con 0x5630b34ff1b0 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.252+0000 7fbc910a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b2ca0 con 0x5630b34d62f0 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.252+0000 7fbc910a1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b1f00 con 0x5630b34de4d0 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.252+0000 7fbc910a1740 10 client.0 _ll_register_callbacks cb 0x7fbc7c007a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.253+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.253+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46026/0 (socket says 172.21.15.79:46026) 2024-09-21T02:42:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.253+0000 7fbc83e00640 1 -- 172.21.15.79:0/830359277 learned_addr learned my addr 172.21.15.79:0/830359277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.254+0000 7fbc83e00640 1 -- 172.21.15.79:0/830359277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 msgr2=0x5630b38b6ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:42:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.254+0000 7fbc83e00640 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38b6ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.254+0000 7fbc83e00640 1 -- 172.21.15.79:0/830359277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 msgr2=0x5630b38b6590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:42:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.254+0000 7fbc83e00640 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38b6590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.254+0000 7fbc83e00640 1 -- 172.21.15.79:0/830359277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b38b73c0 con 0x5630b34ff1b0 2024-09-21T02:42:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.255+0000 7fbc83e00640 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38b5150 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00ed30 tx=0x7fbc7c01d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1930e16bcb7bc8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:32.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.255+0000 7fbc70c00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:42:32.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.256+0000 7fbc70c00640 1 -- 172.21.15.79:0/830359277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c01c770 con 0x5630b34ff1b0 2024-09-21T02:42:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.257+0000 7fbc70c00640 1 -- 172.21.15.79:0/830359277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fbc7c036070 con 0x5630b34ff1b0 2024-09-21T02:42:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.257+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc74040070 con 0x5630b34ff1b0 2024-09-21T02:42:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.257+0000 7fbc70c00640 1 -- 172.21.15.79:0/830359277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc7c01cd40 con 0x5630b34ff1b0 2024-09-21T02:42:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.258+0000 7fbc910a1740 10 client.15936 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.258+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5630b3928290 con 0x5630b34ff1b0 2024-09-21T02:42:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.258+0000 7fbc70c00640 1 -- 172.21.15.79:0/830359277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc74040070 con 0x5630b34ff1b0 2024-09-21T02:42:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.259+0000 7fbc70c00640 1 -- 172.21.15.79:0/830359277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc7c0056a0 con 0x5630b34ff1b0 2024-09-21T02:42:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.259+0000 7fbc910a1740 10 client.15936 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.259+0000 7fbc910a1740 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.259+0000 7fbc910a1740 20 client.15936 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.259+0000 7fbc910a1740 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34931c0 0x5630b392ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.259+0000 7fbc910a1740 4 client.15936 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:42:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.259+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630b38170b0 con 0x5630b34931c0 2024-09-21T02:42:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.261+0000 7fbc83400640 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34931c0 0x5630b392ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:32.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.263+0000 7fbc83400640 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34931c0 0x5630b392ac70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8b6473c8b284dd4 server_cookie=2699224804cf6bb4 in_seq=0 out_seq=0 2024-09-21T02:42:32.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.263+0000 7fbc70c00640 10 client.15936 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.380+0000 7fbc70c00640 1 -- 172.21.15.79:0/830359277 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630b38170b0 con 0x5630b34931c0 2024-09-21T02:42:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.380+0000 7fbc70c00640 10 client.15936 handle_command_reply: tid=0 2024-09-21T02:42:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 client.15936 shutdown 2024-09-21T02:42:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 msgr2=0x5630b38b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38b5150 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00ed30 tx=0x7fbc7c01d6c0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 shutdown_connections 2024-09-21T02:42:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5630b34931c0 0x5630b392ac70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b34ff1b0 0x5630b38b5150 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630b34de4d0 0x5630b38b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 --2- 172.21.15.79:0/830359277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b34d62f0 0x5630b38b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc70c00640 0 client.15936 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.381+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 >> 172.21.15.79:0/830359277 conn(0x5630b34f3300 msgr2=0x5630b38a5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.382+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 shutdown_connections 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.382+0000 7fbc910a1740 1 -- 172.21.15.79:0/830359277 wait complete. 2024-09-21T02:42:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.382+0000 7fbc910a1740 20 client.15936 trim_cache size 0 max 16384 2024-09-21T02:42:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:42:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:42:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:42:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.383+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbc680b6610 msgr2=0x7fbc680b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.383+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbc680b6610 0x7fbc680b8b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c007e10 tx=0x7fbc7c007680 comp rx=0 tx=0).stop 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.383+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 msgr2=0x7fbc8419c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.383+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 0x7fbc8419c020 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00b450 tx=0x7fbc6c00b910 comp rx=0 tx=0).stop 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 shutdown_connections 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fbc680b6610 0x7fbc680b8b20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc84104f00 0x7fbc8419d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc84104560 0x7fbc8419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 --2- 172.21.15.79:0/2570018708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc841034e0 0x7fbc8419c020 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 >> 172.21.15.79:0/2570018708 conn(0x7fbc840fee20 msgr2=0x7fbc840755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 shutdown_connections 2024-09-21T02:42:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:32.384+0000 7fbc88a00640 1 -- 172.21.15.79:0/2570018708 wait complete. 2024-09-21T02:42:33.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:32 smithi148 ceph-mon[34626]: pgmap v619: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 704 op/s 2024-09-21T02:42:33.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:32 smithi098 ceph-mon[34832]: pgmap v619: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 704 op/s 2024-09-21T02:42:33.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:32 smithi079 ceph-mon[30788]: pgmap v619: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 704 op/s 2024-09-21T02:42:35.033 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:34 smithi079 ceph-mon[30788]: pgmap v620: 129 pgs: 129 active+clean; 1.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-21T02:42:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:34 smithi148 ceph-mon[34626]: pgmap v620: 129 pgs: 129 active+clean; 1.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-21T02:42:35.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:34 smithi098 ceph-mon[34832]: pgmap v620: 129 pgs: 129 active+clean; 1.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-21T02:42:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 400.0 s, 909.6 tps, lat 109.424 ms stddev 132.198 2024-09-21T02:42:37.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:36 smithi148 ceph-mon[34626]: pgmap v621: 129 pgs: 129 active+clean; 1.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 674 op/s 2024-09-21T02:42:37.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:36 smithi098 ceph-mon[34832]: pgmap v621: 129 pgs: 129 active+clean; 1.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 674 op/s 2024-09-21T02:42:37.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:36 smithi079 ceph-mon[30788]: pgmap v621: 129 pgs: 129 active+clean; 1.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 674 op/s 2024-09-21T02:42:39.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:38 smithi148 ceph-mon[34626]: pgmap v622: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.2 MiB/s wr, 553 op/s 2024-09-21T02:42:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:38 smithi098 ceph-mon[34832]: pgmap v622: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.2 MiB/s wr, 553 op/s 2024-09-21T02:42:39.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:38 smithi079 ceph-mon[30788]: pgmap v622: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.2 MiB/s wr, 553 op/s 2024-09-21T02:42:41.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:40 smithi148 ceph-mon[34626]: pgmap v623: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 581 op/s 2024-09-21T02:42:41.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:40 smithi098 ceph-mon[34832]: pgmap v623: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 581 op/s 2024-09-21T02:42:41.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:40 smithi079 ceph-mon[30788]: pgmap v623: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 581 op/s 2024-09-21T02:42:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 405.0 s, 742.8 tps, lat 132.787 ms stddev 163.328 2024-09-21T02:42:43.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:42 smithi148 ceph-mon[34626]: pgmap v624: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-21T02:42:43.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:42 smithi098 ceph-mon[34832]: pgmap v624: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-21T02:42:43.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:42 smithi079 ceph-mon[30788]: pgmap v624: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-21T02:42:45.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:44 smithi148 ceph-mon[34626]: pgmap v625: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.1 MiB/s wr, 522 op/s 2024-09-21T02:42:45.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:44 smithi098 ceph-mon[34832]: pgmap v625: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.1 MiB/s wr, 522 op/s 2024-09-21T02:42:45.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:44 smithi079 ceph-mon[30788]: pgmap v625: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.1 MiB/s wr, 522 op/s 2024-09-21T02:42:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.698+0000 7f32e3200640 1 -- 172.21.15.79:0/2021823201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410a3c0 msgr2=0x7f32e410c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.698+0000 7f32e3200640 1 --2- 172.21.15.79:0/2021823201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410a3c0 0x7f32e410c7e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009ca0 tx=0x7f32d402a8d0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.703 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.702+0000 7f32e3200640 1 -- 172.21.15.79:0/2021823201 shutdown_connections 2024-09-21T02:42:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.702+0000 7f32e3200640 1 --2- 172.21.15.79:0/2021823201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e410f830 0x7f32e410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.702+0000 7f32e3200640 1 --2- 172.21.15.79:0/2021823201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32e410cd20 0x7f32e410f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.702+0000 7f32e3200640 1 --2- 172.21.15.79:0/2021823201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410a3c0 0x7f32e410c7e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.702+0000 7f32e3200640 1 -- 172.21.15.79:0/2021823201 >> 172.21.15.79:0/2021823201 conn(0x7f32e4070640 msgr2=0x7f32e4072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.702+0000 7f32e3200640 1 -- 172.21.15.79:0/2021823201 shutdown_connections 2024-09-21T02:42:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.702+0000 7f32e3200640 1 -- 172.21.15.79:0/2021823201 wait complete. 2024-09-21T02:42:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.704+0000 7f32e3200640 1 Processor -- start 2024-09-21T02:42:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.704+0000 7f32e3200640 1 -- start start 2024-09-21T02:42:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.704+0000 7f32e3200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32e410a3c0 0x7f32e41a8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410cd20 0x7f32e41a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e3200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e410f830 0x7f32e41a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e3200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32e411dff0 con 0x7f32e410f830 2024-09-21T02:42:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e3200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f32e411de70 con 0x7f32e410a3c0 2024-09-21T02:42:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e3200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f32e411e170 con 0x7f32e410cd20 2024-09-21T02:42:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410cd20 0x7f32e41a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410cd20 0x7f32e41a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39616/0 (socket says 172.21.15.79:39616) 2024-09-21T02:42:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e1400640 1 -- 172.21.15.79:0/2158063352 learned_addr learned my addr 172.21.15.79:0/2158063352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.705+0000 7f32e1e00640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32e410a3c0 0x7f32e41a8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.706+0000 7f32e2800640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e410f830 0x7f32e41a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.706+0000 7f32e1e00640 1 -- 172.21.15.79:0/2158063352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410cd20 msgr2=0x7f32e41a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.706+0000 7f32e1e00640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410cd20 0x7f32e41a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.706+0000 7f32e1e00640 1 -- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e410f830 msgr2=0x7f32e41a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.706+0000 7f32e1e00640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e410f830 0x7f32e41a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.706+0000 7f32e1e00640 1 -- 172.21.15.79:0/2158063352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e41aa650 con 0x7f32e410a3c0 2024-09-21T02:42:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.707+0000 7f32e1e00640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32e410a3c0 0x7f32e41a8c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009ca0 tx=0x7f32d4003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:45.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.707+0000 7f32daa00640 1 -- 172.21.15.79:0/2158063352 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4004240 con 0x7f32e410a3c0 2024-09-21T02:42:45.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.707+0000 7f32daa00640 1 -- 172.21.15.79:0/2158063352 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d4003e10 con 0x7f32e410a3c0 2024-09-21T02:42:45.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.707+0000 7f32daa00640 1 -- 172.21.15.79:0/2158063352 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4030e40 con 0x7f32e410a3c0 2024-09-21T02:42:45.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.708+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e41aa8e0 con 0x7f32e410a3c0 2024-09-21T02:42:45.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.708+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e41b1030 con 0x7f32e410a3c0 2024-09-21T02:42:45.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.714+0000 7f32daa00640 1 -- 172.21.15.79:0/2158063352 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f32d40305d0 con 0x7f32e410a3c0 2024-09-21T02:42:45.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.715+0000 7f32efa68740 1 Processor -- start 2024-09-21T02:42:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.718+0000 7f32efa68740 1 -- start start 2024-09-21T02:42:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32efa68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2255c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32efa68740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a2255c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32efa68740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221944d0 0x564a2255d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32efa68740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a224cf6b0 con 0x564a221944d0 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32efa68740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564a224beae0 con 0x564a2218c2f0 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32efa68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564a224c28f0 con 0x564a221b51b0 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a2255c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a2255c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:44846/0 (socket says 172.21.15.79:44846) 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.719+0000 7f32e1e00640 1 -- 172.21.15.79:0/1411401947 learned_addr learned my addr 172.21.15.79:0/1411401947 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.720+0000 7f32daa00640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32c80b6590 0x7f32c80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.720+0000 7f32e1400640 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221944d0 0x564a2255d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.720+0000 7f32daa00640 1 -- 172.21.15.79:0/2158063352 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f32d41089e0 con 0x7f32e410a3c0 2024-09-21T02:42:45.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.721+0000 7f32e1e00640 1 -- 172.21.15.79:0/1411401947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 msgr2=0x564a2255c2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:42:45.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.721+0000 7f32e1e00640 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2255c2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.721+0000 7f32e1e00640 1 -- 172.21.15.79:0/1411401947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221944d0 msgr2=0x564a2255d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:45.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.721+0000 7f32e1e00640 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221944d0 0x564a2255d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.721+0000 7f32e1e00640 1 -- 172.21.15.79:0/1411401947 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a2248b780 con 0x564a2218c2f0 2024-09-21T02:42:45.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.721+0000 7f32e2800640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32c80b6590 0x7f32c80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.722+0000 7f32e1e00640 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a2255c920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f32d4106130 tx=0x7f32d4030970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb108c8a2ab69eac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:45.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.723+0000 7f32cf000640 1 -- 172.21.15.79:0/1411401947 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40ce110 con 0x564a2218c2f0 2024-09-21T02:42:45.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.723+0000 7f32e2800640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32c80b6590 0x7f32c80b8aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00b770 tx=0x7f32dc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:45.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.723+0000 7f32cf000640 1 -- 172.21.15.79:0/1411401947 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d4036070 con 0x564a2218c2f0 2024-09-21T02:42:45.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.723+0000 7f32cf000640 1 -- 172.21.15.79:0/1411401947 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40cdf30 con 0x564a2218c2f0 2024-09-21T02:42:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.725+0000 7f32efa68740 1 -- 172.21.15.79:0/1411401947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 msgr2=0x564a2255c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.725+0000 7f32efa68740 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a2255c920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f32d4106130 tx=0x7f32d4030970 comp rx=0 tx=0).stop 2024-09-21T02:42:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.727+0000 7f32efa68740 1 -- 172.21.15.79:0/1411401947 shutdown_connections 2024-09-21T02:42:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.727+0000 7f32efa68740 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221944d0 0x564a2255d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.727+0000 7f32efa68740 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a2255c920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.727+0000 7f32efa68740 1 --2- 172.21.15.79:0/1411401947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2255c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.727+0000 7f32efa68740 1 -- 172.21.15.79:0/1411401947 >> 172.21.15.79:0/1411401947 conn(0x564a221a9300 msgr2=0x564a22557d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.727+0000 7f32efa68740 1 -- 172.21.15.79:0/1411401947 shutdown_connections 2024-09-21T02:42:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.727+0000 7f32efa68740 1 -- 172.21.15.79:0/1411401947 wait complete. 2024-09-21T02:42:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.728+0000 7f32efa68740 1 -- start start 2024-09-21T02:42:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.728+0000 7f32efa68740 1 Processor -- start 2024-09-21T02:42:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.729+0000 7f32efa68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a2218c2f0 0x564a225766f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.729+0000 7f32efa68740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a22576db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.729+0000 7f32efa68740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22577920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32e2800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22577920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32efa68740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a223f6ab0 con 0x564a221b51b0 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32efa68740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564a22465570 con 0x564a221944d0 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32efa68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564a2255dd50 con 0x564a2218c2f0 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a2218c2f0 0x564a225766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a2218c2f0 0x564a225766f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39624/0 (socket says 172.21.15.79:39624) 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32e1e00640 1 -- 172.21.15.79:0/3431622324 learned_addr learned my addr 172.21.15.79:0/3431622324 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.730+0000 7f32efa68740 10 client.0 _ll_register_callbacks cb 0x564a22474100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.731+0000 7f32e1400640 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a22576db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.731+0000 7f32e2800640 1 -- 172.21.15.79:0/3431622324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a2218c2f0 msgr2=0x564a225766f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.731+0000 7f32e2800640 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a2218c2f0 0x564a225766f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.731+0000 7f32e2800640 1 -- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 msgr2=0x564a22576db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.731+0000 7f32e2800640 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a22576db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.731+0000 7f32e2800640 1 -- 172.21.15.79:0/3431622324 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a22220790 con 0x564a221b51b0 2024-09-21T02:42:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.732+0000 7f32e2800640 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22577920 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00d160 tx=0x7f32dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b41813dc6404b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.732+0000 7f32c3400640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:42:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.733+0000 7f32c3400640 1 -- 172.21.15.79:0/3431622324 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc022030 con 0x564a221b51b0 2024-09-21T02:42:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.733+0000 7f32c3400640 1 -- 172.21.15.79:0/3431622324 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f32dc00f040 con 0x564a221b51b0 2024-09-21T02:42:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.733+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d4036070 con 0x564a221b51b0 2024-09-21T02:42:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.734+0000 7f32c3400640 1 -- 172.21.15.79:0/3431622324 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f32dc01a040 con 0x564a221b51b0 2024-09-21T02:42:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.734+0000 7f32efa68740 10 client.15945 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.734+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564a22299620 con 0x564a221b51b0 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32c3400640 1 -- 172.21.15.79:0/3431622324 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d4036070 con 0x564a221b51b0 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32c3400640 1 -- 172.21.15.79:0/3431622324 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f32dc01d030 con 0x564a221b51b0 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32efa68740 10 client.15945 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32efa68740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32efa68740 20 client.15945 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32efa68740 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a22173d80 0x564a22583f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32efa68740 4 client.15945 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.735+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a224d1600 con 0x564a22173d80 2024-09-21T02:42:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.736+0000 7f32e1e00640 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a22173d80 0x564a22583f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.737+0000 7f32e1e00640 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a22173d80 0x564a22583f50 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6646827e2529e393 server_cookie=1a3058a54f56acdb in_seq=0 out_seq=0 2024-09-21T02:42:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.737+0000 7f32c3400640 10 client.15945 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.737+0000 7f32c3400640 1 -- 172.21.15.79:0/3431622324 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a224d1600 con 0x564a22173d80 2024-09-21T02:42:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.738+0000 7f32c3400640 10 client.15945 handle_command_reply: tid=0 2024-09-21T02:42:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.738+0000 7f32efa68740 1 client.15945 shutdown 2024-09-21T02:42:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.738+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 msgr2=0x564a22577920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.738+0000 7f32efa68740 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22577920 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00d160 tx=0x7f32dc004770 comp rx=0 tx=0).stop 2024-09-21T02:42:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 shutdown_connections 2024-09-21T02:42:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32efa68740 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a22173d80 0x564a22583f50 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32efa68740 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22577920 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32efa68740 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a22576db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32efa68740 1 --2- 172.21.15.79:0/3431622324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a2218c2f0 0x564a225766f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 >> 172.21.15.79:0/3431622324 conn(0x564a221a9300 msgr2=0x564a22556360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32c3400640 0 client.15945 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.739+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 shutdown_connections 2024-09-21T02:42:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.740+0000 7f32efa68740 1 -- 172.21.15.79:0/3431622324 wait complete. 2024-09-21T02:42:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.740+0000 7f32efa68740 20 client.15945 trim_cache size 0 max 16384 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.784+0000 7f32efa68740 1 Processor -- start 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.784+0000 7f32efa68740 1 -- start start 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.785+0000 7f32efa68740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a22577e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.785+0000 7f32efa68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221944d0 0x564a225758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.785+0000 7f32efa68740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22558740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.785+0000 7f32efa68740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32e4119cf0 con 0x564a221b51b0 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.785+0000 7f32efa68740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f32e41b3470 con 0x564a2218c2f0 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.785+0000 7f32efa68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f32e41b1280 con 0x564a221944d0 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.785+0000 7f32e1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221944d0 0x564a225758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.786+0000 7f32e1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221944d0 0x564a225758f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39632/0 (socket says 172.21.15.79:39632) 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.786+0000 7f32e1400640 1 -- 172.21.15.79:0/1048941514 learned_addr learned my addr 172.21.15.79:0/1048941514 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.786+0000 7f32e1e00640 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a22577e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.786+0000 7f32e1400640 1 -- 172.21.15.79:0/1048941514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 msgr2=0x564a22577e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.786+0000 7f32e1400640 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a22577e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.786+0000 7f32e1400640 1 -- 172.21.15.79:0/1048941514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 msgr2=0x564a22558740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.786+0000 7f32e1400640 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22558740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.787+0000 7f32e1400640 1 -- 172.21.15.79:0/1048941514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a22558470 con 0x564a221944d0 2024-09-21T02:42:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.787+0000 7f32e1400640 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221944d0 0x564a225758f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009e40 tx=0x7f32d0010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1bb92a97c4878b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.788+0000 7f32ce600640 1 -- 172.21.15.79:0/1048941514 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d003d410 con 0x564a221944d0 2024-09-21T02:42:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.788+0000 7f32ce600640 1 -- 172.21.15.79:0/1048941514 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d003da60 con 0x564a221944d0 2024-09-21T02:42:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.788+0000 7f32ce600640 1 -- 172.21.15.79:0/1048941514 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d000f9c0 con 0x564a221944d0 2024-09-21T02:42:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.790+0000 7f32efa68740 1 -- 172.21.15.79:0/1048941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221944d0 msgr2=0x564a225758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.790+0000 7f32efa68740 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221944d0 0x564a225758f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009e40 tx=0x7f32d0010800 comp rx=0 tx=0).stop 2024-09-21T02:42:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.791+0000 7f32efa68740 1 -- 172.21.15.79:0/1048941514 shutdown_connections 2024-09-21T02:42:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.791+0000 7f32efa68740 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a221b51b0 0x564a22558740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.791+0000 7f32efa68740 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221944d0 0x564a225758f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.791+0000 7f32efa68740 1 --2- 172.21.15.79:0/1048941514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a2218c2f0 0x564a22577e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.791+0000 7f32efa68740 1 -- 172.21.15.79:0/1048941514 >> 172.21.15.79:0/1048941514 conn(0x564a221a9300 msgr2=0x564a2255d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.791+0000 7f32efa68740 1 -- 172.21.15.79:0/1048941514 shutdown_connections 2024-09-21T02:42:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.792+0000 7f32efa68740 1 -- 172.21.15.79:0/1048941514 wait complete. 2024-09-21T02:42:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.792+0000 7f32efa68740 1 -- start start 2024-09-21T02:42:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.792+0000 7f32efa68740 1 Processor -- start 2024-09-21T02:42:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.794+0000 7f32efa68740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a2218c2f0 0x564a2257e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.794+0000 7f32efa68740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a2257d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32efa68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2257db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32efa68740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32e41b1930 con 0x564a2218c2f0 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32efa68740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f32e41b2da0 con 0x564a221944d0 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32efa68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f32e41b2000 con 0x564a221b51b0 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a2218c2f0 0x564a2257e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32efa68740 10 client.0 _ll_register_callbacks cb 0x7f32dc00b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32e2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2257db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32e1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a2257d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32e2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2257db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:39648/0 (socket says 172.21.15.79:39648) 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a2218c2f0 0x564a2257e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36840/0 (socket says 172.21.15.79:36840) 2024-09-21T02:42:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.795+0000 7f32e1e00640 1 -- 172.21.15.79:0/677823424 learned_addr learned my addr 172.21.15.79:0/677823424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.797+0000 7f32e2800640 1 -- 172.21.15.79:0/677823424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 msgr2=0x564a2257d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.797+0000 7f32e2800640 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a2257d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.797+0000 7f32e2800640 1 -- 172.21.15.79:0/677823424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a2218c2f0 msgr2=0x564a2257e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.797+0000 7f32e2800640 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a2218c2f0 0x564a2257e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.797+0000 7f32e2800640 1 -- 172.21.15.79:0/677823424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a2257bf70 con 0x564a221b51b0 2024-09-21T02:42:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.798+0000 7f32e2800640 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2257db00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00d200 tx=0x7f32dc01e810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1209fa70523f1dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.798+0000 7f32c3400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:42:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.801+0000 7f32c3400640 1 -- 172.21.15.79:0/677823424 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc035060 con 0x564a221b51b0 2024-09-21T02:42:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.802+0000 7f32c3400640 1 -- 172.21.15.79:0/677823424 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f32dc02d070 con 0x564a221b51b0 2024-09-21T02:42:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.805+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d003da60 con 0x564a221b51b0 2024-09-21T02:42:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.806+0000 7f32c3400640 1 -- 172.21.15.79:0/677823424 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f32dc022070 con 0x564a221b51b0 2024-09-21T02:42:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.807+0000 7f32efa68740 10 client.26131 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.807+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564a225eeb00 con 0x564a221b51b0 2024-09-21T02:42:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.807+0000 7f32c3400640 1 -- 172.21.15.79:0/677823424 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32d003da60 con 0x564a221b51b0 2024-09-21T02:42:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.809+0000 7f32c3400640 1 -- 172.21.15.79:0/677823424 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f32dc01d040 con 0x564a221b51b0 2024-09-21T02:42:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.809+0000 7f32efa68740 10 client.26131 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.809+0000 7f32efa68740 10 client.26131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.809+0000 7f32efa68740 20 client.26131 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.809+0000 7f32efa68740 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a221491c0 0x564a225f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.809+0000 7f32efa68740 4 client.26131 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:42:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.810+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a224cd0b0 con 0x564a221491c0 2024-09-21T02:42:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.811+0000 7f32e1e00640 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a221491c0 0x564a225f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.812+0000 7f32e1e00640 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a221491c0 0x564a225f14a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86dcee6b09e001cf server_cookie=a0fe83a9c6f47dd3 in_seq=0 out_seq=0 2024-09-21T02:42:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:45.812+0000 7f32c3400640 10 client.26131 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 410.0 s, 491.8 tps, lat 205.681 ms stddev 301.851 2024-09-21T02:42:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.588+0000 7f32c3400640 1 -- 172.21.15.79:0/677823424 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a224cd0b0 con 0x564a221491c0 2024-09-21T02:42:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.588+0000 7f32c3400640 10 client.26131 handle_command_reply: tid=0 2024-09-21T02:42:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.588+0000 7f32efa68740 1 client.26131 shutdown 2024-09-21T02:42:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 msgr2=0x564a2257db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2257db00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00d200 tx=0x7f32dc01e810 comp rx=0 tx=0).stop 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 shutdown_connections 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564a221491c0 0x564a225f14a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a221b51b0 0x564a2257db00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a221944d0 0x564a2257d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32c3400640 0 client.26131 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 --2- 172.21.15.79:0/677823424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a2218c2f0 0x564a2257e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.589+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 >> 172.21.15.79:0/677823424 conn(0x564a221a9300 msgr2=0x564a22563860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.590+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 shutdown_connections 2024-09-21T02:42:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.590+0000 7f32efa68740 1 -- 172.21.15.79:0/677823424 wait complete. 2024-09-21T02:42:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.590+0000 7f32efa68740 20 client.26131 trim_cache size 0 max 16384 2024-09-21T02:42:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:42:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:42:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:42:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:42:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.591+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32c80b6590 msgr2=0x7f32c80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.591+0000 7f32e3200640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32c80b6590 0x7f32c80b8aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00b770 tx=0x7f32dc008040 comp rx=0 tx=0).stop 2024-09-21T02:42:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.591+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32e410a3c0 msgr2=0x7f32e41a8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.591+0000 7f32e3200640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32e410a3c0 0x7f32e41a8c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009ca0 tx=0x7f32d4003c20 comp rx=0 tx=0).stop 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 shutdown_connections 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f32c80b6590 0x7f32c80b8aa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e410f830 0x7f32e41a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e410cd20 0x7f32e41a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 --2- 172.21.15.79:0/2158063352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32e410a3c0 0x7f32e41a8c10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 >> 172.21.15.79:0/2158063352 conn(0x7f32e4070640 msgr2=0x7f32e410b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 shutdown_connections 2024-09-21T02:42:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:46.592+0000 7f32e3200640 1 -- 172.21.15.79:0/2158063352 wait complete. 2024-09-21T02:42:47.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:46 smithi148 ceph-mon[34626]: pgmap v626: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-09-21T02:42:47.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:46 smithi098 ceph-mon[34832]: pgmap v626: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-09-21T02:42:47.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:46 smithi079 ceph-mon[30788]: pgmap v626: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-09-21T02:42:49.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:48 smithi148 ceph-mon[34626]: pgmap v627: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 13 MiB/s wr, 952 op/s 2024-09-21T02:42:49.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:48 smithi098 ceph-mon[34832]: pgmap v627: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 13 MiB/s wr, 952 op/s 2024-09-21T02:42:49.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:48 smithi079 ceph-mon[30788]: pgmap v627: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 13 MiB/s wr, 952 op/s 2024-09-21T02:42:51.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:50 smithi098 ceph-mon[34832]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-21T02:42:51.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:50 smithi079 ceph-mon[30788]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-21T02:42:51.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:50 smithi148 ceph-mon[34626]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-21T02:42:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 415.0 s, 784.1 tps, lat 127.973 ms stddev 189.258 2024-09-21T02:42:53.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:52 smithi098 ceph-mon[34832]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2024-09-21T02:42:53.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:52 smithi079 ceph-mon[30788]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2024-09-21T02:42:53.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:52 smithi148 ceph-mon[34626]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2024-09-21T02:42:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:55 smithi148 ceph-mon[34626]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2024-09-21T02:42:55.858 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:55 smithi098 ceph-mon[34832]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2024-09-21T02:42:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:55 smithi079 ceph-mon[30788]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2024-09-21T02:42:56.494 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 420.0 s, 685.6 tps, lat 148.159 ms stddev 180.499 2024-09-21T02:42:57.215 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T02:42:57.215 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T02:42:57.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:42:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:57 smithi079 ceph-mon[30788]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2024-09-21T02:42:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:57 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:42:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:57 smithi148 ceph-mon[34626]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2024-09-21T02:42:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:57 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:42:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:57 smithi098 ceph-mon[34832]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2024-09-21T02:42:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:57 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:42:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:58.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 -- 172.21.15.79:0/1810705453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2028105bc0 msgr2=0x7f2028105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:58.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 --2- 172.21.15.79:0/1810705453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2028105bc0 0x7f2028105fd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2018009900 tx=0x7f201802a420 comp rx=0 tx=0).stop 2024-09-21T02:42:58.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 -- 172.21.15.79:0/1810705453 shutdown_connections 2024-09-21T02:42:58.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 --2- 172.21.15.79:0/1810705453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810be50 0x7f2028112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:58.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 --2- 172.21.15.79:0/1810705453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202810b500 0x7f202810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:58.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 --2- 172.21.15.79:0/1810705453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2028105bc0 0x7f2028105fd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:58.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 -- 172.21.15.79:0/1810705453 >> 172.21.15.79:0/1810705453 conn(0x7f2028101630 msgr2=0x7f2028103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:58.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.815+0000 7f202e800640 1 -- 172.21.15.79:0/1810705453 shutdown_connections 2024-09-21T02:42:58.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.816+0000 7f202e800640 1 -- 172.21.15.79:0/1810705453 wait complete. 2024-09-21T02:42:58.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.818+0000 7f202e800640 1 Processor -- start 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.818+0000 7f202e800640 1 -- start start 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.819+0000 7f202e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2028105bc0 0x7f202807b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.819+0000 7f202e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810b500 0x7f2028077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.819+0000 7f202e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f202810be50 0x7f2028078040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.819+0000 7f202e800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2028115bc0 con 0x7f2028105bc0 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.819+0000 7f202e800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2028115a40 con 0x7f202810be50 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.819+0000 7f202e800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2028115d40 con 0x7f202810b500 2024-09-21T02:42:58.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202ca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810b500 0x7f2028077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202ca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810b500 0x7f2028077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48598/0 (socket says 172.21.15.79:48598) 2024-09-21T02:42:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202ca00640 1 -- 172.21.15.79:0/3609354508 learned_addr learned my addr 172.21.15.79:0/3609354508 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202de00640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f202810be50 0x7f2028078040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202ca00640 1 -- 172.21.15.79:0/3609354508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f202810be50 msgr2=0x7f2028078040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202ca00640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f202810be50 0x7f2028078040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:58.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202ca00640 1 -- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2028105bc0 msgr2=0x7f202807b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:58.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.820+0000 7f202ca00640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2028105bc0 0x7f202807b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:58.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.821+0000 7f202ca00640 1 -- 172.21.15.79:0/3609354508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20281acb00 con 0x7f202810b500 2024-09-21T02:42:58.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.821+0000 7f202de00640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f202810be50 0x7f2028078040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.822+0000 7f202ca00640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810b500 0x7f2028077920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f201400e9f0 tx=0x7f201400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.823+0000 7f2026000640 1 -- 172.21.15.79:0/3609354508 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201400ccc0 con 0x7f202810b500 2024-09-21T02:42:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.823+0000 7f2026000640 1 -- 172.21.15.79:0/3609354508 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20140108e0 con 0x7f202810b500 2024-09-21T02:42:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.823+0000 7f2026000640 1 -- 172.21.15.79:0/3609354508 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014018860 con 0x7f202810b500 2024-09-21T02:42:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.823+0000 7f202e800640 1 -- 172.21.15.79:0/3609354508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20281acd30 con 0x7f202810b500 2024-09-21T02:42:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.824+0000 7f202e800640 1 -- 172.21.15.79:0/3609354508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20281ad1c0 con 0x7f202810b500 2024-09-21T02:42:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.826+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2028105fd0 con 0x7f202810b500 2024-09-21T02:42:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.834+0000 7f2026000640 1 -- 172.21.15.79:0/3609354508 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2014010430 con 0x7f202810b500 2024-09-21T02:42:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.837+0000 7f2026000640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f200c0b66a0 0x7f200c0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.837+0000 7f2026000640 1 -- 172.21.15.79:0/3609354508 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f20140e7b50 con 0x7f202810b500 2024-09-21T02:42:58.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.838+0000 7f202d400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f200c0b66a0 0x7f200c0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:58.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.839+0000 7f202d400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f200c0b66a0 0x7f200c0b8bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f20180096c0 tx=0x7f2018000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:58.840+0000 7f2026000640 1 -- 172.21.15.79:0/3609354508 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20140ae030 con 0x7f202810b500 2024-09-21T02:42:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.245+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2028078c20 con 0x7f202810b500 2024-09-21T02:42:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.246+0000 7f2026000640 1 -- 172.21.15.79:0/3609354508 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f20140b2410 con 0x7f202810b500 2024-09-21T02:42:59.248 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:42:59.248 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:42:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:42:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.250+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f200c0b66a0 msgr2=0x7f200c0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.250+0000 7f201f400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f200c0b66a0 0x7f200c0b8bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f20180096c0 tx=0x7f2018000bc0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.250+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810b500 msgr2=0x7f2028077920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.250+0000 7f201f400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810b500 0x7f2028077920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f201400e9f0 tx=0x7f201400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 shutdown_connections 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f200c0b66a0 0x7f200c0b8bb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f202810be50 0x7f2028078040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f202810b500 0x7f2028077920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 --2- 172.21.15.79:0/3609354508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2028105bc0 0x7f202807b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 >> 172.21.15.79:0/3609354508 conn(0x7f2028101630 msgr2=0x7f2028103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 shutdown_connections 2024-09-21T02:42:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:42:59.251+0000 7f201f400640 1 -- 172.21.15.79:0/3609354508 wait complete. 2024-09-21T02:42:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:59 smithi148 ceph-mon[34626]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-21T02:42:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:42:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:42:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:42:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:42:59 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3609354508' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:59 smithi098 ceph-mon[34832]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-21T02:42:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:42:59.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:42:59.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:42:59.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:42:59 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3609354508' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 -- 172.21.15.79:0/2550397898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 msgr2=0x7f722c103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 --2- 172.21.15.79:0/2550397898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 0x7f722c103950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f721c009ca0 tx=0x7f721c02a8d0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 -- 172.21.15.79:0/2550397898 shutdown_connections 2024-09-21T02:42:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 --2- 172.21.15.79:0/2550397898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f722c104f00 0x7f722c10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 --2- 172.21.15.79:0/2550397898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c104560 0x7f722c104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 --2- 172.21.15.79:0/2550397898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 0x7f722c103950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 -- 172.21.15.79:0/2550397898 >> 172.21.15.79:0/2550397898 conn(0x7f722c0fee20 msgr2=0x7f722c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 -- 172.21.15.79:0/2550397898 shutdown_connections 2024-09-21T02:42:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.909+0000 7f7230c00640 1 -- 172.21.15.79:0/2550397898 wait complete. 2024-09-21T02:42:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.911+0000 7f7230c00640 1 Processor -- start 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.911+0000 7f7230c00640 1 -- start start 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.911+0000 7f7230c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 0x7f722c19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.912+0000 7f7230c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f722c104560 0x7f722c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.912+0000 7f7230c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c104f00 0x7f722c19d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.912+0000 7f7230c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10f100 con 0x7f722c104560 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.912+0000 7f7230c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10ef80 con 0x7f722c104f00 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.912+0000 7f7230c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10f280 con 0x7f722c1034e0 2024-09-21T02:42:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.912+0000 7f7222a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f722c104560 0x7f722c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.913+0000 7f722be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c104f00 0x7f722c19d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.913+0000 7f722be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c104f00 0x7f722c19d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54828/0 (socket says 172.21.15.79:54828) 2024-09-21T02:42:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.913+0000 7f722be00640 1 -- 172.21.15.79:0/2601790056 learned_addr learned my addr 172.21.15.79:0/2601790056 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.913+0000 7f722b400640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 0x7f722c19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.914+0000 7f722b400640 1 -- 172.21.15.79:0/2601790056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c104f00 msgr2=0x7f722c19d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.914+0000 7f722b400640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c104f00 0x7f722c19d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.914+0000 7f722b400640 1 -- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f722c104560 msgr2=0x7f722c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.914+0000 7f722b400640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f722c104560 0x7f722c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.914+0000 7f722b400640 1 -- 172.21.15.79:0/2601790056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c19d9a0 con 0x7f722c1034e0 2024-09-21T02:42:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.914+0000 7f7222a00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f722c104560 0x7f722c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.915+0000 7f722b400640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 0x7f722c19bf60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f721c02adf0 tx=0x7f721c030800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.915+0000 7f7228c00640 1 -- 172.21.15.79:0/2601790056 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c030e00 con 0x7f722c1034e0 2024-09-21T02:42:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.915+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c19dc30 con 0x7f722c1034e0 2024-09-21T02:42:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.915+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c1a4380 con 0x7f722c1034e0 2024-09-21T02:42:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.915+0000 7f7228c00640 1 -- 172.21.15.79:0/2601790056 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f721c003e20 con 0x7f722c1034e0 2024-09-21T02:42:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.915+0000 7f7228c00640 1 -- 172.21.15.79:0/2601790056 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c03b400 con 0x7f722c1034e0 2024-09-21T02:42:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.919+0000 7f72392cd740 1 Processor -- start 2024-09-21T02:42:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.920+0000 7f72392cd740 1 -- start start 2024-09-21T02:42:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.920+0000 7f72392cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdcb21b0 0x5591fe0592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.920+0000 7f72392cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe059920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.920+0000 7f72392cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc914d0 0x5591fe05a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.920+0000 7f72392cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5591fdfcc6b0 con 0x5591fdc892f0 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.920+0000 7f72392cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5591fdfbbae0 con 0x5591fdc914d0 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.920+0000 7f72392cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5591fdfbf8f0 con 0x5591fdcb21b0 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f7228c00640 1 -- 172.21.15.79:0/2601790056 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f721c03b5c0 con 0x7f722c1034e0 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f722be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdcb21b0 0x5591fe0592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f722be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdcb21b0 0x5591fe0592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48622/0 (socket says 172.21.15.79:48622) 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f722be00640 1 -- 172.21.15.79:0/1046002255 learned_addr learned my addr 172.21.15.79:0/1046002255 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f7222a00640 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc914d0 0x5591fe05a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f722be00640 1 -- 172.21.15.79:0/1046002255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc914d0 msgr2=0x5591fe05a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f722be00640 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc914d0 0x5591fe05a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f722be00640 1 -- 172.21.15.79:0/1046002255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 msgr2=0x5591fe059920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.921+0000 7f722b400640 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe059920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.922+0000 7f722be00640 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe059920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.922+0000 7f722be00640 1 -- 172.21.15.79:0/1046002255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591fdf88780 con 0x5591fdcb21b0 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.922+0000 7f7222a00640 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc914d0 0x5591fe05a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.922+0000 7f722b400640 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe059920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.922+0000 7f722be00640 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdcb21b0 0x5591fe0592b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7224009d90 tx=0x7f7224011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc466cbb1633bda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.922+0000 7f721be00640 1 -- 172.21.15.79:0/1046002255 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722401e070 con 0x5591fdcb21b0 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.923+0000 7f721be00640 1 -- 172.21.15.79:0/1046002255 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7224019ae0 con 0x5591fdcb21b0 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.923+0000 7f721be00640 1 -- 172.21.15.79:0/1046002255 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722401e070 con 0x5591fdcb21b0 2024-09-21T02:42:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.923+0000 7f7228c00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72100b6590 0x7f72100b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.924+0000 7f7228c00640 1 -- 172.21.15.79:0/2601790056 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f721c1080a0 con 0x7f722c1034e0 2024-09-21T02:42:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.924+0000 7f72392cd740 1 -- 172.21.15.79:0/1046002255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdcb21b0 msgr2=0x5591fe0592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.924+0000 7f72392cd740 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdcb21b0 0x5591fe0592b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7224009d90 tx=0x7f7224011810 comp rx=0 tx=0).stop 2024-09-21T02:42:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.924+0000 7f722b400640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72100b6590 0x7f72100b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.925+0000 7f72392cd740 1 -- 172.21.15.79:0/1046002255 shutdown_connections 2024-09-21T02:42:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.925+0000 7f72392cd740 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc914d0 0x5591fe05a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.925+0000 7f72392cd740 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe059920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.925+0000 7f72392cd740 1 --2- 172.21.15.79:0/1046002255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdcb21b0 0x5591fe0592b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.925+0000 7f72392cd740 1 -- 172.21.15.79:0/1046002255 >> 172.21.15.79:0/1046002255 conn(0x5591fdca6300 msgr2=0x5591fe054d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.926+0000 7f722b400640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72100b6590 0x7f72100b8aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f721c0cdec0 tx=0x7f721c03d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.926+0000 7f72392cd740 1 -- 172.21.15.79:0/1046002255 shutdown_connections 2024-09-21T02:42:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.926+0000 7f72392cd740 1 -- 172.21.15.79:0/1046002255 wait complete. 2024-09-21T02:42:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.927+0000 7f72392cd740 1 -- start start 2024-09-21T02:42:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.927+0000 7f72392cd740 1 Processor -- start 2024-09-21T02:42:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.928+0000 7f72392cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.928+0000 7f72392cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.928+0000 7f72392cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 0x5591fe07d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.928+0000 7f722be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.928+0000 7f722be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54832/0 (socket says 172.21.15.79:54832) 2024-09-21T02:42:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.928+0000 7f722be00640 1 -- 172.21.15.79:0/1130963557 learned_addr learned my addr 172.21.15.79:0/1130963557 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:42:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.928+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5591fdef3ab0 con 0x5591fdcb21b0 2024-09-21T02:42:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.929+0000 7f7222a00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.929+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5591fdf62570 con 0x5591fdc892f0 2024-09-21T02:42:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.929+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5591fe05af90 con 0x5591fdc914d0 2024-09-21T02:42:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.929+0000 7f72392cd740 10 client.0 _ll_register_callbacks cb 0x5591fdf71100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.929+0000 7f722be00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 0x5591fe07d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f722be00640 1 -- 172.21.15.79:0/1130963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 msgr2=0x5591fe07c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f722be00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe07c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f722be00640 1 -- 172.21.15.79:0/1130963557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 msgr2=0x5591fe07d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f722be00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 0x5591fe07d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f722be00640 1 -- 172.21.15.79:0/1130963557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591fdd1d790 con 0x5591fdc892f0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f7222a00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe07c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f722be00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07c200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f722400f470 tx=0x7f722400f4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb6cd90580ac990 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f7218c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.930+0000 7f7218c00640 1 -- 172.21.15.79:0/1130963557 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722402d060 con 0x5591fdc892f0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.931+0000 7f7218c00640 1 -- 172.21.15.79:0/1130963557 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7224005460 con 0x5591fdc892f0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.931+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7224019ae0 con 0x5591fdc892f0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.931+0000 7f7218c00640 1 -- 172.21.15.79:0/1130963557 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7224034050 con 0x5591fdc892f0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.931+0000 7f72392cd740 10 client.26132 fetch_fsmap learned FSMap version 21 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.931+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5591fdd96620 con 0x5591fdc892f0 2024-09-21T02:42:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.931+0000 7f7218c00640 1 -- 172.21.15.79:0/1130963557 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7224019ae0 con 0x5591fdc892f0 2024-09-21T02:42:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.931+0000 7f7218c00640 1 -- 172.21.15.79:0/1130963557 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7224024070 con 0x5591fdc892f0 2024-09-21T02:42:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.932+0000 7f72392cd740 10 client.26132 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:42:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.932+0000 7f72392cd740 10 client.26132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.932+0000 7f72392cd740 20 client.26132 populate_metadata read hostname 'smithi079' 2024-09-21T02:42:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.932+0000 7f72392cd740 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc70d80 0x5591fe0895e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.932+0000 7f72392cd740 4 client.26132 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.932+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591fdfce600 con 0x5591fdc70d80 2024-09-21T02:42:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.932+0000 7f7222a00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc70d80 0x5591fe0895e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.934+0000 7f7222a00640 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc70d80 0x5591fe0895e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd26e8d99669ac3b server_cookie=115b22cd272749b6 in_seq=0 out_seq=0 2024-09-21T02:42:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.934+0000 7f7218c00640 10 client.26132 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.937+0000 7f7218c00640 1 -- 172.21.15.79:0/1130963557 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591fdfce600 con 0x5591fdc70d80 2024-09-21T02:42:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.937+0000 7f7218c00640 10 client.26132 handle_command_reply: tid=0 2024-09-21T02:42:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.937+0000 7f72392cd740 1 client.26132 shutdown 2024-09-21T02:42:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.937+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 msgr2=0x5591fe07c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.937+0000 7f72392cd740 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07c200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f722400f470 tx=0x7f722400f4d0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 shutdown_connections 2024-09-21T02:42:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f72392cd740 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc70d80 0x5591fe0895e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f72392cd740 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 0x5591fe07d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f72392cd740 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe07c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f72392cd740 1 --2- 172.21.15.79:0/1130963557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07c200 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 >> 172.21.15.79:0/1130963557 conn(0x5591fdca6300 msgr2=0x5591fe053360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f7218c00640 0 client.26132 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:42:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.938+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 shutdown_connections 2024-09-21T02:42:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.941+0000 7f72392cd740 1 -- 172.21.15.79:0/1130963557 wait complete. 2024-09-21T02:42:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.941+0000 7f72392cd740 20 client.26132 trim_cache size 0 max 16384 2024-09-21T02:42:59.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:59 smithi079 ceph-mon[30788]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-21T02:42:59.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:42:59.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:42:59.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:42:59.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:42:59 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3609354508' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.996+0000 7f72392cd740 1 Processor -- start 2024-09-21T02:42:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f72392cd740 1 -- start start 2024-09-21T02:42:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f72392cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f72392cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe05db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f72392cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 0x5591fe0556c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f72392cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f722c070b90 con 0x5591fdcb21b0 2024-09-21T02:42:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f72392cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f722c0733f0 con 0x5591fdc892f0 2024-09-21T02:42:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f72392cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f722c0711e0 con 0x5591fdc914d0 2024-09-21T02:42:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f7222a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe05db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f7222a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe05db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48652/0 (socket says 172.21.15.79:48652) 2024-09-21T02:43:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.997+0000 7f7222a00640 1 -- 172.21.15.79:0/3459617340 learned_addr learned my addr 172.21.15.79:0/3459617340 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.998+0000 7f722be00640 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.998+0000 7f7222a00640 1 -- 172.21.15.79:0/3459617340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 msgr2=0x5591fe07b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.998+0000 7f7222a00640 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.998+0000 7f7222a00640 1 -- 172.21.15.79:0/3459617340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 msgr2=0x5591fe0556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.998+0000 7f7222a00640 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 0x5591fe0556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.998+0000 7f7222a00640 1 -- 172.21.15.79:0/3459617340 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591fe05e050 con 0x5591fdc914d0 2024-09-21T02:43:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.999+0000 7f7222a00640 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe05db10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7214012740 tx=0x7f721400f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f519d7f3130dbab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:42:59.999+0000 7f721b400640 1 -- 172.21.15.79:0/3459617340 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7214021040 con 0x5591fdc914d0 2024-09-21T02:43:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.000+0000 7f721b400640 1 -- 172.21.15.79:0/3459617340 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f721400fe30 con 0x5591fdc914d0 2024-09-21T02:43:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.000+0000 7f721b400640 1 -- 172.21.15.79:0/3459617340 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7214003e50 con 0x5591fdc914d0 2024-09-21T02:43:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.002+0000 7f72392cd740 1 -- 172.21.15.79:0/3459617340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 msgr2=0x5591fe05db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.002+0000 7f72392cd740 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe05db10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7214012740 tx=0x7f721400f7f0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.003+0000 7f72392cd740 1 -- 172.21.15.79:0/3459617340 shutdown_connections 2024-09-21T02:43:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.003+0000 7f72392cd740 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdcb21b0 0x5591fe0556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.003+0000 7f72392cd740 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe05db10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.003+0000 7f72392cd740 1 --2- 172.21.15.79:0/3459617340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdc892f0 0x5591fe07b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.003+0000 7f72392cd740 1 -- 172.21.15.79:0/3459617340 >> 172.21.15.79:0/3459617340 conn(0x5591fdca6300 msgr2=0x5591fe05d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.003+0000 7f72392cd740 1 -- 172.21.15.79:0/3459617340 shutdown_connections 2024-09-21T02:43:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.003+0000 7f72392cd740 1 -- 172.21.15.79:0/3459617340 wait complete. 2024-09-21T02:43:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.004+0000 7f72392cd740 1 -- start start 2024-09-21T02:43:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.004+0000 7f72392cd740 1 Processor -- start 2024-09-21T02:43:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.005+0000 7f72392cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe0842b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.006+0000 7f72392cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe083030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.006+0000 7f72392cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdcb21b0 0x5591fe083790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.006+0000 7f722be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe0842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.006+0000 7f722be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe0842b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38438/0 (socket says 172.21.15.79:38438) 2024-09-21T02:43:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.007+0000 7f7222a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe083030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.007+0000 7f722be00640 1 -- 172.21.15.79:0/1182329920 learned_addr learned my addr 172.21.15.79:0/1182329920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.007+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f722c0718b0 con 0x5591fdc892f0 2024-09-21T02:43:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.007+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f722c072d20 con 0x5591fdcb21b0 2024-09-21T02:43:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.007+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f722c071f80 con 0x5591fdc914d0 2024-09-21T02:43:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.007+0000 7f72392cd740 10 client.0 _ll_register_callbacks cb 0x7f722401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.008+0000 7f722be00640 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdcb21b0 0x5591fe083790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.009+0000 7f7222a00640 1 -- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdcb21b0 msgr2=0x5591fe083790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.009+0000 7f7222a00640 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdcb21b0 0x5591fe083790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.009+0000 7f7222a00640 1 -- 172.21.15.79:0/1182329920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 msgr2=0x5591fe0842b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.009+0000 7f7222a00640 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe0842b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.009+0000 7f7222a00640 1 -- 172.21.15.79:0/1182329920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591fe081ba0 con 0x5591fdc914d0 2024-09-21T02:43:00.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.011+0000 7f7222a00640 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe083030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7214027040 tx=0x7f7214003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d647009bc5d96d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:00.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.011+0000 7f7218c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:00.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.012+0000 7f7218c00640 1 -- 172.21.15.79:0/1182329920 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7214029050 con 0x5591fdc914d0 2024-09-21T02:43:00.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.012+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f721400fe30 con 0x5591fdc914d0 2024-09-21T02:43:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.012+0000 7f7218c00640 1 -- 172.21.15.79:0/1182329920 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7214012870 con 0x5591fdc914d0 2024-09-21T02:43:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.012+0000 7f7218c00640 1 -- 172.21.15.79:0/1182329920 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f721403d050 con 0x5591fdc914d0 2024-09-21T02:43:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.012+0000 7f72392cd740 10 client.26152 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.012+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5591fe0f41a0 con 0x5591fdc914d0 2024-09-21T02:43:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.013+0000 7f7218c00640 1 -- 172.21.15.79:0/1182329920 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f721400fe30 con 0x5591fdc914d0 2024-09-21T02:43:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.013+0000 7f7218c00640 1 -- 172.21.15.79:0/1182329920 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7214003de0 con 0x5591fdc914d0 2024-09-21T02:43:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.013+0000 7f72392cd740 10 client.26152 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.014+0000 7f72392cd740 10 client.26152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.014+0000 7f72392cd740 20 client.26152 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.014+0000 7f72392cd740 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc461c0 0x5591fe0f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.014+0000 7f72392cd740 4 client.26152 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.014+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5591fdfca0b0 con 0x5591fdc461c0 2024-09-21T02:43:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.014+0000 7f722be00640 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc461c0 0x5591fe0f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.015+0000 7f722be00640 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc461c0 0x5591fe0f6b60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2616a3a69876893 server_cookie=efa653ffe3140ff5 in_seq=0 out_seq=0 2024-09-21T02:43:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.015+0000 7f7218c00640 10 client.26152 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.118+0000 7f7218c00640 1 -- 172.21.15.79:0/1182329920 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5591fdfca0b0 con 0x5591fdc461c0 2024-09-21T02:43:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.118+0000 7f7218c00640 10 client.26152 handle_command_reply: tid=0 2024-09-21T02:43:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.118+0000 7f72392cd740 1 client.26152 shutdown 2024-09-21T02:43:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.119+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 msgr2=0x5591fe083030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.119+0000 7f72392cd740 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe083030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7214027040 tx=0x7f7214003820 comp rx=0 tx=0).stop 2024-09-21T02:43:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.119+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 shutdown_connections 2024-09-21T02:43:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.119+0000 7f72392cd740 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5591fdc461c0 0x5591fe0f6b60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.120+0000 7f72392cd740 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591fdcb21b0 0x5591fe083790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.120+0000 7f72392cd740 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591fdc914d0 0x5591fe083030 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.120+0000 7f72392cd740 1 --2- 172.21.15.79:0/1182329920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591fdc892f0 0x5591fe0842b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.120+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 >> 172.21.15.79:0/1182329920 conn(0x5591fdca6300 msgr2=0x5591fe058ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.120+0000 7f7218c00640 0 client.26152 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.120+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 shutdown_connections 2024-09-21T02:43:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.120+0000 7f72392cd740 1 -- 172.21.15.79:0/1182329920 wait complete. 2024-09-21T02:43:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.121+0000 7f72392cd740 20 client.26152 trim_cache size 0 max 16384 2024-09-21T02:43:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:43:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:43:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:43:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:43:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.122+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72100b6590 msgr2=0x7f72100b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.122+0000 7f7230c00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72100b6590 0x7f72100b8aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f721c0cdec0 tx=0x7f721c03d040 comp rx=0 tx=0).stop 2024-09-21T02:43:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.122+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 msgr2=0x7f722c19bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.122+0000 7f7230c00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 0x7f722c19bf60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f721c02adf0 tx=0x7f721c030800 comp rx=0 tx=0).stop 2024-09-21T02:43:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 shutdown_connections 2024-09-21T02:43:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f72100b6590 0x7f72100b8aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c104f00 0x7f722c19d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f722c104560 0x7f722c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 --2- 172.21.15.79:0/2601790056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f722c1034e0 0x7f722c19bf60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 >> 172.21.15.79:0/2601790056 conn(0x7f722c0fee20 msgr2=0x7f722c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 shutdown_connections 2024-09-21T02:43:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:00.123+0000 7f7230c00640 1 -- 172.21.15.79:0/2601790056 wait complete. 2024-09-21T02:43:00.193 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T02:43:00.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T02:43:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 425.0 s, 615.4 tps, lat 153.737 ms stddev 224.525 2024-09-21T02:43:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.689+0000 7f5874c00640 1 -- 172.21.15.79:0/572617135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5870110420 msgr2=0x7f5870116c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.689+0000 7f5874c00640 1 --2- 172.21.15.79:0/572617135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5870110420 0x7f5870116c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5868009be0 tx=0x7f586802a6f0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.691+0000 7f5874c00640 1 -- 172.21.15.79:0/572617135 shutdown_connections 2024-09-21T02:43:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.691+0000 7f5874c00640 1 --2- 172.21.15.79:0/572617135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5870110420 0x7f5870116c50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.691+0000 7f5874c00640 1 --2- 172.21.15.79:0/572617135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f587010fad0 0x7f587010fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.691+0000 7f5874c00640 1 --2- 172.21.15.79:0/572617135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587010a190 0x7f587010a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.691+0000 7f5874c00640 1 -- 172.21.15.79:0/572617135 >> 172.21.15.79:0/572617135 conn(0x7f58700781c0 msgr2=0x7f58701081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.691+0000 7f5874c00640 1 -- 172.21.15.79:0/572617135 shutdown_connections 2024-09-21T02:43:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.691+0000 7f5874c00640 1 -- 172.21.15.79:0/572617135 wait complete. 2024-09-21T02:43:01.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.694+0000 7f5874c00640 1 Processor -- start 2024-09-21T02:43:01.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.694+0000 7f5874c00640 1 -- start start 2024-09-21T02:43:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f5874c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587010a190 0x7f58701a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f5874c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f587010fad0 0x7f58701a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f5874c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5870110420 0x7f58701a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f5874c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f587011a0d0 con 0x7f5870110420 2024-09-21T02:43:01.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f5874c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5870119f50 con 0x7f587010a190 2024-09-21T02:43:01.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f5874c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f587011a250 con 0x7f587010fad0 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f586d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f587010fad0 0x7f58701a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f586d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f587010fad0 0x7f58701a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48686/0 (socket says 172.21.15.79:48686) 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f586d400640 1 -- 172.21.15.79:0/2212909994 learned_addr learned my addr 172.21.15.79:0/2212909994 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.695+0000 7f586de00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587010a190 0x7f58701a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.696+0000 7f586e800640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5870110420 0x7f58701a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.696+0000 7f586d400640 1 -- 172.21.15.79:0/2212909994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587010a190 msgr2=0x7f58701a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.696+0000 7f586d400640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587010a190 0x7f58701a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.696+0000 7f586d400640 1 -- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5870110420 msgr2=0x7f58701a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.696+0000 7f586d400640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5870110420 0x7f58701a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.696+0000 7f586d400640 1 -- 172.21.15.79:0/2212909994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58701a69d0 con 0x7f587010fad0 2024-09-21T02:43:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.696+0000 7f586d400640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f587010fad0 0x7f58701a1000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f586000d740 tx=0x7f586000dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.698+0000 7f5866a00640 1 -- 172.21.15.79:0/2212909994 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860017070 con 0x7f587010fad0 2024-09-21T02:43:01.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.699+0000 7f5866a00640 1 -- 172.21.15.79:0/2212909994 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f586000de50 con 0x7f587010fad0 2024-09-21T02:43:01.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.700+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58701a6cc0 con 0x7f587010fad0 2024-09-21T02:43:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.700+0000 7f5866a00640 1 -- 172.21.15.79:0/2212909994 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586000f620 con 0x7f587010fad0 2024-09-21T02:43:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.700+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58701ad420 con 0x7f587010fad0 2024-09-21T02:43:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.706+0000 7f587b7e9740 1 Processor -- start 2024-09-21T02:43:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.706+0000 7f587b7e9740 1 -- start start 2024-09-21T02:43:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.706+0000 7f5866a00640 1 -- 172.21.15.79:0/2212909994 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f586001a070 con 0x7f587010fad0 2024-09-21T02:43:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4f8d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bbd990 0x5599b4f8def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f586e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4f8d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f586e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4f8d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54888/0 (socket says 172.21.15.79:54888) 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f586e800640 1 -- 172.21.15.79:0/3349551222 learned_addr learned my addr 172.21.15.79:0/3349551222 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f587b7e9740 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f8e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5599b4f03a90 con 0x5599b4bbd990 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5599b4ef2ec0 con 0x5599b4be6850 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.707+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5599b4ef6cd0 con 0x5599b4bc5b70 2024-09-21T02:43:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.708+0000 7f586d400640 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f8e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.708+0000 7f586de00640 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bbd990 0x5599b4f8def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.708+0000 7f586e800640 1 -- 172.21.15.79:0/3349551222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 msgr2=0x5599b4f8e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.708+0000 7f586e800640 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f8e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.708+0000 7f586e800640 1 -- 172.21.15.79:0/3349551222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bbd990 msgr2=0x5599b4f8def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.708+0000 7f586e800640 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bbd990 0x5599b4f8def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.708+0000 7f586e800640 1 -- 172.21.15.79:0/3349551222 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b4e989d0 con 0x5599b4be6850 2024-09-21T02:43:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.709+0000 7f586e800640 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4f8d9b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5868004af0 tx=0x7f5868030420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f707e628f3135261 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.709+0000 7f585b000640 1 -- 172.21.15.79:0/3349551222 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868040030 con 0x5599b4be6850 2024-09-21T02:43:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.709+0000 7f585b000640 1 -- 172.21.15.79:0/3349551222 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5868030db0 con 0x5599b4be6850 2024-09-21T02:43:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.709+0000 7f585b000640 1 -- 172.21.15.79:0/3349551222 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868036040 con 0x5599b4be6850 2024-09-21T02:43:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 msgr2=0x5599b4f8d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4f8d9b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5868004af0 tx=0x7f5868030420 comp rx=0 tx=0).stop 2024-09-21T02:43:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 shutdown_connections 2024-09-21T02:43:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f8e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bbd990 0x5599b4f8def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 --2- 172.21.15.79:0/3349551222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4f8d9b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 >> 172.21.15.79:0/3349551222 conn(0x5599b4bdac40 msgr2=0x5599b4f8b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.711+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 shutdown_connections 2024-09-21T02:43:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.712+0000 7f587b7e9740 1 -- 172.21.15.79:0/3349551222 wait complete. 2024-09-21T02:43:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.712+0000 7f5866a00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58540b6420 0x7f58540b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.712+0000 7f587b7e9740 1 -- start start 2024-09-21T02:43:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.713+0000 7f586de00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58540b6420 0x7f58540b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.713+0000 7f587b7e9740 1 Processor -- start 2024-09-21T02:43:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.714+0000 7f5866a00640 1 -- 172.21.15.79:0/2212909994 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f58600e7140 con 0x7f587010fad0 2024-09-21T02:43:01.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.715+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4f99540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.715+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f99a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.715+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 0x5599b4fa5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.716+0000 7f587b7e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5599b4d547b0 con 0x5599b4be6850 2024-09-21T02:43:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.716+0000 7f587b7e9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5599b4e97650 con 0x5599b4bbd990 2024-09-21T02:43:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.716+0000 7f587b7e9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5599b4f9c130 con 0x5599b4bc5b70 2024-09-21T02:43:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.716+0000 7f587b7e9740 10 client.0 _ll_register_callbacks cb 0x5599b4bfe0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.717+0000 7f586e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 0x5599b4fa5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.718+0000 7f586de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4f99540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.717+0000 7f586d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f99a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.718+0000 7f586d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f99a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48710/0 (socket says 172.21.15.79:48710) 2024-09-21T02:43:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.718+0000 7f586d400640 1 -- 172.21.15.79:0/1269634717 learned_addr learned my addr 172.21.15.79:0/1269634717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.718+0000 7f586de00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58540b6420 0x7f58540b8930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5599b4f8c630 tx=0x7f585c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.722+0000 7f586d400640 1 -- 172.21.15.79:0/1269634717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 msgr2=0x5599b4f99540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.722+0000 7f586d400640 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4f99540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.722+0000 7f586d400640 1 -- 172.21.15.79:0/1269634717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 msgr2=0x5599b4fa5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.722+0000 7f586d400640 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 0x5599b4fa5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.722+0000 7f586d400640 1 -- 172.21.15.79:0/1269634717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599b4c60ba0 con 0x5599b4bc5b70 2024-09-21T02:43:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.722+0000 7f586d400640 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f99a80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58600aa190 tx=0x7f5860009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=927617f34466e8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.722+0000 7f584f400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.723+0000 7f584f400640 1 -- 172.21.15.79:0/1269634717 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860021070 con 0x5599b4bc5b70 2024-09-21T02:43:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.723+0000 7f584f400640 1 -- 172.21.15.79:0/1269634717 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f58600940d0 con 0x5599b4bc5b70 2024-09-21T02:43:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.723+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5868030db0 con 0x5599b4bc5b70 2024-09-21T02:43:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.723+0000 7f584f400640 1 -- 172.21.15.79:0/1269634717 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f58600accf0 con 0x5599b4bc5b70 2024-09-21T02:43:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.723+0000 7f587b7e9740 10 client.26164 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.723+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5599b4fa8120 con 0x5599b4bc5b70 2024-09-21T02:43:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f584f400640 1 -- 172.21.15.79:0/1269634717 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5868030db0 con 0x5599b4bc5b70 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f584f400640 1 -- 172.21.15.79:0/1269634717 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f58600b0020 con 0x5599b4bc5b70 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f587b7e9740 10 client.26164 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f587b7e9740 10 client.26164 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f587b7e9740 20 client.26164 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f587b7e9740 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4ba51d0 0x5599b4fab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f587b7e9740 4 client.26164 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599b4f059e0 con 0x5599b4ba51d0 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.724+0000 7f586de00640 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4ba51d0 0x5599b4fab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.725+0000 7f586de00640 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4ba51d0 0x5599b4fab540 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e7d2f1d5f7e9cc server_cookie=e3418b273b2ae984 in_seq=0 out_seq=0 2024-09-21T02:43:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.725+0000 7f584f400640 10 client.26164 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.726+0000 7f584f400640 1 -- 172.21.15.79:0/1269634717 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599b4f059e0 con 0x5599b4ba51d0 2024-09-21T02:43:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.726+0000 7f584f400640 10 client.26164 handle_command_reply: tid=0 2024-09-21T02:43:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.726+0000 7f587b7e9740 1 client.26164 shutdown 2024-09-21T02:43:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.726+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 msgr2=0x5599b4f99a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.726+0000 7f587b7e9740 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f99a80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58600aa190 tx=0x7f5860009f80 comp rx=0 tx=0).stop 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 shutdown_connections 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4ba51d0 0x5599b4fab540 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 0x5599b4fa5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f99a80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 --2- 172.21.15.79:0/1269634717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4f99540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f584f400640 0 client.26164 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 >> 172.21.15.79:0/1269634717 conn(0x5599b4bdac40 msgr2=0x5599b4f90b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 shutdown_connections 2024-09-21T02:43:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 1 -- 172.21.15.79:0/1269634717 wait complete. 2024-09-21T02:43:01.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.727+0000 7f587b7e9740 20 client.26164 trim_cache size 0 max 16384 2024-09-21T02:43:01.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 Processor -- start 2024-09-21T02:43:01.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 -- start start 2024-09-21T02:43:01.765 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:01 smithi079 ceph-mon[30788]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 8.3 MiB/s wr, 807 op/s 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bbd990 0x5599b4f8a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bc5b70 0x5599b4fa5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4fa5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f58701b5320 con 0x5599b4bc5b70 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f58701b7ba0 con 0x5599b4be6850 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.763+0000 7f587b7e9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58701b5990 con 0x5599b4bbd990 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.764+0000 7f586de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bbd990 0x5599b4f8a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.764+0000 7f586de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bbd990 0x5599b4f8a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48716/0 (socket says 172.21.15.79:48716) 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.764+0000 7f586de00640 1 -- 172.21.15.79:0/2356060772 learned_addr learned my addr 172.21.15.79:0/2356060772 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.764+0000 7f586d400640 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bc5b70 0x5599b4fa5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.764+0000 7f586e800640 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4fa5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586e800640 1 -- 172.21.15.79:0/2356060772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bbd990 msgr2=0x5599b4f8a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586e800640 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bbd990 0x5599b4f8a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586e800640 1 -- 172.21.15.79:0/2356060772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bc5b70 msgr2=0x5599b4fa5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586e800640 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bc5b70 0x5599b4fa5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586e800640 1 -- 172.21.15.79:0/2356060772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b4f97840 con 0x5599b4be6850 2024-09-21T02:43:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586de00640 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bbd990 0x5599b4f8a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586d400640 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bc5b70 0x5599b4fa5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:01.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f586e800640 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4fa5860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5868009b30 tx=0x7f5868005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f45ea86513a06b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.765+0000 7f585a600640 1 -- 172.21.15.79:0/2356060772 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868036050 con 0x5599b4be6850 2024-09-21T02:43:01.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.766+0000 7f585a600640 1 -- 172.21.15.79:0/2356060772 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5868030db0 con 0x5599b4be6850 2024-09-21T02:43:01.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.766+0000 7f585a600640 1 -- 172.21.15.79:0/2356060772 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868040040 con 0x5599b4be6850 2024-09-21T02:43:01.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.767+0000 7f587b7e9740 1 -- 172.21.15.79:0/2356060772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 msgr2=0x5599b4fa5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.767+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4fa5860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5868009b30 tx=0x7f5868005fd0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.767+0000 7f587b7e9740 1 -- 172.21.15.79:0/2356060772 shutdown_connections 2024-09-21T02:43:01.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.767+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4be6850 0x5599b4fa5860 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.767+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4bc5b70 0x5599b4fa5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.767+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2356060772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bbd990 0x5599b4f8a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.767+0000 7f587b7e9740 1 -- 172.21.15.79:0/2356060772 >> 172.21.15.79:0/2356060772 conn(0x5599b4bdac40 msgr2=0x5599b4f8b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.768+0000 7f587b7e9740 1 -- 172.21.15.79:0/2356060772 shutdown_connections 2024-09-21T02:43:01.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.768+0000 7f587b7e9740 1 -- 172.21.15.79:0/2356060772 wait complete. 2024-09-21T02:43:01.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.769+0000 7f587b7e9740 1 -- start start 2024-09-21T02:43:01.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.770+0000 7f587b7e9740 1 Processor -- start 2024-09-21T02:43:01.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.771+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4fa1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.771+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f9c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.771+0000 7f587b7e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 0x5599b4f9c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.772+0000 7f587b7e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f58701b6060 con 0x5599b4be6850 2024-09-21T02:43:01.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.772+0000 7f587b7e9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f58701b74d0 con 0x5599b4bbd990 2024-09-21T02:43:01.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.772+0000 7f586de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4fa1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.772+0000 7f587b7e9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58701b6730 con 0x5599b4bc5b70 2024-09-21T02:43:01.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.772+0000 7f586de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4fa1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54918/0 (socket says 172.21.15.79:54918) 2024-09-21T02:43:01.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.772+0000 7f586de00640 1 -- 172.21.15.79:0/2490359935 learned_addr learned my addr 172.21.15.79:0/2490359935 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:01.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.772+0000 7f586d400640 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f9c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f587b7e9740 10 client.0 _ll_register_callbacks cb 0x7f58600ea910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f586de00640 1 -- 172.21.15.79:0/2490359935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 msgr2=0x5599b4f9c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f586de00640 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f9c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f586de00640 1 -- 172.21.15.79:0/2490359935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 msgr2=0x5599b4f9c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f586de00640 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 0x5599b4f9c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f586de00640 1 -- 172.21.15.79:0/2490359935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599b4f9d050 con 0x5599b4bbd990 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f586de00640 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4fa1bf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f585c0128e0 tx=0x7f585c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e485d03a883fdd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.773+0000 7f584f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:43:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.774+0000 7f584f400640 1 -- 172.21.15.79:0/2490359935 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c003b30 con 0x5599b4bbd990 2024-09-21T02:43:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.774+0000 7f584f400640 1 -- 172.21.15.79:0/2490359935 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f585c018030 con 0x5599b4bbd990 2024-09-21T02:43:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.774+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5868030db0 con 0x5599b4bbd990 2024-09-21T02:43:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.774+0000 7f584f400640 1 -- 172.21.15.79:0/2490359935 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f585c03b050 con 0x5599b4bbd990 2024-09-21T02:43:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.774+0000 7f587b7e9740 10 client.26156 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.774+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5599b5016e80 con 0x5599b4bbd990 2024-09-21T02:43:01.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f584f400640 1 -- 172.21.15.79:0/2490359935 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5868030db0 con 0x5599b4bbd990 2024-09-21T02:43:01.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f584f400640 1 -- 172.21.15.79:0/2490359935 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f585c032460 con 0x5599b4bbd990 2024-09-21T02:43:01.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f587b7e9740 10 client.26156 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:01.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f587b7e9740 10 client.26156 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:01.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f587b7e9740 20 client.26156 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:01.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4b7a580 0x5599b5019750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f587b7e9740 4 client.26156 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T02:43:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.775+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x5599b4f01490 con 0x5599b4b7a580 2024-09-21T02:43:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.776+0000 7f586d400640 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4b7a580 0x5599b5019750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.777+0000 7f586d400640 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4b7a580 0x5599b5019750 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2041390433082b8a server_cookie=497a1b16b929686 in_seq=0 out_seq=0 2024-09-21T02:43:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:01.777+0000 7f584f400640 10 client.26156 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:01.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:01 smithi148 ceph-mon[34626]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 8.3 MiB/s wr, 807 op/s 2024-09-21T02:43:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:01 smithi098 ceph-mon[34832]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 8.3 MiB/s wr, 807 op/s 2024-09-21T02:43:02.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.119+0000 7f584f400640 1 -- 172.21.15.79:0/2490359935 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5599b4f01490 con 0x5599b4b7a580 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.119+0000 7f584f400640 10 client.26156 handle_command_reply: tid=0 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.119+0000 7f587b7e9740 1 client.26156 shutdown 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 msgr2=0x5599b4fa1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4fa1bf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f585c0128e0 tx=0x7f585c0046c0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 shutdown_connections 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5599b4b7a580 0x5599b5019750 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599b4be6850 0x5599b4f9c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599b4bc5b70 0x5599b4f9c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 --2- 172.21.15.79:0/2490359935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599b4bbd990 0x5599b4fa1bf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f584f400640 0 client.26156 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 >> 172.21.15.79:0/2490359935 conn(0x5599b4bdac40 msgr2=0x5599b4f8e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:02.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 shutdown_connections 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 1 -- 172.21.15.79:0/2490359935 wait complete. 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.120+0000 7f587b7e9740 20 client.26156 trim_cache size 0 max 16384 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 30, 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stdout: "d4964603": { 2024-09-21T02:43:02.123 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 30, 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 141.1, 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:02.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58540b6420 msgr2=0x7f58540b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58540b6420 0x7f58540b8930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5599b4f8c630 tx=0x7f585c005f90 comp rx=0 tx=0).stop 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f587010fad0 msgr2=0x7f58701a1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f587010fad0 0x7f58701a1000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f586000d740 tx=0x7f586000dc00 comp rx=0 tx=0).stop 2024-09-21T02:43:02.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 shutdown_connections 2024-09-21T02:43:02.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58540b6420 0x7f58540b8930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5870110420 0x7f58701a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f587010fad0 0x7f58701a1000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 --2- 172.21.15.79:0/2212909994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587010a190 0x7f58701a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:02.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 >> 172.21.15.79:0/2212909994 conn(0x7f58700781c0 msgr2=0x7f58701083f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:02.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 shutdown_connections 2024-09-21T02:43:02.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:02.121+0000 7f5874c00640 1 -- 172.21.15.79:0/2212909994 wait complete. 2024-09-21T02:43:03.797 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:03 smithi079 ceph-mon[30788]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 729 op/s 2024-09-21T02:43:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:03 smithi148 ceph-mon[34626]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 729 op/s 2024-09-21T02:43:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:03 smithi098 ceph-mon[34832]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 729 op/s 2024-09-21T02:43:04.184 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd4964603', quiesce took 7.0 seconds. Will release after: 14.05 2024-09-21T02:43:05.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:05 smithi148 ceph-mon[34626]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 570 op/s 2024-09-21T02:43:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:05 smithi098 ceph-mon[34832]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 570 op/s 2024-09-21T02:43:05.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:05 smithi079 ceph-mon[30788]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 570 op/s 2024-09-21T02:43:06.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 430.0 s, 41.0 tps, lat 220.867 ms stddev 268.232 2024-09-21T02:43:07.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:07 smithi148 ceph-mon[34626]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 542 op/s 2024-09-21T02:43:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:07 smithi098 ceph-mon[34832]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 542 op/s 2024-09-21T02:43:07.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:07 smithi079 ceph-mon[30788]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 542 op/s 2024-09-21T02:43:09.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:09 smithi148 ceph-mon[34626]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 462 op/s 2024-09-21T02:43:09.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:09 smithi098 ceph-mon[34832]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 462 op/s 2024-09-21T02:43:09.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:09 smithi079 ceph-mon[30788]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 462 op/s 2024-09-21T02:43:11.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:43:11.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:11 smithi148 ceph-mon[34626]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.3 MiB/s wr, 319 op/s 2024-09-21T02:43:11.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:11 smithi098 ceph-mon[34832]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.3 MiB/s wr, 319 op/s 2024-09-21T02:43:11.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:11 smithi079 ceph-mon[30788]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.3 MiB/s wr, 319 op/s 2024-09-21T02:43:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 -- 172.21.15.79:0/850343884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 msgr2=0x7f4894104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 --2- 172.21.15.79:0/850343884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f4894104b60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4880009900 tx=0x7f488002a400 comp rx=0 tx=0).stop 2024-09-21T02:43:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 -- 172.21.15.79:0/850343884 shutdown_connections 2024-09-21T02:43:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 --2- 172.21.15.79:0/850343884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48941050f0 0x7f489410ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 --2- 172.21.15.79:0/850343884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f4894104b60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 --2- 172.21.15.79:0/850343884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48941036d0 0x7f4894103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 -- 172.21.15.79:0/850343884 >> 172.21.15.79:0/850343884 conn(0x7f48940ff030 msgr2=0x7f48941014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 -- 172.21.15.79:0/850343884 shutdown_connections 2024-09-21T02:43:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.336+0000 7f489a600640 1 -- 172.21.15.79:0/850343884 wait complete. 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.337+0000 7f489a600640 1 Processor -- start 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.337+0000 7f489a600640 1 -- start start 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f489a600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48941036d0 0x7f4894199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f489a600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f489419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f489a600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48941050f0 0x7f489419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f489a600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f489410f370 con 0x7f4894104750 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f489a600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f489410f1f0 con 0x7f48941036d0 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f489a600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f489410f4f0 con 0x7f48941050f0 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f489419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f489419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35480/0 (socket says 172.21.15.79:35480) 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 -- 172.21.15.79:0/385645105 learned_addr learned my addr 172.21.15.79:0/385645105 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4893400640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48941036d0 0x7f4894199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4893e00640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48941050f0 0x7f489419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 -- 172.21.15.79:0/385645105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48941050f0 msgr2=0x7f489419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48941050f0 0x7f489419b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 -- 172.21.15.79:0/385645105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48941036d0 msgr2=0x7f4894199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48941036d0 0x7f4894199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4892a00640 1 -- 172.21.15.79:0/385645105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489419b9a0 con 0x7f4894104750 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.338+0000 7f4893400640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48941036d0 0x7f4894199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.339+0000 7f4892a00640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f489419a5d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4880031440 tx=0x7f4880003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.339+0000 7f488be00640 1 -- 172.21.15.79:0/385645105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488003f070 con 0x7f4894104750 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.339+0000 7f488be00640 1 -- 172.21.15.79:0/385645105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4880031c50 con 0x7f4894104750 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.339+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489419bc30 con 0x7f4894104750 2024-09-21T02:43:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.339+0000 7f488be00640 1 -- 172.21.15.79:0/385645105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880035030 con 0x7f4894104750 2024-09-21T02:43:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.339+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48941a2380 con 0x7f4894104750 2024-09-21T02:43:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 Processor -- start 2024-09-21T02:43:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 -- start start 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d634e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d63b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564b82cd26b0 con 0x564b8298f2f0 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564b82cc1ae0 con 0x564b829b81b0 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.342+0000 7f48a1621740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564b82cc58f0 con 0x564b829974d0 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f488be00640 1 -- 172.21.15.79:0/385645105 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4880042070 con 0x7f4894104750 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d63b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d63b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35486/0 (socket says 172.21.15.79:35486) 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 -- 172.21.15.79:0/1429567087 learned_addr learned my addr 172.21.15.79:0/1429567087 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893e00640 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4892a00640 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 -- 172.21.15.79:0/1429567087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 msgr2=0x564b82d646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 -- 172.21.15.79:0/1429567087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 msgr2=0x564b82d634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d634e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 -- 172.21.15.79:0/1429567087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b82c8e780 con 0x564b8298f2f0 2024-09-21T02:43:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893e00640 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.343+0000 7f4893400640 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d63b50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4884009d50 tx=0x7f48840117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e94bb5e32ebd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.344+0000 7f4888c00640 1 -- 172.21.15.79:0/1429567087 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884012650 con 0x564b8298f2f0 2024-09-21T02:43:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.344+0000 7f4888c00640 1 -- 172.21.15.79:0/1429567087 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4884009e40 con 0x564b8298f2f0 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.344+0000 7f4888c00640 1 -- 172.21.15.79:0/1429567087 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488400fc00 con 0x564b8298f2f0 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.344+0000 7f488be00640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48780b6590 0x7f48780b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f488be00640 1 -- 172.21.15.79:0/385645105 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4880107fc0 con 0x7f4894104750 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 -- 172.21.15.79:0/1429567087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 msgr2=0x564b82d63b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d63b50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4884009d50 tx=0x7f48840117b0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f4893e00640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48780b6590 0x7f48780b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 -- 172.21.15.79:0/1429567087 shutdown_connections 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d63b50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 --2- 172.21.15.79:0/1429567087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 -- 172.21.15.79:0/1429567087 >> 172.21.15.79:0/1429567087 conn(0x564b829ac300 msgr2=0x564b82d5ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 -- 172.21.15.79:0/1429567087 shutdown_connections 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f48a1621740 1 -- 172.21.15.79:0/1429567087 wait complete. 2024-09-21T02:43:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.345+0000 7f4893e00640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48780b6590 0x7f48780b8aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f488c005fd0 tx=0x7f488c009620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.346+0000 7f48a1621740 1 -- start start 2024-09-21T02:43:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.346+0000 7f48a1621740 1 Processor -- start 2024-09-21T02:43:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.346+0000 7f48a1621740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d6cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.346+0000 7f48a1621740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829974d0 0x564b82d6d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.346+0000 7f48a1621740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829b81b0 0x564b82d6dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f48a1621740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564b82bf9ab0 con 0x564b829b81b0 2024-09-21T02:43:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f48a1621740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564b82c68570 con 0x564b829974d0 2024-09-21T02:43:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f48a1621740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564b82d651c0 con 0x564b8298f2f0 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f48a1621740 10 client.0 _ll_register_callbacks cb 0x564b82c77100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d6cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d6cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47854/0 (socket says 172.21.15.79:47854) 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 -- 172.21.15.79:0/3091836897 learned_addr learned my addr 172.21.15.79:0/3091836897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893e00640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829b81b0 0x564b82d6dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4892a00640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829974d0 0x564b82d6d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 -- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829974d0 msgr2=0x564b82d6d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829974d0 0x564b82d6d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 -- 172.21.15.79:0/3091836897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829b81b0 msgr2=0x564b82d6dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829b81b0 0x564b82d6dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4893400640 1 -- 172.21.15.79:0/3091836897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b82a23790 con 0x564b8298f2f0 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.347+0000 7f4892a00640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829974d0 0x564b82d6d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f4893400640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d6cb80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4884009d20 tx=0x7f4884004540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c51c0b10d3c7fef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f487d600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f487d600640 1 -- 172.21.15.79:0/3091836897 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884028030 con 0x564b8298f2f0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b82cd4600 con 0x564b8298f2f0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f487d600640 1 -- 172.21.15.79:0/3091836897 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f488400fb10 con 0x564b8298f2f0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f487d600640 1 -- 172.21.15.79:0/3091836897 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4884032050 con 0x564b8298f2f0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f48a1621740 10 client.26179 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564b82a9c620 con 0x564b8298f2f0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.348+0000 7f487d600640 1 -- 172.21.15.79:0/3091836897 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564b82cd4600 con 0x564b8298f2f0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f487d600640 1 -- 172.21.15.79:0/3091836897 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4884012450 con 0x564b8298f2f0 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f48a1621740 10 client.26179 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f48a1621740 10 client.26179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f48a1621740 20 client.26179 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f48a1621740 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b82976d80 0x564b82d79f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f48a1621740 4 client.26179 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b82cd00b0 con 0x564b82976d80 2024-09-21T02:43:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.349+0000 7f4892a00640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b82976d80 0x564b82d79f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.350+0000 7f4892a00640 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b82976d80 0x564b82d79f90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0405b11c169bf9 server_cookie=ee8621b0160693ad in_seq=0 out_seq=0 2024-09-21T02:43:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.350+0000 7f487d600640 10 client.26179 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f487d600640 1 -- 172.21.15.79:0/3091836897 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b82cd00b0 con 0x564b82976d80 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f487d600640 10 client.26179 handle_command_reply: tid=0 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 client.26179 shutdown 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 msgr2=0x564b82d6cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d6cb80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4884009d20 tx=0x7f4884004540 comp rx=0 tx=0).stop 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 shutdown_connections 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b82976d80 0x564b82d79f90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829b81b0 0x564b82d6dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829974d0 0x564b82d6d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 --2- 172.21.15.79:0/3091836897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d6cb80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f487d600640 0 client.26179 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 >> 172.21.15.79:0/3091836897 conn(0x564b829ac300 msgr2=0x564b82d5b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 shutdown_connections 2024-09-21T02:43:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 1 -- 172.21.15.79:0/3091836897 wait complete. 2024-09-21T02:43:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.351+0000 7f48a1621740 20 client.26179 trim_cache size 0 max 16384 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 Processor -- start 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 -- start start 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d6b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d63610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48941a8570 con 0x564b8298f2f0 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48941aadf0 con 0x564b829b81b0 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f48a1621740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f48941a8be0 con 0x564b829974d0 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.366+0000 7f4893400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d6b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d6b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35500/0 (socket says 172.21.15.79:35500) 2024-09-21T02:43:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 -- 172.21.15.79:0/3623522579 learned_addr learned my addr 172.21.15.79:0/3623522579 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893e00640 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d63610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4892a00640 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 -- 172.21.15.79:0/3623522579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 msgr2=0x564b82d630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 -- 172.21.15.79:0/3623522579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 msgr2=0x564b82d63610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d63610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 -- 172.21.15.79:0/3623522579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b82d7a300 con 0x564b8298f2f0 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f4893400640 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d6b7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f48840117f0 tx=0x7f488400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a702a86c22f6abb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f487fe00640 1 -- 172.21.15.79:0/3623522579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884028040 con 0x564b8298f2f0 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f487fe00640 1 -- 172.21.15.79:0/3623522579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4884011cb0 con 0x564b8298f2f0 2024-09-21T02:43:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.367+0000 7f487fe00640 1 -- 172.21.15.79:0/3623522579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48840052d0 con 0x564b8298f2f0 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 -- 172.21.15.79:0/3623522579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 msgr2=0x564b82d6b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d6b7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f48840117f0 tx=0x7f488400f810 comp rx=0 tx=0).stop 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 -- 172.21.15.79:0/3623522579 shutdown_connections 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d63610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b829974d0 0x564b82d630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 --2- 172.21.15.79:0/3623522579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b8298f2f0 0x564b82d6b7a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 -- 172.21.15.79:0/3623522579 >> 172.21.15.79:0/3623522579 conn(0x564b829ac300 msgr2=0x564b82d6b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 -- 172.21.15.79:0/3623522579 shutdown_connections 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.368+0000 7f48a1621740 1 -- 172.21.15.79:0/3623522579 wait complete. 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 -- start start 2024-09-21T02:43:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 Processor -- start 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d71520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829974d0 0x564b82d71be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d72750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48941a92b0 con 0x564b829974d0 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48941aa720 con 0x564b829b81b0 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f48941a9980 con 0x564b8298f2f0 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.369+0000 7f48a1621740 10 client.0 _ll_register_callbacks cb 0x7f488c0094c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829974d0 0x564b82d71be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829974d0 0x564b82d71be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35510/0 (socket says 172.21.15.79:35510) 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 -- 172.21.15.79:0/3166709884 learned_addr learned my addr 172.21.15.79:0/3166709884 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4893e00640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d72750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4893400640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d71520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 -- 172.21.15.79:0/3166709884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 msgr2=0x564b82d71520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d71520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 -- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 msgr2=0x564b82d72750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d72750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 -- 172.21.15.79:0/3166709884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b82d72eb0 con 0x564b829974d0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4893400640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d71520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f4892a00640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829974d0 0x564b82d71be0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f48800cda40 tx=0x7f4880009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97615bbc941860cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f487d600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.370+0000 7f487d600640 1 -- 172.21.15.79:0/3166709884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48800d2070 con 0x564b829974d0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4884011cb0 con 0x564b829974d0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f487d600640 1 -- 172.21.15.79:0/3166709884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f48800c9fb0 con 0x564b829974d0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f487d600640 1 -- 172.21.15.79:0/3166709884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4880049040 con 0x564b829974d0 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 10 client.15996 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564b82d74210 con 0x564b829974d0 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f487d600640 1 -- 172.21.15.79:0/3166709884 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4884011cb0 con 0x564b829974d0 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f487d600640 1 -- 172.21.15.79:0/3166709884 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f48800f5080 con 0x564b829974d0 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 10 client.15996 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 20 client.15996 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b8294c1c0 0x564b82de6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 4 client.15996 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.371+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564b82ccd4e0 con 0x564b8294c1c0 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.372+0000 7f4893400640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b8294c1c0 0x564b82de6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.372+0000 7f487d600640 10 client.15996 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.372+0000 7f4893400640 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b8294c1c0 0x564b82de6910 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2be0cf78b9789e server_cookie=6b51e3fc6d57d2d1 in_seq=0 out_seq=0 2024-09-21T02:43:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.398+0000 7f487d600640 1 -- 172.21.15.79:0/3166709884 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b82ccd4e0 con 0x564b8294c1c0 2024-09-21T02:43:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f487d600640 10 client.15996 handle_command_reply: tid=0 2024-09-21T02:43:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 client.15996 shutdown 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829974d0 msgr2=0x564b82d71be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829974d0 0x564b82d71be0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f48800cda40 tx=0x7f4880009260 comp rx=0 tx=0).stop 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 shutdown_connections 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564b8294c1c0 0x564b82de6910 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564b829b81b0 0x564b82d72750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b829974d0 0x564b82d71be0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 --2- 172.21.15.79:0/3166709884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564b8298f2f0 0x564b82d71520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f487d600640 0 client.15996 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 >> 172.21.15.79:0/3166709884 conn(0x564b829ac300 msgr2=0x564b82d5a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 shutdown_connections 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 1 -- 172.21.15.79:0/3166709884 wait complete. 2024-09-21T02:43:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.399+0000 7f48a1621740 20 client.15996 trim_cache size 0 max 16384 2024-09-21T02:43:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:43:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:43:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:43:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48780b6590 msgr2=0x7f48780b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48780b6590 0x7f48780b8aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f488c005fd0 tx=0x7f488c009620 comp rx=0 tx=0).stop 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 msgr2=0x7f489419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f489419a5d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4880031440 tx=0x7f4880003c10 comp rx=0 tx=0).stop 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 shutdown_connections 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f48780b6590 0x7f48780b8aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48941050f0 0x7f489419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4894104750 0x7f489419a5d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 --2- 172.21.15.79:0/385645105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48941036d0 0x7f4894199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 >> 172.21.15.79:0/385645105 conn(0x7f48940ff030 msgr2=0x7f4894107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 shutdown_connections 2024-09-21T02:43:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:13.400+0000 7f489a600640 1 -- 172.21.15.79:0/385645105 wait complete. 2024-09-21T02:43:13.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:13 smithi148 ceph-mon[34626]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 242 op/s 2024-09-21T02:43:13.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:13 smithi098 ceph-mon[34832]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 242 op/s 2024-09-21T02:43:13.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:13 smithi079 ceph-mon[30788]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 242 op/s 2024-09-21T02:43:15.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:15 smithi098 ceph-mon[34832]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 82 op/s 2024-09-21T02:43:15.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:15 smithi079 ceph-mon[30788]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 82 op/s 2024-09-21T02:43:16.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:15 smithi148 ceph-mon[34626]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 82 op/s 2024-09-21T02:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:43:17.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:17 smithi098 ceph-mon[34832]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 924 KiB/s wr, 53 op/s 2024-09-21T02:43:17.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:17 smithi079 ceph-mon[30788]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 924 KiB/s wr, 53 op/s 2024-09-21T02:43:18.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:17 smithi148 ceph-mon[34626]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 924 KiB/s wr, 53 op/s 2024-09-21T02:43:18.235 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:43:18.617 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 -- 172.21.15.79:0/20718115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb4105d90 msgr2=0x7f7bb41061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 --2- 172.21.15.79:0/20718115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb4105d90 0x7f7bb41061a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8009900 tx=0x7f7ba802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 -- 172.21.15.79:0/20718115 shutdown_connections 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 --2- 172.21.15.79:0/20718115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bb410c020 0x7f7bb4112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 --2- 172.21.15.79:0/20718115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb410b6d0 0x7f7bb410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 --2- 172.21.15.79:0/20718115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb4105d90 0x7f7bb41061a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 -- 172.21.15.79:0/20718115 >> 172.21.15.79:0/20718115 conn(0x7f7bb41017c0 msgr2=0x7f7bb4103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 -- 172.21.15.79:0/20718115 shutdown_connections 2024-09-21T02:43:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.257+0000 7f7bbc200640 1 -- 172.21.15.79:0/20718115 wait complete. 2024-09-21T02:43:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.258+0000 7f7bbc200640 1 Processor -- start 2024-09-21T02:43:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bbc200640 1 -- start start 2024-09-21T02:43:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bbc200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb4105d90 0x7f7bb419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bbc200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bb410b6d0 0x7f7bb419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bbc200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb410c020 0x7f7bb41a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bbc200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb4115ce0 con 0x7f7bb410c020 2024-09-21T02:43:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bbc200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb4115b60 con 0x7f7bb4105d90 2024-09-21T02:43:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bbc200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb4115e60 con 0x7f7bb410b6d0 2024-09-21T02:43:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bba200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb410c020 0x7f7bb41a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bba200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb410c020 0x7f7bb41a1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59784/0 (socket says 172.21.15.79:59784) 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bb9800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb4105d90 0x7f7bb419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.259+0000 7f7bba200640 1 -- 172.21.15.79:0/818994950 learned_addr learned my addr 172.21.15.79:0/818994950 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bb8e00640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bb410b6d0 0x7f7bb419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bba200640 1 -- 172.21.15.79:0/818994950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bb410b6d0 msgr2=0x7f7bb419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bba200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bb410b6d0 0x7f7bb419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bba200640 1 -- 172.21.15.79:0/818994950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb4105d90 msgr2=0x7f7bb419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bba200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb4105d90 0x7f7bb419c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bba200640 1 -- 172.21.15.79:0/818994950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb41a2620 con 0x7f7bb410c020 2024-09-21T02:43:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bb9800640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb4105d90 0x7f7bb419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.260+0000 7f7bba200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb410c020 0x7f7bb41a1ef0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00eb10 tx=0x7f7bac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.261+0000 7f7bb2000640 1 -- 172.21.15.79:0/818994950 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac004b20 con 0x7f7bb410c020 2024-09-21T02:43:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.261+0000 7f7bb2000640 1 -- 172.21.15.79:0/818994950 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bac004cc0 con 0x7f7bb410c020 2024-09-21T02:43:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.261+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb41a2910 con 0x7f7bb410c020 2024-09-21T02:43:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.261+0000 7f7bb2000640 1 -- 172.21.15.79:0/818994950 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac010670 con 0x7f7bb410c020 2024-09-21T02:43:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.261+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb41a9070 con 0x7f7bb410c020 2024-09-21T02:43:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.262+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb41061a0 con 0x7f7bb410c020 2024-09-21T02:43:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.264+0000 7f7bb2000640 1 -- 172.21.15.79:0/818994950 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7bac005000 con 0x7f7bb410c020 2024-09-21T02:43:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.266+0000 7f7bb2000640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7b9c0b6510 0x7f7b9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.266+0000 7f7bb2000640 1 -- 172.21.15.79:0/818994950 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7bac0e7e90 con 0x7f7bb410c020 2024-09-21T02:43:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.266+0000 7f7bb9800640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7b9c0b6510 0x7f7b9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.267+0000 7f7bb9800640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7b9c0b6510 0x7f7b9c0b8a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8031440 tx=0x7f7ba8032ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.268+0000 7f7bb2000640 1 -- 172.21.15.79:0/818994950 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7bac056710 con 0x7f7bb410c020 2024-09-21T02:43:19.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.495+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bb419d7e0 con 0x7f7bb410c020 2024-09-21T02:43:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.496+0000 7f7bb2000640 1 -- 172.21.15.79:0/818994950 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f7bb419d7e0 con 0x7f7bb410c020 2024-09-21T02:43:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:43:19.498 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:43:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:43:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.498+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7b9c0b6510 msgr2=0x7f7b9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.498+0000 7f7bbc200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7b9c0b6510 0x7f7b9c0b8a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8031440 tx=0x7f7ba8032ed0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.498+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb410c020 msgr2=0x7f7bb41a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.498+0000 7f7bbc200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb410c020 0x7f7bb41a1ef0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00eb10 tx=0x7f7bac00c2d0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 shutdown_connections 2024-09-21T02:43:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7b9c0b6510 0x7f7b9c0b8a20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bb410c020 0x7f7bb41a1ef0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bb410b6d0 0x7f7bb419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 --2- 172.21.15.79:0/818994950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb4105d90 0x7f7bb419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 >> 172.21.15.79:0/818994950 conn(0x7f7bb41017c0 msgr2=0x7f7bb410ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 shutdown_connections 2024-09-21T02:43:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:19.499+0000 7f7bbc200640 1 -- 172.21.15.79:0/818994950 wait complete. 2024-09-21T02:43:19.887 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:19 smithi079 ceph-mon[30788]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 778 KiB/s wr, 31 op/s 2024-09-21T02:43:19.888 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:19 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/818994950' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:19 smithi098 ceph-mon[34832]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 778 KiB/s wr, 31 op/s 2024-09-21T02:43:19.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:19 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/818994950' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:20.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:19 smithi148 ceph-mon[34626]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 778 KiB/s wr, 31 op/s 2024-09-21T02:43:20.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:19 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/818994950' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:20.434 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id d4964603 --release --await' 2024-09-21T02:43:20.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id d4964603 --release --await 2024-09-21T02:43:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:21.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 -- 172.21.15.79:0/618734091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 msgr2=0x7f333410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 --2- 172.21.15.79:0/618734091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 0x7f333410d870 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3320009900 tx=0x7f332002a410 comp rx=0 tx=0).stop 2024-09-21T02:43:21.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 -- 172.21.15.79:0/618734091 shutdown_connections 2024-09-21T02:43:21.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 --2- 172.21.15.79:0/618734091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f333410de30 0x7f3334110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 --2- 172.21.15.79:0/618734091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 0x7f333410d870 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 --2- 172.21.15.79:0/618734091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33341049d0 0x7f3334104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 -- 172.21.15.79:0/618734091 >> 172.21.15.79:0/618734091 conn(0x7f3334079740 msgr2=0x7f3334079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:21.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 -- 172.21.15.79:0/618734091 shutdown_connections 2024-09-21T02:43:21.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.463+0000 7f3338c00640 1 -- 172.21.15.79:0/618734091 wait complete. 2024-09-21T02:43:21.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.465+0000 7f3338c00640 1 Processor -- start 2024-09-21T02:43:21.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.465+0000 7f3338c00640 1 -- start start 2024-09-21T02:43:21.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.465+0000 7f3338c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33341049d0 0x7f333419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.465+0000 7f3338c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 0x7f333419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.465+0000 7f3338c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333410de30 0x7f33341a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3338c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3334113a90 con 0x7f3334105320 2024-09-21T02:43:21.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3338c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3334113910 con 0x7f333410de30 2024-09-21T02:43:21.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3338c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3334113c10 con 0x7f33341049d0 2024-09-21T02:43:21.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33341049d0 0x7f333419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33341049d0 0x7f333419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34692/0 (socket says 172.21.15.79:34692) 2024-09-21T02:43:21.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 -- 172.21.15.79:0/1394734958 learned_addr learned my addr 172.21.15.79:0/1394734958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:21.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331400640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 0x7f333419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3332800640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333410de30 0x7f33341a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 -- 172.21.15.79:0/1394734958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333410de30 msgr2=0x7f33341a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333410de30 0x7f33341a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 -- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 msgr2=0x7f333419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 0x7f333419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.466+0000 7f3331e00640 1 -- 172.21.15.79:0/1394734958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33341a2630 con 0x7f33341049d0 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.467+0000 7f3331e00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33341049d0 0x7f333419c6c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f332400e9c0 tx=0x7f332400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.467+0000 7f332aa00640 1 -- 172.21.15.79:0/1394734958 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332400cd80 con 0x7f33341049d0 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.467+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33341a2920 con 0x7f33341049d0 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.467+0000 7f332aa00640 1 -- 172.21.15.79:0/1394734958 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33240035f0 con 0x7f33341049d0 2024-09-21T02:43:21.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.467+0000 7f332aa00640 1 -- 172.21.15.79:0/1394734958 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324010690 con 0x7f33341049d0 2024-09-21T02:43:21.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.467+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33341a9080 con 0x7f33341049d0 2024-09-21T02:43:21.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.471+0000 7f333f82c740 1 Processor -- start 2024-09-21T02:43:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.471+0000 7f333f82c740 1 -- start start 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f333f82c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4b016520 0x55bf4b3bd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f333f82c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 0x55bf4b3bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f333f82c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4aff5840 0x55bf4b3bdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f333f82c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf4b334290 con 0x55bf4b016520 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f333f82c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bf4b3236c0 con 0x55bf4afed660 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f333f82c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55bf4b3274d0 con 0x55bf4aff5840 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f3332800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4b016520 0x55bf4b3bd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f3332800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4b016520 0x55bf4b3bd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59812/0 (socket says 172.21.15.79:59812) 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f3332800640 1 -- 172.21.15.79:0/420152129 learned_addr learned my addr 172.21.15.79:0/420152129 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.472+0000 7f3331400640 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4aff5840 0x55bf4b3bdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f332aa00640 1 -- 172.21.15.79:0/1394734958 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f33240037a0 con 0x7f33341049d0 2024-09-21T02:43:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f3332800640 1 -- 172.21.15.79:0/420152129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4aff5840 msgr2=0x55bf4b3bdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f3332800640 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4aff5840 0x55bf4b3bdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f3332800640 1 -- 172.21.15.79:0/420152129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 msgr2=0x55bf4b3bd700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f3332800640 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 0x55bf4b3bd700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f3332800640 1 -- 172.21.15.79:0/420152129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf4b2b0460 con 0x55bf4b016520 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f3332800640 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4b016520 0x55bf4b3bd1c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f332c010370 tx=0x7f332c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eae1606b398b69e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f331f000640 1 -- 172.21.15.79:0/420152129 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c016070 con 0x55bf4b016520 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f331f000640 1 -- 172.21.15.79:0/420152129 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f332c004d20 con 0x55bf4b016520 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.473+0000 7f331f000640 1 -- 172.21.15.79:0/420152129 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c005420 con 0x55bf4b016520 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f333f82c740 1 -- 172.21.15.79:0/420152129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4b016520 msgr2=0x55bf4b3bd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f333f82c740 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4b016520 0x55bf4b3bd1c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f332c010370 tx=0x7f332c010830 comp rx=0 tx=0).stop 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f333f82c740 1 -- 172.21.15.79:0/420152129 shutdown_connections 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f333f82c740 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4aff5840 0x55bf4b3bdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f332aa00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f33180b6510 0x7f33180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f333f82c740 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 0x55bf4b3bd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f333f82c740 1 --2- 172.21.15.79:0/420152129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4b016520 0x55bf4b3bd1c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.474+0000 7f333f82c740 1 -- 172.21.15.79:0/420152129 >> 172.21.15.79:0/420152129 conn(0x55bf4b00a910 msgr2=0x55bf4b3bb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.475+0000 7f332aa00640 1 -- 172.21.15.79:0/1394734958 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f33240e7a40 con 0x7f33341049d0 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.475+0000 7f333f82c740 1 -- 172.21.15.79:0/420152129 shutdown_connections 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.475+0000 7f3332800640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f33180b6510 0x7f33180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.475+0000 7f333f82c740 1 -- 172.21.15.79:0/420152129 wait complete. 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.475+0000 7f333f82c740 1 -- start start 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.475+0000 7f3332800640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f33180b6510 0x7f33180b8a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f332c010370 tx=0x7f332c000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 1 Processor -- start 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf4b184bb0 con 0x55bf4aff5840 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bf4b2be6c0 con 0x55bf4b016520 2024-09-21T02:43:21.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55bf4b3cb9a0 con 0x55bf4afed660 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f333f82c740 10 client.0 _ll_register_callbacks cb 0x55bf4b2d9490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.476+0000 7f3331400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59826/0 (socket says 172.21.15.79:59826) 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 -- 172.21.15.79:0/2106906892 learned_addr learned my addr 172.21.15.79:0/2106906892 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331e00640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3332800640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 -- 172.21.15.79:0/2106906892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 msgr2=0x55bf4b3c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 -- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 msgr2=0x55bf4b3d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3d4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 -- 172.21.15.79:0/2106906892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf4b081b00 con 0x55bf4aff5840 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331e00640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:21.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3331400640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3c92f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3320009900 tx=0x7f3320032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23452bd2176bc82e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:21.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.477+0000 7f3313400640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:43:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.478+0000 7f3313400640 1 -- 172.21.15.79:0/2106906892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320035040 con 0x55bf4aff5840 2024-09-21T02:43:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.478+0000 7f3313400640 1 -- 172.21.15.79:0/2106906892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3320031760 con 0x55bf4aff5840 2024-09-21T02:43:21.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.478+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f332c004d20 con 0x55bf4aff5840 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.478+0000 7f3313400640 1 -- 172.21.15.79:0/2106906892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f332004f050 con 0x55bf4aff5840 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.478+0000 7f333f82c740 10 client.16014 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.478+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bf4b0f8960 con 0x55bf4aff5840 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.478+0000 7f3313400640 1 -- 172.21.15.79:0/2106906892 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f332c004d20 con 0x55bf4aff5840 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f3313400640 1 -- 172.21.15.79:0/2106906892 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3320004750 con 0x55bf4aff5840 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f333f82c740 10 client.16014 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f333f82c740 10 client.16014 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f333f82c740 20 client.16014 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f333f82c740 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afd4ea0 0x55bf4b3dac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f333f82c740 4 client.16014 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf4b3361e0 con 0x55bf4afd4ea0 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.479+0000 7f3331e00640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afd4ea0 0x55bf4b3dac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.480+0000 7f3313400640 10 client.16014 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:21.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.480+0000 7f3331e00640 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afd4ea0 0x55bf4b3dac80 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73fef4cbfef8e632 server_cookie=e9fa021f915e7dbe in_seq=0 out_seq=0 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.480+0000 7f3313400640 1 -- 172.21.15.79:0/2106906892 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf4b3361e0 con 0x55bf4afd4ea0 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.480+0000 7f3313400640 10 client.16014 handle_command_reply: tid=0 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.480+0000 7f333f82c740 1 client.16014 shutdown 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 msgr2=0x55bf4b3c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3c92f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3320009900 tx=0x7f3320032e90 comp rx=0 tx=0).stop 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 shutdown_connections 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afd4ea0 0x55bf4b3dac80 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f3313400640 0 client.16014 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3c92f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 --2- 172.21.15.79:0/2106906892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 >> 172.21.15.79:0/2106906892 conn(0x55bf4b00a910 msgr2=0x55bf4b3c0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 shutdown_connections 2024-09-21T02:43:21.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 1 -- 172.21.15.79:0/2106906892 wait complete. 2024-09-21T02:43:21.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.481+0000 7f333f82c740 20 client.16014 trim_cache size 0 max 16384 2024-09-21T02:43:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:43:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 Processor -- start 2024-09-21T02:43:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 -- start start 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 0x55bf4b3baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4b016520 0x55bf4b3c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b0e30 con 0x55bf4aff5840 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b36b0 con 0x55bf4afed660 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f333f82c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b14a0 con 0x55bf4b016520 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.500+0000 7f3331400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59836/0 (socket says 172.21.15.79:59836) 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 -- 172.21.15.79:0/579745650 learned_addr learned my addr 172.21.15.79:0/579745650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3332800640 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4b016520 0x55bf4b3c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331e00640 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 0x55bf4b3baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 -- 172.21.15.79:0/579745650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4b016520 msgr2=0x55bf4b3c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4b016520 0x55bf4b3c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 -- 172.21.15.79:0/579745650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 msgr2=0x55bf4b3baaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 0x55bf4b3baaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 -- 172.21.15.79:0/579745650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf4b3c9490 con 0x55bf4aff5840 2024-09-21T02:43:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.501+0000 7f3331400640 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3bafe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f332002a930 tx=0x7f3320001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadc7c46175770de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.502+0000 7f331e600640 1 -- 172.21.15.79:0/579745650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320035070 con 0x55bf4aff5840 2024-09-21T02:43:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.502+0000 7f331e600640 1 -- 172.21.15.79:0/579745650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3320031d10 con 0x55bf4aff5840 2024-09-21T02:43:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.502+0000 7f331e600640 1 -- 172.21.15.79:0/579745650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320003850 con 0x55bf4aff5840 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.502+0000 7f333f82c740 1 -- 172.21.15.79:0/579745650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 msgr2=0x55bf4b3bafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.502+0000 7f333f82c740 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3bafe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f332002a930 tx=0x7f3320001e70 comp rx=0 tx=0).stop 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 -- 172.21.15.79:0/579745650 shutdown_connections 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4b016520 0x55bf4b3c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3bafe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 --2- 172.21.15.79:0/579745650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4afed660 0x55bf4b3baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 -- 172.21.15.79:0/579745650 >> 172.21.15.79:0/579745650 conn(0x55bf4b00a910 msgr2=0x55bf4b3c3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 -- 172.21.15.79:0/579745650 shutdown_connections 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 -- 172.21.15.79:0/579745650 wait complete. 2024-09-21T02:43:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.503+0000 7f333f82c740 1 -- start start 2024-09-21T02:43:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 1 Processor -- start 2024-09-21T02:43:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b1b70 con 0x55bf4aff5840 2024-09-21T02:43:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b2fe0 con 0x55bf4b016520 2024-09-21T02:43:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b2240 con 0x55bf4afed660 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f333f82c740 10 client.0 _ll_register_callbacks cb 0x7f3320009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f3331e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f3331e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34716/0 (socket says 172.21.15.79:34716) 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f3331e00640 1 -- 172.21.15.79:0/746809830 learned_addr learned my addr 172.21.15.79:0/746809830 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.504+0000 7f3331400640 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3332800640 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3331e00640 1 -- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 msgr2=0x55bf4b3cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3331e00640 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3331e00640 1 -- 172.21.15.79:0/746809830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 msgr2=0x55bf4b3cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3331e00640 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3331e00640 1 -- 172.21.15.79:0/746809830 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf4b3cc680 con 0x55bf4afed660 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3331e00640 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3d11e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f33240058c0 tx=0x7f332400e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd770a682ebf4b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3313400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:21.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3313400640 1 -- 172.21.15.79:0/746809830 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240acc20 con 0x55bf4afed660 2024-09-21T02:43:21.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3320031d10 con 0x55bf4afed660 2024-09-21T02:43:21.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.505+0000 7f3313400640 1 -- 172.21.15.79:0/746809830 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f33240aeaf0 con 0x55bf4afed660 2024-09-21T02:43:21.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f3313400640 1 -- 172.21.15.79:0/746809830 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f33240adec0 con 0x55bf4afed660 2024-09-21T02:43:21.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f333f82c740 10 client.26209 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:21.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bf4b446420 con 0x55bf4afed660 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f3313400640 1 -- 172.21.15.79:0/746809830 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3320031d10 con 0x55bf4afed660 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f3313400640 1 -- 172.21.15.79:0/746809830 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f33240ac490 con 0x55bf4afed660 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f333f82c740 10 client.26209 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f333f82c740 10 client.26209 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.506+0000 7f333f82c740 20 client.26209 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.507+0000 7f333f82c740 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afaa250 0x55bf4b448b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.507+0000 7f333f82c740 4 client.26209 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d4964603", "release": true, "await": true}] 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.507+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d4964603", "release": true, "await": true}) -- 0x55bf4b331c90 con 0x55bf4afaa250 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.507+0000 7f3331400640 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afaa250 0x55bf4b448b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:21.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.508+0000 7f3313400640 10 client.26209 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:21.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.507+0000 7f3331400640 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afaa250 0x55bf4b448b90 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbb1fe18767d5e03 server_cookie=a79aee58bac2e831 in_seq=0 out_seq=0 2024-09-21T02:43:21.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.557+0000 7f3313400640 1 -- 172.21.15.79:0/746809830 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bf4b331c90 con 0x55bf4afaa250 2024-09-21T02:43:21.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.557+0000 7f3313400640 10 client.26209 handle_command_reply: tid=0 2024-09-21T02:43:21.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.557+0000 7f333f82c740 1 client.26209 shutdown 2024-09-21T02:43:21.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 msgr2=0x55bf4b3d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3d11e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f33240058c0 tx=0x7f332400e940 comp rx=0 tx=0).stop 2024-09-21T02:43:21.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 shutdown_connections 2024-09-21T02:43:21.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55bf4afaa250 0x55bf4b448b90 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf4b016520 0x55bf4b3cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf4aff5840 0x55bf4b3cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 --2- 172.21.15.79:0/746809830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bf4afed660 0x55bf4b3d11e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 >> 172.21.15.79:0/746809830 conn(0x55bf4b00a910 msgr2=0x55bf4b3c3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:21.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.558+0000 7f3313400640 0 client.26209 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:21.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.559+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 shutdown_connections 2024-09-21T02:43:21.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.559+0000 7f333f82c740 1 -- 172.21.15.79:0/746809830 wait complete. 2024-09-21T02:43:21.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.559+0000 7f333f82c740 20 client.26209 trim_cache size 0 max 16384 2024-09-21T02:43:21.561 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 32, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "d4964603": { 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 32, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 141.1, 2024-09-21T02:43:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:21.563 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.560+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f33180b6510 msgr2=0x7f33180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.560+0000 7f3338c00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f33180b6510 0x7f33180b8a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f332c010370 tx=0x7f332c000f40 comp rx=0 tx=0).stop 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.560+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33341049d0 msgr2=0x7f333419c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.560+0000 7f3338c00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33341049d0 0x7f333419c6c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f332400e9c0 tx=0x7f332400ee80 comp rx=0 tx=0).stop 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 shutdown_connections 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f33180b6510 0x7f33180b8a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333410de30 0x7f33341a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3334105320 0x7f333419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 --2- 172.21.15.79:0/1394734958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33341049d0 0x7f333419c6c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:21.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 >> 172.21.15.79:0/1394734958 conn(0x7f3334079740 msgr2=0x7f3334109c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:21.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 shutdown_connections 2024-09-21T02:43:21.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:21.561+0000 7f3338c00640 1 -- 172.21.15.79:0/1394734958 wait complete. 2024-09-21T02:43:21.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:21 smithi098 ceph-mon[34832]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 537 KiB/s wr, 11 op/s 2024-09-21T02:43:21.977 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:21 smithi079 ceph-mon[30788]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 537 KiB/s wr, 11 op/s 2024-09-21T02:43:22.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:21 smithi148 ceph-mon[34626]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 537 KiB/s wr, 11 op/s 2024-09-21T02:43:22.445 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd4964603', total seconds elapsed: 25.2 2024-09-21T02:43:22.445 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T02:43:22.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:43:23.136 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:23.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:23 smithi098 ceph-mon[34832]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 541 KiB/s wr, 13 op/s 2024-09-21T02:43:23.907 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:23 smithi079 ceph-mon[30788]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 541 KiB/s wr, 13 op/s 2024-09-21T02:43:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:23 smithi148 ceph-mon[34626]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 541 KiB/s wr, 13 op/s 2024-09-21T02:43:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.112+0000 7f42f3e00640 1 -- 172.21.15.79:0/4197019625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f4105bc0 msgr2=0x7f42f4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.112+0000 7f42f3e00640 1 --2- 172.21.15.79:0/4197019625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f4105bc0 0x7f42f4105fd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f42ec01a910 tx=0x7f42ec03b470 comp rx=0 tx=0).stop 2024-09-21T02:43:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.114+0000 7f42f3e00640 1 -- 172.21.15.79:0/4197019625 shutdown_connections 2024-09-21T02:43:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.114+0000 7f42f3e00640 1 --2- 172.21.15.79:0/4197019625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410be50 0x7f42f4112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.114+0000 7f42f3e00640 1 --2- 172.21.15.79:0/4197019625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42f410b500 0x7f42f410b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.114+0000 7f42f3e00640 1 --2- 172.21.15.79:0/4197019625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f4105bc0 0x7f42f4105fd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.114+0000 7f42f3e00640 1 -- 172.21.15.79:0/4197019625 >> 172.21.15.79:0/4197019625 conn(0x7f42f4101630 msgr2=0x7f42f4103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:24.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.114+0000 7f42f3e00640 1 -- 172.21.15.79:0/4197019625 shutdown_connections 2024-09-21T02:43:24.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.114+0000 7f42f3e00640 1 -- 172.21.15.79:0/4197019625 wait complete. 2024-09-21T02:43:24.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 Processor -- start 2024-09-21T02:43:24.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 -- start start 2024-09-21T02:43:24.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42f4105bc0 0x7f42f4112510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:24.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410b500 0x7f42f4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:24.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f410be50 0x7f42f4073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:24.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42f406f750 con 0x7f42f410be50 2024-09-21T02:43:24.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42f406f5d0 con 0x7f42f410b500 2024-09-21T02:43:24.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.117+0000 7f42f3e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42f406f8d0 con 0x7f42f4105bc0 2024-09-21T02:43:24.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.118+0000 7f42f2000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410b500 0x7f42f4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:24.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.118+0000 7f42f2000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410b500 0x7f42f4073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52432/0 (socket says 172.21.15.79:52432) 2024-09-21T02:43:24.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.118+0000 7f42f2000640 1 -- 172.21.15.79:0/1445090497 learned_addr learned my addr 172.21.15.79:0/1445090497 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:24.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.118+0000 7f42f3400640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f410be50 0x7f42f4073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:24.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.119+0000 7f42f2a00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42f4105bc0 0x7f42f4112510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:24.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.119+0000 7f42f2a00640 1 -- 172.21.15.79:0/1445090497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410b500 msgr2=0x7f42f4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:24.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.119+0000 7f42f2a00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410b500 0x7f42f4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.119+0000 7f42f2a00640 1 -- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f410be50 msgr2=0x7f42f4073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:24.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.119+0000 7f42f2a00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f410be50 0x7f42f4073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.120+0000 7f42f2a00640 1 -- 172.21.15.79:0/1445090497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f4074070 con 0x7f42f4105bc0 2024-09-21T02:43:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.120+0000 7f42f2000640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410b500 0x7f42f4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.121+0000 7f42f2a00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42f4105bc0 0x7f42f4112510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f42ec006010 tx=0x7f42ec004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.122+0000 7f42eb400640 1 -- 172.21.15.79:0/1445090497 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec04f070 con 0x7f42f4105bc0 2024-09-21T02:43:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.122+0000 7f42eb400640 1 -- 172.21.15.79:0/1445090497 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42ec040bd0 con 0x7f42f4105bc0 2024-09-21T02:43:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.122+0000 7f42eb400640 1 -- 172.21.15.79:0/1445090497 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec046030 con 0x7f42f4105bc0 2024-09-21T02:43:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.123+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f4074300 con 0x7f42f4105bc0 2024-09-21T02:43:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.124+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f419c2b0 con 0x7f42f4105bc0 2024-09-21T02:43:24.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.125+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f4106050 con 0x7f42f4105bc0 2024-09-21T02:43:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.130+0000 7f42eb400640 1 -- 172.21.15.79:0/1445090497 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f42ec052070 con 0x7f42f4105bc0 2024-09-21T02:43:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.132+0000 7f42eb400640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42d80b65d0 0x7f42d80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.133+0000 7f42f2000640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42d80b65d0 0x7f42d80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:24.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.134+0000 7f42eb400640 1 -- 172.21.15.79:0/1445090497 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f42ec040d80 con 0x7f42f4105bc0 2024-09-21T02:43:24.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.134+0000 7f42f2000640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42d80b65d0 0x7f42d80b8ae0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42f410b0a0 tx=0x7f42e0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:24.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.135+0000 7f42eb400640 1 -- 172.21.15.79:0/1445090497 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42ec0e38f0 con 0x7f42f4105bc0 2024-09-21T02:43:24.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.584+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f402e640 con 0x7f42f4105bc0 2024-09-21T02:43:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:43:24.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.586+0000 7f42eb400640 1 -- 172.21.15.79:0/1445090497 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f42ec0e87a0 con 0x7f42f4105bc0 2024-09-21T02:43:24.592 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:43:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:43:24.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.592+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42d80b65d0 msgr2=0x7f42d80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:24.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.592+0000 7f42f3e00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42d80b65d0 0x7f42d80b8ae0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42f410b0a0 tx=0x7f42e0008040 comp rx=0 tx=0).stop 2024-09-21T02:43:24.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.592+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42f4105bc0 msgr2=0x7f42f4112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:24.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.592+0000 7f42f3e00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42f4105bc0 0x7f42f4112510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f42ec006010 tx=0x7f42ec004a30 comp rx=0 tx=0).stop 2024-09-21T02:43:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.593+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 shutdown_connections 2024-09-21T02:43:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.593+0000 7f42f3e00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f42d80b65d0 0x7f42d80b8ae0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.593+0000 7f42f3e00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42f410be50 0x7f42f4073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.593+0000 7f42f3e00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410b500 0x7f42f4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.593+0000 7f42f3e00640 1 --2- 172.21.15.79:0/1445090497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42f4105bc0 0x7f42f4112510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.593+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 >> 172.21.15.79:0/1445090497 conn(0x7f42f4101630 msgr2=0x7f42f4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:24.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.600+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 shutdown_connections 2024-09-21T02:43:24.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:24.601+0000 7f42f3e00640 1 -- 172.21.15.79:0/1445090497 wait complete. 2024-09-21T02:43:24.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:24 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1445090497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:24 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1445090497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:24 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1445090497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:25.519 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T02:43:25.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T02:43:25.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:25 smithi079 ceph-mon[30788]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 110 KiB/s wr, 22 op/s 2024-09-21T02:43:25.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:25 smithi098 ceph-mon[34832]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 110 KiB/s wr, 22 op/s 2024-09-21T02:43:25.964 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:25 smithi148 ceph-mon[34626]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 110 KiB/s wr, 22 op/s 2024-09-21T02:43:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 450.0 s, 517.5 tps, lat 948.893 ms stddev 3835.955 2024-09-21T02:43:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.707+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1861109993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e78109280 msgr2=0x7f7e7810b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.707+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1861109993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e78109280 0x7f7e7810b790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009ca0 tx=0x7f7e7002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.707+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1861109993 shutdown_connections 2024-09-21T02:43:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.707+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1861109993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e78109280 0x7f7e7810b790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.707+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1861109993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e78106720 0x7f7e78108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.707+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1861109993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e7806b6b0 0x7f7e781061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.707+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1861109993 >> 172.21.15.79:0/1861109993 conn(0x7f7e780fdd80 msgr2=0x7f7e78100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.708+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1861109993 shutdown_connections 2024-09-21T02:43:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.708+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1861109993 wait complete. 2024-09-21T02:43:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.710+0000 7f7e7ee00640 1 Processor -- start 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.712+0000 7f7e7ee00640 1 -- start start 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.712+0000 7f7e7ee00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e7806b6b0 0x7f7e78197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.712+0000 7f7e7ee00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e78106720 0x7f7e78198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.712+0000 7f7e7ee00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e78109280 0x7f7e78198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.712+0000 7f7e7ee00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7810d010 con 0x7f7e78106720 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.712+0000 7f7e7ee00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7810ce90 con 0x7f7e78109280 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.712+0000 7f7e7ee00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7810d190 con 0x7f7e7806b6b0 2024-09-21T02:43:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e7806b6b0 0x7f7e78197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e7806b6b0 0x7f7e78197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38410/0 (socket says 172.21.15.79:38410) 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 -- 172.21.15.79:0/1314096315 learned_addr learned my addr 172.21.15.79:0/1314096315 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 -- 172.21.15.79:0/1314096315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e78109280 msgr2=0x7f7e78198db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e78109280 0x7f7e78198db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 -- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e78106720 msgr2=0x7f7e78198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e78106720 0x7f7e78198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.713+0000 7f7e7da00640 1 -- 172.21.15.79:0/1314096315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e781995d0 con 0x7f7e7806b6b0 2024-09-21T02:43:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.714+0000 7f7e7da00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e7806b6b0 0x7f7e78197b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400ea60 tx=0x7f7e6400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.716+0000 7f7e76000640 1 -- 172.21.15.79:0/1314096315 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400cde0 con 0x7f7e7806b6b0 2024-09-21T02:43:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.716+0000 7f7e76000640 1 -- 172.21.15.79:0/1314096315 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e640035f0 con 0x7f7e7806b6b0 2024-09-21T02:43:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.716+0000 7f7e76000640 1 -- 172.21.15.79:0/1314096315 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64010690 con 0x7f7e7806b6b0 2024-09-21T02:43:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.716+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e781998c0 con 0x7f7e7806b6b0 2024-09-21T02:43:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.717+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7806d040 con 0x7f7e7806b6b0 2024-09-21T02:43:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.722+0000 7f7e873e2740 1 Processor -- start 2024-09-21T02:43:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.722+0000 7f7e873e2740 1 -- start start 2024-09-21T02:43:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255846e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255846e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255846f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e873e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5625583e16b0 con 0x5625580a64d0 2024-09-21T02:43:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e873e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5625583d0ae0 con 0x56255809e2f0 2024-09-21T02:43:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e873e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5625583d48f0 con 0x5625580c71b0 2024-09-21T02:43:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e76000640 1 -- 172.21.15.79:0/1314096315 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7e640037a0 con 0x7f7e7806b6b0 2024-09-21T02:43:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e7e400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255846e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e7e400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255846e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38422/0 (socket says 172.21.15.79:38422) 2024-09-21T02:43:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.724+0000 7f7e7e400640 1 -- 172.21.15.79:0/2521899439 learned_addr learned my addr 172.21.15.79:0/2521899439 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.723+0000 7f7e7d000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255846f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.725+0000 7f7e7da00640 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255846e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.726+0000 7f7e76000640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7e600ba9a0 0x7f7e600bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.726+0000 7f7e76000640 1 -- 172.21.15.79:0/1314096315 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7e640e7b00 con 0x7f7e7806b6b0 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.728+0000 7f7e7e400640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7e600ba9a0 0x7f7e600bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.728+0000 7f7e7e400640 1 -- 172.21.15.79:0/2521899439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 msgr2=0x56255846e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.728+0000 7f7e7e400640 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255846e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.728+0000 7f7e7e400640 1 -- 172.21.15.79:0/2521899439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 msgr2=0x56255846f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.728+0000 7f7e7e400640 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255846f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.728+0000 7f7e7e400640 1 -- 172.21.15.79:0/2521899439 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56255839d780 con 0x5625580c71b0 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.728+0000 7f7e7e400640 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255846e2b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e70004af0 tx=0x7f7e70031e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4658db0bcf1524 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.729+0000 7f7e7d000640 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255846f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.729+0000 7f7e7da00640 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255846e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.729+0000 7f7e6aa00640 1 -- 172.21.15.79:0/2521899439 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70004410 con 0x5625580c71b0 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.729+0000 7f7e6aa00640 1 -- 172.21.15.79:0/2521899439 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e70036070 con 0x5625580c71b0 2024-09-21T02:43:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.729+0000 7f7e6aa00640 1 -- 172.21.15.79:0/2521899439 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70030df0 con 0x5625580c71b0 2024-09-21T02:43:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.730+0000 7f7e873e2740 1 -- 172.21.15.79:0/2521899439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 msgr2=0x56255846e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.730+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255846e2b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e70004af0 tx=0x7f7e70031e80 comp rx=0 tx=0).stop 2024-09-21T02:43:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.730+0000 7f7e7e400640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7e600ba9a0 0x7f7e600bceb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7e70006010 tx=0x7f7e70048000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.731+0000 7f7e873e2740 1 -- 172.21.15.79:0/2521899439 shutdown_connections 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.731+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255846f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.731+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255846e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.731+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2521899439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255846e2b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.731+0000 7f7e873e2740 1 -- 172.21.15.79:0/2521899439 >> 172.21.15.79:0/2521899439 conn(0x5625580bb300 msgr2=0x562558469d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.732+0000 7f7e873e2740 1 -- 172.21.15.79:0/2521899439 shutdown_connections 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.732+0000 7f7e873e2740 1 -- 172.21.15.79:0/2521899439 wait complete. 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.733+0000 7f7e873e2740 1 -- start start 2024-09-21T02:43:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.733+0000 7f7e873e2740 1 Processor -- start 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x5625584779c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580a64d0 0x562558478080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580c71b0 0x562558478bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e873e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562558308ab0 con 0x5625580c71b0 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e873e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562558377570 con 0x56255809e2f0 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e873e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56255846ff30 con 0x5625580a64d0 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e873e2740 10 client.0 _ll_register_callbacks cb 0x562558386100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e7d000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580a64d0 0x562558478080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e7d000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580a64d0 0x562558478080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38436/0 (socket says 172.21.15.79:38436) 2024-09-21T02:43:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.736+0000 7f7e7d000640 1 -- 172.21.15.79:0/3626215226 learned_addr learned my addr 172.21.15.79:0/3626215226 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:26.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.737+0000 7f7e7da00640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x5625584779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.737+0000 7f7e7d000640 1 -- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 msgr2=0x5625584779c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.737+0000 7f7e7d000640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x5625584779c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.737+0000 7f7e7d000640 1 -- 172.21.15.79:0/3626215226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580c71b0 msgr2=0x562558478bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.738+0000 7f7e7e400640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580c71b0 0x562558478bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.738+0000 7f7e7d000640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580c71b0 0x562558478bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.738+0000 7f7e7d000640 1 -- 172.21.15.79:0/3626215226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562558132790 con 0x5625580a64d0 2024-09-21T02:43:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.738+0000 7f7e7da00640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x5625584779c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.739+0000 7f7e7d000640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580a64d0 0x562558478080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00d1e0 tx=0x7f7e6c00d6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d32d085f1663eee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.739+0000 7f7e5f400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.739+0000 7f7e5f400640 1 -- 172.21.15.79:0/3626215226 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c012630 con 0x5625580a64d0 2024-09-21T02:43:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.739+0000 7f7e5f400640 1 -- 172.21.15.79:0/3626215226 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7e6c0127d0 con 0x5625580a64d0 2024-09-21T02:43:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.740+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e70036070 con 0x5625580a64d0 2024-09-21T02:43:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.740+0000 7f7e5f400640 1 -- 172.21.15.79:0/3626215226 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7e6c0129d0 con 0x5625580a64d0 2024-09-21T02:43:26.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.740+0000 7f7e873e2740 10 client.26224 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:26.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.740+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5625581ab620 con 0x5625580a64d0 2024-09-21T02:43:26.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e5f400640 1 -- 172.21.15.79:0/3626215226 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e70036070 con 0x5625580a64d0 2024-09-21T02:43:26.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e5f400640 1 -- 172.21.15.79:0/3626215226 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7e6c01c030 con 0x5625580a64d0 2024-09-21T02:43:26.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e873e2740 10 client.26224 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e873e2740 10 client.26224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e873e2740 20 client.26224 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e873e2740 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562558085d80 0x562558485100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e873e2740 4 client.26224 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.741+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625583e3600 con 0x562558085d80 2024-09-21T02:43:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.742+0000 7f7e7da00640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562558085d80 0x562558485100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.743+0000 7f7e7da00640 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562558085d80 0x562558485100 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2bdedb69b8e82e9 server_cookie=3d3e670222c0d058 in_seq=0 out_seq=0 2024-09-21T02:43:26.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.743+0000 7f7e5f400640 10 client.26224 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.744+0000 7f7e5f400640 1 -- 172.21.15.79:0/3626215226 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625583e3600 con 0x562558085d80 2024-09-21T02:43:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.744+0000 7f7e5f400640 10 client.26224 handle_command_reply: tid=0 2024-09-21T02:43:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.744+0000 7f7e873e2740 1 client.26224 shutdown 2024-09-21T02:43:26.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580a64d0 msgr2=0x562558478080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580a64d0 0x562558478080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00d1e0 tx=0x7f7e6c00d6a0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 shutdown_connections 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562558085d80 0x562558485100 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580c71b0 0x562558478bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580a64d0 0x562558478080 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 --2- 172.21.15.79:0/3626215226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x5625584779c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 >> 172.21.15.79:0/3626215226 conn(0x5625580bb300 msgr2=0x562558468360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e5f400640 0 client.26224 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 shutdown_connections 2024-09-21T02:43:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.745+0000 7f7e873e2740 1 -- 172.21.15.79:0/3626215226 wait complete. 2024-09-21T02:43:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.746+0000 7f7e873e2740 20 client.26224 trim_cache size 0 max 16384 2024-09-21T02:43:26.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.780+0000 7f7e873e2740 1 Processor -- start 2024-09-21T02:43:26.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e873e2740 1 -- start start 2024-09-21T02:43:26.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255809e2f0 0x562558469680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x5625584779c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5625580c71b0 0x562558477f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e873e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e78075450 con 0x5625580a64d0 2024-09-21T02:43:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e873e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781b34c0 con 0x5625580c71b0 2024-09-21T02:43:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e873e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781b12b0 con 0x56255809e2f0 2024-09-21T02:43:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.782+0000 7f7e7da00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255809e2f0 0x562558469680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.783+0000 7f7e7da00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255809e2f0 0x562558469680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38446/0 (socket says 172.21.15.79:38446) 2024-09-21T02:43:26.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.783+0000 7f7e7e400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5625580c71b0 0x562558477f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.783+0000 7f7e7da00640 1 -- 172.21.15.79:0/2411627075 learned_addr learned my addr 172.21.15.79:0/2411627075 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:26.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.783+0000 7f7e7d000640 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x5625584779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.784+0000 7f7e7e400640 1 -- 172.21.15.79:0/2411627075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255809e2f0 msgr2=0x562558469680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.784+0000 7f7e7e400640 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255809e2f0 0x562558469680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.784+0000 7f7e7e400640 1 -- 172.21.15.79:0/2411627075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 msgr2=0x5625584779c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.784+0000 7f7e7e400640 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x5625584779c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.784+0000 7f7e7e400640 1 -- 172.21.15.79:0/2411627075 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562558470070 con 0x5625580c71b0 2024-09-21T02:43:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.785+0000 7f7e7e400640 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5625580c71b0 0x562558477f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e70031e00 tx=0x7f7e7002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908317bedb0df9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:26.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.785+0000 7f7e6a000640 1 -- 172.21.15.79:0/2411627075 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70056070 con 0x5625580c71b0 2024-09-21T02:43:26.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.786+0000 7f7e6a000640 1 -- 172.21.15.79:0/2411627075 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e70036040 con 0x5625580c71b0 2024-09-21T02:43:26.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.786+0000 7f7e6a000640 1 -- 172.21.15.79:0/2411627075 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700309c0 con 0x5625580c71b0 2024-09-21T02:43:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.787+0000 7f7e873e2740 1 -- 172.21.15.79:0/2411627075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5625580c71b0 msgr2=0x562558477f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.787+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5625580c71b0 0x562558477f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e70031e00 tx=0x7f7e7002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.787+0000 7f7e873e2740 1 -- 172.21.15.79:0/2411627075 shutdown_connections 2024-09-21T02:43:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.787+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5625580c71b0 0x562558477f00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.787+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x5625584779c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.787+0000 7f7e873e2740 1 --2- 172.21.15.79:0/2411627075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255809e2f0 0x562558469680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.787+0000 7f7e873e2740 1 -- 172.21.15.79:0/2411627075 >> 172.21.15.79:0/2411627075 conn(0x5625580bb300 msgr2=0x56255846dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.788+0000 7f7e873e2740 1 -- 172.21.15.79:0/2411627075 shutdown_connections 2024-09-21T02:43:26.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.788+0000 7f7e873e2740 1 -- 172.21.15.79:0/2411627075 wait complete. 2024-09-21T02:43:26.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.788+0000 7f7e873e2740 1 -- start start 2024-09-21T02:43:26.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.789+0000 7f7e873e2740 1 Processor -- start 2024-09-21T02:43:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.789+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255847f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.789+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255847e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.789+0000 7f7e873e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255847e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e873e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781b1980 con 0x5625580a64d0 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e873e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781b2df0 con 0x56255809e2f0 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e873e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781b2050 con 0x5625580c71b0 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255847f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e873e2740 10 client.0 _ll_register_callbacks cb 0x7f7e6c00b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255847f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52468/0 (socket says 172.21.15.79:52468) 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 -- 172.21.15.79:0/1520379810 learned_addr learned my addr 172.21.15.79:0/1520379810 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7d000640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255847e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7e400640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255847e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 -- 172.21.15.79:0/1520379810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 msgr2=0x56255847e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255847e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 -- 172.21.15.79:0/1520379810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 msgr2=0x56255847e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255847e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7da00640 1 -- 172.21.15.79:0/1520379810 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56255847ebe0 con 0x56255809e2f0 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.790+0000 7f7e7d000640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255847e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e7da00640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255847f4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e640e51c0 tx=0x7f7e64003e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28105b28f361013f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e5f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e5f400640 1 -- 172.21.15.79:0/1520379810 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e640b2070 con 0x56255809e2f0 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e5f400640 1 -- 172.21.15.79:0/1520379810 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7e640aebb0 con 0x56255809e2f0 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e70036040 con 0x56255809e2f0 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e5f400640 1 -- 172.21.15.79:0/1520379810 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7e640c8050 con 0x56255809e2f0 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e873e2740 10 client.26207 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56255847da30 con 0x56255809e2f0 2024-09-21T02:43:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.791+0000 7f7e5f400640 1 -- 172.21.15.79:0/1520379810 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e70036040 con 0x56255809e2f0 2024-09-21T02:43:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e5f400640 1 -- 172.21.15.79:0/1520379810 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7e640acae0 con 0x56255809e2f0 2024-09-21T02:43:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e873e2740 10 client.26207 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e873e2740 10 client.26207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e873e2740 20 client.26207 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e873e2740 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56255805b1c0 0x5625584fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e873e2740 4 client.26207 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625583df0b0 con 0x56255805b1c0 2024-09-21T02:43:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.792+0000 7f7e7d000640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56255805b1c0 0x5625584fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.793+0000 7f7e7d000640 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56255805b1c0 0x5625584fa9a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd1fc293ebeee58 server_cookie=f8e2db1e07b7821a in_seq=0 out_seq=0 2024-09-21T02:43:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.793+0000 7f7e5f400640 10 client.26207 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:26.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:26 smithi079 ceph-mon[30788]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 571 KiB/s wr, 80 op/s 2024-09-21T02:43:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.964+0000 7f7e5f400640 1 -- 172.21.15.79:0/1520379810 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625583df0b0 con 0x56255805b1c0 2024-09-21T02:43:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.964+0000 7f7e5f400640 10 client.26207 handle_command_reply: tid=0 2024-09-21T02:43:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.965+0000 7f7e873e2740 1 client.26207 shutdown 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.965+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 msgr2=0x56255847f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.965+0000 7f7e873e2740 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255847f4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e640e51c0 tx=0x7f7e64003e90 comp rx=0 tx=0).stop 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.965+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 shutdown_connections 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.965+0000 7f7e873e2740 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56255805b1c0 0x5625584fa9a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.965+0000 7f7e873e2740 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625580c71b0 0x56255847e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.966+0000 7f7e873e2740 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625580a64d0 0x56255847e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.965+0000 7f7e5f400640 0 client.26207 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.966+0000 7f7e873e2740 1 --2- 172.21.15.79:0/1520379810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56255809e2f0 0x56255847f4a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.966+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 >> 172.21.15.79:0/1520379810 conn(0x5625580bb300 msgr2=0x56255846dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.966+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 shutdown_connections 2024-09-21T02:43:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.966+0000 7f7e873e2740 1 -- 172.21.15.79:0/1520379810 wait complete. 2024-09-21T02:43:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.966+0000 7f7e873e2740 20 client.26207 trim_cache size 0 max 16384 2024-09-21T02:43:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:43:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:43:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:43:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:43:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7e600ba9a0 msgr2=0x7f7e600bceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7e600ba9a0 0x7f7e600bceb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7e70006010 tx=0x7f7e70048000 comp rx=0 tx=0).stop 2024-09-21T02:43:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e7806b6b0 msgr2=0x7f7e78197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e7806b6b0 0x7f7e78197b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400ea60 tx=0x7f7e6400ef20 comp rx=0 tx=0).stop 2024-09-21T02:43:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 shutdown_connections 2024-09-21T02:43:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7e600ba9a0 0x7f7e600bceb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e78109280 0x7f7e78198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e78106720 0x7f7e78198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 --2- 172.21.15.79:0/1314096315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e7806b6b0 0x7f7e78197b90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.968+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 >> 172.21.15.79:0/1314096315 conn(0x7f7e780fdd80 msgr2=0x7f7e78104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.969+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 shutdown_connections 2024-09-21T02:43:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:26.969+0000 7f7e7ee00640 1 -- 172.21.15.79:0/1314096315 wait complete. 2024-09-21T02:43:27.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:26 smithi148 ceph-mon[34626]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 571 KiB/s wr, 80 op/s 2024-09-21T02:43:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:26 smithi098 ceph-mon[34832]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 571 KiB/s wr, 80 op/s 2024-09-21T02:43:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 -- 172.21.15.79:0/267960209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f135410de10 msgr2=0x7f1354110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 --2- 172.21.15.79:0/267960209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f135410de10 0x7f1354110320 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f134c009ca0 tx=0x7f134c02a8b0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 -- 172.21.15.79:0/267960209 shutdown_connections 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 --2- 172.21.15.79:0/267960209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f135410de10 0x7f1354110320 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 --2- 172.21.15.79:0/267960209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1354105290 0x7f135410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 --2- 172.21.15.79:0/267960209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1354104860 0x7f1354104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 -- 172.21.15.79:0/267960209 >> 172.21.15.79:0/267960209 conn(0x7f1354079760 msgr2=0x7f1354079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 -- 172.21.15.79:0/267960209 shutdown_connections 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.326+0000 7f135c400640 1 -- 172.21.15.79:0/267960209 wait complete. 2024-09-21T02:43:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.328+0000 7f135c400640 1 Processor -- start 2024-09-21T02:43:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.328+0000 7f135c400640 1 -- start start 2024-09-21T02:43:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f135c400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1354104860 0x7f1354114c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f135c400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1354105290 0x7f1354110ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f135c400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135410de10 0x7f1354111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f135c400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1354115cb0 con 0x7f1354105290 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f135c400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1354115b30 con 0x7f1354104860 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f135c400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1354115e30 con 0x7f135410de10 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f1359a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1354104860 0x7f1354114c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f1359a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1354104860 0x7f1354114c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52496/0 (socket says 172.21.15.79:52496) 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f1359a00640 1 -- 172.21.15.79:0/3699714056 learned_addr learned my addr 172.21.15.79:0/3699714056 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.329+0000 7f1359000640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1354105290 0x7f1354110ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f135a400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135410de10 0x7f1354111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f1359a00640 1 -- 172.21.15.79:0/3699714056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135410de10 msgr2=0x7f1354111600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f1359a00640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135410de10 0x7f1354111600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f1359a00640 1 -- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1354105290 msgr2=0x7f1354110ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f1359a00640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1354105290 0x7f1354110ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f1359a00640 1 -- 172.21.15.79:0/3699714056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13541acc10 con 0x7f1354104860 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f135a400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135410de10 0x7f1354111600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f1359000640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1354105290 0x7f1354110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.330+0000 7f1359a00640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1354104860 0x7f1354114c00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f134800d950 tx=0x7f134800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.331+0000 7f1352000640 1 -- 172.21.15.79:0/3699714056 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348017070 con 0x7f1354104860 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.331+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13541ace40 con 0x7f1354104860 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.331+0000 7f1352000640 1 -- 172.21.15.79:0/3699714056 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1348009c30 con 0x7f1354104860 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.331+0000 7f1352000640 1 -- 172.21.15.79:0/3699714056 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134800f620 con 0x7f1354104860 2024-09-21T02:43:27.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.331+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13541ad290 con 0x7f1354104860 2024-09-21T02:43:27.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.335+0000 7f13631d0740 1 Processor -- start 2024-09-21T02:43:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.335+0000 7f13631d0740 1 -- start start 2024-09-21T02:43:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f13631d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffbe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f13631d0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffbeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f13631d0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffbf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f13631d0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b82ff34a90 con 0x55b82fc17850 2024-09-21T02:43:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f13631d0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b82ff23ec0 con 0x55b82fbf6b70 2024-09-21T02:43:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f13631d0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b82ff27cd0 con 0x55b82fbee990 2024-09-21T02:43:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f1352000640 1 -- 172.21.15.79:0/3699714056 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f134801a070 con 0x7f1354104860 2024-09-21T02:43:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f1359000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffbf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f1359000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffbf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52502/0 (socket says 172.21.15.79:52502) 2024-09-21T02:43:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.336+0000 7f1359000640 1 -- 172.21.15.79:0/3818146918 learned_addr learned my addr 172.21.15.79:0/3818146918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:27.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.337+0000 7f135a400640 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffbe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.337+0000 7f1359a00640 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffbeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.337+0000 7f1359000640 1 -- 172.21.15.79:0/3818146918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 msgr2=0x55b82ffbeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.338+0000 7f1359000640 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffbeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.338+0000 7f1359000640 1 -- 172.21.15.79:0/3818146918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 msgr2=0x55b82ffbe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.338+0000 7f1359000640 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffbe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.338+0000 7f1359000640 1 -- 172.21.15.79:0/3818146918 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b82fec99d0 con 0x55b82fbf6b70 2024-09-21T02:43:27.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.338+0000 7f135a400640 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffbe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:27.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.338+0000 7f1352000640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f133c0b6510 0x7f133c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.339+0000 7f1352000640 1 -- 172.21.15.79:0/3699714056 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f13480e7220 con 0x7f1354104860 2024-09-21T02:43:27.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.339+0000 7f1359000640 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffbf430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1340009bf0 tx=0x7f13400117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c723b9c35865d81f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:27.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.339+0000 7f1346a00640 1 -- 172.21.15.79:0/3818146918 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340012450 con 0x55b82fbf6b70 2024-09-21T02:43:27.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.339+0000 7f1346a00640 1 -- 172.21.15.79:0/3818146918 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1340012aa0 con 0x55b82fbf6b70 2024-09-21T02:43:27.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.339+0000 7f1346a00640 1 -- 172.21.15.79:0/3818146918 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134000fb10 con 0x55b82fbf6b70 2024-09-21T02:43:27.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.340+0000 7f135a400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f133c0b6510 0x7f133c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.340+0000 7f13631d0740 1 -- 172.21.15.79:0/3818146918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 msgr2=0x55b82ffbf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.340+0000 7f13631d0740 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffbf430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1340009bf0 tx=0x7f13400117b0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f135a400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f133c0b6510 0x7f133c0b8a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f134c005e30 tx=0x7f134c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:27.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 -- 172.21.15.79:0/3818146918 shutdown_connections 2024-09-21T02:43:27.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffbf430 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffbeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 --2- 172.21.15.79:0/3818146918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffbe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 -- 172.21.15.79:0/3818146918 >> 172.21.15.79:0/3818146918 conn(0x55b82fc0bc40 msgr2=0x55b82ffbc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:27.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 -- 172.21.15.79:0/3818146918 shutdown_connections 2024-09-21T02:43:27.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 -- 172.21.15.79:0/3818146918 wait complete. 2024-09-21T02:43:27.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.341+0000 7f13631d0740 1 -- start start 2024-09-21T02:43:27.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 1 Processor -- start 2024-09-21T02:43:27.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffcaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffd6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b82fd857b0 con 0x55b82fc17850 2024-09-21T02:43:27.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b82fec8650 con 0x55b82fbf6b70 2024-09-21T02:43:27.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b82ffcd190 con 0x55b82fbee990 2024-09-21T02:43:27.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.342+0000 7f13631d0740 10 client.0 _ll_register_callbacks cb 0x55b82fc2f0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffcaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38490/0 (socket says 172.21.15.79:38490) 2024-09-21T02:43:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 -- 172.21.15.79:0/1925320346 learned_addr learned my addr 172.21.15.79:0/1925320346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 -- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 msgr2=0x55b82ffcaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f135a400640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffd6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffcaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 -- 172.21.15.79:0/1925320346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 msgr2=0x55b82ffd6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffd6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359a00640 1 -- 172.21.15.79:0/1925320346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b82fc91ba0 con 0x55b82fbee990 2024-09-21T02:43:27.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f1359000640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffcaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:27.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.343+0000 7f135a400640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffd6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:27.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f1359a00640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffca4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13480e4970 tx=0x7f1348005f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=983b77b76f75e93d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:27.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f133b400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f133b400640 1 -- 172.21.15.79:0/1925320346 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348021030 con 0x55b82fbee990 2024-09-21T02:43:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1340012aa0 con 0x55b82fbee990 2024-09-21T02:43:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f133b400640 1 -- 172.21.15.79:0/1925320346 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f13480abcd0 con 0x55b82fbee990 2024-09-21T02:43:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f133b400640 1 -- 172.21.15.79:0/1925320346 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f13480b4e60 con 0x55b82fbee990 2024-09-21T02:43:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f13631d0740 10 client.26239 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:27.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.344+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b82ffd9150 con 0x55b82fbee990 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.345+0000 7f133b400640 1 -- 172.21.15.79:0/1925320346 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1340012aa0 con 0x55b82fbee990 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.345+0000 7f133b400640 1 -- 172.21.15.79:0/1925320346 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f13480abed0 con 0x55b82fbee990 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.345+0000 7f13631d0740 10 client.26239 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.345+0000 7f13631d0740 10 client.26239 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.345+0000 7f13631d0740 20 client.26239 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.345+0000 7f13631d0740 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbd61d0 0x55b82ffdc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.346+0000 7f13631d0740 4 client.26239 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:27.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.346+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b82ff369e0 con 0x55b82fbd61d0 2024-09-21T02:43:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.346+0000 7f1359000640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbd61d0 0x55b82ffdc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.349+0000 7f1359000640 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbd61d0 0x55b82ffdc600 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8352a36b3f85502d server_cookie=b23e58966d5d6307 in_seq=0 out_seq=0 2024-09-21T02:43:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.349+0000 7f133b400640 10 client.26239 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.350+0000 7f133b400640 1 -- 172.21.15.79:0/1925320346 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b82ff369e0 con 0x55b82fbd61d0 2024-09-21T02:43:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.350+0000 7f133b400640 10 client.26239 handle_command_reply: tid=0 2024-09-21T02:43:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.350+0000 7f13631d0740 1 client.26239 shutdown 2024-09-21T02:43:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 msgr2=0x55b82ffca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffca4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13480e4970 tx=0x7f1348005f30 comp rx=0 tx=0).stop 2024-09-21T02:43:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 shutdown_connections 2024-09-21T02:43:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbd61d0 0x55b82ffdc600 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f133b400640 0 client.26239 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffd6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbf6b70 0x55b82ffcaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 --2- 172.21.15.79:0/1925320346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbee990 0x55b82ffca4d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.351+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 >> 172.21.15.79:0/1925320346 conn(0x55b82fc0bc40 msgr2=0x55b82ffc1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.352+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 shutdown_connections 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.353+0000 7f13631d0740 1 -- 172.21.15.79:0/1925320346 wait complete. 2024-09-21T02:43:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.353+0000 7f13631d0740 20 client.26239 trim_cache size 0 max 16384 2024-09-21T02:43:27.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.381+0000 7f13631d0740 1 Processor -- start 2024-09-21T02:43:27.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.381+0000 7f13631d0740 1 -- start start 2024-09-21T02:43:27.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.381+0000 7f13631d0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffbb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.381+0000 7f13631d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fbf6b70 0x55b82ffc4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.382+0000 7f1359a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffbb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.382+0000 7f1359a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffbb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52516/0 (socket says 172.21.15.79:52516) 2024-09-21T02:43:27.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.382+0000 7f1359a00640 1 -- 172.21.15.79:0/3842939915 learned_addr learned my addr 172.21.15.79:0/3842939915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:27.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.382+0000 7f13631d0740 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fc17850 0x55b82ffc00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.383+0000 7f1359000640 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fbf6b70 0x55b82ffc4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.383+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f13541b51b0 con 0x55b82fbf6b70 2024-09-21T02:43:27.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.383+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f13541b7a30 con 0x55b82fbee990 2024-09-21T02:43:27.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.383+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13541b5820 con 0x55b82fc17850 2024-09-21T02:43:27.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.383+0000 7f135a400640 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fc17850 0x55b82ffc00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.384+0000 7f1359a00640 1 -- 172.21.15.79:0/3842939915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fc17850 msgr2=0x55b82ffc00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.384+0000 7f1359a00640 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fc17850 0x55b82ffc00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.384+0000 7f1359a00640 1 -- 172.21.15.79:0/3842939915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fbf6b70 msgr2=0x55b82ffc4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.385+0000 7f1359a00640 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fbf6b70 0x55b82ffc4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.385+0000 7f1359a00640 1 -- 172.21.15.79:0/3842939915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b82ffbd190 con 0x55b82fbee990 2024-09-21T02:43:27.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.385+0000 7f135a400640 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fc17850 0x55b82ffc00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:27.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.386+0000 7f1359a00640 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffbb8c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f13480acd00 tx=0x7f13480b1b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d5b93b6d94cc00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:27.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.386+0000 7f1346000640 1 -- 172.21.15.79:0/3842939915 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348021030 con 0x55b82fbee990 2024-09-21T02:43:27.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.386+0000 7f1346000640 1 -- 172.21.15.79:0/3842939915 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13480981f0 con 0x55b82fbee990 2024-09-21T02:43:27.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.386+0000 7f1346000640 1 -- 172.21.15.79:0/3842939915 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348094370 con 0x55b82fbee990 2024-09-21T02:43:27.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 msgr2=0x55b82ffbb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffbb8c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f13480acd00 tx=0x7f13480b1b30 comp rx=0 tx=0).stop 2024-09-21T02:43:27.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 shutdown_connections 2024-09-21T02:43:27.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fc17850 0x55b82ffc00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fbf6b70 0x55b82ffc4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 --2- 172.21.15.79:0/3842939915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffbb8c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 >> 172.21.15.79:0/3842939915 conn(0x55b82fc0bc40 msgr2=0x55b82ffbf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:27.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 shutdown_connections 2024-09-21T02:43:27.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.388+0000 7f13631d0740 1 -- 172.21.15.79:0/3842939915 wait complete. 2024-09-21T02:43:27.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.389+0000 7f13631d0740 1 -- start start 2024-09-21T02:43:27.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.389+0000 7f13631d0740 1 Processor -- start 2024-09-21T02:43:27.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f13631d0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffd27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f13631d0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbf6b70 0x55b82ffd2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f13631d0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffcd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f13631d0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f13541b5ef0 con 0x55b82fc17850 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f13631d0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f13541b7360 con 0x55b82fbee990 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f13631d0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13541b65c0 con 0x55b82fbf6b70 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f13631d0740 10 client.0 _ll_register_callbacks cb 0x7f13480a9650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f1359a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffd27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f1359a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffd27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52528/0 (socket says 172.21.15.79:52528) 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f1359a00640 1 -- 172.21.15.79:0/137434328 learned_addr learned my addr 172.21.15.79:0/137434328 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:27.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.390+0000 7f135a400640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffcd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.391+0000 7f1359000640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbf6b70 0x55b82ffd2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.391+0000 7f1359a00640 1 -- 172.21.15.79:0/137434328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbf6b70 msgr2=0x55b82ffd2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.391+0000 7f1359a00640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbf6b70 0x55b82ffd2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.391+0000 7f1359a00640 1 -- 172.21.15.79:0/137434328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 msgr2=0x55b82ffcd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:27.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.391+0000 7f1359a00640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffcd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.392+0000 7f1359a00640 1 -- 172.21.15.79:0/137434328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b82ffcdc70 con 0x55b82fbee990 2024-09-21T02:43:27.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.393+0000 7f1359000640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbf6b70 0x55b82ffd2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:27.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.393+0000 7f135a400640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffcd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.394+0000 7f1359a00640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffd27c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1348005fd0 tx=0x7f13480e7120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b813ff7df1881e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.394+0000 7f133b400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:43:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.394+0000 7f133b400640 1 -- 172.21.15.79:0/137434328 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348021070 con 0x55b82fbee990 2024-09-21T02:43:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.394+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13480981f0 con 0x55b82fbee990 2024-09-21T02:43:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.394+0000 7f133b400640 1 -- 172.21.15.79:0/137434328 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f13480b2c70 con 0x55b82fbee990 2024-09-21T02:43:27.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.395+0000 7f133b400640 1 -- 172.21.15.79:0/137434328 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1348009de0 con 0x55b82fbee990 2024-09-21T02:43:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.395+0000 7f13631d0740 10 client.26222 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.395+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b82ffcdc70 con 0x55b82fbee990 2024-09-21T02:43:27.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.395+0000 7f133b400640 1 -- 172.21.15.79:0/137434328 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13480981f0 con 0x55b82fbee990 2024-09-21T02:43:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.396+0000 7f133b400640 1 -- 172.21.15.79:0/137434328 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f13480b2eb0 con 0x55b82fbee990 2024-09-21T02:43:27.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.396+0000 7f13631d0740 10 client.26222 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:27.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.396+0000 7f13631d0740 10 client.26222 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:27.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.396+0000 7f13631d0740 20 client.26222 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:27.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.396+0000 7f13631d0740 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbab580 0x55b830049ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:27.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.396+0000 7f13631d0740 4 client.26222 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T02:43:27.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.396+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x55b82ff32490 con 0x55b82fbab580 2024-09-21T02:43:27.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.397+0000 7f1359000640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbab580 0x55b830049ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:27.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.397+0000 7f1359000640 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbab580 0x55b830049ef0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff13e362691ef9c1 server_cookie=b3884a6aa37cc7a1 in_seq=0 out_seq=0 2024-09-21T02:43:27.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.398+0000 7f133b400640 10 client.26222 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f133b400640 1 -- 172.21.15.79:0/137434328 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b82ff32490 con 0x55b82fbab580 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f133b400640 10 client.26222 handle_command_reply: tid=0 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 client.26222 shutdown 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 msgr2=0x55b82ffd27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffd27c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1348005fd0 tx=0x7f13480e7120 comp rx=0 tx=0).stop 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 shutdown_connections 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b82fbab580 0x55b830049ef0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b82fc17850 0x55b82ffcd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b82fbf6b70 0x55b82ffd2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 --2- 172.21.15.79:0/137434328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b82fbee990 0x55b82ffd27c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f133b400640 0 client.26222 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.747+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 >> 172.21.15.79:0/137434328 conn(0x55b82fc0bc40 msgr2=0x55b82ffbb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.748+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 shutdown_connections 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.748+0000 7f13631d0740 1 -- 172.21.15.79:0/137434328 wait complete. 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.748+0000 7f13631d0740 20 client.26222 trim_cache size 0 max 16384 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 34, 2024-09-21T02:43:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "2d5b39cb": { 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 34, 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 141.1, 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:43:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:27.753 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:43:27.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f133c0b6510 msgr2=0x7f133c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f133c0b6510 0x7f133c0b8a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f134c005e30 tx=0x7f134c005fd0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1354104860 msgr2=0x7f1354114c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:27.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1354104860 0x7f1354114c00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f134800d950 tx=0x7f134800de10 comp rx=0 tx=0).stop 2024-09-21T02:43:27.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 shutdown_connections 2024-09-21T02:43:27.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f133c0b6510 0x7f133c0b8a20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f135410de10 0x7f1354111600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1354105290 0x7f1354110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 --2- 172.21.15.79:0/3699714056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1354104860 0x7f1354114c00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:27.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 >> 172.21.15.79:0/3699714056 conn(0x7f1354079760 msgr2=0x7f1354101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:27.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 shutdown_connections 2024-09-21T02:43:27.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:27.749+0000 7f135c400640 1 -- 172.21.15.79:0/3699714056 wait complete. 2024-09-21T02:43:28.538 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2d5b39cb', quiesce took 6.1 seconds. Will release after: 14.950000000000001 2024-09-21T02:43:28.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:28 smithi079 ceph-mon[30788]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 MiB/s wr, 178 op/s 2024-09-21T02:43:29.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:28 smithi148 ceph-mon[34626]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 MiB/s wr, 178 op/s 2024-09-21T02:43:29.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:28 smithi098 ceph-mon[34832]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 MiB/s wr, 178 op/s 2024-09-21T02:43:31.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:30 smithi148 ceph-mon[34626]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-09-21T02:43:31.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:30 smithi098 ceph-mon[34832]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-09-21T02:43:31.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:30 smithi079 ceph-mon[30788]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-09-21T02:43:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 455.0 s, 100.1 tps, lat 239.608 ms stddev 282.867 2024-09-21T02:43:33.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:32 smithi148 ceph-mon[34626]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2024-09-21T02:43:33.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:32 smithi098 ceph-mon[34832]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2024-09-21T02:43:33.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:32 smithi079 ceph-mon[30788]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2024-09-21T02:43:35.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:35 smithi148 ceph-mon[34626]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 294 op/s 2024-09-21T02:43:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:35 smithi098 ceph-mon[34832]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 294 op/s 2024-09-21T02:43:35.932 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:35 smithi079 ceph-mon[30788]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 294 op/s 2024-09-21T02:43:36.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 460.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:43:37.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:37 smithi148 ceph-mon[34626]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.8 MiB/s wr, 284 op/s 2024-09-21T02:43:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:37 smithi098 ceph-mon[34832]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.8 MiB/s wr, 284 op/s 2024-09-21T02:43:37.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:37 smithi079 ceph-mon[30788]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.8 MiB/s wr, 284 op/s 2024-09-21T02:43:39.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:39 smithi148 ceph-mon[34626]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 226 op/s 2024-09-21T02:43:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:39 smithi098 ceph-mon[34832]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 226 op/s 2024-09-21T02:43:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:39 smithi079 ceph-mon[30788]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 226 op/s 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 -- 172.21.15.79:0/2080173416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 msgr2=0x7f8164103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 --2- 172.21.15.79:0/2080173416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f8164103950 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8154009900 tx=0x7f815402a410 comp rx=0 tx=0).stop 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 -- 172.21.15.79:0/2080173416 shutdown_connections 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 --2- 172.21.15.79:0/2080173416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8164104f00 0x7f816410b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 --2- 172.21.15.79:0/2080173416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8164104560 0x7f8164104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 --2- 172.21.15.79:0/2080173416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f8164103950 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 -- 172.21.15.79:0/2080173416 >> 172.21.15.79:0/2080173416 conn(0x7f81640fee20 msgr2=0x7f81641012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 -- 172.21.15.79:0/2080173416 shutdown_connections 2024-09-21T02:43:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.172+0000 7f8169c00640 1 -- 172.21.15.79:0/2080173416 wait complete. 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.173+0000 7f8169c00640 1 Processor -- start 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.173+0000 7f8169c00640 1 -- start start 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8169c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f816419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8169c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8164104560 0x7f816419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8169c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8164104f00 0x7f816419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8169c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f816410f160 con 0x7f81641034e0 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8169c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f816410efe0 con 0x7f8164104560 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8169c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f816410f2e0 con 0x7f8164104f00 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8163e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f816419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8163e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f816419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41668/0 (socket says 172.21.15.79:41668) 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8163e00640 1 -- 172.21.15.79:0/3569482180 learned_addr learned my addr 172.21.15.79:0/3569482180 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8163400640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8164104560 0x7f816419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.174+0000 7f8169200640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8164104f00 0x7f816419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8163e00640 1 -- 172.21.15.79:0/3569482180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8164104f00 msgr2=0x7f816419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8163e00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8164104f00 0x7f816419d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8163e00640 1 -- 172.21.15.79:0/3569482180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8164104560 msgr2=0x7f816419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8163e00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8164104560 0x7f816419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8163e00640 1 -- 172.21.15.79:0/3569482180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816419d9e0 con 0x7f81641034e0 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8169200640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8164104f00 0x7f816419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8163e00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f816419bfa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8154031440 tx=0x7f8154003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8160c00640 1 -- 172.21.15.79:0/3569482180 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815403f070 con 0x7f81641034e0 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8160c00640 1 -- 172.21.15.79:0/3569482180 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8154031c50 con 0x7f81641034e0 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8160c00640 1 -- 172.21.15.79:0/3569482180 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154035030 con 0x7f81641034e0 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816419dc70 con 0x7f81641034e0 2024-09-21T02:43:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.175+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81641a41e0 con 0x7f81641034e0 2024-09-21T02:43:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.178+0000 7f81721eb740 1 Processor -- start 2024-09-21T02:43:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f81721eb740 1 -- start start 2024-09-21T02:43:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f81721eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766471b0 0x55f0769ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f81721eb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769ee920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f81721eb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769ef470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f81721eb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f0769616b0 con 0x55f07661e2f0 2024-09-21T02:43:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f81721eb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f076950ae0 con 0x55f0766264d0 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f81721eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f0769548f0 con 0x55f0766471b0 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f8160c00640 1 -- 172.21.15.79:0/3569482180 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8154042070 con 0x7f81641034e0 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f8169200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766471b0 0x55f0769ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f8163400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f8169200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766471b0 0x55f0769ee2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41990/0 (socket says 172.21.15.79:41990) 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.179+0000 7f8169200640 1 -- 172.21.15.79:0/1681236161 learned_addr learned my addr 172.21.15.79:0/1681236161 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8163e00640 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769ee920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8169200640 1 -- 172.21.15.79:0/1681236161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 msgr2=0x55f0769ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8169200640 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8169200640 1 -- 172.21.15.79:0/1681236161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 msgr2=0x55f0769ee920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8169200640 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769ee920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8169200640 1 -- 172.21.15.79:0/1681236161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f07691d780 con 0x55f0766471b0 2024-09-21T02:43:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8163e00640 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769ee920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8169200640 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766471b0 0x55f0769ee2b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f815c009fd0 tx=0x7f815c0108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cc3c7b29fc8c250 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8159600640 1 -- 172.21.15.79:0/1681236161 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c011760 con 0x55f0766471b0 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8159600640 1 -- 172.21.15.79:0/1681236161 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815c011db0 con 0x55f0766471b0 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.180+0000 7f8159600640 1 -- 172.21.15.79:0/1681236161 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c00e3c0 con 0x55f0766471b0 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.181+0000 7f8160c00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f81480b6510 0x7f81480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.181+0000 7f8163e00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f81480b6510 0x7f81480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.181+0000 7f8160c00640 1 -- 172.21.15.79:0/3569482180 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8154107f00 con 0x7f81641034e0 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.181+0000 7f81721eb740 1 -- 172.21.15.79:0/1681236161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766471b0 msgr2=0x55f0769ee2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.181+0000 7f81721eb740 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766471b0 0x55f0769ee2b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f815c009fd0 tx=0x7f815c0108e0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 -- 172.21.15.79:0/1681236161 shutdown_connections 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769ee920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 --2- 172.21.15.79:0/1681236161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766471b0 0x55f0769ee2b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 -- 172.21.15.79:0/1681236161 >> 172.21.15.79:0/1681236161 conn(0x55f07663b300 msgr2=0x55f0769e9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 -- 172.21.15.79:0/1681236161 shutdown_connections 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 -- 172.21.15.79:0/1681236161 wait complete. 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f8163e00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f81480b6510 0x7f81480b8a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8154000c00 tx=0x7f8154009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 -- start start 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.182+0000 7f81721eb740 1 Processor -- start 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f81721eb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f81721eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f81721eb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 0x55f0769f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f81721eb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f076888ab0 con 0x55f07661e2f0 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f81721eb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0768f7570 con 0x55f0766471b0 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f81721eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f0769eff90 con 0x55f0766264d0 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f81721eb740 10 client.0 _ll_register_callbacks cb 0x55f076906100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f8169200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f8169200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769f79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41678/0 (socket says 172.21.15.79:41678) 2024-09-21T02:43:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f8169200640 1 -- 172.21.15.79:0/3927980597 learned_addr learned my addr 172.21.15.79:0/3927980597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f8163400640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.183+0000 7f8169200640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 0x55f0769f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f8169200640 1 -- 172.21.15.79:0/3927980597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 msgr2=0x55f0769f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f8169200640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f8169200640 1 -- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 msgr2=0x55f0769f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f8169200640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 0x55f0769f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f8169200640 1 -- 172.21.15.79:0/3927980597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0766b2790 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f8163400640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f8169200640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769f79a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f815c006010 tx=0x7f815c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb051895cb10fc73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f814e000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f814e000640 1 -- 172.21.15.79:0/3927980597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0119f0 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f815c011db0 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.184+0000 7f814e000640 1 -- 172.21.15.79:0/3927980597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f815c011b90 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f814e000640 1 -- 172.21.15.79:0/3927980597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f815c034050 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 10 client.16056 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f07672b620 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f814e000640 1 -- 172.21.15.79:0/3927980597 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815c011db0 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f814e000640 1 -- 172.21.15.79:0/3927980597 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f815c029020 con 0x55f07661e2f0 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 10 client.16056 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 10 client.16056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 20 client.16056 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f076605d80 0x55f076a04d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 4 client.16056 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.185+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f076963600 con 0x55f076605d80 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.186+0000 7f8163400640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f076605d80 0x55f076a04d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.186+0000 7f814e000640 10 client.16056 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.186+0000 7f8163400640 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f076605d80 0x55f076a04d30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46edb85c260fadf2 server_cookie=ad2eacc2f1e87833 in_seq=0 out_seq=0 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f814e000640 1 -- 172.21.15.79:0/3927980597 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f076963600 con 0x55f076605d80 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f814e000640 10 client.16056 handle_command_reply: tid=0 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 client.16056 shutdown 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 msgr2=0x55f0769f79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769f79a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f815c006010 tx=0x7f815c009bb0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 shutdown_connections 2024-09-21T02:43:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f076605d80 0x55f076a04d30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 0x55f0769f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 --2- 172.21.15.79:0/3927980597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769f79a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f814e000640 0 client.16056 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 >> 172.21.15.79:0/3927980597 conn(0x55f07663b300 msgr2=0x55f0769ef320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 shutdown_connections 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.187+0000 7f81721eb740 1 -- 172.21.15.79:0/3927980597 wait complete. 2024-09-21T02:43:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.188+0000 7f81721eb740 20 client.16056 trim_cache size 0 max 16384 2024-09-21T02:43:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.202+0000 7f81721eb740 1 Processor -- start 2024-09-21T02:43:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f81721eb740 1 -- start start 2024-09-21T02:43:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f81721eb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f81721eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f81721eb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 0x55f0769e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f81721eb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81641ac7f0 con 0x55f07661e2f0 2024-09-21T02:43:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f81721eb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81641af070 con 0x55f0766471b0 2024-09-21T02:43:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f81721eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81641ace60 con 0x55f0766264d0 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769e8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41684/0 (socket says 172.21.15.79:41684) 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 -- 172.21.15.79:0/2802912845 learned_addr learned my addr 172.21.15.79:0/2802912845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8163400640 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 -- 172.21.15.79:0/2802912845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 msgr2=0x55f0769f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 -- 172.21.15.79:0/2802912845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 msgr2=0x55f0769e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 0x55f0769e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.203+0000 7f8169200640 1 -- 172.21.15.79:0/2802912845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0769f88c0 con 0x55f07661e2f0 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.204+0000 7f8169200640 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769e8d20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f815c009b20 tx=0x7f815c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d901c64e2300ed47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.204+0000 7f8158c00640 1 -- 172.21.15.79:0/2802912845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c00e3c0 con 0x55f07661e2f0 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.204+0000 7f8158c00640 1 -- 172.21.15.79:0/2802912845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815c020030 con 0x55f07661e2f0 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.204+0000 7f8158c00640 1 -- 172.21.15.79:0/2802912845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c00ee60 con 0x55f07661e2f0 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 -- 172.21.15.79:0/2802912845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 msgr2=0x55f0769e8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769e8d20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f815c009b20 tx=0x7f815c005bf0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 -- 172.21.15.79:0/2802912845 shutdown_connections 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766471b0 0x55f0769e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0766264d0 0x55f0769f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 --2- 172.21.15.79:0/2802912845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f07661e2f0 0x55f0769e8d20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 -- 172.21.15.79:0/2802912845 >> 172.21.15.79:0/2802912845 conn(0x55f07663b300 msgr2=0x55f0769e95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 -- 172.21.15.79:0/2802912845 shutdown_connections 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 -- 172.21.15.79:0/2802912845 wait complete. 2024-09-21T02:43:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 -- start start 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.205+0000 7f81721eb740 1 Processor -- start 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f81721eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f07661e2f0 0x55f0769fb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f81721eb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769fb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f81721eb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0766471b0 0x55f0769fc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f81721eb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81641ad530 con 0x55f0766471b0 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f81721eb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81641ae9a0 con 0x55f0766264d0 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f81721eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81641adc00 con 0x55f07661e2f0 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f81721eb740 10 client.0 _ll_register_callbacks cb 0x7f81500097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f8169200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0766471b0 0x55f0769fc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f8169200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0766471b0 0x55f0769fc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41688/0 (socket says 172.21.15.79:41688) 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f8169200640 1 -- 172.21.15.79:0/3811287419 learned_addr learned my addr 172.21.15.79:0/3811287419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f8163400640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f8169200640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f07661e2f0 0x55f0769fb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f8163400640 1 -- 172.21.15.79:0/3811287419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f07661e2f0 msgr2=0x55f0769fb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.206+0000 7f8163400640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f07661e2f0 0x55f0769fb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f8163400640 1 -- 172.21.15.79:0/3811287419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0766471b0 msgr2=0x55f0769fc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f8163400640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0766471b0 0x55f0769fc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f8163400640 1 -- 172.21.15.79:0/3811287419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0769ff8c0 con 0x55f0766264d0 2024-09-21T02:43:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f8169200640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0766471b0 0x55f0769fc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f8163400640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769fb980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8150009fd0 tx=0x7f815001f760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8273e22082385040 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f814e000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:43:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f814e000640 1 -- 172.21.15.79:0/3811287419 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150004030 con 0x55f0766264d0 2024-09-21T02:43:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f815c020030 con 0x55f0766264d0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f814e000640 1 -- 172.21.15.79:0/3811287419 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f81500041d0 con 0x55f0766264d0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f814e000640 1 -- 172.21.15.79:0/3811287419 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8150034050 con 0x55f0766264d0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.207+0000 7f81721eb740 10 client.26237 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f076a6fc10 con 0x55f0766264d0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f814e000640 1 -- 172.21.15.79:0/3811287419 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815c020030 con 0x55f0766264d0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f814e000640 1 -- 172.21.15.79:0/3811287419 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f815c01b670 con 0x55f0766264d0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f81721eb740 10 client.26237 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f81721eb740 10 client.26237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f81721eb740 20 client.26237 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f81721eb740 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f0765db1c0 0x55f076a72630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f81721eb740 4 client.26237 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f07695f0b0 con 0x55f0765db1c0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.208+0000 7f8169200640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f0765db1c0 0x55f076a72630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.209+0000 7f8169200640 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f0765db1c0 0x55f076a72630 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08c371468ba7dc6 server_cookie=4dc2acda18badb60 in_seq=0 out_seq=0 2024-09-21T02:43:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.209+0000 7f814e000640 10 client.26237 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f814e000640 1 -- 172.21.15.79:0/3811287419 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f07695f0b0 con 0x55f0765db1c0 2024-09-21T02:43:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f814e000640 10 client.26237 handle_command_reply: tid=0 2024-09-21T02:43:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 client.26237 shutdown 2024-09-21T02:43:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 msgr2=0x55f0769fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769fb980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8150009fd0 tx=0x7f815001f760 comp rx=0 tx=0).stop 2024-09-21T02:43:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 shutdown_connections 2024-09-21T02:43:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f0765db1c0 0x55f076a72630 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0766471b0 0x55f0769fc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f814e000640 0 client.26237 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0766264d0 0x55f0769fb980 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 --2- 172.21.15.79:0/3811287419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f07661e2f0 0x55f0769fb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.230+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 >> 172.21.15.79:0/3811287419 conn(0x55f07663b300 msgr2=0x55f0769e8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 shutdown_connections 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f81721eb740 1 -- 172.21.15.79:0/3811287419 wait complete. 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f81721eb740 20 client.26237 trim_cache size 0 max 16384 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:43:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:43:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:43:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:43:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f81480b6510 msgr2=0x7f81480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f8169c00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f81480b6510 0x7f81480b8a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8154000c00 tx=0x7f8154009260 comp rx=0 tx=0).stop 2024-09-21T02:43:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 msgr2=0x7f816419bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f8169c00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f816419bfa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8154031440 tx=0x7f8154003c10 comp rx=0 tx=0).stop 2024-09-21T02:43:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 shutdown_connections 2024-09-21T02:43:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f8169c00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f81480b6510 0x7f81480b8a20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.231+0000 7f8169c00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8164104f00 0x7f816419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.232+0000 7f8169c00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8164104560 0x7f816419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.232+0000 7f8169c00640 1 --2- 172.21.15.79:0/3569482180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81641034e0 0x7f816419bfa0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.232+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 >> 172.21.15.79:0/3569482180 conn(0x7f81640fee20 msgr2=0x7f81640755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.232+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 shutdown_connections 2024-09-21T02:43:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:40.232+0000 7f8169c00640 1 -- 172.21.15.79:0/3569482180 wait complete. 2024-09-21T02:43:41.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 465.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:43:41.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:41 smithi148 ceph-mon[34626]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-09-21T02:43:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:41 smithi098 ceph-mon[34832]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-09-21T02:43:41.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:41 smithi079 ceph-mon[30788]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-09-21T02:43:43.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:43:43.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:43 smithi148 ceph-mon[34626]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 621 KiB/s wr, 65 op/s 2024-09-21T02:43:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:43 smithi098 ceph-mon[34832]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 621 KiB/s wr, 65 op/s 2024-09-21T02:43:43.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:43 smithi079 ceph-mon[30788]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 621 KiB/s wr, 65 op/s 2024-09-21T02:43:44.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 -- 172.21.15.79:0/225315090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd01094c0 msgr2=0x7fdbd01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 --2- 172.21.15.79:0/225315090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd01094c0 0x7fdbd01098d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009900 tx=0x7fdbb802a410 comp rx=0 tx=0).stop 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 -- 172.21.15.79:0/225315090 shutdown_connections 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 --2- 172.21.15.79:0/225315090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0109e10 0x7fdbd0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 --2- 172.21.15.79:0/225315090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd01094c0 0x7fdbd01098d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 --2- 172.21.15.79:0/225315090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd0103b80 0x7fdbd0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 -- 172.21.15.79:0/225315090 >> 172.21.15.79:0/225315090 conn(0x7fdbd00ff5d0 msgr2=0x7fdbd0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 -- 172.21.15.79:0/225315090 shutdown_connections 2024-09-21T02:43:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.507+0000 7fdbd7600640 1 -- 172.21.15.79:0/225315090 wait complete. 2024-09-21T02:43:44.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 Processor -- start 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 -- start start 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0103b80 0x7fdbd019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd01094c0 0x7fdbd019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd0109e10 0x7fdbd01a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0113ad0 con 0x7fdbd0109e10 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0113950 con 0x7fdbd01094c0 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.509+0000 7fdbd7600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0113c50 con 0x7fdbd0103b80 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0103b80 0x7fdbd019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0103b80 0x7fdbd019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42624/0 (socket says 172.21.15.79:42624) 2024-09-21T02:43:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd5600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd0109e10 0x7fdbd01a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 -- 172.21.15.79:0/1505728186 learned_addr learned my addr 172.21.15.79:0/1505728186 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbc7e00640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd01094c0 0x7fdbd019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 -- 172.21.15.79:0/1505728186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd01094c0 msgr2=0x7fdbd019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd01094c0 0x7fdbd019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 -- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd0109e10 msgr2=0x7fdbd01a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd0109e10 0x7fdbd01a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 -- 172.21.15.79:0/1505728186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd01a2630 con 0x7fdbd0103b80 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.510+0000 7fdbd4c00640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0103b80 0x7fdbd019c6c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000ea60 tx=0x7fdbc000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.511+0000 7fdbce000640 1 -- 172.21.15.79:0/1505728186 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000cde0 con 0x7fdbd0103b80 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.511+0000 7fdbce000640 1 -- 172.21.15.79:0/1505728186 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbc00035f0 con 0x7fdbd0103b80 2024-09-21T02:43:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.511+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd01a2920 con 0x7fdbd0103b80 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.511+0000 7fdbce000640 1 -- 172.21.15.79:0/1505728186 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0010690 con 0x7fdbd0103b80 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.511+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd01a9080 con 0x7fdbd0103b80 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.512+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd0103f90 con 0x7fdbd0103b80 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.515+0000 7fdbce000640 1 -- 172.21.15.79:0/1505728186 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdbc00037a0 con 0x7fdbd0103b80 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.516+0000 7fdbce000640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdbb40b6510 0x7fdbb40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.516+0000 7fdbce000640 1 -- 172.21.15.79:0/1505728186 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdbc00e7dd0 con 0x7fdbd0103b80 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.516+0000 7fdbc7e00640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdbb40b6510 0x7fdbb40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.517+0000 7fdbc7e00640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdbb40b6510 0x7fdbb40b8a20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009230 tx=0x7fdbb8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.518+0000 7fdbce000640 1 -- 172.21.15.79:0/1505728186 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdbc00ae250 con 0x7fdbd0103b80 2024-09-21T02:43:44.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.743+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbd019d7f0 con 0x7fdbd0103b80 2024-09-21T02:43:44.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.745+0000 7fdbce000640 1 -- 172.21.15.79:0/1505728186 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fdbc00b2630 con 0x7fdbd0103b80 2024-09-21T02:43:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:43:44.747 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:43:44.747 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdbb40b6510 msgr2=0x7fdbb40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdbb40b6510 0x7fdbb40b8a20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009230 tx=0x7fdbb8031400 comp rx=0 tx=0).stop 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0103b80 msgr2=0x7fdbd019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0103b80 0x7fdbd019c6c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000ea60 tx=0x7fdbc000ef20 comp rx=0 tx=0).stop 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 shutdown_connections 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdbb40b6510 0x7fdbb40b8a20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd0109e10 0x7fdbd01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd01094c0 0x7fdbd019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 --2- 172.21.15.79:0/1505728186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd0103b80 0x7fdbd019c6c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:44.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 >> 172.21.15.79:0/1505728186 conn(0x7fdbd00ff5d0 msgr2=0x7fdbd0108bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:44.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 shutdown_connections 2024-09-21T02:43:44.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:44.747+0000 7fdbd7600640 1 -- 172.21.15.79:0/1505728186 wait complete. 2024-09-21T02:43:45.678 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 2d5b39cb --release --await' 2024-09-21T02:43:45.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 2d5b39cb --release --await 2024-09-21T02:43:45.731 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:45 smithi079 ceph-mon[30788]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T02:43:45.731 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:45 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1505728186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:45 smithi148 ceph-mon[34626]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T02:43:45.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:45 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1505728186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:45 smithi098 ceph-mon[34832]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T02:43:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:45 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1505728186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:46.049 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:43:46.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 -- 172.21.15.79:0/2307818949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8105320 msgr2=0x7f2fa810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 --2- 172.21.15.79:0/2307818949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8105320 0x7f2fa810d870 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009900 tx=0x7f2f9402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 -- 172.21.15.79:0/2307818949 shutdown_connections 2024-09-21T02:43:46.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 --2- 172.21.15.79:0/2307818949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fa810de30 0x7f2fa8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 --2- 172.21.15.79:0/2307818949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa8105320 0x7f2fa810d870 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 --2- 172.21.15.79:0/2307818949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa81049d0 0x7f2fa8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 -- 172.21.15.79:0/2307818949 >> 172.21.15.79:0/2307818949 conn(0x7f2fa8079740 msgr2=0x7f2fa8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:46.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.652+0000 7f2fae000640 1 -- 172.21.15.79:0/2307818949 shutdown_connections 2024-09-21T02:43:46.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.653+0000 7f2fae000640 1 -- 172.21.15.79:0/2307818949 wait complete. 2024-09-21T02:43:46.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 Processor -- start 2024-09-21T02:43:46.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 -- start start 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fa81049d0 0x7f2fa819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa8105320 0x7f2fa819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa810de30 0x7f2fa819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8113ae0 con 0x7f2fa810de30 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8113960 con 0x7f2fa8105320 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fae000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8113c60 con 0x7f2fa81049d0 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fa7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa810de30 0x7f2fa819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fa7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa810de30 0x7f2fa819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48098/0 (socket says 172.21.15.79:48098) 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fa7e00640 1 -- 172.21.15.79:0/2036831219 learned_addr learned my addr 172.21.15.79:0/2036831219 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.654+0000 7f2fa7400640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fa81049d0 0x7f2fa819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa8105320 0x7f2fa819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa7e00640 1 -- 172.21.15.79:0/2036831219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fa81049d0 msgr2=0x7f2fa819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa7e00640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fa81049d0 0x7f2fa819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa7e00640 1 -- 172.21.15.79:0/2036831219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa8105320 msgr2=0x7f2fa819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa7e00640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa8105320 0x7f2fa819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa7e00640 1 -- 172.21.15.79:0/2036831219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa81a0400 con 0x7f2fa810de30 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa7400640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fa81049d0 0x7f2fa819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.655+0000 7f2fa7e00640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa810de30 0x7f2fa819fcd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000eb10 tx=0x7f2fa000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.656+0000 7f2f9fe00640 1 -- 172.21.15.79:0/2036831219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0004b20 con 0x7f2fa810de30 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.656+0000 7f2f9fe00640 1 -- 172.21.15.79:0/2036831219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fa0004cc0 con 0x7f2fa810de30 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.656+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa81a06f0 con 0x7f2fa810de30 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.656+0000 7f2f9fe00640 1 -- 172.21.15.79:0/2036831219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0010670 con 0x7f2fa810de30 2024-09-21T02:43:46.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.656+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa81a6e50 con 0x7f2fa810de30 2024-09-21T02:43:46.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.659+0000 7f2fb47fd740 1 Processor -- start 2024-09-21T02:43:46.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.659+0000 7f2f9fe00640 1 -- 172.21.15.79:0/2036831219 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2fa0005020 con 0x7f2fa810de30 2024-09-21T02:43:46.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fb47fd740 1 -- start start 2024-09-21T02:43:46.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a333520 0x55d98a6da1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a30a660 0x55d98a6da700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d98a651290 con 0x55d98a333520 2024-09-21T02:43:46.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d98a6406c0 con 0x55d98a30a660 2024-09-21T02:43:46.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d98a6444d0 con 0x55d98a312840 2024-09-21T02:43:46.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fa6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a333520 0x55d98a6da1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fa6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a333520 0x55d98a6da1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48112/0 (socket says 172.21.15.79:48112) 2024-09-21T02:43:46.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fa6a00640 1 -- 172.21.15.79:0/1792301296 learned_addr learned my addr 172.21.15.79:0/1792301296 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:46.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.660+0000 7f2fa7400640 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a30a660 0x55d98a6da700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6dac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa7400640 1 -- 172.21.15.79:0/1792301296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 msgr2=0x55d98a6dac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa7400640 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6dac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa7400640 1 -- 172.21.15.79:0/1792301296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a333520 msgr2=0x55d98a6da1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa7400640 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a333520 0x55d98a6da1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa7400640 1 -- 172.21.15.79:0/1792301296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d98a5cd460 con 0x55d98a30a660 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a333520 0x55d98a6da1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2fa7400640 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a30a660 0x55d98a6da700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009fa0 tx=0x7f2f980118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5db91f2ed2797752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.661+0000 7f2f9fe00640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2f8c0b6510 0x7f2f8c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.662+0000 7f2f93e00640 1 -- 172.21.15.79:0/1792301296 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98004310 con 0x55d98a30a660 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.662+0000 7f2f9fe00640 1 -- 172.21.15.79:0/2036831219 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2fa00e7c60 con 0x7f2fa810de30 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.662+0000 7f2f93e00640 1 -- 172.21.15.79:0/1792301296 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f980044b0 con 0x55d98a30a660 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.662+0000 7f2f93e00640 1 -- 172.21.15.79:0/1792301296 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f980035f0 con 0x55d98a30a660 2024-09-21T02:43:46.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.662+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2f8c0b6510 0x7f2f8c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1792301296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a30a660 msgr2=0x55d98a6da700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a30a660 0x55d98a6da700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009fa0 tx=0x7f2f980118d0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2f8c0b6510 0x7f2f8c0b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2f940096c0 tx=0x7f2f94041040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:46.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1792301296 shutdown_connections 2024-09-21T02:43:46.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6dac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a30a660 0x55d98a6da700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1792301296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a333520 0x55d98a6da1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1792301296 >> 172.21.15.79:0/1792301296 conn(0x55d98a327910 msgr2=0x55d98a6d80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1792301296 shutdown_connections 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1792301296 wait complete. 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.663+0000 7f2fb47fd740 1 -- start start 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 1 Processor -- start 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6ea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6ea660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a6f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d98a4a1bb0 con 0x55d98a30a660 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d98a5db6c0 con 0x55d98a333520 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d98a6ecc40 con 0x55d98a312840 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.664+0000 7f2fb47fd740 10 client.0 _ll_register_callbacks cb 0x55d98a5f6490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48126/0 (socket says 172.21.15.79:48126) 2024-09-21T02:43:46.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 -- 172.21.15.79:0/612602881 learned_addr learned my addr 172.21.15.79:0/612602881 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:46.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7e00640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a6f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 -- 172.21.15.79:0/612602881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 msgr2=0x55d98a6ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6ea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 -- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 msgr2=0x55d98a6f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a6f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 -- 172.21.15.79:0/612602881 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d98a39eb00 con 0x55d98a30a660 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2fa7400640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6ea120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009580 tx=0x7f2f98004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88db9bf5704c0d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.665+0000 7f2f90c00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.666+0000 7f2f90c00640 1 -- 172.21.15.79:0/612602881 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98027030 con 0x55d98a30a660 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.666+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f980044b0 con 0x55d98a30a660 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.666+0000 7f2f90c00640 1 -- 172.21.15.79:0/612602881 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2f98003670 con 0x55d98a30a660 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.666+0000 7f2f90c00640 1 -- 172.21.15.79:0/612602881 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2f98034050 con 0x55d98a30a660 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.666+0000 7f2fb47fd740 10 client.16080 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.666+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d98a415960 con 0x55d98a30a660 2024-09-21T02:43:46.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.666+0000 7f2f90c00640 1 -- 172.21.15.79:0/612602881 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f980044b0 con 0x55d98a30a660 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2f90c00640 1 -- 172.21.15.79:0/612602881 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2f980052e0 con 0x55d98a30a660 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2fb47fd740 10 client.16080 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2fb47fd740 10 client.16080 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2fb47fd740 20 client.16080 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2f1ea0 0x55d98a6fbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2fb47fd740 4 client.16080 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d98a6531e0 con 0x55d98a2f1ea0 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.667+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2f1ea0 0x55d98a6fbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.668+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2f1ea0 0x55d98a6fbe10 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af33738478fef2b4 server_cookie=422ded73a1ca085e in_seq=0 out_seq=0 2024-09-21T02:43:46.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.668+0000 7f2f90c00640 10 client.16080 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:46.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2f90c00640 1 -- 172.21.15.79:0/612602881 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d98a6531e0 con 0x55d98a2f1ea0 2024-09-21T02:43:46.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2f90c00640 10 client.16080 handle_command_reply: tid=0 2024-09-21T02:43:46.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 client.16080 shutdown 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 msgr2=0x55d98a6ea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6ea120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009580 tx=0x7f2f98004960 comp rx=0 tx=0).stop 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 shutdown_connections 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2f1ea0 0x55d98a6fbe10 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a6f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a312840 0x55d98a6ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2f90c00640 0 client.16080 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/612602881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6ea120 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 >> 172.21.15.79:0/612602881 conn(0x55d98a327910 msgr2=0x55d98a6d6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 shutdown_connections 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 1 -- 172.21.15.79:0/612602881 wait complete. 2024-09-21T02:43:46.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.669+0000 7f2fb47fd740 20 client.16080 trim_cache size 0 max 16384 2024-09-21T02:43:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 Processor -- start 2024-09-21T02:43:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 -- start start 2024-09-21T02:43:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a312840 0x55d98a6db900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a333520 0x55d98a6f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81aca00 con 0x55d98a30a660 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81af280 con 0x55d98a312840 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81ad070 con 0x55d98a333520 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6e56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48136/0 (socket says 172.21.15.79:48136) 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.687+0000 7f2fa7400640 1 -- 172.21.15.79:0/1593387066 learned_addr learned my addr 172.21.15.79:0/1593387066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a312840 0x55d98a6db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7e00640 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a333520 0x55d98a6f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7400640 1 -- 172.21.15.79:0/1593387066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a333520 msgr2=0x55d98a6f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7400640 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a333520 0x55d98a6f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7400640 1 -- 172.21.15.79:0/1593387066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a312840 msgr2=0x55d98a6db900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7400640 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a312840 0x55d98a6db900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7400640 1 -- 172.21.15.79:0/1593387066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d98a6dcad0 con 0x55d98a30a660 2024-09-21T02:43:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7e00640 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a333520 0x55d98a6f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.688+0000 7f2fa7400640 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6e56d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000c00 tx=0x7f2f98009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303142dca374ddf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2f93400640 1 -- 172.21.15.79:0/1593387066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9803d070 con 0x55d98a30a660 2024-09-21T02:43:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2f93400640 1 -- 172.21.15.79:0/1593387066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f980049d0 con 0x55d98a30a660 2024-09-21T02:43:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2f93400640 1 -- 172.21.15.79:0/1593387066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98027040 con 0x55d98a30a660 2024-09-21T02:43:46.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1593387066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 msgr2=0x55d98a6e56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6e56d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000c00 tx=0x7f2f98009310 comp rx=0 tx=0).stop 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1593387066 shutdown_connections 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a333520 0x55d98a6f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a312840 0x55d98a6db900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/1593387066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a30a660 0x55d98a6e56d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.689+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1593387066 >> 172.21.15.79:0/1593387066 conn(0x55d98a327910 msgr2=0x55d98a6db1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.690+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1593387066 shutdown_connections 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.690+0000 7f2fb47fd740 1 -- 172.21.15.79:0/1593387066 wait complete. 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.690+0000 7f2fb47fd740 1 -- start start 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.690+0000 7f2fb47fd740 1 Processor -- start 2024-09-21T02:43:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a30a660 0x55d98a6ee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a312840 0x55d98a6ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fb47fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a765610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81ad740 con 0x55d98a312840 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81aebb0 con 0x55d98a333520 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fb47fd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81ade10 con 0x55d98a30a660 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fb47fd740 10 client.0 _ll_register_callbacks cb 0x7f2fa00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fa6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a312840 0x55d98a6ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a30a660 0x55d98a6ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fa6a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a312840 0x55d98a6ee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48150/0 (socket says 172.21.15.79:48150) 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fa6a00640 1 -- 172.21.15.79:0/112203532 learned_addr learned my addr 172.21.15.79:0/112203532 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a30a660 0x55d98a6ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42680/0 (socket says 172.21.15.79:42680) 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.691+0000 7f2fa7e00640 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a765610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2fa7400640 1 -- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 msgr2=0x55d98a765610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2fa7400640 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a765610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2fa7400640 1 -- 172.21.15.79:0/112203532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a312840 msgr2=0x55d98a6ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2fa7400640 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a312840 0x55d98a6ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2fa7400640 1 -- 172.21.15.79:0/112203532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d98a6eeeb0 con 0x55d98a30a660 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2fa7400640 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a30a660 0x55d98a6ee160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000c00 tx=0x7f2f98004440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2b3753bfd18019 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2f90c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2f90c00640 1 -- 172.21.15.79:0/112203532 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9803d070 con 0x55d98a30a660 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f980049d0 con 0x55d98a30a660 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.692+0000 7f2f90c00640 1 -- 172.21.15.79:0/112203532 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2f9800fa20 con 0x55d98a30a660 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2f90c00640 1 -- 172.21.15.79:0/112203532 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2f98027040 con 0x55d98a30a660 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 10 client.26287 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d98a766b50 con 0x55d98a30a660 2024-09-21T02:43:46.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2f90c00640 1 -- 172.21.15.79:0/112203532 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f980049d0 con 0x55d98a30a660 2024-09-21T02:43:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2f90c00640 1 -- 172.21.15.79:0/112203532 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2f98004b80 con 0x55d98a30a660 2024-09-21T02:43:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 10 client.26287 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 10 client.26287 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 20 client.26287 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2c7250 0x55d98a7691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 4 client.26287 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2d5b39cb", "release": true, "await": true}] 2024-09-21T02:43:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.693+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2d5b39cb", "release": true, "await": true}) -- 0x55d98a64ec90 con 0x55d98a2c7250 2024-09-21T02:43:46.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.694+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2c7250 0x55d98a7691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:46.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.694+0000 7f2fa6a00640 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2c7250 0x55d98a7691e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a49144f6e84ac8bf server_cookie=757923b5f24c355a in_seq=0 out_seq=0 2024-09-21T02:43:46.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.694+0000 7f2f90c00640 10 client.26287 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:46.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2f90c00640 1 -- 172.21.15.79:0/112203532 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d98a64ec90 con 0x55d98a2c7250 2024-09-21T02:43:46.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2f90c00640 10 client.26287 handle_command_reply: tid=0 2024-09-21T02:43:46.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 client.26287 shutdown 2024-09-21T02:43:46.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a30a660 msgr2=0x55d98a6ee160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a30a660 0x55d98a6ee160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000c00 tx=0x7f2f98004440 comp rx=0 tx=0).stop 2024-09-21T02:43:46.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 shutdown_connections 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55d98a2c7250 0x55d98a7691e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d98a333520 0x55d98a765610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d98a312840 0x55d98a6ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 --2- 172.21.15.79:0/112203532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d98a30a660 0x55d98a6ee160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 >> 172.21.15.79:0/112203532 conn(0x55d98a327910 msgr2=0x55d98a6dbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.747+0000 7f2f90c00640 0 client.26287 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.748+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 shutdown_connections 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.748+0000 7f2fb47fd740 1 -- 172.21.15.79:0/112203532 wait complete. 2024-09-21T02:43:46.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.748+0000 7f2fb47fd740 20 client.26287 trim_cache size 0 max 16384 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 36, 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "2d5b39cb": { 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 36, 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:43:46.751 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 141.1, 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:43:46.752 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:43:46.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2f8c0b6510 msgr2=0x7f2f8c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2f8c0b6510 0x7f2f8c0b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2f940096c0 tx=0x7f2f94041040 comp rx=0 tx=0).stop 2024-09-21T02:43:46.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa810de30 msgr2=0x7f2fa819fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:46.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa810de30 0x7f2fa819fcd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000eb10 tx=0x7f2fa000c2d0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 shutdown_connections 2024-09-21T02:43:46.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2f8c0b6510 0x7f2f8c0b8a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fa810de30 0x7f2fa819fcd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa8105320 0x7f2fa819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 --2- 172.21.15.79:0/2036831219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fa81049d0 0x7f2fa819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:46.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 >> 172.21.15.79:0/2036831219 conn(0x7f2fa8079740 msgr2=0x7f2fa8100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:46.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 shutdown_connections 2024-09-21T02:43:46.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:43:46.749+0000 7f2fae000640 1 -- 172.21.15.79:0/2036831219 wait complete. 2024-09-21T02:43:47.593 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2d5b39cb', total seconds elapsed: 25.1 2024-09-21T02:43:47.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:47 smithi148 ceph-mon[34626]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T02:43:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:47 smithi098 ceph-mon[34832]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T02:43:47.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:47 smithi079 ceph-mon[30788]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T02:43:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:49 smithi098 ceph-mon[34832]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-21T02:43:49.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:49 smithi079 ceph-mon[30788]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-21T02:43:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:49 smithi148 ceph-mon[34626]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-21T02:43:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 475.0 s, 690.1 tps, lat 695.267 ms stddev 3257.943 2024-09-21T02:43:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:51 smithi098 ceph-mon[34832]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 140 KiB/s wr, 23 op/s 2024-09-21T02:43:51.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:51 smithi079 ceph-mon[30788]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 140 KiB/s wr, 23 op/s 2024-09-21T02:43:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:51 smithi148 ceph-mon[34626]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 140 KiB/s wr, 23 op/s 2024-09-21T02:43:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.548+0000 7f78d3200640 1 -- 172.21.15.79:0/3455494070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc102440 msgr2=0x7f78cc1028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.548+0000 7f78d3200640 1 --2- 172.21.15.79:0/3455494070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc102440 0x7f78cc1028b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009860 tx=0x7f78c002a340 comp rx=0 tx=0).stop 2024-09-21T02:43:53.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.553+0000 7f78d3200640 1 -- 172.21.15.79:0/3455494070 shutdown_connections 2024-09-21T02:43:53.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.553+0000 7f78d3200640 1 --2- 172.21.15.79:0/3455494070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78cc103e60 0x7f78cc10a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.553+0000 7f78d3200640 1 --2- 172.21.15.79:0/3455494070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc1034c0 0x7f78cc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.553+0000 7f78d3200640 1 --2- 172.21.15.79:0/3455494070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc102440 0x7f78cc1028b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.553+0000 7f78d3200640 1 -- 172.21.15.79:0/3455494070 >> 172.21.15.79:0/3455494070 conn(0x7f78cc0fdd80 msgr2=0x7f78cc100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:53.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.553+0000 7f78d3200640 1 -- 172.21.15.79:0/3455494070 shutdown_connections 2024-09-21T02:43:53.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.553+0000 7f78d3200640 1 -- 172.21.15.79:0/3455494070 wait complete. 2024-09-21T02:43:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.555+0000 7f78d3200640 1 Processor -- start 2024-09-21T02:43:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.556+0000 7f78d3200640 1 -- start start 2024-09-21T02:43:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.556+0000 7f78d3200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc102440 0x7f78cc1a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d3200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78cc1034c0 0x7f78cc1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc103e60 0x7f78cc1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d3200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc10cf60 con 0x7f78cc1034c0 2024-09-21T02:43:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d3200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc10cde0 con 0x7f78cc102440 2024-09-21T02:43:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d3200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc10d0e0 con 0x7f78cc103e60 2024-09-21T02:43:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc102440 0x7f78cc1a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc102440 0x7f78cc1a0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:41718/0 (socket says 172.21.15.79:41718) 2024-09-21T02:43:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.557+0000 7f78d1e00640 1 -- 172.21.15.79:0/1227812543 learned_addr learned my addr 172.21.15.79:0/1227812543 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d2800640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc103e60 0x7f78cc1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d1400640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78cc1034c0 0x7f78cc1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d1e00640 1 -- 172.21.15.79:0/1227812543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc103e60 msgr2=0x7f78cc1a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d1e00640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc103e60 0x7f78cc1a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d1e00640 1 -- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78cc1034c0 msgr2=0x7f78cc1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d1e00640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78cc1034c0 0x7f78cc1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d1e00640 1 -- 172.21.15.79:0/1227812543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc1a1da0 con 0x7f78cc102440 2024-09-21T02:43:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.558+0000 7f78d1400640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78cc1034c0 0x7f78cc1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.559+0000 7f78d1e00640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc102440 0x7f78cc1a0360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f78c0032d50 tx=0x7f78c0032d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.560+0000 7f78c6a00640 1 -- 172.21.15.79:0/1227812543 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0037040 con 0x7f78cc102440 2024-09-21T02:43:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.560+0000 7f78c6a00640 1 -- 172.21.15.79:0/1227812543 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78c0030c10 con 0x7f78cc102440 2024-09-21T02:43:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.560+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78cc1a2030 con 0x7f78cc102440 2024-09-21T02:43:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.560+0000 7f78c6a00640 1 -- 172.21.15.79:0/1227812543 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0003850 con 0x7f78cc102440 2024-09-21T02:43:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.560+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78cc1a85a0 con 0x7f78cc102440 2024-09-21T02:43:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.573+0000 7f78db8b6740 1 Processor -- start 2024-09-21T02:43:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.573+0000 7f78c6a00640 1 -- 172.21.15.79:0/1227812543 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f78c0043030 con 0x7f78cc102440 2024-09-21T02:43:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.576+0000 7f78db8b6740 1 -- start start 2024-09-21T02:43:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bcd1b0 0x555b20f742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20ba42f0 0x555b20f74920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78db8b6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555b20ee76b0 con 0x555b20bcd1b0 2024-09-21T02:43:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78db8b6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555b20ed6ae0 con 0x555b20bac4d0 2024-09-21T02:43:53.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78db8b6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555b20eda8f0 con 0x555b20ba42f0 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78d2800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bcd1b0 0x555b20f742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78d2800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bcd1b0 0x555b20f742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48182/0 (socket says 172.21.15.79:48182) 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.579+0000 7f78d2800640 1 -- 172.21.15.79:0/1327272301 learned_addr learned my addr 172.21.15.79:0/1327272301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.580+0000 7f78d1400640 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.580+0000 7f78d2800640 1 -- 172.21.15.79:0/1327272301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20ba42f0 msgr2=0x555b20f74920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.580+0000 7f78d1e00640 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20ba42f0 0x555b20f74920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.580+0000 7f78d2800640 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20ba42f0 0x555b20f74920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.580+0000 7f78d2800640 1 -- 172.21.15.79:0/1327272301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 msgr2=0x555b20f75470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.580+0000 7f78d2800640 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f75470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.580+0000 7f78d2800640 1 -- 172.21.15.79:0/1327272301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b20ea3780 con 0x555b20bcd1b0 2024-09-21T02:43:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.581+0000 7f78d1e00640 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20ba42f0 0x555b20f74920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.581+0000 7f78d1400640 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f75470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.584+0000 7f78c6a00640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f78b40b66e0 0x7f78b40b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.584+0000 7f78c6a00640 1 -- 172.21.15.79:0/1227812543 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f78c0106b60 con 0x7f78cc102440 2024-09-21T02:43:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.585+0000 7f78d1e00640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f78b40b66e0 0x7f78b40b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.586+0000 7f78d1e00640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f78b40b66e0 0x7f78b40b8bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f78c0035040 tx=0x7f78c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.587+0000 7f78d2800640 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bcd1b0 0x555b20f742b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f78c8003a50 tx=0x7f78c800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9231b565b26aa22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:53.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.596+0000 7f78bb000640 1 -- 172.21.15.79:0/1327272301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004690 con 0x555b20bcd1b0 2024-09-21T02:43:53.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.596+0000 7f78bb000640 1 -- 172.21.15.79:0/1327272301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78c8004830 con 0x555b20bcd1b0 2024-09-21T02:43:53.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.596+0000 7f78bb000640 1 -- 172.21.15.79:0/1327272301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8016470 con 0x555b20bcd1b0 2024-09-21T02:43:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.598+0000 7f78db8b6740 1 -- 172.21.15.79:0/1327272301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bcd1b0 msgr2=0x555b20f742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.598+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bcd1b0 0x555b20f742b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f78c8003a50 tx=0x7f78c800b710 comp rx=0 tx=0).stop 2024-09-21T02:43:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.598+0000 7f78db8b6740 1 -- 172.21.15.79:0/1327272301 shutdown_connections 2024-09-21T02:43:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.598+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f75470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.598+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20ba42f0 0x555b20f74920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.598+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1327272301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bcd1b0 0x555b20f742b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.598+0000 7f78db8b6740 1 -- 172.21.15.79:0/1327272301 >> 172.21.15.79:0/1327272301 conn(0x555b20bc1300 msgr2=0x555b20f6fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:53.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.599+0000 7f78db8b6740 1 -- 172.21.15.79:0/1327272301 shutdown_connections 2024-09-21T02:43:53.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.599+0000 7f78db8b6740 1 -- 172.21.15.79:0/1327272301 wait complete. 2024-09-21T02:43:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.600+0000 7f78db8b6740 1 -- start start 2024-09-21T02:43:53.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.600+0000 7f78db8b6740 1 Processor -- start 2024-09-21T02:43:53.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20ba42f0 0x555b20f7da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f7e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bcd1b0 0x555b20f7eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78db8b6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555b20e0eab0 con 0x555b20ba42f0 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78db8b6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555b20e7d570 con 0x555b20bac4d0 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78db8b6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555b20f75f90 con 0x555b20bcd1b0 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78db8b6740 10 client.0 _ll_register_callbacks cb 0x555b20e8c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78d2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bcd1b0 0x555b20f7eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78d2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bcd1b0 0x555b20f7eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42722/0 (socket says 172.21.15.79:42722) 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.601+0000 7f78d2800640 1 -- 172.21.15.79:0/796355992 learned_addr learned my addr 172.21.15.79:0/796355992 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.602+0000 7f78d2800640 1 -- 172.21.15.79:0/796355992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 msgr2=0x555b20f7e130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.602+0000 7f78d2800640 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f7e130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.602+0000 7f78d2800640 1 -- 172.21.15.79:0/796355992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20ba42f0 msgr2=0x555b20f7da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.602+0000 7f78d2800640 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20ba42f0 0x555b20f7da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.602+0000 7f78d2800640 1 -- 172.21.15.79:0/796355992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b20c38790 con 0x555b20bcd1b0 2024-09-21T02:43:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.603+0000 7f78d2800640 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bcd1b0 0x555b20f7eca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f78c8005b30 tx=0x7f78c8004f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21ea7498c77063ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.603+0000 7f78af400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:43:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.604+0000 7f78af400640 1 -- 172.21.15.79:0/796355992 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8005210 con 0x555b20bcd1b0 2024-09-21T02:43:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.604+0000 7f78af400640 1 -- 172.21.15.79:0/796355992 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f78c80053b0 con 0x555b20bcd1b0 2024-09-21T02:43:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.605+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78c8004830 con 0x555b20bcd1b0 2024-09-21T02:43:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.606+0000 7f78af400640 1 -- 172.21.15.79:0/796355992 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f78c8016470 con 0x555b20bcd1b0 2024-09-21T02:43:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.606+0000 7f78db8b6740 10 client.26296 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.606+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b20cb1620 con 0x555b20bcd1b0 2024-09-21T02:43:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.606+0000 7f78af400640 1 -- 172.21.15.79:0/796355992 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78c8004830 con 0x555b20bcd1b0 2024-09-21T02:43:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.607+0000 7f78af400640 1 -- 172.21.15.79:0/796355992 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f78c801f6b0 con 0x555b20bcd1b0 2024-09-21T02:43:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.607+0000 7f78db8b6740 10 client.26296 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.607+0000 7f78db8b6740 10 client.26296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.607+0000 7f78db8b6740 20 client.26296 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.607+0000 7f78db8b6740 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20b8bd80 0x555b20f8aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.607+0000 7f78db8b6740 4 client.26296 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.607+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b20ee9600 con 0x555b20b8bd80 2024-09-21T02:43:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.608+0000 7f78d1400640 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20b8bd80 0x555b20f8aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.613+0000 7f78af400640 10 client.26296 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.613+0000 7f78d1400640 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20b8bd80 0x555b20f8aed0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203f03ec9139cc3d server_cookie=5b27c229b1db023e in_seq=0 out_seq=0 2024-09-21T02:43:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.615+0000 7f78af400640 1 -- 172.21.15.79:0/796355992 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b20ee9600 con 0x555b20b8bd80 2024-09-21T02:43:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.615+0000 7f78af400640 10 client.26296 handle_command_reply: tid=0 2024-09-21T02:43:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.615+0000 7f78db8b6740 1 client.26296 shutdown 2024-09-21T02:43:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.615+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bcd1b0 msgr2=0x555b20f7eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.615+0000 7f78db8b6740 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bcd1b0 0x555b20f7eca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f78c8005b30 tx=0x7f78c8004f40 comp rx=0 tx=0).stop 2024-09-21T02:43:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.616+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 shutdown_connections 2024-09-21T02:43:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.616+0000 7f78db8b6740 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20b8bd80 0x555b20f8aed0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.616+0000 7f78db8b6740 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bcd1b0 0x555b20f7eca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.616+0000 7f78db8b6740 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20bac4d0 0x555b20f7e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.616+0000 7f78db8b6740 1 --2- 172.21.15.79:0/796355992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20ba42f0 0x555b20f7da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.616+0000 7f78af400640 0 client.26296 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.616+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 >> 172.21.15.79:0/796355992 conn(0x555b20bc1300 msgr2=0x555b20f6e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.618+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 shutdown_connections 2024-09-21T02:43:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.618+0000 7f78db8b6740 1 -- 172.21.15.79:0/796355992 wait complete. 2024-09-21T02:43:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.618+0000 7f78db8b6740 20 client.26296 trim_cache size 0 max 16384 2024-09-21T02:43:53.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.666+0000 7f78db8b6740 1 Processor -- start 2024-09-21T02:43:53.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78db8b6740 1 -- start start 2024-09-21T02:43:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20f6e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20f6e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78db8b6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1b0b80 con 0x555b20bac4d0 2024-09-21T02:43:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78db8b6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1b3400 con 0x555b20ba42f0 2024-09-21T02:43:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78db8b6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1b11f0 con 0x555b20bc1300 2024-09-21T02:43:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.667+0000 7f78d1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20f6e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20f6e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:41738/0 (socket says 172.21.15.79:41738) 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d1400640 1 -- 172.21.15.79:0/3841704502 learned_addr learned my addr 172.21.15.79:0/3841704502 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d2800640 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20f6e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d2800640 1 -- 172.21.15.79:0/3841704502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 msgr2=0x555b20f6e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d2800640 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20f6e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d2800640 1 -- 172.21.15.79:0/3841704502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 msgr2=0x555b20f6e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d2800640 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20f6e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.668+0000 7f78d2800640 1 -- 172.21.15.79:0/3841704502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b20f7e990 con 0x555b20bc1300 2024-09-21T02:43:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.669+0000 7f78d2800640 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f745b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78c8004fd0 tx=0x7f78c8024040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a0ecc3d9acb204e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.670+0000 7f78ba600640 1 -- 172.21.15.79:0/3841704502 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c801fd70 con 0x555b20bc1300 2024-09-21T02:43:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.670+0000 7f78ba600640 1 -- 172.21.15.79:0/3841704502 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78c8004750 con 0x555b20bc1300 2024-09-21T02:43:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.670+0000 7f78ba600640 1 -- 172.21.15.79:0/3841704502 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8005210 con 0x555b20bc1300 2024-09-21T02:43:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.672+0000 7f78db8b6740 1 -- 172.21.15.79:0/3841704502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 msgr2=0x555b20f745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.672+0000 7f78db8b6740 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f745b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f78c8004fd0 tx=0x7f78c8024040 comp rx=0 tx=0).stop 2024-09-21T02:43:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.673+0000 7f78db8b6740 1 -- 172.21.15.79:0/3841704502 shutdown_connections 2024-09-21T02:43:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.673+0000 7f78db8b6740 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20f6e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.673+0000 7f78db8b6740 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20f6e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.673+0000 7f78db8b6740 1 --2- 172.21.15.79:0/3841704502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f745b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.673+0000 7f78db8b6740 1 -- 172.21.15.79:0/3841704502 >> 172.21.15.79:0/3841704502 conn(0x555b20f6af60 msgr2=0x555b20f73ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.673+0000 7f78db8b6740 1 -- 172.21.15.79:0/3841704502 shutdown_connections 2024-09-21T02:43:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.673+0000 7f78db8b6740 1 -- 172.21.15.79:0/3841704502 wait complete. 2024-09-21T02:43:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.674+0000 7f78db8b6740 1 -- start start 2024-09-21T02:43:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.674+0000 7f78db8b6740 1 Processor -- start 2024-09-21T02:43:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.676+0000 7f78db8b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20ff28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.677+0000 7f78d2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20ff28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.677+0000 7f78d2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20ff28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:41754/0 (socket says 172.21.15.79:41754) 2024-09-21T02:43:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.677+0000 7f78d2800640 1 -- 172.21.15.79:0/1455435225 learned_addr learned my addr 172.21.15.79:0/1455435225 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:43:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.678+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20ff2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.678+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f84ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.678+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1b18c0 con 0x555b20bac4d0 2024-09-21T02:43:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.679+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1b2d30 con 0x555b20ba42f0 2024-09-21T02:43:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.679+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1b1f90 con 0x555b20bc1300 2024-09-21T02:43:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.679+0000 7f78db8b6740 10 client.0 _ll_register_callbacks cb 0x7f78c8003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.679+0000 7f78d1400640 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20ff2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.679+0000 7f78d2800640 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f84ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.679+0000 7f78d2800640 1 -- 172.21.15.79:0/1455435225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 msgr2=0x555b20f84ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.680+0000 7f78d2800640 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f84ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.680+0000 7f78d2800640 1 -- 172.21.15.79:0/1455435225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 msgr2=0x555b20ff2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.680+0000 7f78d2800640 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20ff2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.680+0000 7f78d2800640 1 -- 172.21.15.79:0/1455435225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b20f85630 con 0x555b20ba42f0 2024-09-21T02:43:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.681+0000 7f78d2800640 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20ff28d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f78c8004010 tx=0x7f78c800b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa86bba63d0f700 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.681+0000 7f78af400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:43:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.681+0000 7f78af400640 1 -- 172.21.15.79:0/1455435225 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c801fd30 con 0x555b20ba42f0 2024-09-21T02:43:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.682+0000 7f78af400640 1 -- 172.21.15.79:0/1455435225 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f78c8005210 con 0x555b20ba42f0 2024-09-21T02:43:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.682+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78c8004750 con 0x555b20ba42f0 2024-09-21T02:43:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.684+0000 7f78af400640 1 -- 172.21.15.79:0/1455435225 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f78c8048050 con 0x555b20ba42f0 2024-09-21T02:43:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.684+0000 7f78db8b6740 10 client.26276 fetch_fsmap learned FSMap version 21 2024-09-21T02:43:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.684+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b20f80a20 con 0x555b20ba42f0 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.684+0000 7f78af400640 1 -- 172.21.15.79:0/1455435225 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78c8004750 con 0x555b20ba42f0 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78af400640 1 -- 172.21.15.79:0/1455435225 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f78c8021940 con 0x555b20ba42f0 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78db8b6740 10 client.26276 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78db8b6740 10 client.26276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78db8b6740 20 client.26276 populate_metadata read hostname 'smithi079' 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20bcd1b0 0x555b21008ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78db8b6740 4 client.26276 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555b20ee50b0 con 0x555b20bcd1b0 2024-09-21T02:43:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.686+0000 7f78d1400640 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20bcd1b0 0x555b21008ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.687+0000 7f78d1400640 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20bcd1b0 0x555b21008ef0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2331eee5b9af263d server_cookie=cd7dc6d6c31ea0c6 in_seq=0 out_seq=0 2024-09-21T02:43:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:53.687+0000 7f78af400640 10 client.26276 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:53 smithi098 ceph-mon[34832]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.2 MiB/s wr, 138 op/s 2024-09-21T02:43:53.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:53 smithi079 ceph-mon[30788]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.2 MiB/s wr, 138 op/s 2024-09-21T02:43:54.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:53 smithi148 ceph-mon[34626]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 1.2 MiB/s wr, 138 op/s 2024-09-21T02:43:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.605+0000 7f78af400640 1 -- 172.21.15.79:0/1455435225 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555b20ee50b0 con 0x555b20bcd1b0 2024-09-21T02:43:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.605+0000 7f78af400640 10 client.26276 handle_command_reply: tid=0 2024-09-21T02:43:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.605+0000 7f78db8b6740 1 client.26276 shutdown 2024-09-21T02:43:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.605+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 msgr2=0x555b20ff28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.605+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20ff28d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f78c8004010 tx=0x7f78c800b710 comp rx=0 tx=0).stop 2024-09-21T02:43:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.605+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 shutdown_connections 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b20bcd1b0 0x555b21008ef0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b20bc1300 0x555b20f84ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b20bac4d0 0x555b20ff2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 1 --2- 172.21.15.79:0/1455435225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b20ba42f0 0x555b20ff28d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78af400640 0 client.26276 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 >> 172.21.15.79:0/1455435225 conn(0x555b20f6af60 msgr2=0x555b20f78b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 shutdown_connections 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 1 -- 172.21.15.79:0/1455435225 wait complete. 2024-09-21T02:43:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.606+0000 7f78db8b6740 20 client.26276 trim_cache size 0 max 16384 2024-09-21T02:43:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:43:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:43:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:43:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.607+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f78b40b66e0 msgr2=0x7f78b40b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.607+0000 7f78d3200640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f78b40b66e0 0x7f78b40b8bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f78c0035040 tx=0x7f78c0005f90 comp rx=0 tx=0).stop 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.607+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc102440 msgr2=0x7f78cc1a0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.607+0000 7f78d3200640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc102440 0x7f78cc1a0360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f78c0032d50 tx=0x7f78c0032d80 comp rx=0 tx=0).stop 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 shutdown_connections 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f78b40b66e0 0x7f78b40b8bf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78cc103e60 0x7f78cc1a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78cc1034c0 0x7f78cc1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 --2- 172.21.15.79:0/1227812543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78cc102440 0x7f78cc1a0360 secure :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f78c0032d50 tx=0x7f78c0032d80 comp rx=0 tx=0).stop 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 >> 172.21.15.79:0/1227812543 conn(0x7f78cc0fdd80 msgr2=0x7f78cc1067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 shutdown_connections 2024-09-21T02:43:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:43:54.608+0000 7f78d3200640 1 -- 172.21.15.79:0/1227812543 wait complete. 2024-09-21T02:43:55.865 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:55 smithi148 ceph-mon[34626]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-21T02:43:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:55 smithi098 ceph-mon[34832]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-21T02:43:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:55 smithi079 ceph-mon[30788]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-21T02:43:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 480.0 s, 791.0 tps, lat 122.352 ms stddev 176.279 2024-09-21T02:43:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:57 smithi098 ceph-mon[34832]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 3.5 MiB/s wr, 337 op/s 2024-09-21T02:43:57.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:57 smithi079 ceph-mon[30788]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 3.5 MiB/s wr, 337 op/s 2024-09-21T02:43:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:57 smithi148 ceph-mon[34626]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 3.5 MiB/s wr, 337 op/s 2024-09-21T02:43:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:59 smithi098 ceph-mon[34832]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.3 MiB/s wr, 403 op/s 2024-09-21T02:43:59.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:43:59 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:43:59.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:59 smithi079 ceph-mon[30788]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.3 MiB/s wr, 403 op/s 2024-09-21T02:43:59.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:43:59 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:44:00.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:59 smithi148 ceph-mon[34626]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.3 MiB/s wr, 403 op/s 2024-09-21T02:44:00.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:43:59 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:44:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:44:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:44:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:00 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:44:00.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:44:00.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:44:00.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:44:01.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:44:01.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:44:01.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:44:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 485.0 s, 502.2 tps, lat 202.116 ms stddev 228.164 2024-09-21T02:44:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:01 smithi098 ceph-mon[34832]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.9 MiB/s wr, 481 op/s 2024-09-21T02:44:01.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:01 smithi079 ceph-mon[30788]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.9 MiB/s wr, 481 op/s 2024-09-21T02:44:02.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:01 smithi148 ceph-mon[34626]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.9 MiB/s wr, 481 op/s 2024-09-21T02:44:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:03 smithi098 ceph-mon[34832]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.3 MiB/s wr, 610 op/s 2024-09-21T02:44:03.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:03 smithi079 ceph-mon[30788]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.3 MiB/s wr, 610 op/s 2024-09-21T02:44:04.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:03 smithi148 ceph-mon[34626]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.3 MiB/s wr, 610 op/s 2024-09-21T02:44:05.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:05 smithi098 ceph-mon[34832]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.6 MiB/s wr, 539 op/s 2024-09-21T02:44:05.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:05 smithi079 ceph-mon[30788]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.6 MiB/s wr, 539 op/s 2024-09-21T02:44:06.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:05 smithi148 ceph-mon[34626]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.6 MiB/s wr, 539 op/s 2024-09-21T02:44:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 490.0 s, 686.8 tps, lat 149.333 ms stddev 179.810 2024-09-21T02:44:07.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:07 smithi098 ceph-mon[34832]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.925+0000 7f62d3200640 1 -- 172.21.15.79:0/2887773555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62d4075cf0 msgr2=0x7f62d4076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.925+0000 7f62d3200640 1 --2- 172.21.15.79:0/2887773555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62d4075cf0 0x7f62d4076100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009860 tx=0x7f62c002a340 comp rx=0 tx=0).stop 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.925+0000 7f62d3200640 1 -- 172.21.15.79:0/2887773555 shutdown_connections 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.925+0000 7f62d3200640 1 --2- 172.21.15.79:0/2887773555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d410fc60 0x7f62d4112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.925+0000 7f62d3200640 1 --2- 172.21.15.79:0/2887773555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62d4075cf0 0x7f62d4076100 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.925+0000 7f62d3200640 1 --2- 172.21.15.79:0/2887773555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d40770f0 0x7f62d40757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.925+0000 7f62d3200640 1 -- 172.21.15.79:0/2887773555 >> 172.21.15.79:0/2887773555 conn(0x7f62d40fee20 msgr2=0x7f62d41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.926+0000 7f62d3200640 1 -- 172.21.15.79:0/2887773555 shutdown_connections 2024-09-21T02:44:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.926+0000 7f62d3200640 1 -- 172.21.15.79:0/2887773555 wait complete. 2024-09-21T02:44:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.928+0000 7f62d3200640 1 Processor -- start 2024-09-21T02:44:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.928+0000 7f62d3200640 1 -- start start 2024-09-21T02:44:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.929+0000 7f62d3200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62d4075cf0 0x7f62d4197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.929+0000 7f62d3200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d40770f0 0x7f62d4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.929+0000 7f62d3200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d410fc60 0x7f62d4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d40770f0 0x7f62d4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d40770f0 0x7f62d4198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58272/0 (socket says 172.21.15.79:58272) 2024-09-21T02:44:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 -- 172.21.15.79:0/2545316891 learned_addr learned my addr 172.21.15.79:0/2545316891 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62d4109f30 con 0x7f62d410fc60 2024-09-21T02:44:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62d4109db0 con 0x7f62d4075cf0 2024-09-21T02:44:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f62d410a0b0 con 0x7f62d40770f0 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 -- 172.21.15.79:0/2545316891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62d4075cf0 msgr2=0x7f62d4197c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62d4075cf0 0x7f62d4197c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 -- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d410fc60 msgr2=0x7f62d4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d410fc60 0x7f62d4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.930+0000 7f62d1400640 1 -- 172.21.15.79:0/2545316891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d41993c0 con 0x7f62d40770f0 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.931+0000 7f62d1400640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d40770f0 0x7f62d4198270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62c002a930 tx=0x7f62c0030e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.931+0000 7f62caa00640 1 -- 172.21.15.79:0/2545316891 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0040020 con 0x7f62d40770f0 2024-09-21T02:44:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.931+0000 7f62caa00640 1 -- 172.21.15.79:0/2545316891 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c0030900 con 0x7f62d40770f0 2024-09-21T02:44:07.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.931+0000 7f62caa00640 1 -- 172.21.15.79:0/2545316891 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0037040 con 0x7f62d40770f0 2024-09-21T02:44:07.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.932+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d4199650 con 0x7f62d40770f0 2024-09-21T02:44:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.932+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d419fba0 con 0x7f62d40770f0 2024-09-21T02:44:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.937+0000 7f62e0270740 1 Processor -- start 2024-09-21T02:44:07.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.939+0000 7f62e0270740 1 -- start start 2024-09-21T02:44:07.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.939+0000 7f62e0270740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f5a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62d2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f5a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62d2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f5a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50078/0 (socket says 172.21.15.79:50078) 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62e0270740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62d2800640 1 -- 172.21.15.79:0/217952807 learned_addr learned my addr 172.21.15.79:0/217952807 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62e0270740 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f5a7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f21f5196b0 con 0x55f21f1d62f0 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f21f508ae0 con 0x55f21f1ff1b0 2024-09-21T02:44:07.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f21f50c8f0 con 0x55f21f1de4d0 2024-09-21T02:44:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62d2800640 1 -- 172.21.15.79:0/217952807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 msgr2=0x55f21f5a7470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:44:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62d2800640 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f5a7470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.940+0000 7f62d2800640 1 -- 172.21.15.79:0/217952807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 msgr2=0x55f21f5a6920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:44:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.941+0000 7f62caa00640 1 -- 172.21.15.79:0/2545316891 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f62c0043020 con 0x7f62d40770f0 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.942+0000 7f62d1e00640 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.942+0000 7f62d2800640 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.942+0000 7f62d2800640 1 -- 172.21.15.79:0/217952807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f21f4d5780 con 0x55f21f1ff1b0 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.942+0000 7f62d1e00640 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.942+0000 7f62d2800640 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f5a62b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009d80 tx=0x7f62cc00e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c8af065f94a95d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.943+0000 7f62bf400640 1 -- 172.21.15.79:0/217952807 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc016070 con 0x55f21f1ff1b0 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.943+0000 7f62bf400640 1 -- 172.21.15.79:0/217952807 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62cc005020 con 0x55f21f1ff1b0 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.944+0000 7f62caa00640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62b80b6590 0x7f62b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.944+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 msgr2=0x55f21f5a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.944+0000 7f62e0270740 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f5a62b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009d80 tx=0x7f62cc00e6c0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.944+0000 7f62caa00640 1 -- 172.21.15.79:0/2545316891 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f62c0106e00 con 0x7f62d40770f0 2024-09-21T02:44:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.946+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 shutdown_connections 2024-09-21T02:44:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.946+0000 7f62e0270740 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f5a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.946+0000 7f62e0270740 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.946+0000 7f62e0270740 1 --2- 172.21.15.79:0/217952807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f5a62b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.946+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 >> 172.21.15.79:0/217952807 conn(0x55f21f1f3300 msgr2=0x55f21f5a1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.946+0000 7f62d1e00640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62b80b6590 0x7f62b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.950+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 shutdown_connections 2024-09-21T02:44:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.950+0000 7f62e0270740 1 -- 172.21.15.79:0/217952807 wait complete. 2024-09-21T02:44:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.951+0000 7f62e0270740 1 -- start start 2024-09-21T02:44:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.951+0000 7f62e0270740 1 Processor -- start 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62e0270740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62e0270740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1de4d0 0x55f21f5c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62e0270740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62e0270740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f21f440ab0 con 0x55f21f1d62f0 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62e0270740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f21f4af570 con 0x55f21f1de4d0 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62e0270740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f21f5a7fe0 con 0x55f21f1ff1b0 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62d1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1de4d0 0x55f21f5c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62d1400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1de4d0 0x55f21f5c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50090/0 (socket says 172.21.15.79:50090) 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62d1400640 1 -- 172.21.15.79:0/908202963 learned_addr learned my addr 172.21.15.79:0/908202963 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.952+0000 7f62d2800640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62e0270740 10 client.0 _ll_register_callbacks cb 0x55f21f4be100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62d1400640 1 -- 172.21.15.79:0/908202963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 msgr2=0x55f21f5c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:07.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62d1400640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62d1e00640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62d1400640 1 -- 172.21.15.79:0/908202963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 msgr2=0x55f21f5c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62d1400640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62d1400640 1 -- 172.21.15.79:0/908202963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f21f26a790 con 0x55f21f1de4d0 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.953+0000 7f62d1e00640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.954+0000 7f62d1400640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1de4d0 0x55f21f5c10e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f62c00c91b0 tx=0x7f62c00cc530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58767d29b44e0d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.954+0000 7f62b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.954+0000 7f62b3e00640 1 -- 172.21.15.79:0/908202963 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0032e60 con 0x55f21f1de4d0 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.954+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62cc005020 con 0x55f21f1de4d0 2024-09-21T02:44:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.954+0000 7f62b3e00640 1 -- 172.21.15.79:0/908202963 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f62c00c8e50 con 0x55f21f1de4d0 2024-09-21T02:44:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.955+0000 7f62b3e00640 1 -- 172.21.15.79:0/908202963 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f62c00f41b0 con 0x55f21f1de4d0 2024-09-21T02:44:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.955+0000 7f62e0270740 10 client.26285 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.955+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f21f2e3620 con 0x55f21f1de4d0 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.955+0000 7f62d1e00640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62b80b6590 0x7f62b80b8aa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f62c4005fd0 tx=0x7f62c401aab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.955+0000 7f62b3e00640 1 -- 172.21.15.79:0/908202963 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62cc005020 con 0x55f21f1de4d0 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62b3e00640 1 -- 172.21.15.79:0/908202963 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f62c0003c20 con 0x55f21f1de4d0 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62e0270740 10 client.26285 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62e0270740 10 client.26285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62e0270740 20 client.26285 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62e0270740 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f1bdd80 0x55f21f5ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62e0270740 4 client.26285 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f21f51b600 con 0x55f21f1bdd80 2024-09-21T02:44:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.957+0000 7f62d1e00640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f1bdd80 0x55f21f5ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:07.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.958+0000 7f62b3e00640 10 client.26285 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:07.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.958+0000 7f62d1e00640 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f1bdd80 0x55f21f5ce2f0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd6ec758f20afa3a server_cookie=366be848f3124f1 in_seq=0 out_seq=0 2024-09-21T02:44:07.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.961+0000 7f62b3e00640 1 -- 172.21.15.79:0/908202963 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f21f51b600 con 0x55f21f1bdd80 2024-09-21T02:44:07.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.961+0000 7f62b3e00640 10 client.26285 handle_command_reply: tid=0 2024-09-21T02:44:07.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 client.26285 shutdown 2024-09-21T02:44:07.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1de4d0 msgr2=0x55f21f5c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:07.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1de4d0 0x55f21f5c10e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f62c00c91b0 tx=0x7f62c00cc530 comp rx=0 tx=0).stop 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 shutdown_connections 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f1bdd80 0x55f21f5ce2f0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1de4d0 0x55f21f5c10e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 --2- 172.21.15.79:0/908202963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1d62f0 0x55f21f5c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.962+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 >> 172.21.15.79:0/908202963 conn(0x55f21f1f3300 msgr2=0x55f21f5a0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.963+0000 7f62b3e00640 0 client.26285 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.963+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 shutdown_connections 2024-09-21T02:44:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.963+0000 7f62e0270740 1 -- 172.21.15.79:0/908202963 wait complete. 2024-09-21T02:44:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.963+0000 7f62e0270740 20 client.26285 trim_cache size 0 max 16384 2024-09-21T02:44:07.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:07 smithi079 ceph-mon[30788]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2024-09-21T02:44:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.995+0000 7f62e0270740 1 Processor -- start 2024-09-21T02:44:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.996+0000 7f62e0270740 1 -- start start 2024-09-21T02:44:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.996+0000 7f62e0270740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1d62f0 0x55f21f5aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62e0270740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1de4d0 0x55f21f5ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62e0270740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62e0270740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62d40752e0 con 0x55f21f1de4d0 2024-09-21T02:44:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62e0270740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41a2430 con 0x55f21f1d62f0 2024-09-21T02:44:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62e0270740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41a0220 con 0x55f21f1ff1b0 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62d1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1d62f0 0x55f21f5aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62d1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1d62f0 0x55f21f5aaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50092/0 (socket says 172.21.15.79:50092) 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62d1e00640 1 -- 172.21.15.79:0/4219565285 learned_addr learned my addr 172.21.15.79:0/4219565285 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62d2800640 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62d1e00640 1 -- 172.21.15.79:0/4219565285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 msgr2=0x55f21f5acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.997+0000 7f62d1e00640 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.998+0000 7f62d1e00640 1 -- 172.21.15.79:0/4219565285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1de4d0 msgr2=0x55f21f5ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.998+0000 7f62d1e00640 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1de4d0 0x55f21f5ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.998+0000 7f62d1e00640 1 -- 172.21.15.79:0/4219565285 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f21f59d0f0 con 0x55f21f1d62f0 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.998+0000 7f62d1e00640 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1d62f0 0x55f21f5aaad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55f21f5cea40 tx=0x7f62c4026070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb6782e96414851 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.998+0000 7f62bea00640 1 -- 172.21.15.79:0/4219565285 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c403e070 con 0x55f21f1d62f0 2024-09-21T02:44:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.998+0000 7f62bea00640 1 -- 172.21.15.79:0/4219565285 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c402f400 con 0x55f21f1d62f0 2024-09-21T02:44:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:07.998+0000 7f62bea00640 1 -- 172.21.15.79:0/4219565285 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4023660 con 0x55f21f1d62f0 2024-09-21T02:44:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.000+0000 7f62e0270740 1 -- 172.21.15.79:0/4219565285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1d62f0 msgr2=0x55f21f5aaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.000+0000 7f62e0270740 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1d62f0 0x55f21f5aaad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55f21f5cea40 tx=0x7f62c4026070 comp rx=0 tx=0).stop 2024-09-21T02:44:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.000+0000 7f62e0270740 1 -- 172.21.15.79:0/4219565285 shutdown_connections 2024-09-21T02:44:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.000+0000 7f62e0270740 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1ff1b0 0x55f21f5acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.000+0000 7f62e0270740 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1de4d0 0x55f21f5ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.000+0000 7f62e0270740 1 --2- 172.21.15.79:0/4219565285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1d62f0 0x55f21f5aaad0 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55f21f5cea40 tx=0x7f62c4026070 comp rx=0 tx=0).stop 2024-09-21T02:44:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.000+0000 7f62e0270740 1 -- 172.21.15.79:0/4219565285 >> 172.21.15.79:0/4219565285 conn(0x55f21f1f3300 msgr2=0x55f21f5aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.001+0000 7f62e0270740 1 -- 172.21.15.79:0/4219565285 shutdown_connections 2024-09-21T02:44:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.001+0000 7f62e0270740 1 -- 172.21.15.79:0/4219565285 wait complete. 2024-09-21T02:44:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.001+0000 7f62e0270740 1 -- start start 2024-09-21T02:44:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.002+0000 7f62e0270740 1 Processor -- start 2024-09-21T02:44:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.003+0000 7f62e0270740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f632ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.003+0000 7f62e0270740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f6351f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.003+0000 7f62e0270740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1931c0 0x55f21f637910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.003+0000 7f62e0270740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41a08f0 con 0x55f21f1931c0 2024-09-21T02:44:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.003+0000 7f62e0270740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41a1d60 con 0x55f21f1ff1b0 2024-09-21T02:44:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.003+0000 7f62e0270740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41a0fc0 con 0x55f21f1de4d0 2024-09-21T02:44:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.003+0000 7f62e0270740 10 client.0 _ll_register_callbacks cb 0x7f62c0005e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f632ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f632ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58288/0 (socket says 172.21.15.79:58288) 2024-09-21T02:44:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 -- 172.21.15.79:0/2923417540 learned_addr learned my addr 172.21.15.79:0/2923417540 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1400640 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f6351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 -- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 msgr2=0x55f21f6351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f6351f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 -- 172.21.15.79:0/2923417540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1931c0 msgr2=0x55f21f637910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1931c0 0x55f21f637910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.004+0000 7f62d1e00640 1 -- 172.21.15.79:0/2923417540 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f21f6380a0 con 0x55f21f1de4d0 2024-09-21T02:44:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.005+0000 7f62d1e00640 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f632ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f62c403b000 tx=0x7f62c4031d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6212030590f8ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.005+0000 7f62b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:44:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.005+0000 7f62b3e00640 1 -- 172.21.15.79:0/2923417540 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c403e070 con 0x55f21f1de4d0 2024-09-21T02:44:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.005+0000 7f62b3e00640 1 -- 172.21.15.79:0/2923417540 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f62c401a8b0 con 0x55f21f1de4d0 2024-09-21T02:44:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.005+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62c402f400 con 0x55f21f1de4d0 2024-09-21T02:44:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.006+0000 7f62b3e00640 1 -- 172.21.15.79:0/2923417540 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f62c404d050 con 0x55f21f1de4d0 2024-09-21T02:44:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.006+0000 7f62e0270740 10 client.26317 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.006+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f21f6393a0 con 0x55f21f1de4d0 2024-09-21T02:44:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.006+0000 7f62b3e00640 1 -- 172.21.15.79:0/2923417540 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c402f400 con 0x55f21f1de4d0 2024-09-21T02:44:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62b3e00640 1 -- 172.21.15.79:0/2923417540 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f62c4038030 con 0x55f21f1de4d0 2024-09-21T02:44:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62e0270740 10 client.26317 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62e0270740 10 client.26317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62e0270740 20 client.26317 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62e0270740 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f639c00 0x55f21f63c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62e0270740 4 client.26317 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f21f5a81e0 con 0x55f21f639c00 2024-09-21T02:44:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.008+0000 7f62d1400640 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f639c00 0x55f21f63c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.009+0000 7f62d1400640 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f639c00 0x55f21f63c020 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac60a4a0c83075e6 server_cookie=7dbdcb1977cc8b18 in_seq=0 out_seq=0 2024-09-21T02:44:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.009+0000 7f62b3e00640 10 client.26317 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:08.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:07 smithi148 ceph-mon[34626]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2024-09-21T02:44:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.093+0000 7f62b3e00640 1 -- 172.21.15.79:0/2923417540 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f21f5a81e0 con 0x55f21f639c00 2024-09-21T02:44:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.094+0000 7f62b3e00640 10 client.26317 handle_command_reply: tid=0 2024-09-21T02:44:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.094+0000 7f62e0270740 1 client.26317 shutdown 2024-09-21T02:44:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.094+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 msgr2=0x55f21f632ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.094+0000 7f62e0270740 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f632ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f62c403b000 tx=0x7f62c4031d50 comp rx=0 tx=0).stop 2024-09-21T02:44:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 shutdown_connections 2024-09-21T02:44:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62e0270740 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f21f639c00 0x55f21f63c020 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62e0270740 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f21f1931c0 0x55f21f637910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62e0270740 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f21f1ff1b0 0x55f21f6351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62b3e00640 0 client.26317 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62e0270740 1 --2- 172.21.15.79:0/2923417540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f21f1de4d0 0x55f21f632ca0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 >> 172.21.15.79:0/2923417540 conn(0x55f21f1f3300 msgr2=0x55f21f5d2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.095+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 shutdown_connections 2024-09-21T02:44:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.096+0000 7f62e0270740 1 -- 172.21.15.79:0/2923417540 wait complete. 2024-09-21T02:44:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.096+0000 7f62e0270740 20 client.26317 trim_cache size 0 max 16384 2024-09-21T02:44:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:44:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:44:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:44:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:44:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62b80b6590 msgr2=0x7f62b80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62b80b6590 0x7f62b80b8aa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f62c4005fd0 tx=0x7f62c401aab0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d40770f0 msgr2=0x7f62d4198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d40770f0 0x7f62d4198270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62c002a930 tx=0x7f62c0030e00 comp rx=0 tx=0).stop 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 shutdown_connections 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f62b80b6590 0x7f62b80b8aa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d410fc60 0x7f62d4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62d40770f0 0x7f62d4198270 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 --2- 172.21.15.79:0/2545316891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62d4075cf0 0x7f62d4197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 >> 172.21.15.79:0/2545316891 conn(0x7f62d40fee20 msgr2=0x7f62d4102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.097+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 shutdown_connections 2024-09-21T02:44:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:08.098+0000 7f62d3200640 1 -- 172.21.15.79:0/2545316891 wait complete. 2024-09-21T02:44:09.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:09 smithi079 ceph-mon[30788]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.0 MiB/s wr, 497 op/s 2024-09-21T02:44:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:09 smithi148 ceph-mon[34626]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.0 MiB/s wr, 497 op/s 2024-09-21T02:44:10.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:09 smithi098 ceph-mon[34832]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.0 MiB/s wr, 497 op/s 2024-09-21T02:44:10.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:10 smithi079 ceph-mon[30788]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-21T02:44:11.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:10 smithi148 ceph-mon[34626]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-21T02:44:11.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:10 smithi098 ceph-mon[34832]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-21T02:44:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 495.0 s, 653.2 tps, lat 154.665 ms stddev 199.111 2024-09-21T02:44:13.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:12 smithi148 ceph-mon[34626]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 569 op/s 2024-09-21T02:44:13.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:12 smithi098 ceph-mon[34832]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 569 op/s 2024-09-21T02:44:13.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:12 smithi079 ceph-mon[30788]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 569 op/s 2024-09-21T02:44:15.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:14 smithi148 ceph-mon[34626]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.2 MiB/s wr, 501 op/s 2024-09-21T02:44:15.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:14 smithi098 ceph-mon[34832]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.2 MiB/s wr, 501 op/s 2024-09-21T02:44:15.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:14 smithi079 ceph-mon[30788]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.2 MiB/s wr, 501 op/s 2024-09-21T02:44:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 500.0 s, 824.2 tps, lat 117.721 ms stddev 158.400 2024-09-21T02:44:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:16 smithi148 ceph-mon[34626]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.7 MiB/s wr, 551 op/s 2024-09-21T02:44:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:16 smithi098 ceph-mon[34832]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.7 MiB/s wr, 551 op/s 2024-09-21T02:44:17.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:16 smithi079 ceph-mon[30788]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.7 MiB/s wr, 551 op/s 2024-09-21T02:44:19.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:18 smithi148 ceph-mon[34626]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 491 op/s 2024-09-21T02:44:19.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:18 smithi098 ceph-mon[34832]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 491 op/s 2024-09-21T02:44:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:18 smithi079 ceph-mon[30788]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 491 op/s 2024-09-21T02:44:20.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:20 smithi079 ceph-mon[30788]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.0 MiB/s wr, 508 op/s 2024-09-21T02:44:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:20 smithi098 ceph-mon[34832]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.0 MiB/s wr, 508 op/s 2024-09-21T02:44:21.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:20 smithi148 ceph-mon[34626]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.0 MiB/s wr, 508 op/s 2024-09-21T02:44:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.421+0000 7f7c2e600640 1 -- 172.21.15.79:0/1998575888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c28109280 msgr2=0x7f7c2810b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.421+0000 7f7c2e600640 1 --2- 172.21.15.79:0/1998575888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c28109280 0x7f7c2810b790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009ca0 tx=0x7f7c2002a8b0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.422+0000 7f7c2e600640 1 -- 172.21.15.79:0/1998575888 shutdown_connections 2024-09-21T02:44:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.422+0000 7f7c2e600640 1 --2- 172.21.15.79:0/1998575888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c28109280 0x7f7c2810b790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.422+0000 7f7c2e600640 1 --2- 172.21.15.79:0/1998575888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28106700 0x7f7c28108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.422+0000 7f7c2e600640 1 --2- 172.21.15.79:0/1998575888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c2806b6d0 0x7f7c281061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.422+0000 7f7c2e600640 1 -- 172.21.15.79:0/1998575888 >> 172.21.15.79:0/1998575888 conn(0x7f7c280fdd80 msgr2=0x7f7c28100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.425+0000 7f7c2e600640 1 -- 172.21.15.79:0/1998575888 shutdown_connections 2024-09-21T02:44:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.425+0000 7f7c2e600640 1 -- 172.21.15.79:0/1998575888 wait complete. 2024-09-21T02:44:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.427+0000 7f7c2e600640 1 Processor -- start 2024-09-21T02:44:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.427+0000 7f7c2e600640 1 -- start start 2024-09-21T02:44:21.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.428+0000 7f7c2e600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c2806b6d0 0x7f7c281a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.428+0000 7f7c2e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c28106700 0x7f7c281a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.428+0000 7f7c2e600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28109280 0x7f7c281a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.428+0000 7f7c2e600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28111390 con 0x7f7c28109280 2024-09-21T02:44:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.428+0000 7f7c2e600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28111210 con 0x7f7c28106700 2024-09-21T02:44:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.428+0000 7f7c2e600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28111510 con 0x7f7c2806b6d0 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.429+0000 7f7c27e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c28106700 0x7f7c281a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.429+0000 7f7c27e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c28106700 0x7f7c281a0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59678/0 (socket says 172.21.15.79:59678) 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.429+0000 7f7c27e00640 1 -- 172.21.15.79:0/3112530178 learned_addr learned my addr 172.21.15.79:0/3112530178 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.429+0000 7f7c2d200640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c2806b6d0 0x7f7c281a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.429+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28109280 0x7f7c281a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.430+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3112530178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c2806b6d0 msgr2=0x7f7c281a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.430+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c2806b6d0 0x7f7c281a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.430+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3112530178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c28106700 msgr2=0x7f7c281a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.430+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c28106700 0x7f7c281a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.430+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3112530178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c281a1dd0 con 0x7f7c28109280 2024-09-21T02:44:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.430+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28109280 0x7f7c281a15b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009bf0 tx=0x7f7c20003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.431+0000 7f7c25600640 1 -- 172.21.15.79:0/3112530178 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20004240 con 0x7f7c28109280 2024-09-21T02:44:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.431+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c281a2060 con 0x7f7c28109280 2024-09-21T02:44:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.431+0000 7f7c25600640 1 -- 172.21.15.79:0/3112530178 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c20040070 con 0x7f7c28109280 2024-09-21T02:44:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.432+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c281a87b0 con 0x7f7c28109280 2024-09-21T02:44:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.432+0000 7f7c25600640 1 -- 172.21.15.79:0/3112530178 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20004240 con 0x7f7c28109280 2024-09-21T02:44:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.437+0000 7f7c25600640 1 -- 172.21.15.79:0/3112530178 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7c200319d0 con 0x7f7c28109280 2024-09-21T02:44:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.439+0000 7f7c36dfe740 1 Processor -- start 2024-09-21T02:44:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.440+0000 7f7c36dfe740 1 -- start start 2024-09-21T02:44:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187dd1b0 0x564d18b842b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c25600640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7c100b67d0 0x7f7c100b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187b42f0 0x564d18b84920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18b85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564d18af76b0 con 0x564d187dd1b0 2024-09-21T02:44:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d18ae6ae0 con 0x564d187b42f0 2024-09-21T02:44:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564d18aea8f0 con 0x564d187bc4d0 2024-09-21T02:44:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c25600640 1 -- 172.21.15.79:0/3112530178 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7c201081f0 con 0x7f7c28109280 2024-09-21T02:44:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.441+0000 7f7c2d200640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7c100b67d0 0x7f7c100b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.442+0000 7f7c27e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187dd1b0 0x564d18b842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.442+0000 7f7c2dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18b85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.442+0000 7f7c2dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18b85470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51752/0 (socket says 172.21.15.79:51752) 2024-09-21T02:44:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.442+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3744938281 learned_addr learned my addr 172.21.15.79:0/3744938281 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.443+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3744938281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187b42f0 msgr2=0x564d18b84920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:44:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.443+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3744938281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187b42f0 0x564d18b84920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.443+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3744938281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187dd1b0 msgr2=0x564d18b842b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.443+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3744938281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187dd1b0 0x564d18b842b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.443+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3744938281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d18ab3780 con 0x564d187bc4d0 2024-09-21T02:44:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.444+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3744938281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18b85470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c200cee40 tx=0x7f7c200ced40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a39c3e2a3f12bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.444+0000 7f7c1a000640 1 -- 172.21.15.79:0/3744938281 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200cf5b0 con 0x564d187bc4d0 2024-09-21T02:44:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.444+0000 7f7c2d200640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7c100b67d0 0x7f7c100b8ce0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009bd0 tx=0x7f7c1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.444+0000 7f7c1a000640 1 -- 172.21.15.79:0/3744938281 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c20036030 con 0x564d187bc4d0 2024-09-21T02:44:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.444+0000 7f7c1a000640 1 -- 172.21.15.79:0/3744938281 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200d8440 con 0x564d187bc4d0 2024-09-21T02:44:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.446+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3744938281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 msgr2=0x564d18b85470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.446+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3744938281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18b85470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c200cee40 tx=0x7f7c200ced40 comp rx=0 tx=0).stop 2024-09-21T02:44:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.446+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3744938281 shutdown_connections 2024-09-21T02:44:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.446+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3744938281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18b85470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.446+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3744938281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187b42f0 0x564d18b84920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.446+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3744938281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187dd1b0 0x564d18b842b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.446+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3744938281 >> 172.21.15.79:0/3744938281 conn(0x564d187d1300 msgr2=0x564d18b7fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.447+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3744938281 shutdown_connections 2024-09-21T02:44:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.447+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3744938281 wait complete. 2024-09-21T02:44:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.448+0000 7f7c36dfe740 1 -- start start 2024-09-21T02:44:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.448+0000 7f7c36dfe740 1 Processor -- start 2024-09-21T02:44:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.449+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187b42f0 0x564d18b8d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.449+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187bc4d0 0x564d18b8ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18b8e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564d18a1eab0 con 0x564d187bc4d0 2024-09-21T02:44:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d18a8d570 con 0x564d187dd1b0 2024-09-21T02:44:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564d18b85d50 con 0x564d187b42f0 2024-09-21T02:44:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c36dfe740 10 client.0 _ll_register_callbacks cb 0x564d18a9c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c2dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18b8e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c2dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18b8e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59692/0 (socket says 172.21.15.79:59692) 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c2dc00640 1 -- 172.21.15.79:0/2370522035 learned_addr learned my addr 172.21.15.79:0/2370522035 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c2dc00640 1 -- 172.21.15.79:0/2370522035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187b42f0 msgr2=0x564d18b8d700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.450+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187b42f0 0x564d18b8d700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.451+0000 7f7c2dc00640 1 -- 172.21.15.79:0/2370522035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187bc4d0 msgr2=0x564d18b8ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.451+0000 7f7c27e00640 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187bc4d0 0x564d18b8ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.451+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187bc4d0 0x564d18b8ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.451+0000 7f7c2dc00640 1 -- 172.21.15.79:0/2370522035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d18848790 con 0x564d187dd1b0 2024-09-21T02:44:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.451+0000 7f7c27e00640 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187bc4d0 0x564d18b8ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.452+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18b8e930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c200cebb0 tx=0x7f7c20031700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a51184a9adf5cc01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.452+0000 7f7c0ea00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:44:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.452+0000 7f7c0ea00640 1 -- 172.21.15.79:0/2370522035 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200d88d0 con 0x564d187dd1b0 2024-09-21T02:44:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.452+0000 7f7c0ea00640 1 -- 172.21.15.79:0/2370522035 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7c200b60b0 con 0x564d187dd1b0 2024-09-21T02:44:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.452+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c20036030 con 0x564d187dd1b0 2024-09-21T02:44:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.453+0000 7f7c0ea00640 1 -- 172.21.15.79:0/2370522035 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c200b62b0 con 0x564d187dd1b0 2024-09-21T02:44:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.453+0000 7f7c36dfe740 10 client.26300 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.453+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564d188c1620 con 0x564d187dd1b0 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.453+0000 7f7c0ea00640 1 -- 172.21.15.79:0/2370522035 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c20036030 con 0x564d187dd1b0 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.454+0000 7f7c0ea00640 1 -- 172.21.15.79:0/2370522035 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c2004c020 con 0x564d187dd1b0 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.454+0000 7f7c36dfe740 10 client.26300 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.454+0000 7f7c36dfe740 10 client.26300 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.454+0000 7f7c36dfe740 20 client.26300 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.454+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d1879bd80 0x564d18b9ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.455+0000 7f7c36dfe740 4 client.26300 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.455+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d18af9600 con 0x564d1879bd80 2024-09-21T02:44:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.455+0000 7f7c2d200640 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d1879bd80 0x564d18b9ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.456+0000 7f7c2d200640 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d1879bd80 0x564d18b9ab60 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293f456e4cd20967 server_cookie=d9ebd3052b2a401d in_seq=0 out_seq=0 2024-09-21T02:44:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.456+0000 7f7c0ea00640 10 client.26300 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c0ea00640 1 -- 172.21.15.79:0/2370522035 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d18af9600 con 0x564d1879bd80 2024-09-21T02:44:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c0ea00640 10 client.26300 handle_command_reply: tid=0 2024-09-21T02:44:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 client.26300 shutdown 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 msgr2=0x564d18b8e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18b8e930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c200cebb0 tx=0x7f7c20031700 comp rx=0 tx=0).stop 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 shutdown_connections 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d1879bd80 0x564d18b9ab60 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18b8e930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187bc4d0 0x564d18b8ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/2370522035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187b42f0 0x564d18b8d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.457+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 >> 172.21.15.79:0/2370522035 conn(0x564d187d1300 msgr2=0x564d18b7e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.458+0000 7f7c0ea00640 0 client.26300 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.458+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 shutdown_connections 2024-09-21T02:44:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.458+0000 7f7c36dfe740 1 -- 172.21.15.79:0/2370522035 wait complete. 2024-09-21T02:44:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.458+0000 7f7c36dfe740 20 client.26300 trim_cache size 0 max 16384 2024-09-21T02:44:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 Processor -- start 2024-09-21T02:44:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 -- start start 2024-09-21T02:44:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b88ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187bc4d0 0x564d18b8c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187dd1b0 0x564d18b8a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281b0b80 con 0x564d187b42f0 2024-09-21T02:44:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281b3400 con 0x564d187bc4d0 2024-09-21T02:44:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.486+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281b11f0 con 0x564d187dd1b0 2024-09-21T02:44:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.487+0000 7f7c2dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187dd1b0 0x564d18b8a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.487+0000 7f7c2dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187dd1b0 0x564d18b8a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51778/0 (socket says 172.21.15.79:51778) 2024-09-21T02:44:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.487+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3109827606 learned_addr learned my addr 172.21.15.79:0/3109827606 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.487+0000 7f7c27e00640 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187bc4d0 0x564d18b8c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2d200640 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b88ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3109827606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187bc4d0 msgr2=0x564d18b8c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187bc4d0 0x564d18b8c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3109827606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 msgr2=0x564d18b88ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b88ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2dc00640 1 -- 172.21.15.79:0/3109827606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1879bfb0 con 0x564d187dd1b0 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2d200640 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b88ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c27e00640 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187bc4d0 0x564d18b8c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.488+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187dd1b0 0x564d18b8a620 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c2002aea0 tx=0x7f7c200b6450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd4e60fdf44d6681 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.489+0000 7f7c19600640 1 -- 172.21.15.79:0/3109827606 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200cf5b0 con 0x564d187dd1b0 2024-09-21T02:44:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.489+0000 7f7c19600640 1 -- 172.21.15.79:0/3109827606 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c200d88d0 con 0x564d187dd1b0 2024-09-21T02:44:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.489+0000 7f7c19600640 1 -- 172.21.15.79:0/3109827606 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200ce110 con 0x564d187dd1b0 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3109827606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187dd1b0 msgr2=0x564d18b8a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187dd1b0 0x564d18b8a620 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c2002aea0 tx=0x7f7c200b6450 comp rx=0 tx=0).stop 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3109827606 shutdown_connections 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187dd1b0 0x564d18b8a620 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187bc4d0 0x564d18b8c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/3109827606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b88ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3109827606 >> 172.21.15.79:0/3109827606 conn(0x564d187d1300 msgr2=0x564d18b8bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3109827606 shutdown_connections 2024-09-21T02:44:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.491+0000 7f7c36dfe740 1 -- 172.21.15.79:0/3109827606 wait complete. 2024-09-21T02:44:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 505.0 s, 1239.6 tps, lat 81.200 ms stddev 112.614 2024-09-21T02:44:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.492+0000 7f7c36dfe740 1 -- start start 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.492+0000 7f7c36dfe740 1 Processor -- start 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.493+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b95610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.493+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18c01600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.493+0000 7f7c36dfe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18c03d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.493+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281b18c0 con 0x564d187b42f0 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.493+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281b2d30 con 0x564d187dd1b0 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.493+0000 7f7c36dfe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281b1f90 con 0x564d187bc4d0 2024-09-21T02:44:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.493+0000 7f7c36dfe740 10 client.0 _ll_register_callbacks cb 0x7f7c200cad50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18c01600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18c01600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51784/0 (socket says 172.21.15.79:51784) 2024-09-21T02:44:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 -- 172.21.15.79:0/1913365643 learned_addr learned my addr 172.21.15.79:0/1913365643 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c2d200640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b95610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18c03d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 -- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 msgr2=0x564d18c03d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18c03d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 -- 172.21.15.79:0/1913365643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 msgr2=0x564d18b95610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b95610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c27e00640 1 -- 172.21.15.79:0/1913365643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d18c04480 con 0x564d187bc4d0 2024-09-21T02:44:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.494+0000 7f7c2dc00640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18c03d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:44:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.495+0000 7f7c27e00640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18c01600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400de30 tx=0x7f7c140126a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff9c0f8cbf40516 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.495+0000 7f7c0ea00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:44:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.495+0000 7f7c0ea00640 1 -- 172.21.15.79:0/1913365643 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14015860 con 0x564d187bc4d0 2024-09-21T02:44:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.495+0000 7f7c0ea00640 1 -- 172.21.15.79:0/1913365643 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7c14015a00 con 0x564d187bc4d0 2024-09-21T02:44:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.495+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c200d88d0 con 0x564d187bc4d0 2024-09-21T02:44:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.496+0000 7f7c0ea00640 1 -- 172.21.15.79:0/1913365643 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c14027050 con 0x564d187bc4d0 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.496+0000 7f7c36dfe740 10 client.26332 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.496+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564d18c05780 con 0x564d187bc4d0 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.496+0000 7f7c0ea00640 1 -- 172.21.15.79:0/1913365643 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c200d88d0 con 0x564d187bc4d0 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.496+0000 7f7c0ea00640 1 -- 172.21.15.79:0/1913365643 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c1401ebf0 con 0x564d187bc4d0 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.497+0000 7f7c36dfe740 10 client.26332 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.497+0000 7f7c36dfe740 10 client.26332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.497+0000 7f7c36dfe740 20 client.26332 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.497+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d187711c0 0x564d18c081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.497+0000 7f7c36dfe740 4 client.26332 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.497+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d18af50b0 con 0x564d187711c0 2024-09-21T02:44:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.497+0000 7f7c2d200640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d187711c0 0x564d18c081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.498+0000 7f7c0ea00640 10 client.26332 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.498+0000 7f7c2d200640 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d187711c0 0x564d18c081d0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacc134bace0e8e4 server_cookie=1bdc059ca479549d in_seq=0 out_seq=0 2024-09-21T02:44:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.515+0000 7f7c0ea00640 1 -- 172.21.15.79:0/1913365643 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d18af50b0 con 0x564d187711c0 2024-09-21T02:44:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.515+0000 7f7c0ea00640 10 client.26332 handle_command_reply: tid=0 2024-09-21T02:44:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.515+0000 7f7c36dfe740 1 client.26332 shutdown 2024-09-21T02:44:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.515+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 msgr2=0x564d18c01600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.515+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18c01600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400de30 tx=0x7f7c140126a0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.515+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 shutdown_connections 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564d187711c0 0x564d18c081d0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d187dd1b0 0x564d18c03d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d187bc4d0 0x564d18c01600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 1 --2- 172.21.15.79:0/1913365643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d187b42f0 0x564d18b95610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 >> 172.21.15.79:0/1913365643 conn(0x564d187d1300 msgr2=0x564d18b88100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c0ea00640 0 client.26332 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 shutdown_connections 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 1 -- 172.21.15.79:0/1913365643 wait complete. 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.516+0000 7f7c36dfe740 20 client.26332 trim_cache size 0 max 16384 2024-09-21T02:44:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:44:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:44:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:44:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:44:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7c100b67d0 msgr2=0x7f7c100b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7c100b67d0 0x7f7c100b8ce0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009bd0 tx=0x7f7c1c005f90 comp rx=0 tx=0).stop 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28109280 msgr2=0x7f7c281a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28109280 0x7f7c281a15b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009bf0 tx=0x7f7c20003ba0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 shutdown_connections 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7c100b67d0 0x7f7c100b8ce0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28109280 0x7f7c281a15b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c28106700 0x7f7c281a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 --2- 172.21.15.79:0/3112530178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c2806b6d0 0x7f7c281a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 >> 172.21.15.79:0/3112530178 conn(0x7f7c280fdd80 msgr2=0x7f7c28104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 shutdown_connections 2024-09-21T02:44:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:21.517+0000 7f7c2e600640 1 -- 172.21.15.79:0/3112530178 wait complete. 2024-09-21T02:44:23.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:22 smithi098 ceph-mon[34832]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.4 MiB/s wr, 619 op/s 2024-09-21T02:44:23.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:22 smithi079 ceph-mon[30788]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.4 MiB/s wr, 619 op/s 2024-09-21T02:44:23.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:22 smithi148 ceph-mon[34626]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.4 MiB/s wr, 619 op/s 2024-09-21T02:44:25.115 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:24 smithi148 ceph-mon[34626]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.7 MiB/s wr, 526 op/s 2024-09-21T02:44:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:24 smithi098 ceph-mon[34832]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.7 MiB/s wr, 526 op/s 2024-09-21T02:44:25.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:24 smithi079 ceph-mon[30788]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5.7 MiB/s wr, 526 op/s 2024-09-21T02:44:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 510.0 s, 528.8 tps, lat 191.462 ms stddev 211.572 2024-09-21T02:44:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:26 smithi098 ceph-mon[34832]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.9 MiB/s wr, 563 op/s 2024-09-21T02:44:27.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:26 smithi079 ceph-mon[30788]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.9 MiB/s wr, 563 op/s 2024-09-21T02:44:27.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:26 smithi148 ceph-mon[34626]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.9 MiB/s wr, 563 op/s 2024-09-21T02:44:29.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:28 smithi098 ceph-mon[34832]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2024-09-21T02:44:29.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:28 smithi079 ceph-mon[30788]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2024-09-21T02:44:29.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:28 smithi148 ceph-mon[34626]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2024-09-21T02:44:31.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:30 smithi098 ceph-mon[34832]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.7 MiB/s wr, 554 op/s 2024-09-21T02:44:31.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:30 smithi079 ceph-mon[30788]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.7 MiB/s wr, 554 op/s 2024-09-21T02:44:31.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:30 smithi148 ceph-mon[34626]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.7 MiB/s wr, 554 op/s 2024-09-21T02:44:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 515.0 s, 538.8 tps, lat 181.675 ms stddev 207.729 2024-09-21T02:44:33.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:32 smithi098 ceph-mon[34832]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 MiB/s wr, 660 op/s 2024-09-21T02:44:33.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:32 smithi079 ceph-mon[30788]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 MiB/s wr, 660 op/s 2024-09-21T02:44:33.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:32 smithi148 ceph-mon[34626]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.8 MiB/s wr, 660 op/s 2024-09-21T02:44:34.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.833+0000 7f2ada400640 1 -- 172.21.15.79:0/577519592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 msgr2=0x7f2ad4103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.833+0000 7f2ada400640 1 --2- 172.21.15.79:0/577519592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 0x7f2ad4103b40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009900 tx=0x7f2ac402a410 comp rx=0 tx=0).stop 2024-09-21T02:44:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.833+0000 7f2ada400640 1 -- 172.21.15.79:0/577519592 shutdown_connections 2024-09-21T02:44:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.833+0000 7f2ada400640 1 --2- 172.21.15.79:0/577519592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad41050f0 0x7f2ad410ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.833+0000 7f2ada400640 1 --2- 172.21.15.79:0/577519592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ad4104750 0x7f2ad4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.833+0000 7f2ada400640 1 --2- 172.21.15.79:0/577519592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 0x7f2ad4103b40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.833+0000 7f2ada400640 1 -- 172.21.15.79:0/577519592 >> 172.21.15.79:0/577519592 conn(0x7f2ad40ff030 msgr2=0x7f2ad41014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.834+0000 7f2ada400640 1 -- 172.21.15.79:0/577519592 shutdown_connections 2024-09-21T02:44:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.834+0000 7f2ada400640 1 -- 172.21.15.79:0/577519592 wait complete. 2024-09-21T02:44:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.835+0000 7f2ada400640 1 Processor -- start 2024-09-21T02:44:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.835+0000 7f2ada400640 1 -- start start 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ada400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 0x7f2ad4076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ada400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4104750 0x7f2ad4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ada400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ad41050f0 0x7f2ad4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ada400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad410f340 con 0x7f2ad4104750 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ada400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad410f1c0 con 0x7f2ad41050f0 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ada400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad410f4c0 con 0x7f2ad41036d0 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ad3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 0x7f2ad4076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ad3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ad41050f0 0x7f2ad4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ad3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 0x7f2ad4076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49462/0 (socket says 172.21.15.79:49462) 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.836+0000 7f2ad3400640 1 -- 172.21.15.79:0/1107475850 learned_addr learned my addr 172.21.15.79:0/1107475850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.837+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4104750 0x7f2ad4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.837+0000 7f2ad3e00640 1 -- 172.21.15.79:0/1107475850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 msgr2=0x7f2ad4076e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.837+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 0x7f2ad4076e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.837+0000 7f2ad3e00640 1 -- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4104750 msgr2=0x7f2ad4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.837+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4104750 0x7f2ad4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.837+0000 7f2ad3e00640 1 -- 172.21.15.79:0/1107475850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad4076380 con 0x7f2ad41050f0 2024-09-21T02:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.837+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ad41050f0 0x7f2ad4075c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009fd0 tx=0x7f2acc01ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.838+0000 7f2acbe00640 1 -- 172.21.15.79:0/1107475850 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00ce40 con 0x7f2ad41050f0 2024-09-21T02:44:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.838+0000 7f2acbe00640 1 -- 172.21.15.79:0/1107475850 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2acc005020 con 0x7f2ad41050f0 2024-09-21T02:44:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.838+0000 7f2acbe00640 1 -- 172.21.15.79:0/1107475850 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc021680 con 0x7f2ad41050f0 2024-09-21T02:44:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.838+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad406cde0 con 0x7f2ad41050f0 2024-09-21T02:44:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.838+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad4199d60 con 0x7f2ad41050f0 2024-09-21T02:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.848+0000 7f2acbe00640 1 -- 172.21.15.79:0/1107475850 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2acc004b20 con 0x7f2ad41050f0 2024-09-21T02:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.849+0000 7f2ae1477740 1 Processor -- start 2024-09-21T02:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.849+0000 7f2ae1477740 1 -- start start 2024-09-21T02:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.849+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29857c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29857c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29857d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ae1477740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e2984ef6b0 con 0x55e2981ac2f0 2024-09-21T02:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ae1477740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e2984deae0 con 0x55e2981d51b0 2024-09-21T02:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ae1477740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e2984e28f0 con 0x55e2981b44d0 2024-09-21T02:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ad2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29857c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ad2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29857c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33896/0 (socket says 172.21.15.79:33896) 2024-09-21T02:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ad2a00640 1 -- 172.21.15.79:0/3905371703 learned_addr learned my addr 172.21.15.79:0/3905371703 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ad3400640 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29857c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.850+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29857d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ad2a00640 1 -- 172.21.15.79:0/3905371703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 msgr2=0x55e29857d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29857d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ad2a00640 1 -- 172.21.15.79:0/3905371703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 msgr2=0x55e29857c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29857c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ad2a00640 1 -- 172.21.15.79:0/3905371703 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2984ab780 con 0x55e2981d51b0 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29857c0d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00137b0 tx=0x7f2ac0009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ff1b6ff4c86038d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ac8c00640 1 -- 172.21.15.79:0/3905371703 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0013d30 con 0x55e2981d51b0 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ac8c00640 1 -- 172.21.15.79:0/3905371703 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac00130d0 con 0x55e2981d51b0 2024-09-21T02:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.851+0000 7f2ac8c00640 1 -- 172.21.15.79:0/3905371703 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0011870 con 0x55e2981d51b0 2024-09-21T02:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.852+0000 7f2acbe00640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2ab80b6590 0x7f2ab80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.852+0000 7f2acbe00640 1 -- 172.21.15.79:0/1107475850 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2acc0f8dd0 con 0x7f2ad41050f0 2024-09-21T02:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ae1477740 1 -- 172.21.15.79:0/3905371703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 msgr2=0x55e29857c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ae1477740 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29857c0d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00137b0 tx=0x7f2ac0009700 comp rx=0 tx=0).stop 2024-09-21T02:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ad3400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2ab80b6590 0x7f2ab80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ae1477740 1 -- 172.21.15.79:0/3905371703 shutdown_connections 2024-09-21T02:44:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ae1477740 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29857d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ae1477740 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29857c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ae1477740 1 --2- 172.21.15.79:0/3905371703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29857c0d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.853+0000 7f2ae1477740 1 -- 172.21.15.79:0/3905371703 >> 172.21.15.79:0/3905371703 conn(0x55e2981c9300 msgr2=0x55e298577b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.856+0000 7f2ae1477740 1 -- 172.21.15.79:0/3905371703 shutdown_connections 2024-09-21T02:44:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.856+0000 7f2ae1477740 1 -- 172.21.15.79:0/3905371703 wait complete. 2024-09-21T02:44:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.857+0000 7f2ad3400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2ab80b6590 0x7f2ab80b8aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4005f70 tx=0x7f2ac40314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.857+0000 7f2ae1477740 1 -- start start 2024-09-21T02:44:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.857+0000 7f2ae1477740 1 Processor -- start 2024-09-21T02:44:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.858+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981ac2f0 0x55e298585760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.858+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981b44d0 0x55e298585e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e298586990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ad3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981ac2f0 0x55e298585760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ae1477740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e298416ab0 con 0x55e2981b44d0 2024-09-21T02:44:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ae1477740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e298485570 con 0x55e2981d51b0 2024-09-21T02:44:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ae1477740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e29857dd50 con 0x55e2981ac2f0 2024-09-21T02:44:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ae1477740 10 client.0 _ll_register_callbacks cb 0x55e298494100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ad2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981b44d0 0x55e298585e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ad2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981b44d0 0x55e298585e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42858/0 (socket says 172.21.15.79:42858) 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.859+0000 7f2ad2a00640 1 -- 172.21.15.79:0/4014541895 learned_addr learned my addr 172.21.15.79:0/4014541895 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e298586990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad2a00640 1 -- 172.21.15.79:0/4014541895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981ac2f0 msgr2=0x55e298585760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981ac2f0 0x55e298585760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad2a00640 1 -- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 msgr2=0x55e298586990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e298586990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad2a00640 1 -- 172.21.15.79:0/4014541895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e298240790 con 0x55e2981b44d0 2024-09-21T02:44:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e298586990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:44:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2ad2a00640 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981b44d0 0x55e298585e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00056a0 tx=0x7f2ac00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8461dbdc57cdb6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.860+0000 7f2abd600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:44:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.867+0000 7f2abd600640 1 -- 172.21.15.79:0/4014541895 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0004220 con 0x55e2981b44d0 2024-09-21T02:44:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.867+0000 7f2abd600640 1 -- 172.21.15.79:0/4014541895 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2ac00043c0 con 0x55e2981b44d0 2024-09-21T02:44:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.867+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ac00130d0 con 0x55e2981b44d0 2024-09-21T02:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.867+0000 7f2abd600640 1 -- 172.21.15.79:0/4014541895 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2ac000f970 con 0x55e2981b44d0 2024-09-21T02:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.869+0000 7f2ae1477740 10 client.16116 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.869+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e2982b9620 con 0x55e2981b44d0 2024-09-21T02:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.869+0000 7f2abd600640 1 -- 172.21.15.79:0/4014541895 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac00130d0 con 0x55e2981b44d0 2024-09-21T02:44:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2abd600640 1 -- 172.21.15.79:0/4014541895 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2ac00115f0 con 0x55e2981b44d0 2024-09-21T02:44:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2ae1477740 10 client.16116 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2ae1477740 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2ae1477740 20 client.16116 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2ae1477740 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e298193d80 0x55e298592b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2ae1477740 4 client.16116 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2984f1600 con 0x55e298193d80 2024-09-21T02:44:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.872+0000 7f2ad3400640 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e298193d80 0x55e298592b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.874+0000 7f2ad3400640 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e298193d80 0x55e298592b80 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23753a09bc964aea server_cookie=99ea12e1c55584c0 in_seq=0 out_seq=0 2024-09-21T02:44:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.874+0000 7f2abd600640 10 client.16116 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.875+0000 7f2abd600640 1 -- 172.21.15.79:0/4014541895 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2984f1600 con 0x55e298193d80 2024-09-21T02:44:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.875+0000 7f2abd600640 10 client.16116 handle_command_reply: tid=0 2024-09-21T02:44:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.875+0000 7f2ae1477740 1 client.16116 shutdown 2024-09-21T02:44:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981b44d0 msgr2=0x55e298585e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981b44d0 0x55e298585e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00056a0 tx=0x7f2ac00056d0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 shutdown_connections 2024-09-21T02:44:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e298193d80 0x55e298592b80 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e298586990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981b44d0 0x55e298585e20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 --2- 172.21.15.79:0/4014541895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981ac2f0 0x55e298585760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.876+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 >> 172.21.15.79:0/4014541895 conn(0x55e2981c9300 msgr2=0x55e2985760e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.877+0000 7f2abd600640 0 client.16116 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.877+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 shutdown_connections 2024-09-21T02:44:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.877+0000 7f2ae1477740 1 -- 172.21.15.79:0/4014541895 wait complete. 2024-09-21T02:44:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.878+0000 7f2ae1477740 20 client.16116 trim_cache size 0 max 16384 2024-09-21T02:44:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.910+0000 7f2ae1477740 1 Processor -- start 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ae1477740 1 -- start start 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e2985843c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981b44d0 0x55e29858d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981d51b0 0x55e298585760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ae1477740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad40712d0 con 0x55e2981ac2f0 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ae1477740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4073aa0 con 0x55e2981b44d0 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ae1477740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4071890 con 0x55e2981d51b0 2024-09-21T02:44:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.911+0000 7f2ad3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981d51b0 0x55e298585760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.912+0000 7f2ad3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981d51b0 0x55e298585760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49488/0 (socket says 172.21.15.79:49488) 2024-09-21T02:44:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.912+0000 7f2ad3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e2985843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.912+0000 7f2ad3e00640 1 -- 172.21.15.79:0/1653816434 learned_addr learned my addr 172.21.15.79:0/1653816434 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.913+0000 7f2ad3e00640 1 -- 172.21.15.79:0/1653816434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981b44d0 msgr2=0x55e29858d870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:44:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.913+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/1653816434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981b44d0 0x55e29858d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.913+0000 7f2ad3e00640 1 -- 172.21.15.79:0/1653816434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 msgr2=0x55e2985843c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.913+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/1653816434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e2985843c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.913+0000 7f2ad3e00640 1 -- 172.21.15.79:0/1653816434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e298571d50 con 0x55e2981d51b0 2024-09-21T02:44:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.914+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/1653816434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981d51b0 0x55e298585760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0bbe20 tx=0x7f2acc0beab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=665f3d1053c887e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.914+0000 7f2abfe00640 1 -- 172.21.15.79:0/1653816434 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0bf2b0 con 0x55e2981d51b0 2024-09-21T02:44:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.914+0000 7f2abfe00640 1 -- 172.21.15.79:0/1653816434 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2acc0c3690 con 0x55e2981d51b0 2024-09-21T02:44:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.914+0000 7f2abfe00640 1 -- 172.21.15.79:0/1653816434 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0054b0 con 0x55e2981d51b0 2024-09-21T02:44:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.915+0000 7f2ae1477740 1 -- 172.21.15.79:0/1653816434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981d51b0 msgr2=0x55e298585760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.915+0000 7f2ae1477740 1 --2- 172.21.15.79:0/1653816434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981d51b0 0x55e298585760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0bbe20 tx=0x7f2acc0beab0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.916+0000 7f2ae1477740 1 -- 172.21.15.79:0/1653816434 shutdown_connections 2024-09-21T02:44:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.916+0000 7f2ae1477740 1 --2- 172.21.15.79:0/1653816434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981d51b0 0x55e298585760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.916+0000 7f2ae1477740 1 --2- 172.21.15.79:0/1653816434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981b44d0 0x55e29858d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.916+0000 7f2ae1477740 1 --2- 172.21.15.79:0/1653816434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e2985843c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.916+0000 7f2ae1477740 1 -- 172.21.15.79:0/1653816434 >> 172.21.15.79:0/1653816434 conn(0x55e2981c9300 msgr2=0x55e298583cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.916+0000 7f2ae1477740 1 -- 172.21.15.79:0/1653816434 shutdown_connections 2024-09-21T02:44:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.916+0000 7f2ae1477740 1 -- 172.21.15.79:0/1653816434 wait complete. 2024-09-21T02:44:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.917+0000 7f2ae1477740 1 -- start start 2024-09-21T02:44:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.917+0000 7f2ae1477740 1 Processor -- start 2024-09-21T02:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.919+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29858aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.919+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29858b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.919+0000 7f2ae1477740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29858bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.919+0000 7f2ae1477740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4071f60 con 0x55e2981ac2f0 2024-09-21T02:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.919+0000 7f2ae1477740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad40733d0 con 0x55e2981d51b0 2024-09-21T02:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.919+0000 7f2ae1477740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4072630 con 0x55e2981b44d0 2024-09-21T02:44:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.919+0000 7f2ae1477740 10 client.0 _ll_register_callbacks cb 0x7f2ac0009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.920+0000 7f2ad2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29858b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.920+0000 7f2ad2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29858b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49504/0 (socket says 172.21.15.79:49504) 2024-09-21T02:44:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.920+0000 7f2ad3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29858bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.921+0000 7f2ad3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29858bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33918/0 (socket says 172.21.15.79:33918) 2024-09-21T02:44:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.921+0000 7f2ad3e00640 1 -- 172.21.15.79:0/327174216 learned_addr learned my addr 172.21.15.79:0/327174216 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.921+0000 7f2ad3400640 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29858aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.922+0000 7f2ad3e00640 1 -- 172.21.15.79:0/327174216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 msgr2=0x55e29858b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.922+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29858b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.922+0000 7f2ad3e00640 1 -- 172.21.15.79:0/327174216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 msgr2=0x55e29858aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.922+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29858aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.922+0000 7f2ad3e00640 1 -- 172.21.15.79:0/327174216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e29858c390 con 0x55e2981d51b0 2024-09-21T02:44:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.922+0000 7f2ad3400640 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29858aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:44:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.924+0000 7f2ad3e00640 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29858bc30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0bb130 tx=0x7f2acc005400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49afea42d1bb10e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.924+0000 7f2abd600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:44:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.926+0000 7f2abd600640 1 -- 172.21.15.79:0/327174216 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0c3400 con 0x55e2981d51b0 2024-09-21T02:44:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.926+0000 7f2abd600640 1 -- 172.21.15.79:0/327174216 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2acc0e0bc0 con 0x55e2981d51b0 2024-09-21T02:44:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.926+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2acc0c3690 con 0x55e2981d51b0 2024-09-21T02:44:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.929+0000 7f2abd600640 1 -- 172.21.15.79:0/327174216 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2acc0bf2b0 con 0x55e2981d51b0 2024-09-21T02:44:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.929+0000 7f2ae1477740 10 client.26321 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.930+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e29858d720 con 0x55e2981d51b0 2024-09-21T02:44:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.930+0000 7f2abd600640 1 -- 172.21.15.79:0/327174216 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2acc0c3690 con 0x55e2981d51b0 2024-09-21T02:44:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.931+0000 7f2abd600640 1 -- 172.21.15.79:0/327174216 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2acc0ba6a0 con 0x55e2981d51b0 2024-09-21T02:44:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.931+0000 7f2ae1477740 10 client.26321 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.931+0000 7f2ae1477740 10 client.26321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.932+0000 7f2ae1477740 20 client.26321 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.932+0000 7f2ae1477740 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e2981691c0 0x55e2985ff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.932+0000 7f2ae1477740 4 client.26321 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.932+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e2984ed0b0 con 0x55e2981691c0 2024-09-21T02:44:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.932+0000 7f2ad3400640 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e2981691c0 0x55e2985ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.934+0000 7f2ad3400640 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e2981691c0 0x55e2985ff800 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1104d3ff63e15977 server_cookie=82772130ac6dbae3 in_seq=0 out_seq=0 2024-09-21T02:44:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:34.934+0000 7f2abd600640 10 client.26321 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:35.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:34 smithi098 ceph-mon[34832]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2024-09-21T02:44:35.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:34 smithi079 ceph-mon[30788]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2024-09-21T02:44:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.257+0000 7f2abd600640 1 -- 172.21.15.79:0/327174216 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e2984ed0b0 con 0x55e2981691c0 2024-09-21T02:44:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.257+0000 7f2abd600640 10 client.26321 handle_command_reply: tid=0 2024-09-21T02:44:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.257+0000 7f2ae1477740 1 client.26321 shutdown 2024-09-21T02:44:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.257+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 msgr2=0x55e29858bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.257+0000 7f2ae1477740 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29858bc30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0bb130 tx=0x7f2acc005400 comp rx=0 tx=0).stop 2024-09-21T02:44:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 shutdown_connections 2024-09-21T02:44:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55e2981691c0 0x55e2985ff800 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2981d51b0 0x55e29858bc30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e2981b44d0 0x55e29858b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 --2- 172.21.15.79:0/327174216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e2981ac2f0 0x55e29858aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 >> 172.21.15.79:0/327174216 conn(0x55e2981c9300 msgr2=0x55e298585760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2abd600640 0 client.26321 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 shutdown_connections 2024-09-21T02:44:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.258+0000 7f2ae1477740 1 -- 172.21.15.79:0/327174216 wait complete. 2024-09-21T02:44:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.259+0000 7f2ae1477740 20 client.26321 trim_cache size 0 max 16384 2024-09-21T02:44:35.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:44:35.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:44:35.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:44:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:44:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.260+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2ab80b6590 msgr2=0x7f2ab80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.260+0000 7f2ada400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2ab80b6590 0x7f2ab80b8aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4005f70 tx=0x7f2ac40314a0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.260+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ad41050f0 msgr2=0x7f2ad4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.260+0000 7f2ada400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ad41050f0 0x7f2ad4075c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009fd0 tx=0x7f2acc01ff20 comp rx=0 tx=0).stop 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 shutdown_connections 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2ab80b6590 0x7f2ab80b8aa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ad41050f0 0x7f2ad4075c50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4104750 0x7f2ad4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 --2- 172.21.15.79:0/1107475850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ad41036d0 0x7f2ad4076e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 >> 172.21.15.79:0/1107475850 conn(0x7f2ad40ff030 msgr2=0x7f2ad4107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 shutdown_connections 2024-09-21T02:44:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:35.261+0000 7f2ada400640 1 -- 172.21.15.79:0/1107475850 wait complete. 2024-09-21T02:44:35.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:34 smithi148 ceph-mon[34626]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2024-09-21T02:44:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 520.0 s, 607.4 tps, lat 164.186 ms stddev 252.731 2024-09-21T02:44:37.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:36 smithi098 ceph-mon[34832]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 MiB/s wr, 573 op/s 2024-09-21T02:44:37.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:36 smithi079 ceph-mon[30788]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 MiB/s wr, 573 op/s 2024-09-21T02:44:37.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:36 smithi148 ceph-mon[34626]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 MiB/s wr, 573 op/s 2024-09-21T02:44:39.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:38 smithi098 ceph-mon[34832]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 MiB/s wr, 532 op/s 2024-09-21T02:44:39.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:38 smithi079 ceph-mon[30788]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 MiB/s wr, 532 op/s 2024-09-21T02:44:39.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:38 smithi148 ceph-mon[34626]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 MiB/s wr, 532 op/s 2024-09-21T02:44:41.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:40 smithi098 ceph-mon[34832]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-21T02:44:41.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:40 smithi079 ceph-mon[30788]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-21T02:44:41.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:40 smithi148 ceph-mon[34626]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-21T02:44:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 525.0 s, 571.4 tps, lat 175.284 ms stddev 208.178 2024-09-21T02:44:43.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:42 smithi098 ceph-mon[34832]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-09-21T02:44:43.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:42 smithi079 ceph-mon[30788]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-09-21T02:44:43.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:42 smithi148 ceph-mon[34626]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-09-21T02:44:45.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:44 smithi098 ceph-mon[34832]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.5 MiB/s wr, 489 op/s 2024-09-21T02:44:45.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:44 smithi079 ceph-mon[30788]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.5 MiB/s wr, 489 op/s 2024-09-21T02:44:45.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:44 smithi148 ceph-mon[34626]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.5 MiB/s wr, 489 op/s 2024-09-21T02:44:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 530.0 s, 482.6 tps, lat 205.005 ms stddev 237.138 2024-09-21T02:44:47.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:46 smithi098 ceph-mon[34832]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.6 MiB/s wr, 507 op/s 2024-09-21T02:44:47.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:46 smithi079 ceph-mon[30788]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.6 MiB/s wr, 507 op/s 2024-09-21T02:44:47.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:46 smithi148 ceph-mon[34626]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.6 MiB/s wr, 507 op/s 2024-09-21T02:44:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.580+0000 7f5864600640 1 -- 172.21.15.79:0/881933035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c077090 msgr2=0x7f585c075750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.580+0000 7f5864600640 1 --2- 172.21.15.79:0/881933035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c077090 0x7f585c075750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5850009860 tx=0x7f585002a380 comp rx=0 tx=0).stop 2024-09-21T02:44:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.581+0000 7f5864600640 1 -- 172.21.15.79:0/881933035 shutdown_connections 2024-09-21T02:44:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.581+0000 7f5864600640 1 --2- 172.21.15.79:0/881933035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f585c10b6b0 0x7f585c10db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.581+0000 7f5864600640 1 --2- 172.21.15.79:0/881933035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c075c90 0x7f585c0760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.581+0000 7f5864600640 1 --2- 172.21.15.79:0/881933035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c077090 0x7f585c075750 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.581+0000 7f5864600640 1 -- 172.21.15.79:0/881933035 >> 172.21.15.79:0/881933035 conn(0x7f585c0fefe0 msgr2=0x7f585c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.581+0000 7f5864600640 1 -- 172.21.15.79:0/881933035 shutdown_connections 2024-09-21T02:44:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.581+0000 7f5864600640 1 -- 172.21.15.79:0/881933035 wait complete. 2024-09-21T02:44:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 Processor -- start 2024-09-21T02:44:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 -- start start 2024-09-21T02:44:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c075c90 0x7f585c1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f585c077090 0x7f585c1a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c10b6b0 0x7f585c1a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f585c111580 con 0x7f585c077090 2024-09-21T02:44:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f585c111400 con 0x7f585c10b6b0 2024-09-21T02:44:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.583+0000 7f5864600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f585c111700 con 0x7f585c075c90 2024-09-21T02:44:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c075c90 0x7f585c1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c075c90 0x7f585c1a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38774/0 (socket says 172.21.15.79:38774) 2024-09-21T02:44:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 -- 172.21.15.79:0/4242662670 learned_addr learned my addr 172.21.15.79:0/4242662670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5862600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c10b6b0 0x7f585c1a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 -- 172.21.15.79:0/4242662670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c10b6b0 msgr2=0x7f585c1a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c10b6b0 0x7f585c1a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 -- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f585c077090 msgr2=0x7f585c1a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f585c077090 0x7f585c1a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 -- 172.21.15.79:0/4242662670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c1a2040 con 0x7f585c075c90 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.584+0000 7f5861c00640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c075c90 0x7f585c1a0600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5850009780 tx=0x7f58500042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.585+0000 7f585a000640 1 -- 172.21.15.79:0/4242662670 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585003f020 con 0x7f585c075c90 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.585+0000 7f585a000640 1 -- 172.21.15.79:0/4242662670 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5850033e20 con 0x7f585c075c90 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.585+0000 7f585a000640 1 -- 172.21.15.79:0/4242662670 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850037040 con 0x7f585c075c90 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.585+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c1a22d0 con 0x7f585c075c90 2024-09-21T02:44:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.585+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c1a88c0 con 0x7f585c075c90 2024-09-21T02:44:48.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.589+0000 7f585a000640 1 -- 172.21.15.79:0/4242662670 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5850042020 con 0x7f585c075c90 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.592+0000 7f586b827740 1 Processor -- start 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.592+0000 7f586b827740 1 -- start start 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f586b827740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 0x5557411f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f586b827740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f586b827740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f586b827740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5557411556b0 con 0x555740e3b1b0 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f586b827740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555741144ae0 con 0x555740e122f0 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f586b827740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5557411488f0 con 0x555740e1a4d0 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46004/0 (socket says 172.21.15.79:46004) 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 -- 172.21.15.79:0/2282133325 learned_addr learned my addr 172.21.15.79:0/2282133325 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861200640 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 -- 172.21.15.79:0/2282133325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 msgr2=0x5557411f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 -- 172.21.15.79:0/2282133325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 msgr2=0x5557411f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 0x5557411f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.593+0000 7f5861c00640 1 -- 172.21.15.79:0/2282133325 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555741111780 con 0x555740e122f0 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.594+0000 7f5861c00640 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f3750 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f585003c040 tx=0x7f58500306b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80c84a03b811de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.594+0000 7f584ea00640 1 -- 172.21.15.79:0/2282133325 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850108c90 con 0x555740e122f0 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.594+0000 7f584ea00640 1 -- 172.21.15.79:0/2282133325 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5850108e30 con 0x555740e122f0 2024-09-21T02:44:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.595+0000 7f585a000640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58440b6590 0x7f58440b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.595+0000 7f586b827740 1 -- 172.21.15.79:0/2282133325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 msgr2=0x5557411f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.595+0000 7f586b827740 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f3750 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f585003c040 tx=0x7f58500306b0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.596+0000 7f586b827740 1 -- 172.21.15.79:0/2282133325 shutdown_connections 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.596+0000 7f586b827740 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.596+0000 7f586b827740 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f3750 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.596+0000 7f586b827740 1 --2- 172.21.15.79:0/2282133325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 0x5557411f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.596+0000 7f586b827740 1 -- 172.21.15.79:0/2282133325 >> 172.21.15.79:0/2282133325 conn(0x555740e2f300 msgr2=0x5557411ddb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.596+0000 7f5862600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58440b6590 0x7f58440b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.597+0000 7f586b827740 1 -- 172.21.15.79:0/2282133325 shutdown_connections 2024-09-21T02:44:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.597+0000 7f586b827740 1 -- 172.21.15.79:0/2282133325 wait complete. 2024-09-21T02:44:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.597+0000 7f586b827740 1 -- start start 2024-09-21T02:44:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.598+0000 7f586b827740 1 Processor -- start 2024-09-21T02:44:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.598+0000 7f585a000640 1 -- 172.21.15.79:0/4242662670 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f58501087b0 con 0x7f585c075c90 2024-09-21T02:44:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.598+0000 7f586b827740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f586b827740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e1a4d0 0x5557411e9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f586b827740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411ea180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f586b827740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55574107cab0 con 0x555740e122f0 2024-09-21T02:44:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f586b827740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5557410eb570 con 0x555740e1a4d0 2024-09-21T02:44:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f586b827740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5557411f4b80 con 0x555740e3b1b0 2024-09-21T02:44:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f586b827740 10 client.0 _ll_register_callbacks cb 0x5557410fa100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5862600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58440b6590 0x7f58440b8aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5854004b90 tx=0x7f585400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e1a4d0 0x5557411e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e1a4d0 0x5557411e9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46020/0 (socket says 172.21.15.79:46020) 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 -- 172.21.15.79:0/2232116465 learned_addr learned my addr 172.21.15.79:0/2232116465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861c00640 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 -- 172.21.15.79:0/2232116465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 msgr2=0x5557411ea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 -- 172.21.15.79:0/2232116465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e122f0 msgr2=0x5557411e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861200640 1 -- 172.21.15.79:0/2232116465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555740ea6790 con 0x555740e1a4d0 2024-09-21T02:44:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.599+0000 7f5861c00640 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.600+0000 7f5861200640 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e1a4d0 0x5557411e9630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58480116c0 tx=0x7f5848009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f503e572d18df9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.600+0000 7f5843400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.600+0000 7f5843400640 1 -- 172.21.15.79:0/2232116465 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848004460 con 0x555740e1a4d0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.600+0000 7f5843400640 1 -- 172.21.15.79:0/2232116465 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f584800f920 con 0x555740e1a4d0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.600+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5850108e30 con 0x555740e1a4d0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.601+0000 7f5843400640 1 -- 172.21.15.79:0/2232116465 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f584800fb20 con 0x555740e1a4d0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.601+0000 7f586b827740 10 client.26333 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.601+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555740f1f620 con 0x555740e1a4d0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.601+0000 7f5843400640 1 -- 172.21.15.79:0/2232116465 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5850108e30 con 0x555740e1a4d0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.601+0000 7f5843400640 1 -- 172.21.15.79:0/2232116465 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5848018070 con 0x555740e1a4d0 2024-09-21T02:44:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.602+0000 7f586b827740 10 client.26333 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.602+0000 7f586b827740 10 client.26333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.602+0000 7f586b827740 20 client.26333 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.602+0000 7f586b827740 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740df9d80 0x5557411f2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.602+0000 7f586b827740 4 client.26333 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.602+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555741157600 con 0x555740df9d80 2024-09-21T02:44:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.602+0000 7f5861c00640 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740df9d80 0x5557411f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.603+0000 7f5843400640 10 client.26333 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.603+0000 7f5861c00640 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740df9d80 0x5557411f2600 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66fdc5e9a1a5712 server_cookie=800aa476753e3afd in_seq=0 out_seq=0 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.604+0000 7f5843400640 1 -- 172.21.15.79:0/2232116465 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555741157600 con 0x555740df9d80 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.604+0000 7f5843400640 10 client.26333 handle_command_reply: tid=0 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.604+0000 7f586b827740 1 client.26333 shutdown 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.604+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e1a4d0 msgr2=0x5557411e9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.604+0000 7f586b827740 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e1a4d0 0x5557411e9630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58480116c0 tx=0x7f5848009f90 comp rx=0 tx=0).stop 2024-09-21T02:44:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 shutdown_connections 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740df9d80 0x5557411f2600 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f5843400640 0 client.26333 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e1a4d0 0x5557411e9630 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 --2- 172.21.15.79:0/2232116465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 >> 172.21.15.79:0/2232116465 conn(0x555740e2f300 msgr2=0x5557411dc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 shutdown_connections 2024-09-21T02:44:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.605+0000 7f586b827740 1 -- 172.21.15.79:0/2232116465 wait complete. 2024-09-21T02:44:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.606+0000 7f586b827740 20 client.26333 trim_cache size 0 max 16384 2024-09-21T02:44:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.632+0000 7f586b827740 1 Processor -- start 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.635+0000 7f586b827740 1 -- start start 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.635+0000 7f586b827740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.635+0000 7f586b827740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.635+0000 7f586b827740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 0x5557411e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.635+0000 7f586b827740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f585c075100 con 0x555740e3b1b0 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.635+0000 7f586b827740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1aae90 con 0x555740e122f0 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.635+0000 7f586b827740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1a8c80 con 0x555740e1a4d0 2024-09-21T02:44:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.636+0000 7f5861200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.636+0000 7f5861200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411e94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38800/0 (socket says 172.21.15.79:38800) 2024-09-21T02:44:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.636+0000 7f5861200640 1 -- 172.21.15.79:0/1674666370 learned_addr learned my addr 172.21.15.79:0/1674666370 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.636+0000 7f5862600640 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 0x5557411e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.636+0000 7f5861c00640 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.637+0000 7f5861200640 1 -- 172.21.15.79:0/1674666370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 msgr2=0x5557411e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.637+0000 7f5861200640 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.637+0000 7f5861200640 1 -- 172.21.15.79:0/1674666370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 msgr2=0x5557411e3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.637+0000 7f5861200640 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 0x5557411e3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.637+0000 7f5861200640 1 -- 172.21.15.79:0/1674666370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557411f2970 con 0x555740e1a4d0 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.637+0000 7f5861200640 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411e94d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58480246a0 tx=0x7f584800fa50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80ecdc4af9341cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.637+0000 7f584e000640 1 -- 172.21.15.79:0/1674666370 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848024910 con 0x555740e1a4d0 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.638+0000 7f584e000640 1 -- 172.21.15.79:0/1674666370 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5848024ab0 con 0x555740e1a4d0 2024-09-21T02:44:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.638+0000 7f584e000640 1 -- 172.21.15.79:0/1674666370 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584801a440 con 0x555740e1a4d0 2024-09-21T02:44:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.639+0000 7f586b827740 1 -- 172.21.15.79:0/1674666370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 msgr2=0x5557411e94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.639+0000 7f586b827740 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411e94d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58480246a0 tx=0x7f584800fa50 comp rx=0 tx=0).stop 2024-09-21T02:44:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.640+0000 7f586b827740 1 -- 172.21.15.79:0/1674666370 shutdown_connections 2024-09-21T02:44:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.640+0000 7f586b827740 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e3b1b0 0x5557411e3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.640+0000 7f586b827740 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e1a4d0 0x5557411e94d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.640+0000 7f586b827740 1 --2- 172.21.15.79:0/1674666370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.640+0000 7f586b827740 1 -- 172.21.15.79:0/1674666370 >> 172.21.15.79:0/1674666370 conn(0x555740e2f300 msgr2=0x5557411f3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.641+0000 7f586b827740 1 -- 172.21.15.79:0/1674666370 shutdown_connections 2024-09-21T02:44:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.642+0000 7f586b827740 1 -- 172.21.15.79:0/1674666370 wait complete. 2024-09-21T02:44:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.642+0000 7f586b827740 1 -- start start 2024-09-21T02:44:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.643+0000 7f586b827740 1 Processor -- start 2024-09-21T02:44:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.644+0000 7f586b827740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.644+0000 7f586b827740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e1a4d0 0x5557411ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.644+0000 7f586b827740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411efe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.644+0000 7f586b827740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1a9350 con 0x555740e1a4d0 2024-09-21T02:44:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.644+0000 7f586b827740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1aa7c0 con 0x555740e122f0 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.644+0000 7f586b827740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1a9a20 con 0x555740e3b1b0 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.644+0000 7f586b827740 10 client.0 _ll_register_callbacks cb 0x7f5848009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411efe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38806/0 (socket says 172.21.15.79:38806) 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 -- 172.21.15.79:0/3149136916 learned_addr learned my addr 172.21.15.79:0/3149136916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5861c00640 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 -- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 msgr2=0x5557411f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 -- 172.21.15.79:0/3149136916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e1a4d0 msgr2=0x5557411ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e1a4d0 0x5557411ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.645+0000 7f5862600640 1 -- 172.21.15.79:0/3149136916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557411f0420 con 0x555740e3b1b0 2024-09-21T02:44:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.646+0000 7f5862600640 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411efe10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5854016f40 tx=0x7f5854004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d570579e2f52dabe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.646+0000 7f5843400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:44:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.647+0000 7f5843400640 1 -- 172.21.15.79:0/3149136916 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854027060 con 0x555740e3b1b0 2024-09-21T02:44:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.647+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5848024ab0 con 0x555740e3b1b0 2024-09-21T02:44:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.648+0000 7f5843400640 1 -- 172.21.15.79:0/3149136916 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f58540225f0 con 0x555740e3b1b0 2024-09-21T02:44:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.649+0000 7f5843400640 1 -- 172.21.15.79:0/3149136916 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f585402e050 con 0x555740e3b1b0 2024-09-21T02:44:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.649+0000 7f586b827740 10 client.26365 fetch_fsmap learned FSMap version 21 2024-09-21T02:44:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.649+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555741263760 con 0x555740e3b1b0 2024-09-21T02:44:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.649+0000 7f5843400640 1 -- 172.21.15.79:0/3149136916 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5848024ab0 con 0x555740e3b1b0 2024-09-21T02:44:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.651+0000 7f5843400640 1 -- 172.21.15.79:0/3149136916 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f58540227f0 con 0x555740e3b1b0 2024-09-21T02:44:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.651+0000 7f586b827740 10 client.26365 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:44:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.652+0000 7f586b827740 10 client.26365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.652+0000 7f586b827740 20 client.26365 populate_metadata read hostname 'smithi079' 2024-09-21T02:44:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.652+0000 7f586b827740 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740dcf1c0 0x555741266040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.652+0000 7f586b827740 4 client.26365 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.652+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5557411530b0 con 0x555740dcf1c0 2024-09-21T02:44:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.652+0000 7f5861c00640 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740dcf1c0 0x555741266040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.661+0000 7f5843400640 10 client.26365 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:48.661+0000 7f5861c00640 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740dcf1c0 0x555741266040 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49a7c26a22fbc2ca server_cookie=b32144724da72588 in_seq=0 out_seq=0 2024-09-21T02:44:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.039+0000 7f5843400640 1 -- 172.21.15.79:0/3149136916 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5557411530b0 con 0x555740dcf1c0 2024-09-21T02:44:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.039+0000 7f5843400640 10 client.26365 handle_command_reply: tid=0 2024-09-21T02:44:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.039+0000 7f586b827740 1 client.26365 shutdown 2024-09-21T02:44:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 msgr2=0x5557411efe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411efe10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5854016f40 tx=0x7f5854004a40 comp rx=0 tx=0).stop 2024-09-21T02:44:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 shutdown_connections 2024-09-21T02:44:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555740dcf1c0 0x555741266040 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555740e3b1b0 0x5557411efe10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555740e1a4d0 0x5557411ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 --2- 172.21.15.79:0/3149136916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555740e122f0 0x5557411f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.040+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 >> 172.21.15.79:0/3149136916 conn(0x555740e2f300 msgr2=0x5557411e3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.041+0000 7f5843400640 0 client.26365 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:44:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.041+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 shutdown_connections 2024-09-21T02:44:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.041+0000 7f586b827740 1 -- 172.21.15.79:0/3149136916 wait complete. 2024-09-21T02:44:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.042+0000 7f586b827740 20 client.26365 trim_cache size 0 max 16384 2024-09-21T02:44:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:44:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:44:49.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:44:49.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:44:49.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.043+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58440b6590 msgr2=0x7f58440b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:49.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.043+0000 7f5864600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58440b6590 0x7f58440b8aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5854004b90 tx=0x7f585400d040 comp rx=0 tx=0).stop 2024-09-21T02:44:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.043+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c075c90 msgr2=0x7f585c1a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.043+0000 7f5864600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c075c90 0x7f585c1a0600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5850009780 tx=0x7f58500042f0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 shutdown_connections 2024-09-21T02:44:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f58440b6590 0x7f58440b8aa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c10b6b0 0x7f585c1a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f585c077090 0x7f585c1a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 --2- 172.21.15.79:0/4242662670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f585c075c90 0x7f585c1a0600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 >> 172.21.15.79:0/4242662670 conn(0x7f585c0fefe0 msgr2=0x7f585c103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 shutdown_connections 2024-09-21T02:44:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:44:49.044+0000 7f5864600640 1 -- 172.21.15.79:0/4242662670 wait complete. 2024-09-21T02:44:49.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:48 smithi079 ceph-mon[30788]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2024-09-21T02:44:49.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:48 smithi148 ceph-mon[34626]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2024-09-21T02:44:49.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:48 smithi098 ceph-mon[34832]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2024-09-21T02:44:51.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:50 smithi079 ceph-mon[30788]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.3 MiB/s wr, 470 op/s 2024-09-21T02:44:51.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:50 smithi148 ceph-mon[34626]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.3 MiB/s wr, 470 op/s 2024-09-21T02:44:51.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:50 smithi098 ceph-mon[34832]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.3 MiB/s wr, 470 op/s 2024-09-21T02:44:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 535.0 s, 506.0 tps, lat 198.582 ms stddev 265.454 2024-09-21T02:44:53.245 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:52 smithi079 ceph-mon[30788]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 567 op/s 2024-09-21T02:44:53.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:52 smithi148 ceph-mon[34626]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 567 op/s 2024-09-21T02:44:53.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:52 smithi098 ceph-mon[34832]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 567 op/s 2024-09-21T02:44:55.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:54 smithi079 ceph-mon[30788]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:44:55.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:54 smithi148 ceph-mon[34626]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:44:55.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:54 smithi098 ceph-mon[34832]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:44:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 540.0 s, 644.2 tps, lat 157.665 ms stddev 166.079 2024-09-21T02:44:57.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:56 smithi079 ceph-mon[30788]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 495 op/s 2024-09-21T02:44:57.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:56 smithi148 ceph-mon[34626]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 495 op/s 2024-09-21T02:44:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:56 smithi098 ceph-mon[34832]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 495 op/s 2024-09-21T02:44:59.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:44:58 smithi148 ceph-mon[34626]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-21T02:44:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:44:58 smithi098 ceph-mon[34832]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-21T02:44:59.487 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:44:58 smithi079 ceph-mon[30788]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-21T02:45:01.018 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:00 smithi079 ceph-mon[30788]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 525 op/s 2024-09-21T02:45:01.018 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:00 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:45:01.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:00 smithi148 ceph-mon[34626]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 525 op/s 2024-09-21T02:45:01.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:00 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:45:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:00 smithi098 ceph-mon[34832]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 525 op/s 2024-09-21T02:45:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:01 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:45:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 545.0 s, 505.2 tps, lat 167.816 ms stddev 182.215 2024-09-21T02:45:03.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:02 smithi098 ceph-mon[34832]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.2 MiB/s wr, 671 op/s 2024-09-21T02:45:03.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:03.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:02 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:03.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:02 smithi079 ceph-mon[30788]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.2 MiB/s wr, 671 op/s 2024-09-21T02:45:03.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:03.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:02 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:03.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:02 smithi148 ceph-mon[34626]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.2 MiB/s wr, 671 op/s 2024-09-21T02:45:03.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:03.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:02 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.036+0000 7f3f0be00640 1 -- 172.21.15.79:0/3827294246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 msgr2=0x7f3f0c1085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.036+0000 7f3f0be00640 1 --2- 172.21.15.79:0/3827294246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 0x7f3f0c1085e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009860 tx=0x7f3ef802a340 comp rx=0 tx=0).stop 2024-09-21T02:45:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.036+0000 7f3f0be00640 1 -- 172.21.15.79:0/3827294246 shutdown_connections 2024-09-21T02:45:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.036+0000 7f3f0be00640 1 --2- 172.21.15.79:0/3827294246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0c10b480 0x7f3f0c10d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.036+0000 7f3f0be00640 1 --2- 172.21.15.79:0/3827294246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f0c108b20 0x7f3f0c10af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.036+0000 7f3f0be00640 1 --2- 172.21.15.79:0/3827294246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 0x7f3f0c1085e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.036+0000 7f3f0be00640 1 -- 172.21.15.79:0/3827294246 >> 172.21.15.79:0/3827294246 conn(0x7f3f0c0fdd80 msgr2=0x7f3f0c100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.038+0000 7f3f0be00640 1 -- 172.21.15.79:0/3827294246 shutdown_connections 2024-09-21T02:45:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.038+0000 7f3f0be00640 1 -- 172.21.15.79:0/3827294246 wait complete. 2024-09-21T02:45:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.039+0000 7f3f0be00640 1 Processor -- start 2024-09-21T02:45:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.040+0000 7f3f0be00640 1 -- start start 2024-09-21T02:45:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.042+0000 7f3f0be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 0x7f3f0c072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.042+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 0x7f3f0c072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.043+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 0x7f3f0c072340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34938/0 (socket says 172.21.15.79:34938) 2024-09-21T02:45:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.043+0000 7f3f0be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f0c108b20 0x7f3f0c0729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.043+0000 7f3f0aa00640 1 -- 172.21.15.79:0/1325450088 learned_addr learned my addr 172.21.15.79:0/1325450088 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.043+0000 7f3f0be00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0c10b480 0x7f3f0c073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.043+0000 7f3f0a000640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f0c108b20 0x7f3f0c0729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.043+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c111370 con 0x7f3f0c10b480 2024-09-21T02:45:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.044+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1111f0 con 0x7f3f0c108b20 2024-09-21T02:45:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.044+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1114f0 con 0x7f3f0c06b4e0 2024-09-21T02:45:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.044+0000 7f3f0b400640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0c10b480 0x7f3f0c073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.045+0000 7f3f0a000640 1 -- 172.21.15.79:0/1325450088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 msgr2=0x7f3f0c072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.045+0000 7f3f0a000640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 0x7f3f0c072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.045+0000 7f3f0a000640 1 -- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0c10b480 msgr2=0x7f3f0c073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.045+0000 7f3f0a000640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0c10b480 0x7f3f0c073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.045+0000 7f3f0a000640 1 -- 172.21.15.79:0/1325450088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c073d80 con 0x7f3f0c108b20 2024-09-21T02:45:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.045+0000 7f3f0b400640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0c10b480 0x7f3f0c073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.046+0000 7f3f0a000640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f0c108b20 0x7f3f0c0729b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e790 tx=0x7f3efc00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:04.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.047+0000 7f3f03400640 1 -- 172.21.15.79:0/1325450088 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00eea0 con 0x7f3f0c108b20 2024-09-21T02:45:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.047+0000 7f3f03400640 1 -- 172.21.15.79:0/1325450088 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3efc00ccc0 con 0x7f3f0c108b20 2024-09-21T02:45:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.047+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c074070 con 0x7f3f0c108b20 2024-09-21T02:45:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.047+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c074730 con 0x7f3f0c108b20 2024-09-21T02:45:04.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.049+0000 7f3f03400640 1 -- 172.21.15.79:0/1325450088 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc018660 con 0x7f3f0c108b20 2024-09-21T02:45:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.054+0000 7f3f03400640 1 -- 172.21.15.79:0/1325450088 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3efc018800 con 0x7f3f0c108b20 2024-09-21T02:45:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.057+0000 7f3f03400640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3ef00b6510 0x7f3ef00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.061+0000 7f3f03400640 1 -- 172.21.15.79:0/1325450088 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3efc0e8960 con 0x7f3f0c108b20 2024-09-21T02:45:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.061+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3ef00b6510 0x7f3ef00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.091+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3ef00b6510 0x7f3ef00b8a20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80304b0 tx=0x7f3ef8005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.091+0000 7f3f1866e740 1 Processor -- start 2024-09-21T02:45:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.092+0000 7f3f1866e740 1 -- start start 2024-09-21T02:45:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.093+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.093+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c1952f0 0x562a6c565920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.093+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c19d4d0 0x562a6c566470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.093+0000 7f3f1866e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a6c4d86b0 con 0x562a6c1be1b0 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.093+0000 7f3f1866e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a6c4c7ae0 con 0x562a6c19d4d0 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.093+0000 7f3f1866e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562a6c4cb8f0 con 0x562a6c1952f0 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.093+0000 7f3f0a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c1952f0 0x562a6c565920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.094+0000 7f3f0a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c1952f0 0x562a6c565920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34954/0 (socket says 172.21.15.79:34954) 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.094+0000 7f3f0a000640 1 -- 172.21.15.79:0/3698594131 learned_addr learned my addr 172.21.15.79:0/3698594131 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.094+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.094+0000 7f3f0b400640 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c19d4d0 0x562a6c566470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.095+0000 7f3f0a000640 1 -- 172.21.15.79:0/3698594131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c19d4d0 msgr2=0x562a6c566470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.095+0000 7f3f0a000640 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c19d4d0 0x562a6c566470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.095+0000 7f3f0a000640 1 -- 172.21.15.79:0/3698594131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 msgr2=0x562a6c5652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.095+0000 7f3f0a000640 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.095+0000 7f3f0a000640 1 -- 172.21.15.79:0/3698594131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6c494780 con 0x562a6c1952f0 2024-09-21T02:45:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.095+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.096+0000 7f3f0b400640 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c19d4d0 0x562a6c566470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:45:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.096+0000 7f3f0a000640 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c1952f0 0x562a6c565920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ae6d0 tx=0x7f3efc0ae190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a091d2f9094175d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.097+0000 7f3ef7400640 1 -- 172.21.15.79:0/3698594131 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0b3020 con 0x562a6c1952f0 2024-09-21T02:45:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.097+0000 7f3ef7400640 1 -- 172.21.15.79:0/3698594131 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3efc0b3220 con 0x562a6c1952f0 2024-09-21T02:45:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.097+0000 7f3ef7400640 1 -- 172.21.15.79:0/3698594131 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0ad670 con 0x562a6c1952f0 2024-09-21T02:45:04.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.100+0000 7f3f1866e740 1 -- 172.21.15.79:0/3698594131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c1952f0 msgr2=0x562a6c565920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.100+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c1952f0 0x562a6c565920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ae6d0 tx=0x7f3efc0ae190 comp rx=0 tx=0).stop 2024-09-21T02:45:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.100+0000 7f3f1866e740 1 -- 172.21.15.79:0/3698594131 shutdown_connections 2024-09-21T02:45:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.100+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c19d4d0 0x562a6c566470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.100+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c1952f0 0x562a6c565920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.100+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3698594131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.101+0000 7f3f1866e740 1 -- 172.21.15.79:0/3698594131 >> 172.21.15.79:0/3698594131 conn(0x562a6c1b2300 msgr2=0x562a6c560d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.101+0000 7f3f1866e740 1 -- 172.21.15.79:0/3698594131 shutdown_connections 2024-09-21T02:45:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.101+0000 7f3f1866e740 1 -- 172.21.15.79:0/3698594131 wait complete. 2024-09-21T02:45:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.105+0000 7f3f1866e740 1 -- start start 2024-09-21T02:45:04.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.106+0000 7f3f1866e740 1 Processor -- start 2024-09-21T02:45:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.107+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5771c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.107+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c577880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.107+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.107+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54816/0 (socket says 172.21.15.79:54816) 2024-09-21T02:45:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f0a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c577880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f0a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c577880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34962/0 (socket says 172.21.15.79:34962) 2024-09-21T02:45:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f1866e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a6c3ffab0 con 0x562a6c1be1b0 2024-09-21T02:45:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f1866e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a6c46e570 con 0x562a6c1952f0 2024-09-21T02:45:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f1866e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562a6c566f90 con 0x562a6c19d4d0 2024-09-21T02:45:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f1866e740 10 client.0 _ll_register_callbacks cb 0x562a6c47d100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f0b400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.108+0000 7f3f0aa00640 1 -- 172.21.15.79:0/3150059393 learned_addr learned my addr 172.21.15.79:0/3150059393 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.109+0000 7f3f0aa00640 1 -- 172.21.15.79:0/3150059393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 msgr2=0x562a6c577880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.109+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c577880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.109+0000 7f3f0aa00640 1 -- 172.21.15.79:0/3150059393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 msgr2=0x562a6c5783f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.109+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5783f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.109+0000 7f3f0aa00640 1 -- 172.21.15.79:0/3150059393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6c229790 con 0x562a6c1952f0 2024-09-21T02:45:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.109+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5771c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8035040 tx=0x7f3ef8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3446c491534114c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.109+0000 7f3eebe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:45:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.110+0000 7f3eebe00640 1 -- 172.21.15.79:0/3150059393 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef804e070 con 0x562a6c1952f0 2024-09-21T02:45:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.110+0000 7f3eebe00640 1 -- 172.21.15.79:0/3150059393 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3ef8005240 con 0x562a6c1952f0 2024-09-21T02:45:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.110+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3efc0b3220 con 0x562a6c1952f0 2024-09-21T02:45:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.111+0000 7f3eebe00640 1 -- 172.21.15.79:0/3150059393 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3ef8037040 con 0x562a6c1952f0 2024-09-21T02:45:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.111+0000 7f3f1866e740 10 client.26348 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.111+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562a6c2a2620 con 0x562a6c1952f0 2024-09-21T02:45:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.112+0000 7f3eebe00640 1 -- 172.21.15.79:0/3150059393 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3efc0b3220 con 0x562a6c1952f0 2024-09-21T02:45:04.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.112+0000 7f3eebe00640 1 -- 172.21.15.79:0/3150059393 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3ef8003950 con 0x562a6c1952f0 2024-09-21T02:45:04.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.112+0000 7f3f1866e740 10 client.26348 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:04.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.112+0000 7f3f1866e740 10 client.26348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:04.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.113+0000 7f3f1866e740 20 client.26348 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:04.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.113+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c17cd80 0x562a6c584910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.113+0000 7f3f1866e740 4 client.26348 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:04.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.113+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a6c4da600 con 0x562a6c17cd80 2024-09-21T02:45:04.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.113+0000 7f3f0a000640 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c17cd80 0x562a6c584910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.114+0000 7f3f0a000640 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c17cd80 0x562a6c584910 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b67a09633222f3d server_cookie=d9422539a62ee01c in_seq=0 out_seq=0 2024-09-21T02:45:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.114+0000 7f3eebe00640 10 client.26348 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:04.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.115+0000 7f3eebe00640 1 -- 172.21.15.79:0/3150059393 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a6c4da600 con 0x562a6c17cd80 2024-09-21T02:45:04.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3eebe00640 10 client.26348 handle_command_reply: tid=0 2024-09-21T02:45:04.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 client.26348 shutdown 2024-09-21T02:45:04.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 msgr2=0x562a6c5771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5771c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8035040 tx=0x7f3ef8005f90 comp rx=0 tx=0).stop 2024-09-21T02:45:04.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 shutdown_connections 2024-09-21T02:45:04.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c17cd80 0x562a6c584910 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c5783f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c577880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 --2- 172.21.15.79:0/3150059393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5771c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 >> 172.21.15.79:0/3150059393 conn(0x562a6c1b2300 msgr2=0x562a6c55f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:04.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.116+0000 7f3eebe00640 0 client.26348 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:04.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.119+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 shutdown_connections 2024-09-21T02:45:04.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.119+0000 7f3f1866e740 1 -- 172.21.15.79:0/3150059393 wait complete. 2024-09-21T02:45:04.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.119+0000 7f3f1866e740 20 client.26348 trim_cache size 0 max 16384 2024-09-21T02:45:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 Processor -- start 2024-09-21T02:45:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 -- start start 2024-09-21T02:45:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5693a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c5698e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c569e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec00dc30 con 0x562a6c1be1b0 2024-09-21T02:45:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec0104b0 con 0x562a6c1952f0 2024-09-21T02:45:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.157+0000 7f3f1866e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec00e2a0 con 0x562a6c19d4d0 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c5698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54828/0 (socket says 172.21.15.79:54828) 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2774588688 learned_addr learned my addr 172.21.15.79:0/2774588688 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0b400640 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c569e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c5698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34974/0 (socket says 172.21.15.79:34974) 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2774588688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 msgr2=0x562a6c5698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c5698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2774588688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 msgr2=0x562a6c569e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c569e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.158+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2774588688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6c56cb40 con 0x562a6c1952f0 2024-09-21T02:45:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.160+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5693a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8003fd0 tx=0x7f3ef8030c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c550ee9b74caea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.162+0000 7f3ef6a00640 1 -- 172.21.15.79:0/2774588688 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef804e040 con 0x562a6c1952f0 2024-09-21T02:45:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.162+0000 7f3ef6a00640 1 -- 172.21.15.79:0/2774588688 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef8005870 con 0x562a6c1952f0 2024-09-21T02:45:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.162+0000 7f3ef6a00640 1 -- 172.21.15.79:0/2774588688 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8032c20 con 0x562a6c1952f0 2024-09-21T02:45:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.164+0000 7f3f1866e740 1 -- 172.21.15.79:0/2774588688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 msgr2=0x562a6c5693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.164+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5693a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8003fd0 tx=0x7f3ef8030c20 comp rx=0 tx=0).stop 2024-09-21T02:45:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.164+0000 7f3f1866e740 1 -- 172.21.15.79:0/2774588688 shutdown_connections 2024-09-21T02:45:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.164+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c569e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.164+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c5698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.164+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2774588688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1952f0 0x562a6c5693a0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8003fd0 tx=0x7f3ef8030c20 comp rx=0 tx=0).stop 2024-09-21T02:45:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.164+0000 7f3f1866e740 1 -- 172.21.15.79:0/2774588688 >> 172.21.15.79:0/2774588688 conn(0x562a6c1b2300 msgr2=0x562a6c5763e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.171+0000 7f3f1866e740 1 -- 172.21.15.79:0/2774588688 shutdown_connections 2024-09-21T02:45:04.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.171+0000 7f3f1866e740 1 -- 172.21.15.79:0/2774588688 wait complete. 2024-09-21T02:45:04.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.172+0000 7f3f1866e740 1 -- start start 2024-09-21T02:45:04.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.172+0000 7f3f1866e740 1 Processor -- start 2024-09-21T02:45:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.172+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c57ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c57f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f1866e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1521c0 0x562a6c57d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f1866e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec00e970 con 0x562a6c1be1b0 2024-09-21T02:45:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f1866e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec00fde0 con 0x562a6c1521c0 2024-09-21T02:45:04.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f1866e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec00f040 con 0x562a6c19d4d0 2024-09-21T02:45:04.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f1866e740 10 client.0 _ll_register_callbacks cb 0x7f3efc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c57ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f0aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c57ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34978/0 (socket says 172.21.15.79:34978) 2024-09-21T02:45:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2566845631 learned_addr learned my addr 172.21.15.79:0/2566845631 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.173+0000 7f3f0b400640 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1521c0 0x562a6c57d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3f0a000640 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c57f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1521c0 msgr2=0x562a6c57d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1521c0 0x562a6c57d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2566845631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 msgr2=0x562a6c57f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c57f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3f0aa00640 1 -- 172.21.15.79:0/2566845631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6c57db30 con 0x562a6c19d4d0 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3f0aa00640 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c57ea30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000c00 tx=0x7f3ef8003e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae9e93971f5faef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.174+0000 7f3eebe00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.175+0000 7f3eebe00640 1 -- 172.21.15.79:0/2566845631 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef806c060 con 0x562a6c19d4d0 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.175+0000 7f3eebe00640 1 -- 172.21.15.79:0/2566845631 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3ef8003800 con 0x562a6c19d4d0 2024-09-21T02:45:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.177+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef8005870 con 0x562a6c19d4d0 2024-09-21T02:45:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.187+0000 7f3eebe00640 1 -- 172.21.15.79:0/2566845631 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3ef804e040 con 0x562a6c19d4d0 2024-09-21T02:45:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.188+0000 7f3f1866e740 10 client.26383 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.188+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562a6c56d4a0 con 0x562a6c19d4d0 2024-09-21T02:45:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.188+0000 7f3eebe00640 1 -- 172.21.15.79:0/2566845631 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef8005870 con 0x562a6c19d4d0 2024-09-21T02:45:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.189+0000 7f3eebe00640 1 -- 172.21.15.79:0/2566845631 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3ef805ece0 con 0x562a6c19d4d0 2024-09-21T02:45:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.189+0000 7f3f1866e740 10 client.26383 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.189+0000 7f3f1866e740 10 client.26383 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.189+0000 7f3f1866e740 20 client.26383 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.189+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c56dc70 0x562a6c570090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.189+0000 7f3f1866e740 4 client.26383 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.189+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a6c4d60b0 con 0x562a6c56dc70 2024-09-21T02:45:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.190+0000 7f3f0a000640 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c56dc70 0x562a6c570090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.190+0000 7f3eebe00640 10 client.26383 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.190+0000 7f3f0a000640 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c56dc70 0x562a6c570090 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ec6138981656b2 server_cookie=fe4a4442826999b2 in_seq=0 out_seq=0 2024-09-21T02:45:04.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:04.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:04 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3eebe00640 1 -- 172.21.15.79:0/2566845631 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a6c4d60b0 con 0x562a6c56dc70 2024-09-21T02:45:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3eebe00640 10 client.26383 handle_command_reply: tid=0 2024-09-21T02:45:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 client.26383 shutdown 2024-09-21T02:45:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 msgr2=0x562a6c57ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c57ea30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000c00 tx=0x7f3ef8003e40 comp rx=0 tx=0).stop 2024-09-21T02:45:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 shutdown_connections 2024-09-21T02:45:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562a6c56dc70 0x562a6c570090 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a6c1521c0 0x562a6c57d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a6c1be1b0 0x562a6c57f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 --2- 172.21.15.79:0/2566845631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a6c19d4d0 0x562a6c57ea30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 >> 172.21.15.79:0/2566845631 conn(0x562a6c1b2300 msgr2=0x562a6c5693a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3eebe00640 0 client.26383 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.513+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 shutdown_connections 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.514+0000 7f3f1866e740 1 -- 172.21.15.79:0/2566845631 wait complete. 2024-09-21T02:45:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.514+0000 7f3f1866e740 20 client.26383 trim_cache size 0 max 16384 2024-09-21T02:45:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:45:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:45:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:45:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:45:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3ef00b6510 msgr2=0x7f3ef00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3ef00b6510 0x7f3ef00b8a20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80304b0 tx=0x7f3ef8005da0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f0c108b20 msgr2=0x7f3f0c0729b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f0c108b20 0x7f3f0c0729b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e790 tx=0x7f3efc00ec50 comp rx=0 tx=0).stop 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 shutdown_connections 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3ef00b6510 0x7f3ef00b8a20 secure :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80304b0 tx=0x7f3ef8005da0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f0c10b480 0x7f3f0c073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f0c108b20 0x7f3f0c0729b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 --2- 172.21.15.79:0/1325450088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f0c06b4e0 0x7f3f0c072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.516+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 >> 172.21.15.79:0/1325450088 conn(0x7f3f0c0fdd80 msgr2=0x7f3f0c1098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.518+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 shutdown_connections 2024-09-21T02:45:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:04.518+0000 7f3f0be00640 1 -- 172.21.15.79:0/1325450088 wait complete. 2024-09-21T02:45:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:04.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:04 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:04.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:04 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:05.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:05 smithi079 ceph-mon[30788]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 689 op/s 2024-09-21T02:45:05.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:05.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:05 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:05 smithi148 ceph-mon[34626]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 689 op/s 2024-09-21T02:45:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:05 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:05 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:05.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:05 smithi098 ceph-mon[34832]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 689 op/s 2024-09-21T02:45:05.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:05 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:05.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:05 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:05.780 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T02:45:05.780 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T02:45:05.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:45:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 550.0 s, 568.6 tps, lat 206.309 ms stddev 259.473 2024-09-21T02:45:07.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:07 smithi079 ceph-mon[30788]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 881 op/s 2024-09-21T02:45:07.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:07 smithi148 ceph-mon[34626]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 881 op/s 2024-09-21T02:45:07.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:07 smithi098 ceph-mon[34832]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 881 op/s 2024-09-21T02:45:09.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:09 smithi079 ceph-mon[30788]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.5 MiB/s wr, 913 op/s 2024-09-21T02:45:09.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:09 smithi148 ceph-mon[34626]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.5 MiB/s wr, 913 op/s 2024-09-21T02:45:09.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:09 smithi098 ceph-mon[34832]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.5 MiB/s wr, 913 op/s 2024-09-21T02:45:10.165 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 555.0 s, 733.2 tps, lat 132.366 ms stddev 147.842 2024-09-21T02:45:11.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:11 smithi148 ceph-mon[34626]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 897 op/s 2024-09-21T02:45:11.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:11 smithi098 ceph-mon[34832]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 897 op/s 2024-09-21T02:45:11.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:11 smithi079 ceph-mon[30788]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 897 op/s 2024-09-21T02:45:12.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.208+0000 7fce93c00640 1 -- 172.21.15.79:0/4067403170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 msgr2=0x7fce8c118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.208+0000 7fce93c00640 1 --2- 172.21.15.79:0/4067403170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c118b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce78009900 tx=0x7fce7802a440 comp rx=0 tx=0).stop 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.209+0000 7fce93c00640 1 -- 172.21.15.79:0/4067403170 shutdown_connections 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.209+0000 7fce93c00640 1 --2- 172.21.15.79:0/4067403170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c118b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.209+0000 7fce93c00640 1 --2- 172.21.15.79:0/4067403170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c10aee0 0x7fce8c115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.209+0000 7fce93c00640 1 --2- 172.21.15.79:0/4067403170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c10a590 0x7fce8c10a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.209+0000 7fce93c00640 1 -- 172.21.15.79:0/4067403170 >> 172.21.15.79:0/4067403170 conn(0x7fce8c070ec0 msgr2=0x7fce8c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.209+0000 7fce93c00640 1 -- 172.21.15.79:0/4067403170 shutdown_connections 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.209+0000 7fce93c00640 1 -- 172.21.15.79:0/4067403170 wait complete. 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.211+0000 7fce93c00640 1 Processor -- start 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.212+0000 7fce93c00640 1 -- start start 2024-09-21T02:45:12.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce93c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c10a590 0x7fce8c1a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce93c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c10aee0 0x7fce8c1a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce93c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c1aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce91200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c10a590 0x7fce8c1a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce93c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c11e5c0 con 0x7fce8c10aee0 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce93c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c11e440 con 0x7fce8c116640 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce93c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c11e740 con 0x7fce8c10a590 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce91c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c1aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce91c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c1aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:54846/0 (socket says 172.21.15.79:54846) 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce91c00640 1 -- 172.21.15.79:0/2558363275 learned_addr learned my addr 172.21.15.79:0/2558363275 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce91200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c10a590 0x7fce8c1a5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34998/0 (socket says 172.21.15.79:34998) 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.213+0000 7fce8be00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c10aee0 0x7fce8c1a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:12.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.214+0000 7fce91c00640 1 -- 172.21.15.79:0/2558363275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c10a590 msgr2=0x7fce8c1a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.214+0000 7fce91c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c10a590 0x7fce8c1a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.214+0000 7fce91c00640 1 -- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c10aee0 msgr2=0x7fce8c1a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.214+0000 7fce91c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c10aee0 0x7fce8c1a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.214+0000 7fce91c00640 1 -- 172.21.15.79:0/2558363275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c1aaf80 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.214+0000 7fce91c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c1aa850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce78009a20 tx=0x7fce78004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.215+0000 7fce89600640 1 -- 172.21.15.79:0/2558363275 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7803f030 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.215+0000 7fce89600640 1 -- 172.21.15.79:0/2558363275 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce78003aa0 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.215+0000 7fce89600640 1 -- 172.21.15.79:0/2558363275 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78035070 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.215+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8c1ab210 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.215+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8c1b19d0 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.218+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8c10aa20 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.226+0000 7fce89600640 1 -- 172.21.15.79:0/2558363275 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fce78042030 con 0x7fce8c116640 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.230+0000 7fce89600640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce700b6610 0x7fce700b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:12.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.230+0000 7fce89600640 1 -- 172.21.15.79:0/2558363275 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fce78108460 con 0x7fce8c116640 2024-09-21T02:45:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.231+0000 7fce89600640 1 -- 172.21.15.79:0/2558363275 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce78049030 con 0x7fce8c116640 2024-09-21T02:45:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.233+0000 7fce91200640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce700b6610 0x7fce700b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:12.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.235+0000 7fce91200640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce700b6610 0x7fce700b8b20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce84009fd0 tx=0x7fce8400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:12.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.730+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce8c111690 con 0x7fce8c116640 2024-09-21T02:45:12.734 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:45:12.734 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:45:12.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.731+0000 7fce89600640 1 -- 172.21.15.79:0/2558363275 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fce780ce8e0 con 0x7fce8c116640 2024-09-21T02:45:12.734 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:45:12.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.736+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce700b6610 msgr2=0x7fce700b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:12.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.736+0000 7fce93c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce700b6610 0x7fce700b8b20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce84009fd0 tx=0x7fce8400d040 comp rx=0 tx=0).stop 2024-09-21T02:45:12.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.736+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 msgr2=0x7fce8c1aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:12.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.736+0000 7fce93c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c1aa850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce78009a20 tx=0x7fce78004270 comp rx=0 tx=0).stop 2024-09-21T02:45:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.738+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 shutdown_connections 2024-09-21T02:45:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.738+0000 7fce93c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fce700b6610 0x7fce700b8b20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.738+0000 7fce93c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce8c116640 0x7fce8c1aa850 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.738+0000 7fce93c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce8c10aee0 0x7fce8c1a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.738+0000 7fce93c00640 1 --2- 172.21.15.79:0/2558363275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c10a590 0x7fce8c1a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:12.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.738+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 >> 172.21.15.79:0/2558363275 conn(0x7fce8c070ec0 msgr2=0x7fce8c072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.740+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 shutdown_connections 2024-09-21T02:45:12.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:12.740+0000 7fce93c00640 1 -- 172.21.15.79:0/2558363275 wait complete. 2024-09-21T02:45:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:13 smithi148 ceph-mon[34626]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.6 MiB/s wr, 949 op/s 2024-09-21T02:45:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:13 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2558363275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:13.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:13 smithi098 ceph-mon[34832]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.6 MiB/s wr, 949 op/s 2024-09-21T02:45:13.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:13 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2558363275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:13.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:13 smithi079 ceph-mon[30788]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.6 MiB/s wr, 949 op/s 2024-09-21T02:45:13.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:13 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2558363275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:14.017 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T02:45:14.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T02:45:14.944 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:15.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:15 smithi079 ceph-mon[30788]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 888 op/s 2024-09-21T02:45:15.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:15.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:15 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:15 smithi098 ceph-mon[34832]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 888 op/s 2024-09-21T02:45:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:15.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:15 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:15 smithi148 ceph-mon[34626]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 888 op/s 2024-09-21T02:45:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:15.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:15 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 560.0 s, 530.2 tps, lat 187.538 ms stddev 307.872 2024-09-21T02:45:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.650+0000 7f3e02e00640 1 -- 172.21.15.79:0/4034487248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc1094c0 msgr2=0x7f3dfc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:16.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.650+0000 7f3e02e00640 1 --2- 172.21.15.79:0/4034487248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc1094c0 0x7f3dfc1098d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009900 tx=0x7f3dec02a420 comp rx=0 tx=0).stop 2024-09-21T02:45:16.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.654+0000 7f3e02e00640 1 -- 172.21.15.79:0/4034487248 shutdown_connections 2024-09-21T02:45:16.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.654+0000 7f3e02e00640 1 --2- 172.21.15.79:0/4034487248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dfc109e10 0x7f3dfc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.722 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:45:16.723 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:45:16.723 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:16.723 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:45:16.723 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:45:16.723 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.654+0000 7f3e02e00640 1 --2- 172.21.15.79:0/4034487248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc1094c0 0x7f3dfc1098d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.654+0000 7f3e02e00640 1 --2- 172.21.15.79:0/4034487248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dfc103b80 0x7f3dfc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.654+0000 7f3e02e00640 1 -- 172.21.15.79:0/4034487248 >> 172.21.15.79:0/4034487248 conn(0x7f3dfc0ff5b0 msgr2=0x7f3dfc101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.656+0000 7f3e02e00640 1 -- 172.21.15.79:0/4034487248 shutdown_connections 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.656+0000 7f3e02e00640 1 -- 172.21.15.79:0/4034487248 wait complete. 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.667+0000 7f3e02e00640 1 Processor -- start 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.668+0000 7f3e02e00640 1 -- start start 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.672+0000 7f3e02e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc103b80 0x7f3dfc1a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3dfbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc103b80 0x7f3dfc1a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3dfbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc103b80 0x7f3dfc1a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33444/0 (socket says 172.21.15.79:33444) 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3dfbe00640 1 -- 172.21.15.79:0/1251366847 learned_addr learned my addr 172.21.15.79:0/1251366847 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dfc1094c0 0x7f3dfc1a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dfc109e10 0x7f3dfc10fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc113b20 con 0x7f3dfc1094c0 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3e00e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dfc109e10 0x7f3dfc10fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.674+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1139a0 con 0x7f3dfc103b80 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.675+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc113ca0 con 0x7f3dfc109e10 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.675+0000 7f3dfb400640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dfc1094c0 0x7f3dfc1a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.676+0000 7f3e00e00640 1 -- 172.21.15.79:0/1251366847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc103b80 msgr2=0x7f3dfc1a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.676+0000 7f3e00e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc103b80 0x7f3dfc1a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.676+0000 7f3e00e00640 1 -- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dfc1094c0 msgr2=0x7f3dfc1a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.676+0000 7f3e00e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dfc1094c0 0x7f3dfc1a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.676+0000 7f3e00e00640 1 -- 172.21.15.79:0/1251366847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc110410 con 0x7f3dfc109e10 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.677+0000 7f3e00e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dfc109e10 0x7f3dfc10fc70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3df400ec50 tx=0x7f3df400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.677+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc103b80 0x7f3dfc1a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.678+0000 7f3dfb400640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dfc1094c0 0x7f3dfc1a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.679+0000 7f3df8c00640 1 -- 172.21.15.79:0/1251366847 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4003b70 con 0x7f3dfc109e10 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.679+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc110700 con 0x7f3dfc109e10 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.679+0000 7f3df8c00640 1 -- 172.21.15.79:0/1251366847 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3df4003d10 con 0x7f3dfc109e10 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.680+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc19daa0 con 0x7f3dfc109e10 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.681+0000 7f3df8c00640 1 -- 172.21.15.79:0/1251366847 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4003b70 con 0x7f3dfc109e10 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.685+0000 7f3df8c00640 1 -- 172.21.15.79:0/1251366847 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3df4004b40 con 0x7f3dfc109e10 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.688+0000 7f3df8c00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3de00b6810 0x7f3de00b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.688+0000 7f3df8c00640 1 -- 172.21.15.79:0/1251366847 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3df40e81f0 con 0x7f3dfc109e10 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.690+0000 7f3e09beb740 1 Processor -- start 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3de00b6810 0x7f3de00b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3e09beb740 1 -- start start 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f29350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b58980 0x55aff0f29890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b60b60 0x55aff0f29dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3e09beb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aff0e9eca0 con 0x55aff0b81840 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3e09beb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aff0e8e0d0 con 0x55aff0b58980 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.691+0000 7f3e09beb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55aff0e91ee0 con 0x55aff0b60b60 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.692+0000 7f3e00e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b60b60 0x55aff0f29dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.692+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b58980 0x55aff0f29890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.692+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b58980 0x55aff0f29890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33454/0 (socket says 172.21.15.79:33454) 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.692+0000 7f3dfb400640 1 -- 172.21.15.79:0/2136501497 learned_addr learned my addr 172.21.15.79:0/2136501497 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.692+0000 7f3dfb400640 1 -- 172.21.15.79:0/2136501497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b60b60 msgr2=0x55aff0f29dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.692+0000 7f3dfb400640 1 --2- 172.21.15.79:0/2136501497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b60b60 0x55aff0f29dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.693+0000 7f3dfb400640 1 -- 172.21.15.79:0/2136501497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 msgr2=0x55aff0f29350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.693+0000 7f3dfb400640 1 --2- 172.21.15.79:0/2136501497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f29350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.693+0000 7f3dfb400640 1 -- 172.21.15.79:0/2136501497 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff0e40400 con 0x55aff0b58980 2024-09-21T02:45:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.693+0000 7f3dfb400640 1 --2- 172.21.15.79:0/2136501497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b58980 0x55aff0f29890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009850 tx=0x7f3dec000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9842d175b48255d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.694+0000 7f3df1600640 1 -- 172.21.15.79:0/2136501497 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec03f070 con 0x55aff0b58980 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.694+0000 7f3df1600640 1 -- 172.21.15.79:0/2136501497 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dec003aa0 con 0x55aff0b58980 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.694+0000 7f3df1600640 1 -- 172.21.15.79:0/2136501497 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec035030 con 0x55aff0b58980 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.694+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3de00b6810 0x7f3de00b8d20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3de8005fd0 tx=0x7f3de800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.695+0000 7f3e09beb740 1 -- 172.21.15.79:0/2136501497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b58980 msgr2=0x55aff0f29890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.695+0000 7f3e09beb740 1 --2- 172.21.15.79:0/2136501497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b58980 0x55aff0f29890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009850 tx=0x7f3dec000bc0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.695+0000 7f3e09beb740 1 -- 172.21.15.79:0/2136501497 shutdown_connections 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.695+0000 7f3e09beb740 1 --2- 172.21.15.79:0/2136501497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b60b60 0x55aff0f29dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.695+0000 7f3e09beb740 1 --2- 172.21.15.79:0/2136501497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b58980 0x55aff0f29890 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.696+0000 7f3e09beb740 1 --2- 172.21.15.79:0/2136501497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f29350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.696+0000 7f3e09beb740 1 -- 172.21.15.79:0/2136501497 >> 172.21.15.79:0/2136501497 conn(0x55aff0b75990 msgr2=0x55aff0f27240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.696+0000 7f3e09beb740 1 -- 172.21.15.79:0/2136501497 shutdown_connections 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.696+0000 7f3e09beb740 1 -- 172.21.15.79:0/2136501497 wait complete. 2024-09-21T02:45:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.697+0000 7f3e09beb740 1 -- start start 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.697+0000 7f3e09beb740 1 Processor -- start 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.698+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f34970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.698+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f34eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.698+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.698+0000 7f3e09beb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aff0cef7a0 con 0x55aff0b81840 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.698+0000 7f3e09beb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aff0e33a10 con 0x55aff0b60b60 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.698+0000 7f3e09beb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55aff0f37ad0 con 0x55aff0b58980 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.698+0000 7f3e09beb740 10 client.0 _ll_register_callbacks cb 0x55aff0e43be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.699+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f34eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.700+0000 7f3e00e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.700+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f34eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33458/0 (socket says 172.21.15.79:33458) 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.700+0000 7f3dfb400640 1 -- 172.21.15.79:0/3220463494 learned_addr learned my addr 172.21.15.79:0/3220463494 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.701+0000 7f3e00e00640 1 -- 172.21.15.79:0/3220463494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 msgr2=0x55aff0f34970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.701+0000 7f3e00e00640 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f34970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.701+0000 7f3e00e00640 1 -- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 msgr2=0x55aff0f34eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.702+0000 7f3e00e00640 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f34eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.702+0000 7f3e00e00640 1 -- 172.21.15.79:0/3220463494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff0bfbb90 con 0x55aff0b81840 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.702+0000 7f3dfb400640 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f34eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.703+0000 7f3e00e00640 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f353f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3df400cba0 tx=0x7f3df40b78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c034c2048eb0e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.703+0000 7f3de6000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.707+0000 7f3de6000640 1 -- 172.21.15.79:0/3220463494 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df40ad6e0 con 0x55aff0b81840 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.707+0000 7f3de6000640 1 -- 172.21.15.79:0/3220463494 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3df40d51d0 con 0x55aff0b81840 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.707+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dec003aa0 con 0x55aff0b81840 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.707+0000 7f3de6000640 1 -- 172.21.15.79:0/3220463494 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3df40ada80 con 0x55aff0b81840 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.707+0000 7f3e09beb740 10 client.16146 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.707+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aff0f437c0 con 0x55aff0b81840 2024-09-21T02:45:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.708+0000 7f3de6000640 1 -- 172.21.15.79:0/3220463494 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dec003aa0 con 0x55aff0b81840 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.708+0000 7f3de6000640 1 -- 172.21.15.79:0/3220463494 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3df40b2480 con 0x55aff0b81840 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.709+0000 7f3e09beb740 10 client.16146 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.709+0000 7f3e09beb740 10 client.16146 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.709+0000 7f3e09beb740 20 client.16146 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.709+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b401c0 0x55aff0f46d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.710+0000 7f3e09beb740 4 client.16146 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.710+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aff0ea0bf0 con 0x55aff0b401c0 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.710+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b401c0 0x55aff0f46d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.712+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b401c0 0x55aff0f46d90 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58d2c2cb069b9163 server_cookie=c270d9c9f41468ae in_seq=0 out_seq=0 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.712+0000 7f3de6000640 10 client.16146 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3de6000640 1 -- 172.21.15.79:0/3220463494 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aff0ea0bf0 con 0x55aff0b401c0 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3de6000640 10 client.16146 handle_command_reply: tid=0 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 client.16146 shutdown 2024-09-21T02:45:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 msgr2=0x55aff0f353f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f353f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3df400cba0 tx=0x7f3df40b78c0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 shutdown_connections 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b401c0 0x55aff0f46d90 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b81840 0x55aff0f353f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f34eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3220463494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f34970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.715+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 >> 172.21.15.79:0/3220463494 conn(0x55aff0b75990 msgr2=0x55aff0f2c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.717+0000 7f3de6000640 0 client.16146 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.719+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 shutdown_connections 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.719+0000 7f3e09beb740 1 -- 172.21.15.79:0/3220463494 wait complete. 2024-09-21T02:45:16.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.719+0000 7f3e09beb740 20 client.16146 trim_cache size 0 max 16384 2024-09-21T02:45:16.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.757+0000 7f3e09beb740 1 Processor -- start 2024-09-21T02:45:16.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.757+0000 7f3e09beb740 1 -- start start 2024-09-21T02:45:16.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b58980 0x55aff0f2aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f31b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b81840 0x55aff0f320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3e09beb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc00dc70 con 0x55aff0b58980 2024-09-21T02:45:16.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3e09beb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc0104f0 con 0x55aff0b60b60 2024-09-21T02:45:16.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3e09beb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc00e2e0 con 0x55aff0b81840 2024-09-21T02:45:16.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f31b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f31b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33466/0 (socket says 172.21.15.79:33466) 2024-09-21T02:45:16.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3dfb400640 1 -- 172.21.15.79:0/4153122974 learned_addr learned my addr 172.21.15.79:0/4153122974 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:16.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.759+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b58980 0x55aff0f2aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.760+0000 7f3e00e00640 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b81840 0x55aff0f320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.760+0000 7f3dfb400640 1 -- 172.21.15.79:0/4153122974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b81840 msgr2=0x55aff0f320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.760+0000 7f3dfb400640 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b81840 0x55aff0f320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.760+0000 7f3dfb400640 1 -- 172.21.15.79:0/4153122974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b58980 msgr2=0x55aff0f2aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.760+0000 7f3dfb400640 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b58980 0x55aff0f2aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.760+0000 7f3dfb400640 1 -- 172.21.15.79:0/4153122974 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff0f22c50 con 0x55aff0b60b60 2024-09-21T02:45:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.761+0000 7f3dfb400640 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f31b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005ab0 tx=0x7f3dec00b0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb4cd1b71390d9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:16.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.761+0000 7f3df0c00640 1 -- 172.21.15.79:0/4153122974 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec052070 con 0x55aff0b60b60 2024-09-21T02:45:16.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.761+0000 7f3df0c00640 1 -- 172.21.15.79:0/4153122974 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dec004320 con 0x55aff0b60b60 2024-09-21T02:45:16.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.761+0000 7f3df0c00640 1 -- 172.21.15.79:0/4153122974 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec035040 con 0x55aff0b60b60 2024-09-21T02:45:16.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.763+0000 7f3e09beb740 1 -- 172.21.15.79:0/4153122974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 msgr2=0x55aff0f31b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:16.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.763+0000 7f3e09beb740 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f31b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005ab0 tx=0x7f3dec00b0b0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.765+0000 7f3e09beb740 1 -- 172.21.15.79:0/4153122974 shutdown_connections 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.765+0000 7f3e09beb740 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b81840 0x55aff0f320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.765+0000 7f3e09beb740 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b60b60 0x55aff0f31b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.765+0000 7f3e09beb740 1 --2- 172.21.15.79:0/4153122974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b58980 0x55aff0f2aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.765+0000 7f3e09beb740 1 -- 172.21.15.79:0/4153122974 >> 172.21.15.79:0/4153122974 conn(0x55aff0b75990 msgr2=0x55aff0f2a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.765+0000 7f3e09beb740 1 -- 172.21.15.79:0/4153122974 shutdown_connections 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.765+0000 7f3e09beb740 1 -- 172.21.15.79:0/4153122974 wait complete. 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.766+0000 7f3e09beb740 1 -- start start 2024-09-21T02:45:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.766+0000 7f3e09beb740 1 Processor -- start 2024-09-21T02:45:16.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.768+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f3d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.768+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b60b60 0x55aff0f39760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.768+0000 7f3e09beb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b81840 0x55aff0f39ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.768+0000 7f3e09beb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc00e9b0 con 0x55aff0b60b60 2024-09-21T02:45:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.768+0000 7f3e09beb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc00fe20 con 0x55aff0b81840 2024-09-21T02:45:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.768+0000 7f3e09beb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc00f080 con 0x55aff0b58980 2024-09-21T02:45:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.768+0000 7f3e09beb740 10 client.0 _ll_register_callbacks cb 0x7f3df4005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:16.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.769+0000 7f3dfbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f3d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.769+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b60b60 0x55aff0f39760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.769+0000 7f3dfb400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b60b60 0x55aff0f39760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36732/0 (socket says 172.21.15.79:36732) 2024-09-21T02:45:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.769+0000 7f3dfb400640 1 -- 172.21.15.79:0/3474732994 learned_addr learned my addr 172.21.15.79:0/3474732994 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.769+0000 7f3dfbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f3d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47834/0 (socket says 172.21.15.79:47834) 2024-09-21T02:45:16.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.769+0000 7f3e00e00640 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b81840 0x55aff0f39ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.770+0000 7f3dfb400640 1 -- 172.21.15.79:0/3474732994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 msgr2=0x55aff0f3d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.770+0000 7f3dfb400640 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f3d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.770+0000 7f3dfb400640 1 -- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b81840 msgr2=0x55aff0f39ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.770+0000 7f3dfb400640 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b81840 0x55aff0f39ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.770+0000 7f3dfb400640 1 -- 172.21.15.79:0/3474732994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff0f3a1e0 con 0x55aff0b60b60 2024-09-21T02:45:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.771+0000 7f3e00e00640 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b81840 0x55aff0f39ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:16.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.775+0000 7f3dfb400640 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b60b60 0x55aff0f39760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3dec03d040 tx=0x7f3dec003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5f7500f879bf2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:16.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.775+0000 7f3de6000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:16.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.775+0000 7f3de6000640 1 -- 172.21.15.79:0/3474732994 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec052070 con 0x55aff0b60b60 2024-09-21T02:45:16.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.775+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dec004320 con 0x55aff0b60b60 2024-09-21T02:45:16.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.776+0000 7f3de6000640 1 -- 172.21.15.79:0/3474732994 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3dec0328d0 con 0x55aff0b60b60 2024-09-21T02:45:16.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.776+0000 7f3de6000640 1 -- 172.21.15.79:0/3474732994 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3dec035040 con 0x55aff0b60b60 2024-09-21T02:45:16.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.777+0000 7f3e09beb740 10 client.16152 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:16.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.777+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aff0fb2380 con 0x55aff0b60b60 2024-09-21T02:45:16.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3de6000640 1 -- 172.21.15.79:0/3474732994 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dec004320 con 0x55aff0b60b60 2024-09-21T02:45:16.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3de6000640 1 -- 172.21.15.79:0/3474732994 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3dec04c070 con 0x55aff0b60b60 2024-09-21T02:45:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3e09beb740 10 client.16152 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3e09beb740 10 client.16152 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3e09beb740 20 client.16152 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b15570 0x55aff0fb4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3e09beb740 4 client.16152 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T02:45:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x55aff0e9c6a0 con 0x55aff0b15570 2024-09-21T02:45:16.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.778+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b15570 0x55aff0fb4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.779+0000 7f3de6000640 10 client.16152 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:16.780+0000 7f3dfbe00640 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b15570 0x55aff0fb4560 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d9fa6d882b31d3 server_cookie=d98885483dae1015 in_seq=0 out_seq=0 2024-09-21T02:45:16.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:45:16.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:45:16.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3de6000640 1 -- 172.21.15.79:0/3474732994 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55aff0e9c6a0 con 0x55aff0b15570 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3de6000640 10 client.16152 handle_command_reply: tid=0 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 client.16152 shutdown 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b60b60 msgr2=0x55aff0f39760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b60b60 0x55aff0f39760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3dec03d040 tx=0x7f3dec003ea0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 shutdown_connections 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55aff0b15570 0x55aff0fb4560 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aff0b81840 0x55aff0f39ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aff0b60b60 0x55aff0f39760 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 --2- 172.21.15.79:0/3474732994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55aff0b58980 0x55aff0f3d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 >> 172.21.15.79:0/3474732994 conn(0x55aff0b75990 msgr2=0x55aff0f259a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3de6000640 0 client.16152 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 shutdown_connections 2024-09-21T02:45:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.085+0000 7f3e09beb740 1 -- 172.21.15.79:0/3474732994 wait complete. 2024-09-21T02:45:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e09beb740 20 client.16152 trim_cache size 0 max 16384 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 38, 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "37351c55": { 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 38, 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:45:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 144.5, 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:17.091 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:45:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3de00b6810 msgr2=0x7f3de00b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3de00b6810 0x7f3de00b8d20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3de8005fd0 tx=0x7f3de800a380 comp rx=0 tx=0).stop 2024-09-21T02:45:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dfc109e10 msgr2=0x7f3dfc10fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dfc109e10 0x7f3dfc10fc70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3df400ec50 tx=0x7f3df400c6a0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 shutdown_connections 2024-09-21T02:45:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3de00b6810 0x7f3de00b8d20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dfc109e10 0x7f3dfc10fc70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dfc1094c0 0x7f3dfc1a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 --2- 172.21.15.79:0/1251366847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dfc103b80 0x7f3dfc1a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.086+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 >> 172.21.15.79:0/1251366847 conn(0x7f3dfc0ff5b0 msgr2=0x7f3dfc105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.087+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 shutdown_connections 2024-09-21T02:45:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:17.087+0000 7f3e02e00640 1 -- 172.21.15.79:0/1251366847 wait complete. 2024-09-21T02:45:17.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:17 smithi098 ceph-mon[34832]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 MiB/s wr, 811 op/s 2024-09-21T02:45:17.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:17 smithi079 ceph-mon[30788]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 MiB/s wr, 811 op/s 2024-09-21T02:45:17.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:17 smithi148 ceph-mon[34626]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 MiB/s wr, 811 op/s 2024-09-21T02:45:18.072 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '37351c55', quiesce took 12.3 seconds. Will release after: 12.2 2024-09-21T02:45:18.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 -- 172.21.15.79:0/3116041573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281072e0 msgr2=0x7fc82810dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 --2- 172.21.15.79:0/3116041573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281072e0 0x7fc82810dc80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc820009ca0 tx=0x7fc82002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 -- 172.21.15.79:0/3116041573 shutdown_connections 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 --2- 172.21.15.79:0/3116041573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281072e0 0x7fc82810dc80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 --2- 172.21.15.79:0/3116041573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc828106940 0x7fc828106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 --2- 172.21.15.79:0/3116041573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8281058c0 0x7fc828105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 -- 172.21.15.79:0/3116041573 >> 172.21.15.79:0/3116041573 conn(0x7fc828101220 msgr2=0x7fc8281036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 -- 172.21.15.79:0/3116041573 shutdown_connections 2024-09-21T02:45:18.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.302+0000 7fc82f800640 1 -- 172.21.15.79:0/3116041573 wait complete. 2024-09-21T02:45:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 Processor -- start 2024-09-21T02:45:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 -- start start 2024-09-21T02:45:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281058c0 0x7fc82819c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828106940 0x7fc82819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8281072e0 0x7fc82819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc828111560 con 0x7fc828106940 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281113e0 con 0x7fc8281058c0 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.303+0000 7fc82f800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281116e0 con 0x7fc8281072e0 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828106940 0x7fc82819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828106940 0x7fc82819c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36748/0 (socket says 172.21.15.79:36748) 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 -- 172.21.15.79:0/967539951 learned_addr learned my addr 172.21.15.79:0/967539951 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc82d800640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8281072e0 0x7fc82819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc82ce00640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281058c0 0x7fc82819c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 -- 172.21.15.79:0/967539951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8281072e0 msgr2=0x7fc82819d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8281072e0 0x7fc82819d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 -- 172.21.15.79:0/967539951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281058c0 msgr2=0x7fc82819c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281058c0 0x7fc82819c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 -- 172.21.15.79:0/967539951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82819db30 con 0x7fc828106940 2024-09-21T02:45:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.304+0000 7fc827e00640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828106940 0x7fc82819c760 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc81400e9f0 tx=0x7fc81400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.305+0000 7fc825600640 1 -- 172.21.15.79:0/967539951 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81400cd80 con 0x7fc828106940 2024-09-21T02:45:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.305+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82819de20 con 0x7fc828106940 2024-09-21T02:45:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.305+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8281a4510 con 0x7fc828106940 2024-09-21T02:45:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.305+0000 7fc825600640 1 -- 172.21.15.79:0/967539951 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8140054d0 con 0x7fc828106940 2024-09-21T02:45:18.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.305+0000 7fc825600640 1 -- 172.21.15.79:0/967539951 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814010430 con 0x7fc828106940 2024-09-21T02:45:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.308+0000 7fc825600640 1 -- 172.21.15.79:0/967539951 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc8140046c0 con 0x7fc828106940 2024-09-21T02:45:18.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.310+0000 7fc825600640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8100b6590 0x7fc8100b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.310+0000 7fc825600640 1 -- 172.21.15.79:0/967539951 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fc8140e7980 con 0x7fc828106940 2024-09-21T02:45:18.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.310+0000 7fc82ce00640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8100b6590 0x7fc8100b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.311+0000 7fc82ce00640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8100b6590 0x7fc8100b8aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0095f0 tx=0x7fc81c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.388+0000 7fc8368d9740 1 Processor -- start 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.388+0000 7fc8368d9740 1 -- start start 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3ef290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc8368d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555b1c3616b0 con 0x555b1c0264d0 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc8368d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555b1c350ae0 con 0x555b1c01e2f0 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc8368d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555b1c3548f0 con 0x555b1c0471b0 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc82d800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3ee740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33496/0 (socket says 172.21.15.79:33496) 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc82d800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3ef290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36762/0 (socket says 172.21.15.79:36762) 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 -- 172.21.15.79:0/1912557469 learned_addr learned my addr 172.21.15.79:0/1912557469 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc82ce00640 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 -- 172.21.15.79:0/1912557469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 msgr2=0x555b1c3ee0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ee0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 -- 172.21.15.79:0/1912557469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 msgr2=0x555b1c3ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3ef290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc827e00640 1 -- 172.21.15.79:0/1912557469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b1c31d780 con 0x555b1c01e2f0 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.389+0000 7fc82ce00640 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.390+0000 7fc827e00640 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3ee740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8140ad690 tx=0x7fc8140ad050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf00d11e4142317e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.390+0000 7fc81a000640 1 -- 172.21.15.79:0/1912557469 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140ade00 con 0x555b1c01e2f0 2024-09-21T02:45:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.390+0000 7fc81a000640 1 -- 172.21.15.79:0/1912557469 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8140d4020 con 0x555b1c01e2f0 2024-09-21T02:45:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.390+0000 7fc81a000640 1 -- 172.21.15.79:0/1912557469 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814005260 con 0x555b1c01e2f0 2024-09-21T02:45:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 -- 172.21.15.79:0/1912557469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 msgr2=0x555b1c3ee740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3ee740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8140ad690 tx=0x7fc8140ad050 comp rx=0 tx=0).stop 2024-09-21T02:45:18.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 -- 172.21.15.79:0/1912557469 shutdown_connections 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3ee740 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 --2- 172.21.15.79:0/1912557469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 -- 172.21.15.79:0/1912557469 >> 172.21.15.79:0/1912557469 conn(0x555b1c03b300 msgr2=0x555b1c3e9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 -- 172.21.15.79:0/1912557469 shutdown_connections 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.391+0000 7fc8368d9740 1 -- 172.21.15.79:0/1912557469 wait complete. 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 -- start start 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 Processor -- start 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c01e2f0 0x555b1c3f7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3f8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555b1c288ab0 con 0x555b1c0264d0 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555b1c2f7570 con 0x555b1c0471b0 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555b1c3efd50 con 0x555b1c01e2f0 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.392+0000 7fc8368d9740 10 client.0 _ll_register_callbacks cb 0x555b1c306100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3f7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36778/0 (socket says 172.21.15.79:36778) 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 -- 172.21.15.79:0/2199472203 learned_addr learned my addr 172.21.15.79:0/2199472203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc82ce00640 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c01e2f0 0x555b1c3f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc82d800640 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 -- 172.21.15.79:0/2199472203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c01e2f0 msgr2=0x555b1c3f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c01e2f0 0x555b1c3f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 -- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 msgr2=0x555b1c3f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 -- 172.21.15.79:0/2199472203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b1c0b2790 con 0x555b1c0264d0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc827e00640 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3f7df0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc8140a9cd0 tx=0x7fc8140acc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cffafdb18e73be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.393+0000 7fc80ea00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc80ea00640 1 -- 172.21.15.79:0/2199472203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140b21e0 con 0x555b1c0264d0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc80ea00640 1 -- 172.21.15.79:0/2199472203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fc8140a9260 con 0x555b1c0264d0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8140d4020 con 0x555b1c0264d0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc80ea00640 1 -- 172.21.15.79:0/2199472203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc8140b7120 con 0x555b1c0264d0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc8368d9740 10 client.16164 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b1c12b620 con 0x555b1c0264d0 2024-09-21T02:45:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc80ea00640 1 -- 172.21.15.79:0/2199472203 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8140d4020 con 0x555b1c0264d0 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc80ea00640 1 -- 172.21.15.79:0/2199472203 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc8140b3570 con 0x555b1c0264d0 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc8368d9740 10 client.16164 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.394+0000 7fc8368d9740 10 client.16164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.395+0000 7fc8368d9740 20 client.16164 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.395+0000 7fc8368d9740 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1c005d80 0x555b1c404a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.395+0000 7fc8368d9740 4 client.16164 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.395+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b1c363600 con 0x555b1c005d80 2024-09-21T02:45:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.395+0000 7fc82ce00640 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1c005d80 0x555b1c404a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.395+0000 7fc80ea00640 10 client.16164 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.395+0000 7fc82ce00640 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1c005d80 0x555b1c404a40 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=564004eeb1091928 server_cookie=9d0e1b969e34ab4b in_seq=0 out_seq=0 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.396+0000 7fc80ea00640 1 -- 172.21.15.79:0/2199472203 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b1c363600 con 0x555b1c005d80 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.396+0000 7fc80ea00640 10 client.16164 handle_command_reply: tid=0 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.396+0000 7fc8368d9740 1 client.16164 shutdown 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 msgr2=0x555b1c3f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3f7df0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc8140a9cd0 tx=0x7fc8140acc10 comp rx=0 tx=0).stop 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 shutdown_connections 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1c005d80 0x555b1c404a40 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3f7df0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 --2- 172.21.15.79:0/2199472203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c01e2f0 0x555b1c3f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 >> 172.21.15.79:0/2199472203 conn(0x555b1c03b300 msgr2=0x555b1c3ef140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc80ea00640 0 client.16164 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 shutdown_connections 2024-09-21T02:45:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 1 -- 172.21.15.79:0/2199472203 wait complete. 2024-09-21T02:45:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.397+0000 7fc8368d9740 20 client.16164 trim_cache size 0 max 16384 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.412+0000 7fc8368d9740 1 Processor -- start 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.412+0000 7fc8368d9740 1 -- start start 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c01e2f0 0x555b1c3e9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0264d0 0x555b1c3e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc8368d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800dc30 con 0x555b1c01e2f0 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc8368d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8080104b0 con 0x555b1c0471b0 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc8368d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800e2a0 con 0x555b1c0264d0 2024-09-21T02:45:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c01e2f0 0x555b1c3e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82ce00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c01e2f0 0x555b1c3e9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36788/0 (socket says 172.21.15.79:36788) 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82ce00640 1 -- 172.21.15.79:0/60902683 learned_addr learned my addr 172.21.15.79:0/60902683 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc827e00640 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0264d0 0x555b1c3e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82d800640 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82ce00640 1 -- 172.21.15.79:0/60902683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0264d0 msgr2=0x555b1c3e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82ce00640 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0264d0 0x555b1c3e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82ce00640 1 -- 172.21.15.79:0/60902683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 msgr2=0x555b1c3e9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.413+0000 7fc82ce00640 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3e9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.414+0000 7fc82ce00640 1 -- 172.21.15.79:0/60902683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b1c3f8dc0 con 0x555b1c01e2f0 2024-09-21T02:45:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.414+0000 7fc82ce00640 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c01e2f0 0x555b1c3e9330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x555b1c405120 tx=0x7fc81c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd3b8b3aab7f2be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.414+0000 7fc819600640 1 -- 172.21.15.79:0/60902683 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c029420 con 0x555b1c01e2f0 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.414+0000 7fc819600640 1 -- 172.21.15.79:0/60902683 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81c029a70 con 0x555b1c01e2f0 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.414+0000 7fc819600640 1 -- 172.21.15.79:0/60902683 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c030a70 con 0x555b1c01e2f0 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 -- 172.21.15.79:0/60902683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c01e2f0 msgr2=0x555b1c3e9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c01e2f0 0x555b1c3e9330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x555b1c405120 tx=0x7fc81c014000 comp rx=0 tx=0).stop 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 -- 172.21.15.79:0/60902683 shutdown_connections 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c0471b0 0x555b1c3e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0264d0 0x555b1c3e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 --2- 172.21.15.79:0/60902683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c01e2f0 0x555b1c3e9330 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 -- 172.21.15.79:0/60902683 >> 172.21.15.79:0/60902683 conn(0x555b1c03b300 msgr2=0x555b1c3f5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 -- 172.21.15.79:0/60902683 shutdown_connections 2024-09-21T02:45:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 -- 172.21.15.79:0/60902683 wait complete. 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.415+0000 7fc8368d9740 1 -- start start 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 1 Processor -- start 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3fae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3fb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ff100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800e970 con 0x555b1c0264d0 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800fde0 con 0x555b1c01e2f0 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc80800f040 con 0x555b1c0471b0 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc8368d9740 10 client.0 _ll_register_callbacks cb 0x7fc8140d2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc827e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc827e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3fb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36796/0 (socket says 172.21.15.79:36796) 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc827e00640 1 -- 172.21.15.79:0/3982945990 learned_addr learned my addr 172.21.15.79:0/3982945990 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.416+0000 7fc82ce00640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3fae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc82d800640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc827e00640 1 -- 172.21.15.79:0/3982945990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 msgr2=0x555b1c3ff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc827e00640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ff100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc827e00640 1 -- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 msgr2=0x555b1c3fae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc827e00640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3fae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc827e00640 1 -- 172.21.15.79:0/3982945990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b1c3ff860 con 0x555b1c0264d0 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc82ce00640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc827e00640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3fb510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8140a99b0 tx=0x7fc8140ad180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b949add04340bb05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc80ea00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc80ea00640 1 -- 172.21.15.79:0/3982945990 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140acc80 con 0x555b1c0264d0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc80ea00640 1 -- 172.21.15.79:0/3982945990 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fc8140cf490 con 0x555b1c0264d0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.417+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc81c029a70 con 0x555b1c0264d0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc80ea00640 1 -- 172.21.15.79:0/3982945990 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc814005310 con 0x555b1c0264d0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 10 client.16170 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555b1c3ff860 con 0x555b1c0264d0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc80ea00640 1 -- 172.21.15.79:0/3982945990 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81c029a70 con 0x555b1c0264d0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc80ea00640 1 -- 172.21.15.79:0/3982945990 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc8140b6660 con 0x555b1c0264d0 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 10 client.16170 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 10 client.16170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 20 client.16170 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1bfdb1c0 0x555b1c471730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 4 client.16170 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.418+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555b1c35f0b0 con 0x555b1bfdb1c0 2024-09-21T02:45:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.419+0000 7fc82ce00640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1bfdb1c0 0x555b1c471730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.419+0000 7fc80ea00640 10 client.16170 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.419+0000 7fc82ce00640 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1bfdb1c0 0x555b1c471730 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a27df02fea527018 server_cookie=bd9ea6e67f4701d2 in_seq=0 out_seq=0 2024-09-21T02:45:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.435+0000 7fc80ea00640 1 -- 172.21.15.79:0/3982945990 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555b1c35f0b0 con 0x555b1bfdb1c0 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.435+0000 7fc80ea00640 10 client.16170 handle_command_reply: tid=0 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 client.16170 shutdown 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 msgr2=0x555b1c3fb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3fb510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8140a99b0 tx=0x7fc8140ad180 comp rx=0 tx=0).stop 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 shutdown_connections 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x555b1bfdb1c0 0x555b1c471730 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b1c0471b0 0x555b1c3ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555b1c0264d0 0x555b1c3fb510 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc80ea00640 0 client.16170 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 --2- 172.21.15.79:0/3982945990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555b1c01e2f0 0x555b1c3fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 >> 172.21.15.79:0/3982945990 conn(0x555b1c03b300 msgr2=0x555b1c3e9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 shutdown_connections 2024-09-21T02:45:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 1 -- 172.21.15.79:0/3982945990 wait complete. 2024-09-21T02:45:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.436+0000 7fc8368d9740 20 client.16170 trim_cache size 0 max 16384 2024-09-21T02:45:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:45:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:45:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:45:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:45:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8100b6590 msgr2=0x7fc8100b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8100b6590 0x7fc8100b8aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0095f0 tx=0x7fc81c005f90 comp rx=0 tx=0).stop 2024-09-21T02:45:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828106940 msgr2=0x7fc82819c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828106940 0x7fc82819c760 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc81400e9f0 tx=0x7fc81400edf0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 shutdown_connections 2024-09-21T02:45:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc8100b6590 0x7fc8100b8aa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8281072e0 0x7fc82819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828106940 0x7fc82819c760 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 --2- 172.21.15.79:0/967539951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8281058c0 0x7fc82819c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 >> 172.21.15.79:0/967539951 conn(0x7fc828101220 msgr2=0x7fc828109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 shutdown_connections 2024-09-21T02:45:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:18.437+0000 7fc82f800640 1 -- 172.21.15.79:0/967539951 wait complete. 2024-09-21T02:45:19.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:19 smithi098 ceph-mon[34832]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-21T02:45:19.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:19 smithi079 ceph-mon[30788]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-21T02:45:19.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:19 smithi148 ceph-mon[34626]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-21T02:45:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 565.0 s, 28.8 tps, lat 231.335 ms stddev 227.722 2024-09-21T02:45:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:21 smithi098 ceph-mon[34832]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 595 op/s 2024-09-21T02:45:21.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:21 smithi079 ceph-mon[30788]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 595 op/s 2024-09-21T02:45:21.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:21 smithi148 ceph-mon[34626]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 595 op/s 2024-09-21T02:45:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:23 smithi098 ceph-mon[34832]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 540 op/s 2024-09-21T02:45:23.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:23 smithi079 ceph-mon[30788]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 540 op/s 2024-09-21T02:45:23.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:23 smithi148 ceph-mon[34626]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 540 op/s 2024-09-21T02:45:25.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:25 smithi098 ceph-mon[34832]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.6 MiB/s wr, 402 op/s 2024-09-21T02:45:25.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:25 smithi079 ceph-mon[30788]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.6 MiB/s wr, 402 op/s 2024-09-21T02:45:25.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:25 smithi148 ceph-mon[34626]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.6 MiB/s wr, 402 op/s 2024-09-21T02:45:26.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:45:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:27 smithi098 ceph-mon[34832]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.2 MiB/s wr, 267 op/s 2024-09-21T02:45:27.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:27 smithi079 ceph-mon[30788]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.2 MiB/s wr, 267 op/s 2024-09-21T02:45:27.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:27 smithi148 ceph-mon[34626]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.2 MiB/s wr, 267 op/s 2024-09-21T02:45:29.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:29 smithi098 ceph-mon[34832]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-21T02:45:29.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:29 smithi079 ceph-mon[30788]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-21T02:45:29.814 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:29 smithi148 ceph-mon[34626]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-21T02:45:30.272 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:45:30.676 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.348+0000 7f951e200640 1 -- 172.21.15.79:0/3806537604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9518102d30 msgr2=0x7f951810fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.348+0000 7f951e200640 1 --2- 172.21.15.79:0/3806537604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9518102d30 0x7f951810fa50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9504009860 tx=0x7f950402a3d0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.349+0000 7f951e200640 1 -- 172.21.15.79:0/3806537604 shutdown_connections 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.349+0000 7f951e200640 1 --2- 172.21.15.79:0/3806537604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f951810ff90 0x7f95181123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.349+0000 7f951e200640 1 --2- 172.21.15.79:0/3806537604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9518102d30 0x7f951810fa50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.349+0000 7f951e200640 1 --2- 172.21.15.79:0/3806537604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95181023e0 0x7f95181027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.349+0000 7f951e200640 1 -- 172.21.15.79:0/3806537604 >> 172.21.15.79:0/3806537604 conn(0x7f95180fe2c0 msgr2=0x7f9518100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.349+0000 7f951e200640 1 -- 172.21.15.79:0/3806537604 shutdown_connections 2024-09-21T02:45:31.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.349+0000 7f951e200640 1 -- 172.21.15.79:0/3806537604 wait complete. 2024-09-21T02:45:31.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 Processor -- start 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 -- start start 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95181023e0 0x7f951819c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518102d30 0x7f951819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f951810ff90 0x7f95181a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9518115ad0 con 0x7f951810ff90 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9518115950 con 0x7f95181023e0 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.350+0000 7f951e200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9518115c50 con 0x7f9518102d30 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95181023e0 0x7f951819c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95181023e0 0x7f951819c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:45610/0 (socket says 172.21.15.79:45610) 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 -- 172.21.15.79:0/1856160296 learned_addr learned my addr 172.21.15.79:0/1856160296 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f9517e00640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518102d30 0x7f951819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951d800640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f951810ff90 0x7f95181a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 -- 172.21.15.79:0/1856160296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518102d30 msgr2=0x7f951819caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518102d30 0x7f951819caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 -- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f951810ff90 msgr2=0x7f95181a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f951810ff90 0x7f95181a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 -- 172.21.15.79:0/1856160296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95181a2470 con 0x7f95181023e0 2024-09-21T02:45:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951d800640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f951810ff90 0x7f95181a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:31.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.351+0000 7f951ce00640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95181023e0 0x7f951819c500 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f950c00e9f0 tx=0x7f950c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.352+0000 7f9515600640 1 -- 172.21.15.79:0/1856160296 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c00cd80 con 0x7f95181023e0 2024-09-21T02:45:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.352+0000 7f9515600640 1 -- 172.21.15.79:0/1856160296 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f950c0054d0 con 0x7f95181023e0 2024-09-21T02:45:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.352+0000 7f9515600640 1 -- 172.21.15.79:0/1856160296 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c010690 con 0x7f95181023e0 2024-09-21T02:45:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.352+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95181a2760 con 0x7f95181023e0 2024-09-21T02:45:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.352+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95181a8ec0 con 0x7f95181023e0 2024-09-21T02:45:31.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.353+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95181027f0 con 0x7f95181023e0 2024-09-21T02:45:31.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.355+0000 7f9515600640 1 -- 172.21.15.79:0/1856160296 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f950c004e30 con 0x7f95181023e0 2024-09-21T02:45:31.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.357+0000 7f9515600640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f95000b6510 0x7f95000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.357+0000 7f9515600640 1 -- 172.21.15.79:0/1856160296 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f950c0e7d60 con 0x7f95181023e0 2024-09-21T02:45:31.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.357+0000 7f9517e00640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f95000b6510 0x7f95000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.358+0000 7f9517e00640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f95000b6510 0x7f95000b8a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9518111270 tx=0x7f9504005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.359+0000 7f9515600640 1 -- 172.21.15.79:0/1856160296 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f950c056710 con 0x7f95181023e0 2024-09-21T02:45:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:45:31.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.593+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f951819d630 con 0x7f95181023e0 2024-09-21T02:45:31.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.594+0000 7f9515600640 1 -- 172.21.15.79:0/1856160296 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f951819d630 con 0x7f95181023e0 2024-09-21T02:45:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:45:31.596 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:45:31.596 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:45:31.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f95000b6510 msgr2=0x7f95000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f95000b6510 0x7f95000b8a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9518111270 tx=0x7f9504005c90 comp rx=0 tx=0).stop 2024-09-21T02:45:31.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95181023e0 msgr2=0x7f951819c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95181023e0 0x7f951819c500 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f950c00e9f0 tx=0x7f950c00edf0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 shutdown_connections 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f95000b6510 0x7f95000b8a20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f951810ff90 0x7f95181a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9518102d30 0x7f951819caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 --2- 172.21.15.79:0/1856160296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95181023e0 0x7f951819c500 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 >> 172.21.15.79:0/1856160296 conn(0x7f95180fe2c0 msgr2=0x7f9518109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 shutdown_connections 2024-09-21T02:45:31.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:31.598+0000 7f951e200640 1 -- 172.21.15.79:0/1856160296 wait complete. 2024-09-21T02:45:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 -- 172.21.15.79:0/2732102221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 msgr2=0x7f5294103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 --2- 172.21.15.79:0/2732102221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294103b10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5284009900 tx=0x7f528402a410 comp rx=0 tx=0).stop 2024-09-21T02:45:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 -- 172.21.15.79:0/2732102221 shutdown_connections 2024-09-21T02:45:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 --2- 172.21.15.79:0/2732102221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52941050c0 0x7f529410ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 --2- 172.21.15.79:0/2732102221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294104720 0x7f5294104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 --2- 172.21.15.79:0/2732102221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294103b10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 -- 172.21.15.79:0/2732102221 >> 172.21.15.79:0/2732102221 conn(0x7f52940fefe0 msgr2=0x7f5294101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.639+0000 7f5298e00640 1 -- 172.21.15.79:0/2732102221 shutdown_connections 2024-09-21T02:45:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.640+0000 7f5298e00640 1 -- 172.21.15.79:0/2732102221 wait complete. 2024-09-21T02:45:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 Processor -- start 2024-09-21T02:45:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 -- start start 2024-09-21T02:45:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5294104720 0x7f5294075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52941050c0 0x7f5294075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f529410f310 con 0x7f52941036a0 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f529410f190 con 0x7f5294104720 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5298e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f529410f490 con 0x7f52941050c0 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34504/0 (socket says 172.21.15.79:34504) 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.641+0000 7f5291e00640 1 -- 172.21.15.79:0/3654276100 learned_addr learned my addr 172.21.15.79:0/3654276100 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5292800640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52941050c0 0x7f5294075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5289400640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5294104720 0x7f5294075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5291e00640 1 -- 172.21.15.79:0/3654276100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52941050c0 msgr2=0x7f5294075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5291e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52941050c0 0x7f5294075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5291e00640 1 -- 172.21.15.79:0/3654276100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5294104720 msgr2=0x7f5294075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5291e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5294104720 0x7f5294075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5291e00640 1 -- 172.21.15.79:0/3654276100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5294076380 con 0x7f52941036a0 2024-09-21T02:45:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.642+0000 7f5291e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294076e50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5284031440 tx=0x7f5284003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.643+0000 7f528b400640 1 -- 172.21.15.79:0/3654276100 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528403f070 con 0x7f52941036a0 2024-09-21T02:45:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.643+0000 7f528b400640 1 -- 172.21.15.79:0/3654276100 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5284031c50 con 0x7f52941036a0 2024-09-21T02:45:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.643+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52941a4040 con 0x7f52941036a0 2024-09-21T02:45:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.643+0000 7f528b400640 1 -- 172.21.15.79:0/3654276100 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284035030 con 0x7f52941036a0 2024-09-21T02:45:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.643+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941a4440 con 0x7f52941036a0 2024-09-21T02:45:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.646+0000 7f529fe53740 1 Processor -- start 2024-09-21T02:45:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f529fe53740 1 -- start start 2024-09-21T02:45:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f528b400640 1 -- 172.21.15.79:0/3654276100 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5284042070 con 0x7f52941036a0 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f529fe53740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f529fe53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f529fe53740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580a2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f529fe53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a1580146b0 con 0x55a157cd12f0 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f529fe53740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a158003ae0 con 0x55a157cfa1b0 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f529fe53740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a1580078f0 con 0x55a157cd94d0 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f5292800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f5292800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580a10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:45652/0 (socket says 172.21.15.79:45652) 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f5292800640 1 -- 172.21.15.79:0/1938822067 learned_addr learned my addr 172.21.15.79:0/1938822067 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.647+0000 7f5289400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5289400640 1 -- 172.21.15.79:0/1938822067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 msgr2=0x55a1580a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5289400640 1 --2- 172.21.15.79:0/1938822067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5289400640 1 -- 172.21.15.79:0/1938822067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 msgr2=0x55a1580a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5289400640 1 --2- 172.21.15.79:0/1938822067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5289400640 1 -- 172.21.15.79:0/1938822067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a157fd0780 con 0x55a157cd94d0 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5289400640 1 --2- 172.21.15.79:0/1938822067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580a2290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f527c009c20 tx=0x7f527c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ec84248a00ac64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5283400640 1 -- 172.21.15.79:0/1938822067 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c009dd0 con 0x55a157cd94d0 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f528b400640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f52780b6510 0x7f52780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5283400640 1 -- 172.21.15.79:0/1938822067 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f527c005020 con 0x55a157cd94d0 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.648+0000 7f5283400640 1 -- 172.21.15.79:0/1938822067 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c004b20 con 0x55a157cd94d0 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.649+0000 7f528b400640 1 -- 172.21.15.79:0/3654276100 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f5284107e20 con 0x7f52941036a0 2024-09-21T02:45:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.649+0000 7f5292800640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f52780b6510 0x7f52780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 -- 172.21.15.79:0/1938822067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 msgr2=0x55a1580a2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f5292800640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f52780b6510 0x7f52780b8a20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f528c011630 tx=0x7f528c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 --2- 172.21.15.79:0/1938822067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580a2290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f527c009c20 tx=0x7f527c011810 comp rx=0 tx=0).stop 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 -- 172.21.15.79:0/1938822067 shutdown_connections 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 --2- 172.21.15.79:0/1938822067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580a2290 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 --2- 172.21.15.79:0/1938822067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 --2- 172.21.15.79:0/1938822067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 -- 172.21.15.79:0/1938822067 >> 172.21.15.79:0/1938822067 conn(0x55a157cee300 msgr2=0x55a15809cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 -- 172.21.15.79:0/1938822067 shutdown_connections 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 -- 172.21.15.79:0/1938822067 wait complete. 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.650+0000 7f529fe53740 1 -- start start 2024-09-21T02:45:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 1 Processor -- start 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580aa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580aae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580ab930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a157f3bab0 con 0x55a157cd12f0 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a157faa570 con 0x55a157cfa1b0 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a1580a2db0 con 0x55a157cd94d0 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f529fe53740 10 client.0 _ll_register_callbacks cb 0x55a157fb9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34510/0 (socket says 172.21.15.79:34510) 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f5291e00640 1 -- 172.21.15.79:0/2272729355 learned_addr learned my addr 172.21.15.79:0/2272729355 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.651+0000 7f5289400640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5292800640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5291e00640 1 -- 172.21.15.79:0/2272729355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 msgr2=0x55a1580aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5291e00640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5291e00640 1 -- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 msgr2=0x55a1580ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5291e00640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5291e00640 1 -- 172.21.15.79:0/2272729355 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a157d65790 con 0x55a157cd12f0 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5289400640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5291e00640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580aa770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f52840caf20 tx=0x7f528403b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea05af048e3abad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5277e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5277e00640 1 -- 172.21.15.79:0/2272729355 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284049030 con 0x55a157cd12f0 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f5277e00640 1 -- 172.21.15.79:0/2272729355 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f52840f10b0 con 0x55a157cd12f0 2024-09-21T02:45:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.652+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f527c005020 con 0x55a157cd12f0 2024-09-21T02:45:31.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:31 smithi098 ceph-mon[34832]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 889 KiB/s wr, 109 op/s 2024-09-21T02:45:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f5277e00640 1 -- 172.21.15.79:0/2272729355 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f52840c9b50 con 0x55a157cd12f0 2024-09-21T02:45:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 10 client.16188 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a157dde620 con 0x55a157cd12f0 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f5277e00640 1 -- 172.21.15.79:0/2272729355 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f527c005020 con 0x55a157cd12f0 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f5277e00640 1 -- 172.21.15.79:0/2272729355 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f52840d7190 con 0x55a157cd12f0 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 10 client.16188 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 10 client.16188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 20 client.16188 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157cb8d80 0x55a1580b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 4 client.16188 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.653+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a158016600 con 0x55a157cb8d80 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.654+0000 7f5289400640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157cb8d80 0x55a1580b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.654+0000 7f5289400640 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157cb8d80 0x55a1580b7ea0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb7d1b4bb75b34a server_cookie=15cad3d717089927 in_seq=0 out_seq=0 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.654+0000 7f5277e00640 10 client.16188 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.655+0000 7f5277e00640 1 -- 172.21.15.79:0/2272729355 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a158016600 con 0x55a157cb8d80 2024-09-21T02:45:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.655+0000 7f5277e00640 10 client.16188 handle_command_reply: tid=0 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.655+0000 7f529fe53740 1 client.16188 shutdown 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.655+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 msgr2=0x55a1580aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.655+0000 7f529fe53740 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580aa770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f52840caf20 tx=0x7f528403b6e0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.655+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 shutdown_connections 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.655+0000 7f529fe53740 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157cb8d80 0x55a1580b7ea0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f529fe53740 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f529fe53740 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f529fe53740 1 --2- 172.21.15.79:0/2272729355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580aa770 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f5277e00640 0 client.16188 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 >> 172.21.15.79:0/2272729355 conn(0x55a157cee300 msgr2=0x55a15809d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 shutdown_connections 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f529fe53740 1 -- 172.21.15.79:0/2272729355 wait complete. 2024-09-21T02:45:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.656+0000 7f529fe53740 20 client.16188 trim_cache size 0 max 16384 2024-09-21T02:45:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 Processor -- start 2024-09-21T02:45:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 -- start start 2024-09-21T02:45:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cd94d0 0x55a15809c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cfa1b0 0x55a15809c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52941ac920 con 0x55a157cd12f0 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f52941af1a0 con 0x55a157cd94d0 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f529fe53740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52941acf90 con 0x55a157cfa1b0 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34514/0 (socket says 172.21.15.79:34514) 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.673+0000 7f5291e00640 1 -- 172.21.15.79:0/2224093865 learned_addr learned my addr 172.21.15.79:0/2224093865 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5289400640 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cd94d0 0x55a15809c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5292800640 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cfa1b0 0x55a15809c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5291e00640 1 -- 172.21.15.79:0/2224093865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cfa1b0 msgr2=0x55a15809c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5291e00640 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cfa1b0 0x55a15809c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5291e00640 1 -- 172.21.15.79:0/2224093865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cd94d0 msgr2=0x55a15809c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5291e00640 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cd94d0 0x55a15809c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5291e00640 1 -- 172.21.15.79:0/2224093865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1580ab5f0 con 0x55a157cd12f0 2024-09-21T02:45:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5291e00640 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a13d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f52840ca280 tx=0x7f52841081b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9222af7ffe95a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5282a00640 1 -- 172.21.15.79:0/2224093865 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284049070 con 0x55a157cd12f0 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5282a00640 1 -- 172.21.15.79:0/2224093865 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5284031e00 con 0x55a157cd12f0 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.674+0000 7f5282a00640 1 -- 172.21.15.79:0/2224093865 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840cd420 con 0x55a157cd12f0 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 -- 172.21.15.79:0/2224093865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 msgr2=0x55a1580a13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a13d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f52840ca280 tx=0x7f52841081b0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 -- 172.21.15.79:0/2224093865 shutdown_connections 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cfa1b0 0x55a15809c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cd94d0 0x55a15809c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 --2- 172.21.15.79:0/2224093865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580a13d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 -- 172.21.15.79:0/2224093865 >> 172.21.15.79:0/2224093865 conn(0x55a157cee300 msgr2=0x55a1580a0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 -- 172.21.15.79:0/2224093865 shutdown_connections 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.675+0000 7f529fe53740 1 -- 172.21.15.79:0/2224093865 wait complete. 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 -- start start 2024-09-21T02:45:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 Processor -- start 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52941ad660 con 0x55a157cd12f0 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f52941aead0 con 0x55a157cfa1b0 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52941add30 con 0x55a157cd94d0 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.676+0000 7f529fe53740 10 client.0 _ll_register_callbacks cb 0x7f5284005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5289400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34528/0 (socket says 172.21.15.79:34528) 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 -- 172.21.15.79:0/4030498723 learned_addr learned my addr 172.21.15.79:0/4030498723 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5292800640 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 -- 172.21.15.79:0/4030498723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 msgr2=0x55a1580b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 -- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 msgr2=0x55a1580b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 -- 172.21.15.79:0/4030498723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1580afc50 con 0x55a157cd12f0 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5289400640 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5291e00640 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580b1010 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f52840caf20 tx=0x7f5284005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbf6292bcc42a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.677+0000 7f5277e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f5277e00640 1 -- 172.21.15.79:0/4030498723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284049070 con 0x55a157cd12f0 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f5277e00640 1 -- 172.21.15.79:0/4030498723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f52840319a0 con 0x55a157cd12f0 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1580120b0 con 0x55a157cd12f0 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f5277e00640 1 -- 172.21.15.79:0/4030498723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f52840cd600 con 0x55a157cd12f0 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 10 client.16194 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a1580afc50 con 0x55a157cd12f0 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f5277e00640 1 -- 172.21.15.79:0/4030498723 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a1580120b0 con 0x55a157cd12f0 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f5277e00640 1 -- 172.21.15.79:0/4030498723 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f52840d2180 con 0x55a157cd12f0 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 10 client.16194 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 10 client.16194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 20 client.16194 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157c8e1c0 0x55a158125140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 4 client.16194 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.678+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a15800f4e0 con 0x55a157c8e1c0 2024-09-21T02:45:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.679+0000 7f5289400640 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157c8e1c0 0x55a158125140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.679+0000 7f5289400640 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157c8e1c0 0x55a158125140 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4239425471ac94f server_cookie=ec63ff538092ca0 in_seq=0 out_seq=0 2024-09-21T02:45:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.679+0000 7f5277e00640 10 client.16194 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f5277e00640 1 -- 172.21.15.79:0/4030498723 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a15800f4e0 con 0x55a157c8e1c0 2024-09-21T02:45:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f5277e00640 10 client.16194 handle_command_reply: tid=0 2024-09-21T02:45:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 client.16194 shutdown 2024-09-21T02:45:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 msgr2=0x55a1580b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580b1010 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f52840caf20 tx=0x7f5284005c90 comp rx=0 tx=0).stop 2024-09-21T02:45:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 shutdown_connections 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a157c8e1c0 0x55a158125140 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a157cfa1b0 0x55a1580b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f5277e00640 0 client.16194 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a157cd94d0 0x55a1580b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 --2- 172.21.15.79:0/4030498723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a157cd12f0 0x55a1580b1010 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.692+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 >> 172.21.15.79:0/4030498723 conn(0x55a157cee300 msgr2=0x55a15809c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.693+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 shutdown_connections 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.693+0000 7f529fe53740 1 -- 172.21.15.79:0/4030498723 wait complete. 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.693+0000 7f529fe53740 20 client.16194 trim_cache size 0 max 16384 2024-09-21T02:45:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:45:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:45:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:45:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:45:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.693+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f52780b6510 msgr2=0x7f52780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.693+0000 7f5298e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f52780b6510 0x7f52780b8a20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f528c011630 tx=0x7f528c009500 comp rx=0 tx=0).stop 2024-09-21T02:45:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.693+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 msgr2=0x7f5294076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.693+0000 7f5298e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294076e50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5284031440 tx=0x7f5284003c10 comp rx=0 tx=0).stop 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 shutdown_connections 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f52780b6510 0x7f52780b8a20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52941050c0 0x7f5294075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5294104720 0x7f5294075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 --2- 172.21.15.79:0/3654276100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52941036a0 0x7f5294076e50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 >> 172.21.15.79:0/3654276100 conn(0x7f52940fefe0 msgr2=0x7f5294107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 shutdown_connections 2024-09-21T02:45:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:31.694+0000 7f5298e00640 1 -- 172.21.15.79:0/3654276100 wait complete. 2024-09-21T02:45:31.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:31 smithi079 ceph-mon[30788]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 889 KiB/s wr, 109 op/s 2024-09-21T02:45:31.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:31 smithi148 ceph-mon[34626]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 889 KiB/s wr, 109 op/s 2024-09-21T02:45:32.499 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 37351c55 --release --await' 2024-09-21T02:45:32.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 37351c55 --release --await 2024-09-21T02:45:32.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:32 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1856160296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:32.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:32 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1856160296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:32.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:32 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1856160296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:32.867 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:33.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 -- 172.21.15.79:0/1662391539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 msgr2=0x7f9354075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 --2- 172.21.15.79:0/1662391539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f9354075bc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9344009900 tx=0x7f934402a410 comp rx=0 tx=0).stop 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 -- 172.21.15.79:0/1662391539 shutdown_connections 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 --2- 172.21.15.79:0/1662391539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935410ff10 0x7f9354112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 --2- 172.21.15.79:0/1662391539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 0x7f935410f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 --2- 172.21.15.79:0/1662391539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f9354075bc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 -- 172.21.15.79:0/1662391539 >> 172.21.15.79:0/1662391539 conn(0x7f93540ff440 msgr2=0x7f9354101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 -- 172.21.15.79:0/1662391539 shutdown_connections 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.642+0000 7f9359a00640 1 -- 172.21.15.79:0/1662391539 wait complete. 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.643+0000 7f9359a00640 1 Processor -- start 2024-09-21T02:45:33.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.643+0000 7f9359a00640 1 -- start start 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.643+0000 7f9359a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f935419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9359a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 0x7f935419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9359a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935410ff10 0x7f93541a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9359a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9354115ac0 con 0x7f93540757b0 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9359a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9354115940 con 0x7f935410ff10 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9359a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9354115c40 con 0x7f9354076100 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f935419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 0x7f935419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 0x7f935419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:38614/0 (socket says 172.21.15.79:38614) 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f935419c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34544/0 (socket says 172.21.15.79:34544) 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 -- 172.21.15.79:0/1995402091 learned_addr learned my addr 172.21.15.79:0/1995402091 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9359000640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935410ff10 0x7f93541a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 -- 172.21.15.79:0/1995402091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935410ff10 msgr2=0x7f93541a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935410ff10 0x7f93541a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 -- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 msgr2=0x7f935419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f935419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353400640 1 -- 172.21.15.79:0/1995402091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93541a2440 con 0x7f9354076100 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.644+0000 7f9353e00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f935419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.645+0000 7f9353400640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 0x7f935419ca70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f934000e9c0 tx=0x7f934000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.645+0000 7f9350c00640 1 -- 172.21.15.79:0/1995402091 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934000cd80 con 0x7f9354076100 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.645+0000 7f9350c00640 1 -- 172.21.15.79:0/1995402091 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93400035f0 con 0x7f9354076100 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.645+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93541a2730 con 0x7f9354076100 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.645+0000 7f9350c00640 1 -- 172.21.15.79:0/1995402091 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340010690 con 0x7f9354076100 2024-09-21T02:45:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.645+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93541a8e90 con 0x7f9354076100 2024-09-21T02:45:33.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 Processor -- start 2024-09-21T02:45:33.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 -- start start 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedccd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9350c00640 1 -- 172.21.15.79:0/1995402091 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f93400037a0 con 0x7f9354076100 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed8fd660 0x55afedccd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed905840 0x55afedccddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55afedc44290 con 0x55afed8fd660 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55afedc336c0 con 0x55afed926520 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9361de9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55afedc374d0 con 0x55afed905840 2024-09-21T02:45:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.649+0000 7f9353e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed8fd660 0x55afedccd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed8fd660 0x55afedccd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34550/0 (socket says 172.21.15.79:34550) 2024-09-21T02:45:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 -- 172.21.15.79:0/2519673446 learned_addr learned my addr 172.21.15.79:0/2519673446 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9359000640 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedccd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353400640 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed905840 0x55afedccddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 -- 172.21.15.79:0/2519673446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed905840 msgr2=0x55afedccddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed905840 0x55afedccddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 -- 172.21.15.79:0/2519673446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 msgr2=0x55afedccd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedccd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 -- 172.21.15.79:0/2519673446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afedbc0460 con 0x55afed8fd660 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9359000640 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedccd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.650+0000 7f9353e00640 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed8fd660 0x55afedccd880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9344009900 tx=0x7f9344005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd60826720a47e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.651+0000 7f9349600640 1 -- 172.21.15.79:0/2519673446 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344040070 con 0x55afed8fd660 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.651+0000 7f9349600640 1 -- 172.21.15.79:0/2519673446 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9344031720 con 0x55afed8fd660 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.651+0000 7f9349600640 1 -- 172.21.15.79:0/2519673446 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344035040 con 0x55afed8fd660 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.651+0000 7f9350c00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f93380b6590 0x7f93380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.651+0000 7f9350c00640 1 -- 172.21.15.79:0/1995402091 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f93400e7ae0 con 0x7f9354076100 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.651+0000 7f9359000640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f93380b6590 0x7f93380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 -- 172.21.15.79:0/2519673446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed8fd660 msgr2=0x55afedccd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed8fd660 0x55afedccd880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9344009900 tx=0x7f9344005e20 comp rx=0 tx=0).stop 2024-09-21T02:45:33.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 -- 172.21.15.79:0/2519673446 shutdown_connections 2024-09-21T02:45:33.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed905840 0x55afedccddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed8fd660 0x55afedccd880 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 --2- 172.21.15.79:0/2519673446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedccd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 -- 172.21.15.79:0/2519673446 >> 172.21.15.79:0/2519673446 conn(0x55afed91a910 msgr2=0x55afedccb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:33.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9359000640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f93380b6590 0x7f93380b8aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f934c005fd0 tx=0x7f934c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:33.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 -- 172.21.15.79:0/2519673446 shutdown_connections 2024-09-21T02:45:33.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.652+0000 7f9361de9740 1 -- 172.21.15.79:0/2519673446 wait complete. 2024-09-21T02:45:33.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.653+0000 7f9361de9740 1 -- start start 2024-09-21T02:45:33.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.653+0000 7f9361de9740 1 Processor -- start 2024-09-21T02:45:33.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9361de9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed8fd660 0x55afedcd8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9361de9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcd9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9361de9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed926520 0x55afedce4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9361de9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55afeda94bb0 con 0x55afed905840 2024-09-21T02:45:33.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9361de9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55afedbce6c0 con 0x55afed8fd660 2024-09-21T02:45:33.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9361de9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55afedcdbac0 con 0x55afed926520 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9361de9740 10 client.0 _ll_register_callbacks cb 0x55afedbe9490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcd9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcd9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34552/0 (socket says 172.21.15.79:34552) 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353400640 1 -- 172.21.15.79:0/3033589413 learned_addr learned my addr 172.21.15.79:0/3033589413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353e00640 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed8fd660 0x55afedcd8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9359000640 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed926520 0x55afedce4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353e00640 1 -- 172.21.15.79:0/3033589413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed926520 msgr2=0x55afedce4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353e00640 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed926520 0x55afedce4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353e00640 1 -- 172.21.15.79:0/3033589413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 msgr2=0x55afedcd9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353e00640 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcd9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.654+0000 7f9353e00640 1 -- 172.21.15.79:0/3033589413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afed991b00 con 0x55afed8fd660 2024-09-21T02:45:33.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.655+0000 7f9353e00640 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed8fd660 0x55afedcd8f00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f934402a930 tx=0x7f93440053f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947f65461da87c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:33.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.655+0000 7f933e000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:45:33.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.655+0000 7f933e000640 1 -- 172.21.15.79:0/3033589413 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934404b030 con 0x55afed8fd660 2024-09-21T02:45:33.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.655+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9344031720 con 0x55afed8fd660 2024-09-21T02:45:33.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.655+0000 7f933e000640 1 -- 172.21.15.79:0/3033589413 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9344031520 con 0x55afed8fd660 2024-09-21T02:45:33.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:33 smithi079 ceph-mon[30788]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-09-21T02:45:33.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f933e000640 1 -- 172.21.15.79:0/3033589413 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9344058050 con 0x55afed8fd660 2024-09-21T02:45:33.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 10 client.26432 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:33.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55afeda08960 con 0x55afed8fd660 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f933e000640 1 -- 172.21.15.79:0/3033589413 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9344031720 con 0x55afed8fd660 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f933e000640 1 -- 172.21.15.79:0/3033589413 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f93440524c0 con 0x55afed8fd660 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 10 client.26432 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 10 client.26432 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 20 client.26432 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8e4ea0 0x55afedceac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 4 client.26432 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.656+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afedc461e0 con 0x55afed8e4ea0 2024-09-21T02:45:33.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.657+0000 7f9353400640 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8e4ea0 0x55afedceac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.658+0000 7f933e000640 10 client.26432 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.658+0000 7f9353400640 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8e4ea0 0x55afedceac40 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3ce41f385617083 server_cookie=8cad8c6ff90a4438 in_seq=0 out_seq=0 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.658+0000 7f933e000640 1 -- 172.21.15.79:0/3033589413 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55afedc461e0 con 0x55afed8e4ea0 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.658+0000 7f933e000640 10 client.26432 handle_command_reply: tid=0 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.658+0000 7f9361de9740 1 client.26432 shutdown 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed8fd660 msgr2=0x55afedcd8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed8fd660 0x55afedcd8f00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f934402a930 tx=0x7f93440053f0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 shutdown_connections 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8e4ea0 0x55afedceac40 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed926520 0x55afedce4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcd9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f933e000640 0 client.26432 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 --2- 172.21.15.79:0/3033589413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed8fd660 0x55afedcd8f00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 >> 172.21.15.79:0/3033589413 conn(0x55afed91a910 msgr2=0x55afedcd04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:33.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 shutdown_connections 2024-09-21T02:45:33.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 1 -- 172.21.15.79:0/3033589413 wait complete. 2024-09-21T02:45:33.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.659+0000 7f9361de9740 20 client.26432 trim_cache size 0 max 16384 2024-09-21T02:45:33.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 Processor -- start 2024-09-21T02:45:33.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 -- start start 2024-09-21T02:45:33.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedccea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed905840 0x55afedcd25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed926520 0x55afedcd2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93541b0bb0 con 0x55afed926520 2024-09-21T02:45:33.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f93541b3430 con 0x55afed905840 2024-09-21T02:45:33.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.679+0000 7f9361de9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f93541b1220 con 0x55afed8fd660 2024-09-21T02:45:33.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9359000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed926520 0x55afedcd2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed905840 0x55afedcd25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed905840 0x55afedcd25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:45748/0 (socket says 172.21.15.79:45748) 2024-09-21T02:45:33.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9359000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed926520 0x55afedcd2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34554/0 (socket says 172.21.15.79:34554) 2024-09-21T02:45:33.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 -- 172.21.15.79:0/3185205499 learned_addr learned my addr 172.21.15.79:0/3185205499 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:33.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353e00640 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedccea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 -- 172.21.15.79:0/3185205499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 msgr2=0x55afedccea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedccea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 -- 172.21.15.79:0/3185205499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed926520 msgr2=0x55afedcd2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed926520 0x55afedcd2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 -- 172.21.15.79:0/3185205499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afedccf630 con 0x55afed905840 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.680+0000 7f9353400640 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed905840 0x55afedcd25a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f93400eb2c0 tx=0x7f93400eb4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52fdd0f7df82fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.681+0000 7f9348c00640 1 -- 172.21.15.79:0/3185205499 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93400a9700 con 0x55afed905840 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.681+0000 7f9348c00640 1 -- 172.21.15.79:0/3185205499 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93400ad370 con 0x55afed905840 2024-09-21T02:45:33.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.681+0000 7f9348c00640 1 -- 172.21.15.79:0/3185205499 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93400acfd0 con 0x55afed905840 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 -- 172.21.15.79:0/3185205499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed905840 msgr2=0x55afedcd25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed905840 0x55afedcd25a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f93400eb2c0 tx=0x7f93400eb4a0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 -- 172.21.15.79:0/3185205499 shutdown_connections 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed926520 0x55afedcd2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed905840 0x55afedcd25a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 --2- 172.21.15.79:0/3185205499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedccea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 -- 172.21.15.79:0/3185205499 >> 172.21.15.79:0/3185205499 conn(0x55afed91a910 msgr2=0x55afedcce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 -- 172.21.15.79:0/3185205499 shutdown_connections 2024-09-21T02:45:33.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 -- 172.21.15.79:0/3185205499 wait complete. 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.682+0000 7f9361de9740 1 -- start start 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 1 Processor -- start 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedcec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedd4e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93541b18f0 con 0x55afed905840 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f93541b2d60 con 0x55afed926520 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f93541b1fc0 con 0x55afed8fd660 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9361de9740 10 client.0 _ll_register_callbacks cb 0x7f934c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9353400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9353400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcecc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34570/0 (socket says 172.21.15.79:34570) 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9353e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedcec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9353400640 1 -- 172.21.15.79:0/2662023815 learned_addr learned my addr 172.21.15.79:0/2662023815 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:33.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.683+0000 7f9359000640 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedd4e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.684+0000 7f9353400640 1 -- 172.21.15.79:0/2662023815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 msgr2=0x55afedcec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.684+0000 7f9353400640 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedcec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.684+0000 7f9353400640 1 -- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 msgr2=0x55afedd4e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.684+0000 7f9353400640 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedd4e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.684+0000 7f9353400640 1 -- 172.21.15.79:0/2662023815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afedd4eae0 con 0x55afed905840 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.684+0000 7f9353400640 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcecc80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f93400ad7f0 tx=0x7f934000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275034a768219a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.684+0000 7f933e000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.685+0000 7f933e000640 1 -- 172.21.15.79:0/2662023815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93400ad1b0 con 0x55afed905840 2024-09-21T02:45:33.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.685+0000 7f933e000640 1 -- 172.21.15.79:0/2662023815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f93400aeb90 con 0x55afed905840 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.685+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93400ad370 con 0x55afed905840 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.685+0000 7f933e000640 1 -- 172.21.15.79:0/2662023815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f93400ad630 con 0x55afed905840 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.685+0000 7f9361de9740 10 client.16212 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.685+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55afedd55e60 con 0x55afed905840 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.685+0000 7f933e000640 1 -- 172.21.15.79:0/2662023815 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93400ad370 con 0x55afed905840 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f933e000640 1 -- 172.21.15.79:0/2662023815 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f93400a91b0 con 0x55afed905840 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9361de9740 10 client.16212 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9361de9740 10 client.16212 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9361de9740 20 client.16212 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9361de9740 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8ba250 0x55afedd585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9361de9740 4 client.16212 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "37351c55", "release": true, "await": true}] 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "37351c55", "release": true, "await": true}) -- 0x55afedc41c90 con 0x55afed8ba250 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9353e00640 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8ba250 0x55afedd585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:33.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f933e000640 10 client.16212 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:33.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.686+0000 7f9353e00640 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8ba250 0x55afedd585a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c184e3f7f114e308 server_cookie=da9639dd0f0c4196 in_seq=0 out_seq=0 2024-09-21T02:45:33.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.739+0000 7f933e000640 1 -- 172.21.15.79:0/2662023815 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55afedc41c90 con 0x55afed8ba250 2024-09-21T02:45:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.739+0000 7f933e000640 10 client.16212 handle_command_reply: tid=0 2024-09-21T02:45:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.739+0000 7f9361de9740 1 client.16212 shutdown 2024-09-21T02:45:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 msgr2=0x55afedcecc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcecc80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f93400ad7f0 tx=0x7f934000c7d0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 shutdown_connections 2024-09-21T02:45:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55afed8ba250 0x55afedd585a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55afed926520 0x55afedd4e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55afed905840 0x55afedcecc80 secure :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f93400ad7f0 tx=0x7f934000c7d0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 --2- 172.21.15.79:0/2662023815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55afed8fd660 0x55afedcec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f933e000640 0 client.16212 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.745+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 >> 172.21.15.79:0/2662023815 conn(0x55afed91a910 msgr2=0x55afedcd1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.746+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 shutdown_connections 2024-09-21T02:45:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.747+0000 7f9361de9740 1 -- 172.21.15.79:0/2662023815 wait complete. 2024-09-21T02:45:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.747+0000 7f9361de9740 20 client.16212 trim_cache size 0 max 16384 2024-09-21T02:45:33.750 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:45:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:45:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 40, 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "37351c55": { 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 40, 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 144.5, 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:45:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:33.752 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.749+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f93380b6590 msgr2=0x7f93380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.749+0000 7f9359a00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f93380b6590 0x7f93380b8aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f934c005fd0 tx=0x7f934c009500 comp rx=0 tx=0).stop 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.749+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 msgr2=0x7f935419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.749+0000 7f9359a00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 0x7f935419ca70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f934000e9c0 tx=0x7f934000ee80 comp rx=0 tx=0).stop 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 shutdown_connections 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f93380b6590 0x7f93380b8aa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935410ff10 0x7f93541a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354076100 0x7f935419ca70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 --2- 172.21.15.79:0/1995402091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93540757b0 0x7f935419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 >> 172.21.15.79:0/1995402091 conn(0x7f93540ff440 msgr2=0x7f9354109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 shutdown_connections 2024-09-21T02:45:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:33.750+0000 7f9359a00640 1 -- 172.21.15.79:0/1995402091 wait complete. 2024-09-21T02:45:33.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:33 smithi148 ceph-mon[34626]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-09-21T02:45:33.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:33 smithi098 ceph-mon[34832]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-09-21T02:45:34.673 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '37351c55', total seconds elapsed: 28.9 2024-09-21T02:45:34.673 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T02:45:34.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:45:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:35.750 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:35 smithi079 ceph-mon[30788]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-21T02:45:35.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:35 smithi098 ceph-mon[34832]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-21T02:45:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:35 smithi148 ceph-mon[34626]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-21T02:45:36.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.267+0000 7ff46e000640 1 -- 172.21.15.79:0/4288562735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 msgr2=0x7ff46806ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.267+0000 7ff46e000640 1 --2- 172.21.15.79:0/4288562735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 0x7ff46806ae60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff460013490 tx=0x7ff460032b10 comp rx=0 tx=0).stop 2024-09-21T02:45:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.269+0000 7ff46e000640 1 -- 172.21.15.79:0/4288562735 shutdown_connections 2024-09-21T02:45:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.269+0000 7ff46e000640 1 --2- 172.21.15.79:0/4288562735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 0x7ff46806ae60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.269+0000 7ff46e000640 1 --2- 172.21.15.79:0/4288562735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 0x7ff4681085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.269+0000 7ff46e000640 1 --2- 172.21.15.79:0/4288562735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4681028a0 0x7ff468102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.269+0000 7ff46e000640 1 -- 172.21.15.79:0/4288562735 >> 172.21.15.79:0/4288562735 conn(0x7ff4680fe2f0 msgr2=0x7ff468100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.271+0000 7ff46e000640 1 -- 172.21.15.79:0/4288562735 shutdown_connections 2024-09-21T02:45:36.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.271+0000 7ff46e000640 1 -- 172.21.15.79:0/4288562735 wait complete. 2024-09-21T02:45:36.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.272+0000 7ff46e000640 1 Processor -- start 2024-09-21T02:45:36.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.276+0000 7ff46e000640 1 -- start start 2024-09-21T02:45:36.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.277+0000 7ff46e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4681028a0 0x7ff468074eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:36.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.277+0000 7ff46e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 0x7ff46806e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:36.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.277+0000 7ff46e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 0x7ff46806e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:36.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.278+0000 7ff466a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 0x7ff46806e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:36.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.278+0000 7ff46e000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681117e0 con 0x7ff4681028a0 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.278+0000 7ff466a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 0x7ff46806e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:44176/0 (socket says 172.21.15.79:44176) 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.278+0000 7ff466a00640 1 -- 172.21.15.79:0/238084249 learned_addr learned my addr 172.21.15.79:0/238084249 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.278+0000 7ff467e00640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 0x7ff46806e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.278+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff468111660 con 0x7ff4681081e0 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.278+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff468111960 con 0x7ff468108b30 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.279+0000 7ff466a00640 1 -- 172.21.15.79:0/238084249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 msgr2=0x7ff46806e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.279+0000 7ff466a00640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 0x7ff46806e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.279+0000 7ff466a00640 1 -- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4681028a0 msgr2=0x7ff468074eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.279+0000 7ff466a00640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4681028a0 0x7ff468074eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.279+0000 7ff466a00640 1 -- 172.21.15.79:0/238084249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46806ef70 con 0x7ff4681081e0 2024-09-21T02:45:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.279+0000 7ff466a00640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 0x7ff46806e180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff45400e970 tx=0x7ff45400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:36.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.280+0000 7ff45fe00640 1 -- 172.21.15.79:0/238084249 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45400cd80 con 0x7ff4681081e0 2024-09-21T02:45:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.280+0000 7ff45fe00640 1 -- 172.21.15.79:0/238084249 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4540035f0 con 0x7ff4681081e0 2024-09-21T02:45:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.280+0000 7ff45fe00640 1 -- 172.21.15.79:0/238084249 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454010690 con 0x7ff4681081e0 2024-09-21T02:45:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.280+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff468073c40 con 0x7ff4681081e0 2024-09-21T02:45:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.281+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff468074130 con 0x7ff4681081e0 2024-09-21T02:45:36.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.284+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4681085f0 con 0x7ff4681081e0 2024-09-21T02:45:36.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.289+0000 7ff45fe00640 1 -- 172.21.15.79:0/238084249 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff454004020 con 0x7ff4681081e0 2024-09-21T02:45:36.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.293+0000 7ff45fe00640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff44c0b6590 0x7ff44c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:36.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.293+0000 7ff45fe00640 1 -- 172.21.15.79:0/238084249 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff4540e79a0 con 0x7ff4681081e0 2024-09-21T02:45:36.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.296+0000 7ff467400640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff44c0b6590 0x7ff44c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:36.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.297+0000 7ff467400640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff44c0b6590 0x7ff44c0b8aa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff4580096f0 tx=0x7ff458006c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:36.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.299+0000 7ff45fe00640 1 -- 172.21.15.79:0/238084249 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4540ade80 con 0x7ff4681081e0 2024-09-21T02:45:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 580.0 s, 259.2 tps, lat 1526.722 ms stddev 4615.953 2024-09-21T02:45:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.709+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4680744b0 con 0x7ff4681081e0 2024-09-21T02:45:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.710+0000 7ff45fe00640 1 -- 172.21.15.79:0/238084249 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7ff4540ade80 con 0x7ff4681081e0 2024-09-21T02:45:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:45:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:45:36.713 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:45:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.714+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff44c0b6590 msgr2=0x7ff44c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.714+0000 7ff46e000640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff44c0b6590 0x7ff44c0b8aa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff4580096f0 tx=0x7ff458006c40 comp rx=0 tx=0).stop 2024-09-21T02:45:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.714+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 msgr2=0x7ff46806e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.714+0000 7ff46e000640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 0x7ff46806e180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff45400e970 tx=0x7ff45400ee30 comp rx=0 tx=0).stop 2024-09-21T02:45:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 shutdown_connections 2024-09-21T02:45:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff44c0b6590 0x7ff44c0b8aa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff468108b30 0x7ff46806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4681081e0 0x7ff46806e180 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 --2- 172.21.15.79:0/238084249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4681028a0 0x7ff468074eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 >> 172.21.15.79:0/238084249 conn(0x7ff4680fe2f0 msgr2=0x7ff468105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 shutdown_connections 2024-09-21T02:45:36.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:36.717+0000 7ff46e000640 1 -- 172.21.15.79:0/238084249 wait complete. 2024-09-21T02:45:37.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:37 smithi079 ceph-mon[30788]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 163 KiB/s wr, 24 op/s 2024-09-21T02:45:37.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:37 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/238084249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:37 smithi098 ceph-mon[34832]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 163 KiB/s wr, 24 op/s 2024-09-21T02:45:37.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:37 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/238084249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:37.995 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T02:45:37.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T02:45:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:37 smithi148 ceph-mon[34626]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 163 KiB/s wr, 24 op/s 2024-09-21T02:45:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:37 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/238084249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:38.845 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:39.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:39 smithi098 ceph-mon[34832]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 549 KiB/s wr, 55 op/s 2024-09-21T02:45:39.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:39 smithi079 ceph-mon[30788]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 549 KiB/s wr, 55 op/s 2024-09-21T02:45:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:39 smithi148 ceph-mon[34626]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 549 KiB/s wr, 55 op/s 2024-09-21T02:45:40.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 -- 172.21.15.79:0/1163294603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b20116640 msgr2=0x7f2b20118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:40.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 --2- 172.21.15.79:0/1163294603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b20116640 0x7f2b20118b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009ca0 tx=0x7f2b1802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 -- 172.21.15.79:0/1163294603 shutdown_connections 2024-09-21T02:45:40.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 --2- 172.21.15.79:0/1163294603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b20116640 0x7f2b20118b50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 --2- 172.21.15.79:0/1163294603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b2010af40 0x7f2b20115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 --2- 172.21.15.79:0/1163294603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b2010a5f0 0x7f2b2010aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 -- 172.21.15.79:0/1163294603 >> 172.21.15.79:0/1163294603 conn(0x7f2b200712b0 msgr2=0x7f2b20073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:40.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.846+0000 7f2b26e00640 1 -- 172.21.15.79:0/1163294603 shutdown_connections 2024-09-21T02:45:40.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.847+0000 7f2b26e00640 1 -- 172.21.15.79:0/1163294603 wait complete. 2024-09-21T02:45:40.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.848+0000 7f2b26e00640 1 Processor -- start 2024-09-21T02:45:40.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b26e00640 1 -- start start 2024-09-21T02:45:40.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b26e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b2010a5f0 0x7f2b201a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b26e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b2010af40 0x7f2b201a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b26e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20116640 0x7f2b201a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b26e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2011c310 con 0x7f2b2010af40 2024-09-21T02:45:40.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b26e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2011c190 con 0x7f2b2010a5f0 2024-09-21T02:45:40.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b26e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2011c490 con 0x7f2b20116640 2024-09-21T02:45:40.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b1f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b2010af40 0x7f2b201a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b24e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20116640 0x7f2b201a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b24e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20116640 0x7f2b201a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51476/0 (socket says 172.21.15.79:51476) 2024-09-21T02:45:40.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.849+0000 7f2b24e00640 1 -- 172.21.15.79:0/938125568 learned_addr learned my addr 172.21.15.79:0/938125568 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:40.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.850+0000 7f2b24e00640 1 -- 172.21.15.79:0/938125568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b2010a5f0 msgr2=0x7f2b201a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:40.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.850+0000 7f2b24e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b2010a5f0 0x7f2b201a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.850+0000 7f2b24e00640 1 -- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b2010af40 msgr2=0x7f2b201a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:40.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.850+0000 7f2b24e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b2010af40 0x7f2b201a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.850+0000 7f2b24e00640 1 -- 172.21.15.79:0/938125568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b201a8ad0 con 0x7f2b20116640 2024-09-21T02:45:40.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.850+0000 7f2b1f400640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b2010af40 0x7f2b201a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:40.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.850+0000 7f2b24e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20116640 0x7f2b201a2260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b18005e30 tx=0x7f2b18031c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:40.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.851+0000 7f2b1cc00640 1 -- 172.21.15.79:0/938125568 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18003cf0 con 0x7f2b20116640 2024-09-21T02:45:40.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.851+0000 7f2b1cc00640 1 -- 172.21.15.79:0/938125568 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b180044f0 con 0x7f2b20116640 2024-09-21T02:45:40.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.851+0000 7f2b1cc00640 1 -- 172.21.15.79:0/938125568 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18003cf0 con 0x7f2b20116640 2024-09-21T02:45:40.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.851+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b201a8d60 con 0x7f2b20116640 2024-09-21T02:45:40.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.851+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b201a9190 con 0x7f2b20116640 2024-09-21T02:45:40.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.857+0000 7f2b2da2b740 1 Processor -- start 2024-09-21T02:45:40.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.858+0000 7f2b1cc00640 1 -- 172.21.15.79:0/938125568 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2b18004040 con 0x7f2b20116640 2024-09-21T02:45:40.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.860+0000 7f2b2da2b740 1 -- start start 2024-09-21T02:45:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.860+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.860+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370beca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.860+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.861+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56370be3fca0 con 0x56370baf9980 2024-09-21T02:45:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.861+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56370be2f0d0 con 0x56370bb01b60 2024-09-21T02:45:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.861+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56370be32ee0 con 0x56370bb22840 2024-09-21T02:45:40.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.863+0000 7f2b1fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370beca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.863+0000 7f2b1fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370beca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56772/0 (socket says 172.21.15.79:56772) 2024-09-21T02:45:40.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.863+0000 7f2b1f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.863+0000 7f2b1f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51484/0 (socket says 172.21.15.79:51484) 2024-09-21T02:45:40.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.863+0000 7f2b1f400640 1 -- 172.21.15.79:0/2991399761 learned_addr learned my addr 172.21.15.79:0/2991399761 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:40.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1cc00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b040b6790 0x7f2b040b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1f400640 1 -- 172.21.15.79:0/2991399761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 msgr2=0x56370becadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:40.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1f400640 1 -- 172.21.15.79:0/2991399761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 msgr2=0x56370beca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:40.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370beca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1cc00640 1 -- 172.21.15.79:0/938125568 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2b181084d0 con 0x7f2b20116640 2024-09-21T02:45:40.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.864+0000 7f2b1f400640 1 -- 172.21.15.79:0/2991399761 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56370bde1400 con 0x56370bb22840 2024-09-21T02:45:40.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.866+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beca350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009fc0 tx=0x7f2b10009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbbc580ee5849338 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:40.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.866+0000 7f2b24e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b040b6790 0x7f2b040b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.866+0000 7f2b15600640 1 -- 172.21.15.79:0/2991399761 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10004230 con 0x56370bb22840 2024-09-21T02:45:40.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.866+0000 7f2b15600640 1 -- 172.21.15.79:0/2991399761 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b100043d0 con 0x56370bb22840 2024-09-21T02:45:40.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.866+0000 7f2b15600640 1 -- 172.21.15.79:0/2991399761 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b100109e0 con 0x56370bb22840 2024-09-21T02:45:40.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2991399761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 msgr2=0x56370beca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:40.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beca350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009fc0 tx=0x7f2b10009770 comp rx=0 tx=0).stop 2024-09-21T02:45:40.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b24e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b040b6790 0x7f2b040b8ca0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2b18105c20 tx=0x7f2b1802a8c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:40.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2991399761 shutdown_connections 2024-09-21T02:45:40.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370beca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2991399761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beca350 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.869+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2991399761 >> 172.21.15.79:0/2991399761 conn(0x56370bb16990 msgr2=0x56370bec8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:40.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.870+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2991399761 shutdown_connections 2024-09-21T02:45:40.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.870+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2991399761 wait complete. 2024-09-21T02:45:40.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.870+0000 7f2b2da2b740 1 -- start start 2024-09-21T02:45:40.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.871+0000 7f2b2da2b740 1 Processor -- start 2024-09-21T02:45:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.871+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.871+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb01b60 0x56370bed5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.871+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb22840 0x56370bee1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.871+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56370bc907a0 con 0x56370baf9980 2024-09-21T02:45:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.871+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56370bdd4a10 con 0x56370bb22840 2024-09-21T02:45:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.871+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56370bed8b30 con 0x56370bb01b60 2024-09-21T02:45:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.872+0000 7f2b2da2b740 10 client.0 _ll_register_callbacks cb 0x56370bde4be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:40.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.872+0000 7f2b1fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb01b60 0x56370bed5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.872+0000 7f2b1fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb01b60 0x56370bed5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51498/0 (socket says 172.21.15.79:51498) 2024-09-21T02:45:40.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.872+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2437104546 learned_addr learned my addr 172.21.15.79:0/2437104546 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:40.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.873+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb22840 msgr2=0x56370bee1e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:45:40.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.873+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb22840 0x56370bee1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.873+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.873+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb22840 0x56370bee1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.873+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2437104546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 msgr2=0x56370bed5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:40.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.874+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.874+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2437104546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56370bb9cb90 con 0x56370bb01b60 2024-09-21T02:45:40.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.874+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:45:40.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.874+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb01b60 0x56370bed5fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c011690 tx=0x7f2b0c011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16008877a1fcf143 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:40.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.874+0000 7f2b0a000640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:45:40.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.875+0000 7f2b0a000640 1 -- 172.21.15.79:0/2437104546 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c01f060 con 0x56370bb01b60 2024-09-21T02:45:40.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.875+0000 7f2b0a000640 1 -- 172.21.15.79:0/2437104546 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2b0c00fac0 con 0x56370bb01b60 2024-09-21T02:45:40.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.875+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b100043d0 con 0x56370bb01b60 2024-09-21T02:45:40.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.875+0000 7f2b0a000640 1 -- 172.21.15.79:0/2437104546 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2b0c026050 con 0x56370bb01b60 2024-09-21T02:45:40.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.875+0000 7f2b2da2b740 10 client.26473 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:40.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.875+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56370bee4920 con 0x56370bb01b60 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b0a000640 1 -- 172.21.15.79:0/2437104546 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b100043d0 con 0x56370bb01b60 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b0a000640 1 -- 172.21.15.79:0/2437104546 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2b0c012c70 con 0x56370bb01b60 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b2da2b740 10 client.26473 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b2da2b740 10 client.26473 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b2da2b740 20 client.26473 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bae11c0 0x56370bee7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b2da2b740 4 client.26473 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:40.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.876+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56370be41bf0 con 0x56370bae11c0 2024-09-21T02:45:40.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.877+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bae11c0 0x56370bee7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.877+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bae11c0 0x56370bee7e30 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a28ab027f4464c4 server_cookie=fdf33de86101b555 in_seq=0 out_seq=0 2024-09-21T02:45:40.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.877+0000 7f2b0a000640 10 client.26473 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:40.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.878+0000 7f2b0a000640 1 -- 172.21.15.79:0/2437104546 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56370be41bf0 con 0x56370bae11c0 2024-09-21T02:45:40.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.878+0000 7f2b0a000640 10 client.26473 handle_command_reply: tid=0 2024-09-21T02:45:40.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.878+0000 7f2b2da2b740 1 client.26473 shutdown 2024-09-21T02:45:40.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.879+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb01b60 msgr2=0x56370bed5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:40.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.879+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb01b60 0x56370bed5fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c011690 tx=0x7f2b0c011b50 comp rx=0 tx=0).stop 2024-09-21T02:45:40.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 shutdown_connections 2024-09-21T02:45:40.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bae11c0 0x56370bee7e30 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb22840 0x56370bee1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb01b60 0x56370bed5fd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2437104546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 >> 172.21.15.79:0/2437104546 conn(0x56370bb16990 msgr2=0x56370bec69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:40.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b0a000640 0 client.26473 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:40.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.880+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 shutdown_connections 2024-09-21T02:45:40.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.881+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2437104546 wait complete. 2024-09-21T02:45:40.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.881+0000 7f2b2da2b740 20 client.26473 trim_cache size 0 max 16384 2024-09-21T02:45:40.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.915+0000 7f2b2da2b740 1 Processor -- start 2024-09-21T02:45:40.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.916+0000 7f2b2da2b740 1 -- start start 2024-09-21T02:45:40.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.916+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370baf9980 0x56370bed7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.916+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.916+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370bb22840 0x56370bee1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.916+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201c6160 con 0x56370bb22840 2024-09-21T02:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.916+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201c89e0 con 0x56370bb01b60 2024-09-21T02:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.916+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201c67d0 con 0x56370baf9980 2024-09-21T02:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370baf9980 0x56370bed7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:44212/0 (socket says 172.21.15.79:44212) 2024-09-21T02:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2463715551 learned_addr learned my addr 172.21.15.79:0/2463715551 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2463715551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370baf9980 msgr2=0x56370bed7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2463715551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370baf9980 0x56370bed7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2463715551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370bb22840 msgr2=0x56370bee1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2463715551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370bb22840 0x56370bee1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 -- 172.21.15.79:0/2463715551 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56370bae13f0 con 0x56370bb01b60 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.917+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2463715551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becbd40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c01a510 tx=0x7f2b0c009d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c4219383e04fb89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.918+0000 7f2b14c00640 1 -- 172.21.15.79:0/2463715551 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c004300 con 0x56370bb01b60 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.918+0000 7f2b14c00640 1 -- 172.21.15.79:0/2463715551 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0c02f070 con 0x56370bb01b60 2024-09-21T02:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.918+0000 7f2b14c00640 1 -- 172.21.15.79:0/2463715551 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c004c80 con 0x56370bb01b60 2024-09-21T02:45:40.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.919+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2463715551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 msgr2=0x56370becbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:40.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.919+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2463715551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becbd40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c01a510 tx=0x7f2b0c009d10 comp rx=0 tx=0).stop 2024-09-21T02:45:40.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.921+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2463715551 shutdown_connections 2024-09-21T02:45:40.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.921+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2463715551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370bb22840 0x56370bee1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.921+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2463715551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370becbd40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.921+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2463715551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370baf9980 0x56370bed7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.921+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2463715551 >> 172.21.15.79:0/2463715551 conn(0x56370bb16990 msgr2=0x56370bed4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:40.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.921+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2463715551 shutdown_connections 2024-09-21T02:45:40.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.921+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2463715551 wait complete. 2024-09-21T02:45:40.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.922+0000 7f2b2da2b740 1 -- start start 2024-09-21T02:45:40.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.922+0000 7f2b2da2b740 1 Processor -- start 2024-09-21T02:45:40.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.924+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.924+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370beda410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.924+0000 7f2b1f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.926+0000 7f2b1f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56790/0 (socket says 172.21.15.79:56790) 2024-09-21T02:45:40.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.924+0000 7f2b2da2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beda950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.925+0000 7f2b1fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370beda410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.926+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201c6ea0 con 0x56370baf9980 2024-09-21T02:45:40.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.926+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201c8310 con 0x56370bb01b60 2024-09-21T02:45:40.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.926+0000 7f2b2da2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201c7570 con 0x56370bb22840 2024-09-21T02:45:40.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.926+0000 7f2b2da2b740 10 client.0 _ll_register_callbacks cb 0x7f2b0c0095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:40.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.926+0000 7f2b1f400640 1 -- 172.21.15.79:0/2574957828 learned_addr learned my addr 172.21.15.79:0/2574957828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:40.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.926+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beda950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.927+0000 7f2b1f400640 1 -- 172.21.15.79:0/2574957828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 msgr2=0x56370beda950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.927+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beda950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.927+0000 7f2b1f400640 1 -- 172.21.15.79:0/2574957828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 msgr2=0x56370beda410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.927+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370beda410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.927+0000 7f2b1f400640 1 -- 172.21.15.79:0/2574957828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56370bf51970 con 0x56370baf9980 2024-09-21T02:45:40.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.929+0000 7f2b1f400640 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed9ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2b10010510 tx=0x7f2b10009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72217a5e1f79106 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:40.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.929+0000 7f2b0a000640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:40.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.931+0000 7f2b0a000640 1 -- 172.21.15.79:0/2574957828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1003a060 con 0x56370baf9980 2024-09-21T02:45:40.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.931+0000 7f2b0a000640 1 -- 172.21.15.79:0/2574957828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2b10010a60 con 0x56370baf9980 2024-09-21T02:45:40.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.931+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b0c02f070 con 0x56370baf9980 2024-09-21T02:45:40.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.932+0000 7f2b0a000640 1 -- 172.21.15.79:0/2574957828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2b10010c60 con 0x56370baf9980 2024-09-21T02:45:40.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.932+0000 7f2b2da2b740 10 client.16224 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:40.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.932+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56370bf52bd0 con 0x56370baf9980 2024-09-21T02:45:40.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b0a000640 1 -- 172.21.15.79:0/2574957828 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0c02f070 con 0x56370baf9980 2024-09-21T02:45:40.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b0a000640 1 -- 172.21.15.79:0/2574957828 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2b1001c020 con 0x56370baf9980 2024-09-21T02:45:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b2da2b740 10 client.16224 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:40.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b2da2b740 10 client.16224 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b2da2b740 20 client.16224 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bab6570 0x56370bf55220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b2da2b740 4 client.16224 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T02:45:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.933+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x56370be3d6a0 con 0x56370bab6570 2024-09-21T02:45:40.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.934+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bab6570 0x56370bf55220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:40.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.936+0000 7f2b1fe00640 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bab6570 0x56370bf55220 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83b71114c0aac013 server_cookie=873ce72b41e8eeb in_seq=0 out_seq=0 2024-09-21T02:45:40.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:40.936+0000 7f2b0a000640 10 client.16224 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:41.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.268+0000 7f2b0a000640 1 -- 172.21.15.79:0/2574957828 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56370be3d6a0 con 0x56370bab6570 2024-09-21T02:45:41.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b0a000640 10 client.16224 handle_command_reply: tid=0 2024-09-21T02:45:41.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 client.16224 shutdown 2024-09-21T02:45:41.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 msgr2=0x56370bed9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:41.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed9ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2b10010510 tx=0x7f2b10009f30 comp rx=0 tx=0).stop 2024-09-21T02:45:41.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 shutdown_connections 2024-09-21T02:45:41.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56370bab6570 0x56370bf55220 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56370bb22840 0x56370beda950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56370bb01b60 0x56370beda410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b0a000640 0 client.16224 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 --2- 172.21.15.79:0/2574957828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56370baf9980 0x56370bed9ed0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 >> 172.21.15.79:0/2574957828 conn(0x56370bb16990 msgr2=0x56370becbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 shutdown_connections 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 1 -- 172.21.15.79:0/2574957828 wait complete. 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.269+0000 7f2b2da2b740 20 client.16224 trim_cache size 0 max 16384 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:45:41.272 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 42, 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "13d6b322": { 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 42, 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 144.5, 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:45:41.273 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:45:41.274 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.270+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b040b6790 msgr2=0x7f2b040b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.270+0000 7f2b26e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b040b6790 0x7f2b040b8ca0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2b18105c20 tx=0x7f2b1802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.270+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20116640 msgr2=0x7f2b201a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.270+0000 7f2b26e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20116640 0x7f2b201a2260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b18005e30 tx=0x7f2b18031c90 comp rx=0 tx=0).stop 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 shutdown_connections 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2b040b6790 0x7f2b040b8ca0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b20116640 0x7f2b201a2260 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b2010af40 0x7f2b201a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 --2- 172.21.15.79:0/938125568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b2010a5f0 0x7f2b201a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 >> 172.21.15.79:0/938125568 conn(0x7f2b200712b0 msgr2=0x7f2b2010de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:41.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 shutdown_connections 2024-09-21T02:45:41.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:45:41.271+0000 7f2b26e00640 1 -- 172.21.15.79:0/938125568 wait complete. 2024-09-21T02:45:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 585.0 s, 463.6 tps, lat 194.035 ms stddev 238.760 2024-09-21T02:45:41.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:41 smithi098 ceph-mon[34832]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1017 KiB/s wr, 114 op/s 2024-09-21T02:45:41.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:41 smithi079 ceph-mon[30788]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1017 KiB/s wr, 114 op/s 2024-09-21T02:45:42.027 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '13d6b322', quiesce took 7.4 seconds. Will release after: 17.1 2024-09-21T02:45:42.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:41 smithi148 ceph-mon[34626]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1017 KiB/s wr, 114 op/s 2024-09-21T02:45:43.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:43 smithi098 ceph-mon[34832]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-21T02:45:43.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:43 smithi079 ceph-mon[30788]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-21T02:45:44.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:43 smithi148 ceph-mon[34626]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-21T02:45:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 -- 172.21.15.79:0/1363835418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d01058d0 msgr2=0x7f30d0105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 --2- 172.21.15.79:0/1363835418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d01058d0 0x7f30d0105d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009900 tx=0x7f30c002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 -- 172.21.15.79:0/1363835418 shutdown_connections 2024-09-21T02:45:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 --2- 172.21.15.79:0/1363835418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01072f0 0x7f30d010dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 --2- 172.21.15.79:0/1363835418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30d0106950 0x7f30d0106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 --2- 172.21.15.79:0/1363835418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d01058d0 0x7f30d0105d40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 -- 172.21.15.79:0/1363835418 >> 172.21.15.79:0/1363835418 conn(0x7f30d0101230 msgr2=0x7f30d01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 -- 172.21.15.79:0/1363835418 shutdown_connections 2024-09-21T02:45:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.975+0000 7f30d5800640 1 -- 172.21.15.79:0/1363835418 wait complete. 2024-09-21T02:45:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.976+0000 7f30d5800640 1 Processor -- start 2024-09-21T02:45:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30d5800640 1 -- start start 2024-09-21T02:45:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30d5800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01058d0 0x7f30d019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30d5800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d0106950 0x7f30d019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30d5800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30d01072f0 0x7f30d019d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30d5800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01114f0 con 0x7f30d01058d0 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30d5800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30d0111370 con 0x7f30d01072f0 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30d5800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f30d0111670 con 0x7f30d0106950 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30cea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01058d0 0x7f30d019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30cea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01058d0 0x7f30d019c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52040/0 (socket says 172.21.15.79:52040) 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30cea00640 1 -- 172.21.15.79:0/1580822042 learned_addr learned my addr 172.21.15.79:0/1580822042 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30c7e00640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d0106950 0x7f30d019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.977+0000 7f30cf400640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30d01072f0 0x7f30d019d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30cea00640 1 -- 172.21.15.79:0/1580822042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d0106950 msgr2=0x7f30d019c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30cea00640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d0106950 0x7f30d019c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30cea00640 1 -- 172.21.15.79:0/1580822042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30d01072f0 msgr2=0x7f30d019d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30cea00640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30d01072f0 0x7f30d019d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30cea00640 1 -- 172.21.15.79:0/1580822042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d019dbb0 con 0x7f30d01058d0 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30cf400640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30d01072f0 0x7f30d019d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30cea00640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01058d0 0x7f30d019c170 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006010 tx=0x7f30c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30c7400640 1 -- 172.21.15.79:0/1580822042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c003f030 con 0x7f30d01058d0 2024-09-21T02:45:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30c7400640 1 -- 172.21.15.79:0/1580822042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c0032e50 con 0x7f30d01058d0 2024-09-21T02:45:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d019de40 con 0x7f30d01058d0 2024-09-21T02:45:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.978+0000 7f30c7400640 1 -- 172.21.15.79:0/1580822042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0035070 con 0x7f30d01058d0 2024-09-21T02:45:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.979+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d019e150 con 0x7f30d01058d0 2024-09-21T02:45:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 Processor -- start 2024-09-21T02:45:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 -- start start 2024-09-21T02:45:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30c7400640 1 -- 172.21.15.79:0/1580822042 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f30c0042030 con 0x7f30d01058d0 2024-09-21T02:45:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd0a2f0 0x56055d0da740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0db290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56055d04d6b0 con 0x56055cd124d0 2024-09-21T02:45:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56055d03cae0 con 0x56055cd331b0 2024-09-21T02:45:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.982+0000 7f30dc9da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56055d0408f0 con 0x56055cd0a2f0 2024-09-21T02:45:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0db290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd0a2f0 0x56055d0da740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cf400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0db290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52044/0 (socket says 172.21.15.79:52044) 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30c7e00640 1 -- 172.21.15.79:0/1559429329 learned_addr learned my addr 172.21.15.79:0/1559429329 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cf400640 1 -- 172.21.15.79:0/1559429329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd0a2f0 msgr2=0x56055d0da740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cf400640 1 --2- 172.21.15.79:0/1559429329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd0a2f0 0x56055d0da740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cf400640 1 -- 172.21.15.79:0/1559429329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 msgr2=0x56055d0db290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cf400640 1 --2- 172.21.15.79:0/1559429329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0db290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cf400640 1 -- 172.21.15.79:0/1559429329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055d009780 con 0x56055cd331b0 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.983+0000 7f30cf400640 1 --2- 172.21.15.79:0/1559429329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0da0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005fd0 tx=0x7f30c8010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c39d7702233ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.984+0000 7f30bfe00640 1 -- 172.21.15.79:0/1559429329 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8011700 con 0x56055cd331b0 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.984+0000 7f30bfe00640 1 -- 172.21.15.79:0/1559429329 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c8015070 con 0x56055cd331b0 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.984+0000 7f30bfe00640 1 -- 172.21.15.79:0/1559429329 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c801bc00 con 0x56055cd331b0 2024-09-21T02:45:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.984+0000 7f30c7400640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30b40b6510 0x7f30b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.984+0000 7f30c7400640 1 -- 172.21.15.79:0/1580822042 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f30c0107c80 con 0x7f30d01058d0 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.984+0000 7f30cea00640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30b40b6510 0x7f30b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 -- 172.21.15.79:0/1559429329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 msgr2=0x56055d0da0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 --2- 172.21.15.79:0/1559429329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0da0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005fd0 tx=0x7f30c8010860 comp rx=0 tx=0).stop 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 -- 172.21.15.79:0/1559429329 shutdown_connections 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 --2- 172.21.15.79:0/1559429329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0db290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 --2- 172.21.15.79:0/1559429329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd0a2f0 0x56055d0da740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 --2- 172.21.15.79:0/1559429329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0da0d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 -- 172.21.15.79:0/1559429329 >> 172.21.15.79:0/1559429329 conn(0x56055cd27300 msgr2=0x56055d0d5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 -- 172.21.15.79:0/1559429329 shutdown_connections 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30cea00640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30b40b6510 0x7f30b40b8a20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f30c00cd9f0 tx=0x7f30c010b750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 -- 172.21.15.79:0/1559429329 wait complete. 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.985+0000 7f30dc9da740 1 -- start start 2024-09-21T02:45:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 1 Processor -- start 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd0a2f0 0x56055d0e3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0e4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56055cf74ab0 con 0x56055cd0a2f0 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56055cfe3570 con 0x56055cd331b0 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56055d0dbdb0 con 0x56055cd124d0 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30dc9da740 10 client.0 _ll_register_callbacks cb 0x56055cff2100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30cf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd0a2f0 0x56055d0e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30cf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd0a2f0 0x56055d0e3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52060/0 (socket says 172.21.15.79:52060) 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.986+0000 7f30cf400640 1 -- 172.21.15.79:0/2674367997 learned_addr learned my addr 172.21.15.79:0/2674367997 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30c7e00640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30cf400640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30cf400640 1 -- 172.21.15.79:0/2674367997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 msgr2=0x56055d0e3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30cf400640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0e3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30cf400640 1 -- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 msgr2=0x56055d0e4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30cf400640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0e4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30cf400640 1 -- 172.21.15.79:0/2674367997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56055cd9e790 con 0x56055cd0a2f0 2024-09-21T02:45:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30c7e00640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0e3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30cf400640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd0a2f0 0x56055d0e3700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000f80 tx=0x7f30c8009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2522b0f97cc2515 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30bcc00640 1 -- 172.21.15.79:0/2674367997 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c801bcb0 con 0x56055cd0a2f0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30bcc00640 1 -- 172.21.15.79:0/2674367997 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f30c8003970 con 0x56055cd0a2f0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.987+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c8015070 con 0x56055cd0a2f0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30bcc00640 1 -- 172.21.15.79:0/2674367997 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f30c8033050 con 0x56055cd0a2f0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 10 client.16236 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56055ce17620 con 0x56055cd0a2f0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30bcc00640 1 -- 172.21.15.79:0/2674367997 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c8015070 con 0x56055cd0a2f0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30bcc00640 1 -- 172.21.15.79:0/2674367997 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f30c80046a0 con 0x56055cd0a2f0 2024-09-21T02:45:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 10 client.16236 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 10 client.16236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 20 client.16236 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccf1d80 0x56055d0f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 4 client.16236 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.988+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56055d04f600 con 0x56055ccf1d80 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.989+0000 7f30c7e00640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccf1d80 0x56055d0f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.989+0000 7f30c7e00640 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccf1d80 0x56055d0f0ad0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13288bbcc93a70f0 server_cookie=a7e6d9812a0a9bb4 in_seq=0 out_seq=0 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.989+0000 7f30bcc00640 10 client.16236 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30bcc00640 1 -- 172.21.15.79:0/2674367997 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56055d04f600 con 0x56055ccf1d80 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30bcc00640 10 client.16236 handle_command_reply: tid=0 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 client.16236 shutdown 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd0a2f0 msgr2=0x56055d0e3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd0a2f0 0x56055d0e3700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000f80 tx=0x7f30c8009bc0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 shutdown_connections 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccf1d80 0x56055d0f0ad0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd331b0 0x56055d0e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0e3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 --2- 172.21.15.79:0/2674367997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd0a2f0 0x56055d0e3700 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30bcc00640 0 client.16236 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.990+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 >> 172.21.15.79:0/2674367997 conn(0x56055cd27300 msgr2=0x56055d0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.991+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 shutdown_connections 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.991+0000 7f30dc9da740 1 -- 172.21.15.79:0/2674367997 wait complete. 2024-09-21T02:45:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:44.991+0000 7f30dc9da740 20 client.16236 trim_cache size 0 max 16384 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 Processor -- start 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 -- start start 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0d50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd331b0 0x56055d0d5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01ac940 con 0x56055cd331b0 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01af1c0 con 0x56055cd0a2f0 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30dc9da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01acfb0 con 0x56055cd124d0 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30cf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd331b0 0x56055d0d5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30cf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd331b0 0x56055d0d5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52064/0 (socket says 172.21.15.79:52064) 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30cf400640 1 -- 172.21.15.79:0/3703908622 learned_addr learned my addr 172.21.15.79:0/3703908622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30c7e00640 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0d50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.006+0000 7f30cf400640 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30cf400640 1 -- 172.21.15.79:0/3703908622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 msgr2=0x56055d0d50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30cf400640 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0d50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30cf400640 1 -- 172.21.15.79:0/3703908622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 msgr2=0x56055d0da3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30cf400640 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0da3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30cf400640 1 -- 172.21.15.79:0/3703908622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055d0dbc90 con 0x56055cd331b0 2024-09-21T02:45:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30c7e00640 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0d50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30cf400640 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd331b0 0x56055d0d5630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f30c801b480 tx=0x7f30c8013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0e595cc9e2e6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30bf400640 1 -- 172.21.15.79:0/3703908622 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8011910 con 0x56055cd331b0 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30bf400640 1 -- 172.21.15.79:0/3703908622 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c8015070 con 0x56055cd331b0 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.007+0000 7f30bf400640 1 -- 172.21.15.79:0/3703908622 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8003970 con 0x56055cd331b0 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 -- 172.21.15.79:0/3703908622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd331b0 msgr2=0x56055d0d5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd331b0 0x56055d0d5630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f30c801b480 tx=0x7f30c8013040 comp rx=0 tx=0).stop 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 -- 172.21.15.79:0/3703908622 shutdown_connections 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd331b0 0x56055d0d5630 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd124d0 0x56055d0d50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3703908622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0da3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 -- 172.21.15.79:0/3703908622 >> 172.21.15.79:0/3703908622 conn(0x56055cd27300 msgr2=0x56055d0d9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 -- 172.21.15.79:0/3703908622 shutdown_connections 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.008+0000 7f30dc9da740 1 -- 172.21.15.79:0/3703908622 wait complete. 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 -- start start 2024-09-21T02:45:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 Processor -- start 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0eade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd331b0 0x56055d0e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01ad680 con 0x56055cd124d0 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01aeaf0 con 0x56055cd0a2f0 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01add50 con 0x56055cd331b0 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30dc9da740 10 client.0 _ll_register_callbacks cb 0x7f30b80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30cf400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0eade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30c7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0e9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52072/0 (socket says 172.21.15.79:52072) 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.009+0000 7f30c7e00640 1 -- 172.21.15.79:0/3534282956 learned_addr learned my addr 172.21.15.79:0/3534282956 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30cf400640 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd331b0 0x56055d0e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30c7e00640 1 -- 172.21.15.79:0/3534282956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd331b0 msgr2=0x56055d0e9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30c7e00640 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd331b0 0x56055d0e9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30c7e00640 1 -- 172.21.15.79:0/3534282956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 msgr2=0x56055d0eade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30c7e00640 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0eade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30c7e00640 1 -- 172.21.15.79:0/3534282956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56055d0ea5a0 con 0x56055cd124d0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30c7e00640 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0e9aa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f30b80125e0 tx=0x7f30b8012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9028810365bc74ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.010+0000 7f30bcc00640 1 -- 172.21.15.79:0/3534282956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8028070 con 0x56055cd124d0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c8015070 con 0x56055cd124d0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30bcc00640 1 -- 172.21.15.79:0/3534282956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f30b8010c70 con 0x56055cd124d0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30bcc00640 1 -- 172.21.15.79:0/3534282956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f30b8031050 con 0x56055cd124d0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 10 client.16242 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56055d15b3b0 con 0x56055cd124d0 2024-09-21T02:45:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30bcc00640 1 -- 172.21.15.79:0/3534282956 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c8015070 con 0x56055cd124d0 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30bcc00640 1 -- 172.21.15.79:0/3534282956 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f30b802b020 con 0x56055cd124d0 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 10 client.16242 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 10 client.16242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 20 client.16242 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccc71c0 0x56055d15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 4 client.16242 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.011+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56055d04b0b0 con 0x56055ccc71c0 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.012+0000 7f30cf400640 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccc71c0 0x56055d15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.012+0000 7f30cf400640 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccc71c0 0x56055d15dcb0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdfb0ddf62af37c3 server_cookie=49c4cfa50926c6f6 in_seq=0 out_seq=0 2024-09-21T02:45:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.012+0000 7f30bcc00640 10 client.16242 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30bcc00640 1 -- 172.21.15.79:0/3534282956 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56055d04b0b0 con 0x56055ccc71c0 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30bcc00640 10 client.16242 handle_command_reply: tid=0 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 client.16242 shutdown 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 msgr2=0x56055d0e9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0e9aa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f30b80125e0 tx=0x7f30b8012b80 comp rx=0 tx=0).stop 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 shutdown_connections 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56055ccc71c0 0x56055d15dcb0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56055cd331b0 0x56055d0e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56055cd124d0 0x56055d0e9aa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 --2- 172.21.15.79:0/3534282956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56055cd0a2f0 0x56055d0eade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30bcc00640 0 client.16242 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 >> 172.21.15.79:0/3534282956 conn(0x56055cd27300 msgr2=0x56055d0de9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.024+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 shutdown_connections 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30dc9da740 1 -- 172.21.15.79:0/3534282956 wait complete. 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30dc9da740 20 client.16242 trim_cache size 0 max 16384 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:45:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:45:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:45:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30b40b6510 msgr2=0x7f30b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30b40b6510 0x7f30b40b8a20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f30c00cd9f0 tx=0x7f30c010b750 comp rx=0 tx=0).stop 2024-09-21T02:45:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01058d0 msgr2=0x7f30d019c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01058d0 0x7f30d019c170 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006010 tx=0x7f30c00042f0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 shutdown_connections 2024-09-21T02:45:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f30b40b6510 0x7f30b40b8a20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30d01072f0 0x7f30d019d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30d0106950 0x7f30d019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 --2- 172.21.15.79:0/1580822042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30d01058d0 0x7f30d019c170 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.025+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 >> 172.21.15.79:0/1580822042 conn(0x7f30d0101230 msgr2=0x7f30d0109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.026+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 shutdown_connections 2024-09-21T02:45:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:45.026+0000 7f30d5800640 1 -- 172.21.15.79:0/1580822042 wait complete. 2024-09-21T02:45:45.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:45 smithi098 ceph-mon[34832]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.3 MiB/s wr, 265 op/s 2024-09-21T02:45:45.914 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:45 smithi079 ceph-mon[30788]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.3 MiB/s wr, 265 op/s 2024-09-21T02:45:46.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:45 smithi148 ceph-mon[34626]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.3 MiB/s wr, 265 op/s 2024-09-21T02:45:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:45:47.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:47 smithi098 ceph-mon[34832]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.6 MiB/s wr, 289 op/s 2024-09-21T02:45:47.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:47 smithi079 ceph-mon[30788]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.6 MiB/s wr, 289 op/s 2024-09-21T02:45:48.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:47 smithi148 ceph-mon[34626]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.6 MiB/s wr, 289 op/s 2024-09-21T02:45:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:49 smithi098 ceph-mon[34832]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.4 MiB/s wr, 268 op/s 2024-09-21T02:45:49.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:49 smithi079 ceph-mon[30788]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.4 MiB/s wr, 268 op/s 2024-09-21T02:45:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:49 smithi148 ceph-mon[34626]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.4 MiB/s wr, 268 op/s 2024-09-21T02:45:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:45:51.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:51 smithi098 ceph-mon[34832]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 241 op/s 2024-09-21T02:45:51.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:51 smithi079 ceph-mon[30788]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 241 op/s 2024-09-21T02:45:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:51 smithi148 ceph-mon[34626]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 241 op/s 2024-09-21T02:45:53.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:53 smithi098 ceph-mon[34832]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2024-09-21T02:45:53.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:53 smithi079 ceph-mon[30788]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2024-09-21T02:45:54.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:53 smithi148 ceph-mon[34626]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2024-09-21T02:45:55.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:55 smithi098 ceph-mon[34832]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 886 KiB/s wr, 95 op/s 2024-09-21T02:45:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:55 smithi079 ceph-mon[30788]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 886 KiB/s wr, 95 op/s 2024-09-21T02:45:56.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:55 smithi148 ceph-mon[34626]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 886 KiB/s wr, 95 op/s 2024-09-21T02:45:56.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:45:57.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:57 smithi098 ceph-mon[34832]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 233 KiB/s wr, 31 op/s 2024-09-21T02:45:57.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:57 smithi079 ceph-mon[30788]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 233 KiB/s wr, 31 op/s 2024-09-21T02:45:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:57 smithi148 ceph-mon[34626]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 233 KiB/s wr, 31 op/s 2024-09-21T02:45:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.219+0000 7f908fe00640 1 -- 172.21.15.79:0/1090748185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9090107070 msgr2=0x7f9090107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.219+0000 7f908fe00640 1 --2- 172.21.15.79:0/1090748185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9090107070 0x7f9090107570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9088009ca0 tx=0x7f908802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.220+0000 7f908fe00640 1 -- 172.21.15.79:0/1090748185 shutdown_connections 2024-09-21T02:45:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.220+0000 7f908fe00640 1 --2- 172.21.15.79:0/1090748185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9090107070 0x7f9090107570 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.220+0000 7f908fe00640 1 --2- 172.21.15.79:0/1090748185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90901044b0 0x7f9090106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.220+0000 7f908fe00640 1 --2- 172.21.15.79:0/1090748185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f909006b710 0x7f9090103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.220+0000 7f908fe00640 1 -- 172.21.15.79:0/1090748185 >> 172.21.15.79:0/1090748185 conn(0x7f90900fdd80 msgr2=0x7f9090100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.220+0000 7f908fe00640 1 -- 172.21.15.79:0/1090748185 shutdown_connections 2024-09-21T02:45:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.220+0000 7f908fe00640 1 -- 172.21.15.79:0/1090748185 wait complete. 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 Processor -- start 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 -- start start 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f909006b710 0x7f90901a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90901044b0 0x7f90901a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9090107070 0x7f90901a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9090115750 con 0x7f9090107070 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90901155d0 con 0x7f90901044b0 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908fe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f90901158d0 con 0x7f909006b710 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9090107070 0x7f90901a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9090107070 0x7f90901a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53988/0 (socket says 172.21.15.79:53988) 2024-09-21T02:45:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908f400640 1 -- 172.21.15.79:0/3207818179 learned_addr learned my addr 172.21.15.79:0/3207818179 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908ea00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f909006b710 0x7f90901a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.221+0000 7f908e000640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90901044b0 0x7f90901a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f908f400640 1 -- 172.21.15.79:0/3207818179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f909006b710 msgr2=0x7f90901a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f908f400640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f909006b710 0x7f90901a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f908f400640 1 -- 172.21.15.79:0/3207818179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90901044b0 msgr2=0x7f90901a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f908f400640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90901044b0 0x7f90901a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f908f400640 1 -- 172.21.15.79:0/3207818179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90901a1d90 con 0x7f9090107070 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f908f400640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9090107070 0x7f90901a1570 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9088004af0 tx=0x7f9088031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f9087400640 1 -- 172.21.15.79:0/3207818179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088003b70 con 0x7f9090107070 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f9087400640 1 -- 172.21.15.79:0/3207818179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9088003d10 con 0x7f9090107070 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90901a2020 con 0x7f9090107070 2024-09-21T02:45:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.222+0000 7f9087400640 1 -- 172.21.15.79:0/3207818179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908802fb20 con 0x7f9090107070 2024-09-21T02:45:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.223+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90901a8770 con 0x7f9090107070 2024-09-21T02:45:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.226+0000 7f909c5cf740 1 Processor -- start 2024-09-21T02:45:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.227+0000 7f9087400640 1 -- 172.21.15.79:0/3207818179 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9088004580 con 0x7f9090107070 2024-09-21T02:45:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.227+0000 7f909c5cf740 1 -- start start 2024-09-21T02:45:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.227+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933ad1b0 0x55df937542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.227+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93754920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.227+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93755470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f909c5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55df936c76b0 con 0x55df933842f0 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f909c5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55df936b6ae0 con 0x55df933ad1b0 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f909c5cf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55df936ba8f0 con 0x55df9338c4d0 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93754920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93754920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54002/0 (socket says 172.21.15.79:54002) 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908ea00640 1 -- 172.21.15.79:0/2868248350 learned_addr learned my addr 172.21.15.79:0/2868248350 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908e000640 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933ad1b0 0x55df937542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908e000640 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93755470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908e000640 1 -- 172.21.15.79:0/2868248350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 msgr2=0x55df93755470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908e000640 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93755470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908e000640 1 -- 172.21.15.79:0/2868248350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 msgr2=0x55df93754920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908e000640 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93754920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908e000640 1 -- 172.21.15.79:0/2868248350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df93683780 con 0x55df933ad1b0 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.228+0000 7f908ea00640 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93754920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.229+0000 7f908e000640 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933ad1b0 0x55df937542b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f907c0097e0 tx=0x7f907c009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdea681f590e0e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.229+0000 7f9087400640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90740b6510 0x7f90740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.229+0000 7f907b400640 1 -- 172.21.15.79:0/2868248350 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c004030 con 0x55df933ad1b0 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.229+0000 7f907b400640 1 -- 172.21.15.79:0/2868248350 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c005020 con 0x55df933ad1b0 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.229+0000 7f907b400640 1 -- 172.21.15.79:0/2868248350 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c004b20 con 0x55df933ad1b0 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.229+0000 7f9087400640 1 -- 172.21.15.79:0/3207818179 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9088108c40 con 0x7f9090107070 2024-09-21T02:45:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.229+0000 7f908ea00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90740b6510 0x7f90740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f908ea00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90740b6510 0x7f90740b8a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9080012560 tx=0x7f9080005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 -- 172.21.15.79:0/2868248350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933ad1b0 msgr2=0x55df937542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933ad1b0 0x55df937542b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f907c0097e0 tx=0x7f907c009770 comp rx=0 tx=0).stop 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 -- 172.21.15.79:0/2868248350 shutdown_connections 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93755470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93754920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 --2- 172.21.15.79:0/2868248350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933ad1b0 0x55df937542b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 -- 172.21.15.79:0/2868248350 >> 172.21.15.79:0/2868248350 conn(0x55df933a1300 msgr2=0x55df9374fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 -- 172.21.15.79:0/2868248350 shutdown_connections 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.230+0000 7f909c5cf740 1 -- 172.21.15.79:0/2868248350 wait complete. 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 -- start start 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 Processor -- start 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df9375d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df9338c4d0 0x55df9375e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df933ad1b0 0x55df9375eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55df935eeab0 con 0x55df933842f0 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55df9365d570 con 0x55df9338c4d0 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.231+0000 7f909c5cf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55df93755f90 con 0x55df933ad1b0 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f909c5cf740 10 client.0 _ll_register_callbacks cb 0x55df9366c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df9338c4d0 0x55df9375e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df9338c4d0 0x55df9375e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53656/0 (socket says 172.21.15.79:53656) 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 -- 172.21.15.79:0/274692876 learned_addr learned my addr 172.21.15.79:0/274692876 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908ea00640 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df9375d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908f400640 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df933ad1b0 0x55df9375eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 -- 172.21.15.79:0/274692876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df933ad1b0 msgr2=0x55df9375eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df933ad1b0 0x55df9375eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 -- 172.21.15.79:0/274692876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 msgr2=0x55df9375d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df9375d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 -- 172.21.15.79:0/274692876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df93418790 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f908e000640 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df9338c4d0 0x55df9375e010 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f907c005ff0 tx=0x7f907c0056a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3047beac2b4fd68a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.232+0000 7f906fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f906fe00640 1 -- 172.21.15.79:0/274692876 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c02d060 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f907c005020 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f906fe00640 1 -- 172.21.15.79:0/274692876 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f907c004180 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f906fe00640 1 -- 172.21.15.79:0/274692876 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f907c034050 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f909c5cf740 10 client.26486 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55df93491620 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f906fe00640 1 -- 172.21.15.79:0/274692876 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c005020 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.233+0000 7f906fe00640 1 -- 172.21.15.79:0/274692876 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f907c027030 con 0x55df9338c4d0 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.234+0000 7f909c5cf740 10 client.26486 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.234+0000 7f909c5cf740 10 client.26486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.234+0000 7f909c5cf740 20 client.26486 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.234+0000 7f909c5cf740 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df9336bd80 0x55df9376ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.234+0000 7f909c5cf740 4 client.26486 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.234+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df936c9600 con 0x55df9336bd80 2024-09-21T02:45:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.234+0000 7f908ea00640 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df9336bd80 0x55df9376ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.235+0000 7f906fe00640 10 client.26486 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.235+0000 7f908ea00640 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df9336bd80 0x55df9376ae10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a4895427d8a92 server_cookie=4b76af488c021876 in_seq=0 out_seq=0 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.235+0000 7f906fe00640 1 -- 172.21.15.79:0/274692876 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df936c9600 con 0x55df9336bd80 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.235+0000 7f906fe00640 10 client.26486 handle_command_reply: tid=0 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.235+0000 7f909c5cf740 1 client.26486 shutdown 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df9338c4d0 msgr2=0x55df9375e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df9338c4d0 0x55df9375e010 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f907c005ff0 tx=0x7f907c0056a0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 shutdown_connections 2024-09-21T02:45:58.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df9336bd80 0x55df9376ae10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df933ad1b0 0x55df9375eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df9338c4d0 0x55df9375e010 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 --2- 172.21.15.79:0/274692876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df9375d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f906fe00640 0 client.26486 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 >> 172.21.15.79:0/274692876 conn(0x55df933a1300 msgr2=0x55df9374e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 shutdown_connections 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 1 -- 172.21.15.79:0/274692876 wait complete. 2024-09-21T02:45:58.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.236+0000 7f909c5cf740 20 client.26486 trim_cache size 0 max 16384 2024-09-21T02:45:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 Processor -- start 2024-09-21T02:45:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 -- start start 2024-09-21T02:45:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933a1300 0x55df9374aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93765a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df9375be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b0b40 con 0x55df933842f0 2024-09-21T02:45:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b33c0 con 0x55df933a1300 2024-09-21T02:45:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f909c5cf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b11b0 con 0x55df9338c4d0 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f908e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93765a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f908e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93765a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54024/0 (socket says 172.21.15.79:54024) 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f908e000640 1 -- 172.21.15.79:0/1113700247 learned_addr learned my addr 172.21.15.79:0/1113700247 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.251+0000 7f908ea00640 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933a1300 0x55df9374aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908f400640 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df9375be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908e000640 1 -- 172.21.15.79:0/1113700247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 msgr2=0x55df9375be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908e000640 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df9375be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908e000640 1 -- 172.21.15.79:0/1113700247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933a1300 msgr2=0x55df9374aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908e000640 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933a1300 0x55df9374aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908e000640 1 -- 172.21.15.79:0/1113700247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9375eef0 con 0x55df933842f0 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908f400640 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df9375be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f908e000640 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93765a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f907c0057c0 tx=0x7f907c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0c90baa7b45837 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f907aa00640 1 -- 172.21.15.79:0/1113700247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c00fd10 con 0x55df933842f0 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f907aa00640 1 -- 172.21.15.79:0/1113700247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c003aa0 con 0x55df933842f0 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.252+0000 7f907aa00640 1 -- 172.21.15.79:0/1113700247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c01f6a0 con 0x55df933842f0 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 -- 172.21.15.79:0/1113700247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 msgr2=0x55df93765a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93765a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f907c0057c0 tx=0x7f907c011660 comp rx=0 tx=0).stop 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 -- 172.21.15.79:0/1113700247 shutdown_connections 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df9375be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933842f0 0x55df93765a60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 --2- 172.21.15.79:0/1113700247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933a1300 0x55df9374aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 -- 172.21.15.79:0/1113700247 >> 172.21.15.79:0/1113700247 conn(0x55df93754b80 msgr2=0x55df93755140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 -- 172.21.15.79:0/1113700247 shutdown_connections 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 -- 172.21.15.79:0/1113700247 wait complete. 2024-09-21T02:45:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.253+0000 7f909c5cf740 1 -- start start 2024-09-21T02:45:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 1 Processor -- start 2024-09-21T02:45:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933842f0 0x55df937653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93764080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933a1300 0x55df937645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b1880 con 0x55df933a1300 2024-09-21T02:45:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b2cf0 con 0x55df933842f0 2024-09-21T02:45:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b1f50 con 0x55df9338c4d0 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f909c5cf740 10 client.0 _ll_register_callbacks cb 0x7f9080009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f908f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933a1300 0x55df937645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f908f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933a1300 0x55df937645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54038/0 (socket says 172.21.15.79:54038) 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f908f400640 1 -- 172.21.15.79:0/3040462555 learned_addr learned my addr 172.21.15.79:0/3040462555 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.254+0000 7f908e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93764080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908ea00640 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933842f0 0x55df937653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908f400640 1 -- 172.21.15.79:0/3040462555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 msgr2=0x55df93764080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908f400640 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93764080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908f400640 1 -- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933842f0 msgr2=0x55df937653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908f400640 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933842f0 0x55df937653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908f400640 1 -- 172.21.15.79:0/3040462555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df93764b00 con 0x55df933a1300 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908ea00640 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933842f0 0x55df937653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f908f400640 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933a1300 0x55df937645c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f90880cbba0 tx=0x7f90880ce790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e34e0e5aa9668d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f906fe00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:45:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f906fe00640 1 -- 172.21.15.79:0/3040462555 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880ca0a0 con 0x55df933a1300 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f906fe00640 1 -- 172.21.15.79:0/3040462555 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f90880cc910 con 0x55df933a1300 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f907c003aa0 con 0x55df933a1300 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f906fe00640 1 -- 172.21.15.79:0/3040462555 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f908802fec0 con 0x55df933a1300 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f909c5cf740 10 client.16260 fetch_fsmap learned FSMap version 21 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.255+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55df93763970 con 0x55df933a1300 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f906fe00640 1 -- 172.21.15.79:0/3040462555 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c003aa0 con 0x55df933a1300 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f906fe00640 1 -- 172.21.15.79:0/3040462555 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f90880e4b70 con 0x55df933a1300 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f909c5cf740 10 client.16260 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f909c5cf740 10 client.16260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f909c5cf740 20 client.16260 populate_metadata read hostname 'smithi079' 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f909c5cf740 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df933ad1b0 0x55df937d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f909c5cf740 4 client.16260 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df936c50b0 con 0x55df933ad1b0 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.256+0000 7f908ea00640 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df933ad1b0 0x55df937d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.257+0000 7f908ea00640 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df933ad1b0 0x55df937d7fe0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82048a22e801e661 server_cookie=eca7712d9754c489 in_seq=0 out_seq=0 2024-09-21T02:45:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.257+0000 7f906fe00640 10 client.16260 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f906fe00640 1 -- 172.21.15.79:0/3040462555 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df936c50b0 con 0x55df933ad1b0 2024-09-21T02:45:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f906fe00640 10 client.16260 handle_command_reply: tid=0 2024-09-21T02:45:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 client.16260 shutdown 2024-09-21T02:45:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933a1300 msgr2=0x55df937645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933a1300 0x55df937645c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f90880cbba0 tx=0x7f90880ce790 comp rx=0 tx=0).stop 2024-09-21T02:45:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 shutdown_connections 2024-09-21T02:45:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55df933ad1b0 0x55df937d7fe0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df933a1300 0x55df937645c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df9338c4d0 0x55df93764080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f906fe00640 0 client.16260 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 --2- 172.21.15.79:0/3040462555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df933842f0 0x55df937653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.271+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 >> 172.21.15.79:0/3040462555 conn(0x55df93754b80 msgr2=0x55df9375be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 shutdown_connections 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f909c5cf740 1 -- 172.21.15.79:0/3040462555 wait complete. 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f909c5cf740 20 client.16260 trim_cache size 0 max 16384 2024-09-21T02:45:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:45:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:45:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:45:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:45:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90740b6510 msgr2=0x7f90740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90740b6510 0x7f90740b8a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9080012560 tx=0x7f9080005f90 comp rx=0 tx=0).stop 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9090107070 msgr2=0x7f90901a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9090107070 0x7f90901a1570 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9088004af0 tx=0x7f9088031700 comp rx=0 tx=0).stop 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 shutdown_connections 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f90740b6510 0x7f90740b8a20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9090107070 0x7f90901a1570 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90901044b0 0x7f90901a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 --2- 172.21.15.79:0/3207818179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f909006b710 0x7f90901a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.272+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 >> 172.21.15.79:0/3207818179 conn(0x7f90900fdd80 msgr2=0x7f90901053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.273+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 shutdown_connections 2024-09-21T02:45:58.277 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:45:58.273+0000 7f908fe00640 1 -- 172.21.15.79:0/3207818179 wait complete. 2024-09-21T02:45:59.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:45:59.566 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:59.885 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:45:59 smithi079 ceph-mon[30788]: pgmap v722: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.4 KiB/s wr, 5 op/s 2024-09-21T02:45:59.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:45:59 smithi098 ceph-mon[34832]: pgmap v722: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.4 KiB/s wr, 5 op/s 2024-09-21T02:46:00.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:45:59 smithi148 ceph-mon[34626]: pgmap v722: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.4 KiB/s wr, 5 op/s 2024-09-21T02:46:00.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.214+0000 7f9d9a400640 1 -- 172.21.15.79:0/109000774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 msgr2=0x7f9d94105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:00.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.214+0000 7f9d9a400640 1 --2- 172.21.15.79:0/109000774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 0x7f9d94105fc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009900 tx=0x7f9d8402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.214+0000 7f9d9a400640 1 -- 172.21.15.79:0/109000774 shutdown_connections 2024-09-21T02:46:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.214+0000 7f9d9a400640 1 --2- 172.21.15.79:0/109000774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d9410be40 0x7f9d94112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.214+0000 7f9d9a400640 1 --2- 172.21.15.79:0/109000774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 0x7f9d9410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.214+0000 7f9d9a400640 1 --2- 172.21.15.79:0/109000774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 0x7f9d94105fc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.214+0000 7f9d9a400640 1 -- 172.21.15.79:0/109000774 >> 172.21.15.79:0/109000774 conn(0x7f9d94101680 msgr2=0x7f9d94103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.215+0000 7f9d9a400640 1 -- 172.21.15.79:0/109000774 shutdown_connections 2024-09-21T02:46:00.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.215+0000 7f9d9a400640 1 -- 172.21.15.79:0/109000774 wait complete. 2024-09-21T02:46:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 Processor -- start 2024-09-21T02:46:00.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 -- start start 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 0x7f9d9419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 0x7f9d9419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d9410be40 0x7f9d941a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94115b00 con 0x7f9d9410b4f0 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94115980 con 0x7f9d94105bb0 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d9a400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94115c80 con 0x7f9d9410be40 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d8be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 0x7f9d9419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d8be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 0x7f9d9419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54056/0 (socket says 172.21.15.79:54056) 2024-09-21T02:46:00.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d99000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 0x7f9d9419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.216+0000 7f9d8be00640 1 -- 172.21.15.79:0/92695656 learned_addr learned my addr 172.21.15.79:0/92695656 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d99a00640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d9410be40 0x7f9d941a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d8be00640 1 -- 172.21.15.79:0/92695656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d9410be40 msgr2=0x7f9d941a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d8be00640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d9410be40 0x7f9d941a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d8be00640 1 -- 172.21.15.79:0/92695656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 msgr2=0x7f9d9419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d8be00640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 0x7f9d9419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d8be00640 1 -- 172.21.15.79:0/92695656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d941a2440 con 0x7f9d9410b4f0 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d99a00640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d9410be40 0x7f9d941a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:46:00.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d99000640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 0x7f9d9419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.217+0000 7f9d8be00640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 0x7f9d9419ca70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00e970 tx=0x7f9d7c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.218+0000 7f9d92000640 1 -- 172.21.15.79:0/92695656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00cd80 con 0x7f9d9410b4f0 2024-09-21T02:46:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.218+0000 7f9d92000640 1 -- 172.21.15.79:0/92695656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d7c0035f0 con 0x7f9d9410b4f0 2024-09-21T02:46:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.218+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d941a2730 con 0x7f9d9410b4f0 2024-09-21T02:46:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.218+0000 7f9d92000640 1 -- 172.21.15.79:0/92695656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c010690 con 0x7f9d9410b4f0 2024-09-21T02:46:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.218+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d941a8e90 con 0x7f9d9410b4f0 2024-09-21T02:46:00.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.219+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d94105fc0 con 0x7f9d9410b4f0 2024-09-21T02:46:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.221+0000 7f9d92000640 1 -- 172.21.15.79:0/92695656 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9d7c003aa0 con 0x7f9d9410b4f0 2024-09-21T02:46:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.223+0000 7f9d92000640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d780b6510 0x7f9d780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.223+0000 7f9d92000640 1 -- 172.21.15.79:0/92695656 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9d7c0e7b20 con 0x7f9d9410b4f0 2024-09-21T02:46:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.223+0000 7f9d99000640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d780b6510 0x7f9d780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.224+0000 7f9d99000640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d780b6510 0x7f9d780b8a20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9d84031440 tx=0x7f9d84032ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.225+0000 7f9d92000640 1 -- 172.21.15.79:0/92695656 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d7c0adfa0 con 0x7f9d9410b4f0 2024-09-21T02:46:00.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.448+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d9419d600 con 0x7f9d9410b4f0 2024-09-21T02:46:00.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.449+0000 7f9d92000640 1 -- 172.21.15.79:0/92695656 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f9d9419d600 con 0x7f9d9410b4f0 2024-09-21T02:46:00.451 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:46:00.451 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:46:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:46:00.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.452+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d780b6510 msgr2=0x7f9d780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:00.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.452+0000 7f9d9a400640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d780b6510 0x7f9d780b8a20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9d84031440 tx=0x7f9d84032ed0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.452+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 msgr2=0x7f9d9419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:00.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.452+0000 7f9d9a400640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 0x7f9d9419ca70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00e970 tx=0x7f9d7c00ee30 comp rx=0 tx=0).stop 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 shutdown_connections 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9d780b6510 0x7f9d780b8a20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d9410be40 0x7f9d941a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9410b4f0 0x7f9d9419ca70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 --2- 172.21.15.79:0/92695656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d94105bb0 0x7f9d9419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 >> 172.21.15.79:0/92695656 conn(0x7f9d94101680 msgr2=0x7f9d94103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 shutdown_connections 2024-09-21T02:46:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:00.453+0000 7f9d9a400640 1 -- 172.21.15.79:0/92695656 wait complete. 2024-09-21T02:46:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:00 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/92695656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:46:00.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:00 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/92695656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:46:01.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:00 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/92695656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:46:01.263 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 13d6b322 --release --await' 2024-09-21T02:46:01.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 13d6b322 --release --await 2024-09-21T02:46:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:46:01.657 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:46:01.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:01 smithi098 ceph-mon[34832]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-09-21T02:46:01.973 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:01 smithi079 ceph-mon[30788]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-09-21T02:46:02.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:01 smithi148 ceph-mon[34626]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 -- 172.21.15.79:0/1397298578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 msgr2=0x7f2c88112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/1397298578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 0x7f2c88112840 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009ca0 tx=0x7f2c8002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 -- 172.21.15.79:0/1397298578 shutdown_connections 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/1397298578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 0x7f2c88112840 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/1397298578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c8810b6c0 0x7f2c8810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/1397298578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 0x7f2c88106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 -- 172.21.15.79:0/1397298578 >> 172.21.15.79:0/1397298578 conn(0x7f2c88101810 msgr2=0x7f2c88103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 -- 172.21.15.79:0/1397298578 shutdown_connections 2024-09-21T02:46:02.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.335+0000 7f2c8ea00640 1 -- 172.21.15.79:0/1397298578 wait complete. 2024-09-21T02:46:02.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.336+0000 7f2c8ea00640 1 Processor -- start 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.336+0000 7f2c8ea00640 1 -- start start 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c8ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 0x7f2c8819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c8ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c8810b6c0 0x7f2c8819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c8ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 0x7f2c881a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c8ea00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88115d20 con 0x7f2c8810c010 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c8ea00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88115ba0 con 0x7f2c88105d80 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c8ea00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88115ea0 con 0x7f2c8810b6c0 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c8ca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 0x7f2c881a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 0x7f2c8819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 0x7f2c8819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53694/0 (socket says 172.21.15.79:53694) 2024-09-21T02:46:02.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c87e00640 1 -- 172.21.15.79:0/2242851322 learned_addr learned my addr 172.21.15.79:0/2242851322 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:02.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.337+0000 7f2c87400640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c8810b6c0 0x7f2c8819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c8ca00640 1 -- 172.21.15.79:0/2242851322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c8810b6c0 msgr2=0x7f2c8819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c8ca00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c8810b6c0 0x7f2c8819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c8ca00640 1 -- 172.21.15.79:0/2242851322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 msgr2=0x7f2c8819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c8ca00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 0x7f2c8819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c8ca00640 1 -- 172.21.15.79:0/2242851322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c881a25e0 con 0x7f2c8810c010 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c87e00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 0x7f2c8819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c8ca00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 0x7f2c881a1eb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005e30 tx=0x7f2c800317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c84c00640 1 -- 172.21.15.79:0/2242851322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80003b70 con 0x7f2c8810c010 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c84c00640 1 -- 172.21.15.79:0/2242851322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c80003d10 con 0x7f2c8810c010 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c881a2870 con 0x7f2c8810c010 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.338+0000 7f2c84c00640 1 -- 172.21.15.79:0/2242851322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8002f970 con 0x7f2c8810c010 2024-09-21T02:46:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.339+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c881a9030 con 0x7f2c8810c010 2024-09-21T02:46:02.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.341+0000 7f2c95822740 1 Processor -- start 2024-09-21T02:46:02.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.342+0000 7f2c84c00640 1 -- 172.21.15.79:0/2242851322 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2c8002fb10 con 0x7f2c8810c010 2024-09-21T02:46:02.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.342+0000 7f2c95822740 1 -- start start 2024-09-21T02:46:02.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.342+0000 7f2c95822740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c95822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c95822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c95822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563989520290 con 0x5639891d9660 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c95822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56398950f6c0 con 0x5639891e1840 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c95822740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5639895134d0 con 0x563989202520 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54928/0 (socket says 172.21.15.79:54928) 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54082/0 (socket says 172.21.15.79:54082) 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 -- 172.21.15.79:0/2549547713 learned_addr learned my addr 172.21.15.79:0/2549547713 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 -- 172.21.15.79:0/2549547713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 msgr2=0x5639895a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 -- 172.21.15.79:0/2549547713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 msgr2=0x5639895a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.343+0000 7f2c87400640 1 -- 172.21.15.79:0/2549547713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56398949c460 con 0x563989202520 2024-09-21T02:46:02.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.344+0000 7f2c87400640 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895a91c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c74011710 tx=0x7f2c74005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aedf43b4cc31f1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:02.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.344+0000 7f2c84c00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c6c0b6590 0x7f2c6c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.344+0000 7f2c7d200640 1 -- 172.21.15.79:0/2549547713 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400f840 con 0x563989202520 2024-09-21T02:46:02.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.344+0000 7f2c7d200640 1 -- 172.21.15.79:0/2549547713 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c7400fe90 con 0x563989202520 2024-09-21T02:46:02.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.344+0000 7f2c7d200640 1 -- 172.21.15.79:0/2549547713 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7401fca0 con 0x563989202520 2024-09-21T02:46:02.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.344+0000 7f2c84c00640 1 -- 172.21.15.79:0/2242851322 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2c80108620 con 0x7f2c8810c010 2024-09-21T02:46:02.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.344+0000 7f2c87e00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c6c0b6590 0x7f2c6c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 -- 172.21.15.79:0/2549547713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 msgr2=0x5639895a91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895a91c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2c74011710 tx=0x7f2c74005850 comp rx=0 tx=0).stop 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c87e00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c6c0b6590 0x7f2c6c0b8aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5639895a7e40 tx=0x7f2c78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 -- 172.21.15.79:0/2549547713 shutdown_connections 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 --2- 172.21.15.79:0/2549547713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895a91c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 -- 172.21.15.79:0/2549547713 >> 172.21.15.79:0/2549547713 conn(0x5639891f6910 msgr2=0x5639895a70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:02.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.345+0000 7f2c95822740 1 -- 172.21.15.79:0/2549547713 shutdown_connections 2024-09-21T02:46:02.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.346+0000 7f2c95822740 1 -- 172.21.15.79:0/2549547713 wait complete. 2024-09-21T02:46:02.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.346+0000 7f2c95822740 1 -- start start 2024-09-21T02:46:02.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.346+0000 7f2c95822740 1 Processor -- start 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c95822740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c95822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891e1840 0x5639895b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c95822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563989202520 0x5639895c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c95822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563989370bb0 con 0x5639891e1840 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c95822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5639894aa6c0 con 0x563989202520 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c95822740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5639895b79a0 con 0x5639891d9660 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c95822740 10 client.0 _ll_register_callbacks cb 0x5639894c5490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c87400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891e1840 0x5639895b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54936/0 (socket says 172.21.15.79:54936) 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c87e00640 1 -- 172.21.15.79:0/1715614538 learned_addr learned my addr 172.21.15.79:0/1715614538 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.347+0000 7f2c8ca00640 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563989202520 0x5639895c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c87400640 1 -- 172.21.15.79:0/1715614538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 msgr2=0x5639895b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c87400640 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c87400640 1 -- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563989202520 msgr2=0x5639895c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c87400640 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563989202520 0x5639895c0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c87400640 1 -- 172.21.15.79:0/1715614538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56398926db00 con 0x5639891e1840 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c87e00640 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c87400640 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891e1840 0x5639895b5320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c740058c0 tx=0x7f2c74009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a9d229e1b6822 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c71600640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c71600640 1 -- 172.21.15.79:0/1715614538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7402c060 con 0x5639891e1840 2024-09-21T02:46:02.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c71600640 1 -- 172.21.15.79:0/1715614538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2c74019070 con 0x5639891e1840 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.348+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c7400fe90 con 0x5639891e1840 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c71600640 1 -- 172.21.15.79:0/1715614538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2c74011020 con 0x5639891e1840 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 10 client.16278 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5639892e4960 con 0x5639891e1840 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c71600640 1 -- 172.21.15.79:0/1715614538 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c7400fe90 con 0x5639891e1840 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c71600640 1 -- 172.21.15.79:0/1715614538 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2c7401d020 con 0x5639891e1840 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 10 client.16278 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 10 client.16278 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 20 client.16278 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639891c0ea0 0x5639895c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 4 client.16278 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:02.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.349+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639895221e0 con 0x5639891c0ea0 2024-09-21T02:46:02.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.350+0000 7f2c87e00640 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639891c0ea0 0x5639895c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.350+0000 7f2c87e00640 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639891c0ea0 0x5639895c6b80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27c9d2bfc764ab4 server_cookie=d8436411ffb39186 in_seq=0 out_seq=0 2024-09-21T02:46:02.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.350+0000 7f2c71600640 10 client.16278 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.351+0000 7f2c71600640 1 -- 172.21.15.79:0/1715614538 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639895221e0 con 0x5639891c0ea0 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.351+0000 7f2c71600640 10 client.16278 handle_command_reply: tid=0 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.351+0000 7f2c95822740 1 client.16278 shutdown 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891e1840 msgr2=0x5639895b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891e1840 0x5639895b5320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c740058c0 tx=0x7f2c74009dc0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 shutdown_connections 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639891c0ea0 0x5639895c6b80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563989202520 0x5639895c0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891e1840 0x5639895b5320 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 --2- 172.21.15.79:0/1715614538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c71600640 0 client.16278 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 >> 172.21.15.79:0/1715614538 conn(0x5639891f6910 msgr2=0x5639895ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:02.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 shutdown_connections 2024-09-21T02:46:02.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 1 -- 172.21.15.79:0/1715614538 wait complete. 2024-09-21T02:46:02.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.352+0000 7f2c95822740 20 client.16278 trim_cache size 0 max 16384 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.369+0000 7f2c95822740 1 Processor -- start 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c95822740 1 -- start start 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c95822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c95822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c95822740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c95822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881b0cf0 con 0x5639891d9660 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c95822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881b3570 con 0x5639891e1840 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c95822740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881b1360 con 0x563989202520 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54090/0 (socket says 172.21.15.79:54090) 2024-09-21T02:46:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c87e00640 1 -- 172.21.15.79:0/3132611332 learned_addr learned my addr 172.21.15.79:0/3132611332 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c87400640 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.370+0000 7f2c8ca00640 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c87e00640 1 -- 172.21.15.79:0/3132611332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 msgr2=0x5639895b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c87e00640 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c87e00640 1 -- 172.21.15.79:0/3132611332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 msgr2=0x5639895aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c87e00640 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c87e00640 1 -- 172.21.15.79:0/3132611332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639895ac020 con 0x5639891d9660 2024-09-21T02:46:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c87400640 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c87e00640 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a7260 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x563989370d00 tx=0x7f2c7801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f234ea5f195d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c73e00640 1 -- 172.21.15.79:0/3132611332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7801f8f0 con 0x5639891d9660 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c73e00640 1 -- 172.21.15.79:0/3132611332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c7802b420 con 0x5639891d9660 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.371+0000 7f2c73e00640 1 -- 172.21.15.79:0/3132611332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780326b0 con 0x5639891d9660 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 -- 172.21.15.79:0/3132611332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 msgr2=0x5639895a7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a7260 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x563989370d00 tx=0x7f2c7801a000 comp rx=0 tx=0).stop 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 -- 172.21.15.79:0/3132611332 shutdown_connections 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563989202520 0x5639895b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 --2- 172.21.15.79:0/3132611332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639891d9660 0x5639895a7260 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 -- 172.21.15.79:0/3132611332 >> 172.21.15.79:0/3132611332 conn(0x5639891f6910 msgr2=0x5639895aa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 -- 172.21.15.79:0/3132611332 shutdown_connections 2024-09-21T02:46:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.372+0000 7f2c95822740 1 -- 172.21.15.79:0/3132611332 wait complete. 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.373+0000 7f2c95822740 1 -- start start 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.373+0000 7f2c95822740 1 Processor -- start 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c95822740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c95822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c95822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563989202520 0x5639895b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c95822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881b1a30 con 0x563989202520 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c95822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881b2ea0 con 0x5639891e1840 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c95822740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881b2100 con 0x5639891d9660 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c95822740 10 client.0 _ll_register_callbacks cb 0x7f2c78009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c87e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:54968/0 (socket says 172.21.15.79:54968) 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c87e00640 1 -- 172.21.15.79:0/1632964467 learned_addr learned my addr 172.21.15.79:0/1632964467 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c8ca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563989202520 0x5639895b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c87400640 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.374+0000 7f2c87e00640 1 -- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 msgr2=0x5639895b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c87e00640 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c87e00640 1 -- 172.21.15.79:0/1632964467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563989202520 msgr2=0x5639895b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c87e00640 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563989202520 0x5639895b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c87e00640 1 -- 172.21.15.79:0/1632964467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639895b86e0 con 0x5639891d9660 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c87e00640 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895bd240 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800a000 tx=0x7f2c7800faa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f8b2b17f574094 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c71600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c71600640 1 -- 172.21.15.79:0/1632964467 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78004230 con 0x5639891d9660 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c7802b420 con 0x5639891d9660 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c71600640 1 -- 172.21.15.79:0/1632964467 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2c780043d0 con 0x5639891d9660 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c71600640 1 -- 172.21.15.79:0/1632964467 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2c7801f9b0 con 0x5639891d9660 2024-09-21T02:46:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c95822740 10 client.26539 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.375+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5639896320d0 con 0x5639891d9660 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c71600640 1 -- 172.21.15.79:0/1632964467 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c7802b420 con 0x5639891d9660 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c71600640 1 -- 172.21.15.79:0/1632964467 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2c7803a070 con 0x5639891d9660 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c95822740 10 client.26539 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c95822740 10 client.26539 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c95822740 20 client.26539 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c95822740 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563989196250 0x563989634840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c95822740 4 client.26539 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "13d6b322", "release": true, "await": true}] 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "13d6b322", "release": true, "await": true}) -- 0x56398951dc90 con 0x563989196250 2024-09-21T02:46:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.376+0000 7f2c87400640 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563989196250 0x563989634840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:02.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.377+0000 7f2c87400640 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563989196250 0x563989634840 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f01a616e677f7ddd server_cookie=68392af061812e2c in_seq=0 out_seq=0 2024-09-21T02:46:02.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.377+0000 7f2c71600640 10 client.26539 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c71600640 1 -- 172.21.15.79:0/1632964467 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56398951dc90 con 0x563989196250 2024-09-21T02:46:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c71600640 10 client.26539 handle_command_reply: tid=0 2024-09-21T02:46:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 client.26539 shutdown 2024-09-21T02:46:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 msgr2=0x5639895bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895bd240 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800a000 tx=0x7f2c7800faa0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 shutdown_connections 2024-09-21T02:46:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x563989196250 0x563989634840 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563989202520 0x5639895b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639891e1840 0x5639895b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 --2- 172.21.15.79:0/1632964467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639891d9660 0x5639895bd240 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 >> 172.21.15.79:0/1632964467 conn(0x5639891f6910 msgr2=0x5639895a7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c71600640 0 client.26539 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.429+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 shutdown_connections 2024-09-21T02:46:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.430+0000 7f2c95822740 1 -- 172.21.15.79:0/1632964467 wait complete. 2024-09-21T02:46:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.430+0000 7f2c95822740 20 client.26539 trim_cache size 0 max 16384 2024-09-21T02:46:02.432 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:46:02.432 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 44, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "13d6b322": { 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 44, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 144.5, 2024-09-21T02:46:02.433 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:46:02.434 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.431+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c6c0b6590 msgr2=0x7f2c6c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c6c0b6590 0x7f2c6c0b8aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5639895a7e40 tx=0x7f2c78005f90 comp rx=0 tx=0).stop 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 msgr2=0x7f2c881a1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 0x7f2c881a1eb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005e30 tx=0x7f2c800317c0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 shutdown_connections 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c6c0b6590 0x7f2c6c0b8aa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c8810c010 0x7f2c881a1eb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c8810b6c0 0x7f2c8819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 --2- 172.21.15.79:0/2242851322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c88105d80 0x7f2c8819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:02.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 >> 172.21.15.79:0/2242851322 conn(0x7f2c88101810 msgr2=0x7f2c8810acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:02.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 shutdown_connections 2024-09-21T02:46:02.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:46:02.432+0000 7f2c8ea00640 1 -- 172.21.15.79:0/2242851322 wait complete. 2024-09-21T02:46:03.722 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '13d6b322', total seconds elapsed: 29.0 2024-09-21T02:46:03.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:03 smithi098 ceph-mon[34832]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-21T02:46:03.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:03 smithi079 ceph-mon[30788]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-21T02:46:04.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:03 smithi148 ceph-mon[34626]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-21T02:46:05.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:05 smithi079 ceph-mon[30788]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 152 KiB/s wr, 25 op/s 2024-09-21T02:46:06.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:05 smithi148 ceph-mon[34626]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 152 KiB/s wr, 25 op/s 2024-09-21T02:46:06.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:05 smithi098 ceph-mon[34832]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 152 KiB/s wr, 25 op/s 2024-09-21T02:46:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 610.0 s, 282.4 tps, lat 1791.494 ms stddev 5638.741 2024-09-21T02:46:07.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:07 smithi079 ceph-mon[30788]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-09-21T02:46:08.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:07 smithi148 ceph-mon[34626]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-09-21T02:46:08.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:07 smithi098 ceph-mon[34832]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-09-21T02:46:09.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:09 smithi079 ceph-mon[30788]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-09-21T02:46:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:09 smithi148 ceph-mon[34626]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-09-21T02:46:10.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:09 smithi098 ceph-mon[34832]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-09-21T02:46:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 615.0 s, 560.0 tps, lat 186.185 ms stddev 239.434 2024-09-21T02:46:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.691+0000 7f5d3a000640 1 -- 172.21.15.79:0/3298190015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d341050d0 msgr2=0x7f5d3410ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.691+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3298190015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d341050d0 0x7f5d3410ba70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009ca0 tx=0x7f5d2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.692+0000 7f5d3a000640 1 -- 172.21.15.79:0/3298190015 shutdown_connections 2024-09-21T02:46:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.692+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3298190015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d341050d0 0x7f5d3410ba70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.692+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3298190015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 0x7f5d34104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.692+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3298190015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d341036b0 0x7f5d34103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.692+0000 7f5d3a000640 1 -- 172.21.15.79:0/3298190015 >> 172.21.15.79:0/3298190015 conn(0x7f5d340feff0 msgr2=0x7f5d341014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.692+0000 7f5d3a000640 1 -- 172.21.15.79:0/3298190015 shutdown_connections 2024-09-21T02:46:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.692+0000 7f5d3a000640 1 -- 172.21.15.79:0/3298190015 wait complete. 2024-09-21T02:46:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 Processor -- start 2024-09-21T02:46:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 -- start start 2024-09-21T02:46:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d341036b0 0x7f5d3419c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 0x7f5d3419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d341050d0 0x7f5d3419d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410f330 con 0x7f5d341050d0 2024-09-21T02:46:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410f1b0 con 0x7f5d341036b0 2024-09-21T02:46:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.695+0000 7f5d3a000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410f4b0 con 0x7f5d34104730 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.696+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 0x7f5d3419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.696+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 0x7f5d3419c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48572/0 (socket says 172.21.15.79:48572) 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.696+0000 7f5d32a00640 1 -- 172.21.15.79:0/3780521273 learned_addr learned my addr 172.21.15.79:0/3780521273 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.696+0000 7f5d33e00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d341050d0 0x7f5d3419d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.697+0000 7f5d32a00640 1 -- 172.21.15.79:0/3780521273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d341036b0 msgr2=0x7f5d3419c0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.697+0000 7f5d32a00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d341036b0 0x7f5d3419c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.697+0000 7f5d32a00640 1 -- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d341050d0 msgr2=0x7f5d3419d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.697+0000 7f5d32a00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d341050d0 0x7f5d3419d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.697+0000 7f5d32a00640 1 -- 172.21.15.79:0/3780521273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3419db10 con 0x7f5d34104730 2024-09-21T02:46:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.697+0000 7f5d33e00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d341050d0 0x7f5d3419d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:46:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.697+0000 7f5d32a00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 0x7f5d3419c740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000ea60 tx=0x7f5d2000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.698+0000 7f5d2be00640 1 -- 172.21.15.79:0/3780521273 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000cde0 con 0x7f5d34104730 2024-09-21T02:46:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.698+0000 7f5d2be00640 1 -- 172.21.15.79:0/3780521273 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d200035f0 con 0x7f5d34104730 2024-09-21T02:46:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.698+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3419de00 con 0x7f5d34104730 2024-09-21T02:46:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.698+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d341a44f0 con 0x7f5d34104730 2024-09-21T02:46:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.698+0000 7f5d2be00640 1 -- 172.21.15.79:0/3780521273 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20010690 con 0x7f5d34104730 2024-09-21T02:46:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.702+0000 7f5d411fe740 1 Processor -- start 2024-09-21T02:46:11.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d411fe740 1 -- start start 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c36740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561286e4d0 0x555612c37290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d411fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555612ba96b0 con 0x55561288f1b0 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d411fe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555612b98ae0 con 0x55561286e4d0 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d411fe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555612b9c8f0 con 0x5556128662f0 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d33400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c36740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d33400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c36740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48582/0 (socket says 172.21.15.79:48582) 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d33400640 1 -- 172.21.15.79:0/1827061666 learned_addr learned my addr 172.21.15.79:0/1827061666 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.703+0000 7f5d33e00640 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.704+0000 7f5d33400640 1 -- 172.21.15.79:0/1827061666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561286e4d0 msgr2=0x555612c37290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:46:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.704+0000 7f5d33400640 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561286e4d0 0x555612c37290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.704+0000 7f5d33400640 1 -- 172.21.15.79:0/1827061666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 msgr2=0x555612c360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.704+0000 7f5d33400640 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.704+0000 7f5d33400640 1 -- 172.21.15.79:0/1827061666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555612b65780 con 0x5556128662f0 2024-09-21T02:46:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.704+0000 7f5d33e00640 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:46:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.704+0000 7f5d2be00640 1 -- 172.21.15.79:0/3780521273 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5d20004020 con 0x7f5d34104730 2024-09-21T02:46:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.705+0000 7f5d33400640 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c36740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009bd0 tx=0x7f5d2400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe3253be3b6a8772 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.705+0000 7f5d1fe00640 1 -- 172.21.15.79:0/1827061666 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24005020 con 0x5556128662f0 2024-09-21T02:46:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.705+0000 7f5d1fe00640 1 -- 172.21.15.79:0/1827061666 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d240047a0 con 0x5556128662f0 2024-09-21T02:46:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.705+0000 7f5d1fe00640 1 -- 172.21.15.79:0/1827061666 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24010690 con 0x5556128662f0 2024-09-21T02:46:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d411fe740 1 -- 172.21.15.79:0/1827061666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 msgr2=0x555612c36740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d411fe740 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c36740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009bd0 tx=0x7f5d2400e720 comp rx=0 tx=0).stop 2024-09-21T02:46:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d411fe740 1 -- 172.21.15.79:0/1827061666 shutdown_connections 2024-09-21T02:46:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d411fe740 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561286e4d0 0x555612c37290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d411fe740 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c36740 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d411fe740 1 --2- 172.21.15.79:0/1827061666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d411fe740 1 -- 172.21.15.79:0/1827061666 >> 172.21.15.79:0/1827061666 conn(0x555612883300 msgr2=0x555612c31b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.707+0000 7f5d2be00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5d180b66e0 0x7f5d180b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.708+0000 7f5d2be00640 1 -- 172.21.15.79:0/3780521273 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f5d200e79b0 con 0x7f5d34104730 2024-09-21T02:46:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.708+0000 7f5d411fe740 1 -- 172.21.15.79:0/1827061666 shutdown_connections 2024-09-21T02:46:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.708+0000 7f5d33e00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5d180b66e0 0x7f5d180b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.708+0000 7f5d411fe740 1 -- 172.21.15.79:0/1827061666 wait complete. 2024-09-21T02:46:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.709+0000 7f5d33e00640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5d180b66e0 0x7f5d180b8bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c004af0 tx=0x7f5d2c009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.709+0000 7f5d411fe740 1 -- start start 2024-09-21T02:46:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.710+0000 7f5d411fe740 1 Processor -- start 2024-09-21T02:46:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.710+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c3f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d33400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c3f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d33400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c3f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33600/0 (socket says 172.21.15.79:33600) 2024-09-21T02:46:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d33400640 1 -- 172.21.15.79:0/2640652578 learned_addr learned my addr 172.21.15.79:0/2640652578 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c3fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561288f1b0 0x555612c409e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555612ad0ab0 con 0x55561286e4d0 2024-09-21T02:46:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555612b3f570 con 0x5556128662f0 2024-09-21T02:46:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555612c37db0 con 0x55561288f1b0 2024-09-21T02:46:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d33e00640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561288f1b0 0x555612c409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d32a00640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c3fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.711+0000 7f5d411fe740 10 client.0 _ll_register_callbacks cb 0x555612b4e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d33400640 1 -- 172.21.15.79:0/2640652578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561288f1b0 msgr2=0x555612c409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d33400640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561288f1b0 0x555612c409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d33400640 1 -- 172.21.15.79:0/2640652578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 msgr2=0x555612c3fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d33400640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c3fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d33400640 1 -- 172.21.15.79:0/2640652578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556128fa790 con 0x5556128662f0 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d33e00640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561288f1b0 0x555612c409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d33400640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c3f820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5d24004770 tx=0x7f5d24005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e6f84393d1b4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.712+0000 7f5d1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.713+0000 7f5d1cc00640 1 -- 172.21.15.79:0/2640652578 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24026020 con 0x5556128662f0 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.713+0000 7f5d1cc00640 1 -- 172.21.15.79:0/2640652578 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f5d24005220 con 0x5556128662f0 2024-09-21T02:46:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.713+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d240047a0 con 0x5556128662f0 2024-09-21T02:46:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.713+0000 7f5d1cc00640 1 -- 172.21.15.79:0/2640652578 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5d2401d040 con 0x5556128662f0 2024-09-21T02:46:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.713+0000 7f5d411fe740 10 client.26522 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555612973620 con 0x5556128662f0 2024-09-21T02:46:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d1cc00640 1 -- 172.21.15.79:0/2640652578 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d240047a0 con 0x5556128662f0 2024-09-21T02:46:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d1cc00640 1 -- 172.21.15.79:0/2640652578 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5d24010430 con 0x5556128662f0 2024-09-21T02:46:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d411fe740 10 client.26522 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d411fe740 10 client.26522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d411fe740 20 client.26522 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55561284dd80 0x555612c4cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d411fe740 4 client.26522 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.714+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555612bab600 con 0x55561284dd80 2024-09-21T02:46:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.715+0000 7f5d32a00640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55561284dd80 0x555612c4cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.718+0000 7f5d32a00640 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55561284dd80 0x555612c4cb90 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b0d7060f2785c4 server_cookie=86c55e80f46baa13 in_seq=0 out_seq=0 2024-09-21T02:46:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.718+0000 7f5d1cc00640 10 client.26522 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:11.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.719+0000 7f5d1cc00640 1 -- 172.21.15.79:0/2640652578 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555612bab600 con 0x55561284dd80 2024-09-21T02:46:11.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.719+0000 7f5d1cc00640 10 client.26522 handle_command_reply: tid=0 2024-09-21T02:46:11.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.719+0000 7f5d411fe740 1 client.26522 shutdown 2024-09-21T02:46:11.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.719+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 msgr2=0x555612c3f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c3f820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5d24004770 tx=0x7f5d24005dc0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 shutdown_connections 2024-09-21T02:46:11.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55561284dd80 0x555612c4cb90 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561288f1b0 0x555612c409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c3fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d1cc00640 0 client.26522 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d411fe740 1 --2- 172.21.15.79:0/2640652578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c3f820 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.720+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 >> 172.21.15.79:0/2640652578 conn(0x555612883300 msgr2=0x555612c300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.721+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 shutdown_connections 2024-09-21T02:46:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.721+0000 7f5d411fe740 1 -- 172.21.15.79:0/2640652578 wait complete. 2024-09-21T02:46:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.721+0000 7f5d411fe740 20 client.26522 trim_cache size 0 max 16384 2024-09-21T02:46:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.756+0000 7f5d411fe740 1 Processor -- start 2024-09-21T02:46:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.756+0000 7f5d411fe740 1 -- start start 2024-09-21T02:46:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.757+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c30850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.757+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c478a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.757+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561288f1b0 0x555612c30d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.757+0000 7f5d411fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1400dc30 con 0x55561286e4d0 2024-09-21T02:46:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.757+0000 7f5d411fe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d140104b0 con 0x55561288f1b0 2024-09-21T02:46:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.757+0000 7f5d411fe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1400e2a0 con 0x5556128662f0 2024-09-21T02:46:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.757+0000 7f5d33e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561288f1b0 0x555612c30d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.758+0000 7f5d33e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561288f1b0 0x555612c30d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33616/0 (socket says 172.21.15.79:33616) 2024-09-21T02:46:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.758+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.758+0000 7f5d33e00640 1 -- 172.21.15.79:0/184561388 learned_addr learned my addr 172.21.15.79:0/184561388 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.758+0000 7f5d33400640 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c30850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.761+0000 7f5d33e00640 1 -- 172.21.15.79:0/184561388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 msgr2=0x555612c30850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.761+0000 7f5d33e00640 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c30850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.761+0000 7f5d33e00640 1 -- 172.21.15.79:0/184561388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 msgr2=0x555612c478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.761+0000 7f5d33e00640 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.761+0000 7f5d33e00640 1 -- 172.21.15.79:0/184561388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555612c300e0 con 0x55561288f1b0 2024-09-21T02:46:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.762+0000 7f5d33e00640 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561288f1b0 0x555612c30d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c035000 tx=0x7f5d2c048000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c15a95793ec0e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.767+0000 7f5d1f400640 1 -- 172.21.15.79:0/184561388 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0316f0 con 0x55561288f1b0 2024-09-21T02:46:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.767+0000 7f5d1f400640 1 -- 172.21.15.79:0/184561388 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d2c036040 con 0x55561288f1b0 2024-09-21T02:46:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.767+0000 7f5d1f400640 1 -- 172.21.15.79:0/184561388 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c02f7b0 con 0x55561288f1b0 2024-09-21T02:46:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.768+0000 7f5d411fe740 1 -- 172.21.15.79:0/184561388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561288f1b0 msgr2=0x555612c30d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.768+0000 7f5d411fe740 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561288f1b0 0x555612c30d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c035000 tx=0x7f5d2c048000 comp rx=0 tx=0).stop 2024-09-21T02:46:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.771+0000 7f5d411fe740 1 -- 172.21.15.79:0/184561388 shutdown_connections 2024-09-21T02:46:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.771+0000 7f5d411fe740 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55561288f1b0 0x555612c30d90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.771+0000 7f5d411fe740 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561286e4d0 0x555612c478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.771+0000 7f5d411fe740 1 --2- 172.21.15.79:0/184561388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5556128662f0 0x555612c30850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.771+0000 7f5d411fe740 1 -- 172.21.15.79:0/184561388 >> 172.21.15.79:0/184561388 conn(0x555612883300 msgr2=0x555612c314a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.772+0000 7f5d411fe740 1 -- 172.21.15.79:0/184561388 shutdown_connections 2024-09-21T02:46:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.772+0000 7f5d411fe740 1 -- 172.21.15.79:0/184561388 wait complete. 2024-09-21T02:46:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.773+0000 7f5d411fe740 1 -- start start 2024-09-21T02:46:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.773+0000 7f5d411fe740 1 Processor -- start 2024-09-21T02:46:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c47880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561286e4d0 0x555612c437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d411fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c44800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561286e4d0 0x555612c437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561286e4d0 0x555612c437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48602/0 (socket says 172.21.15.79:48602) 2024-09-21T02:46:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d411fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1400e970 con 0x55561288f1b0 2024-09-21T02:46:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d411fe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1400fde0 con 0x5556128662f0 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d411fe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1400f040 con 0x55561286e4d0 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.774+0000 7f5d32a00640 1 -- 172.21.15.79:0/524103352 learned_addr learned my addr 172.21.15.79:0/524103352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.775+0000 7f5d411fe740 10 client.0 _ll_register_callbacks cb 0x7f5d24009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.775+0000 7f5d33400640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c47880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.775+0000 7f5d33e00640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c44800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.775+0000 7f5d32a00640 1 -- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 msgr2=0x555612c47880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.775+0000 7f5d32a00640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c47880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.775+0000 7f5d32a00640 1 -- 172.21.15.79:0/524103352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 msgr2=0x555612c44800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.776+0000 7f5d32a00640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c44800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.776+0000 7f5d32a00640 1 -- 172.21.15.79:0/524103352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555612c44150 con 0x55561286e4d0 2024-09-21T02:46:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.776+0000 7f5d33e00640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c44800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:46:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.776+0000 7f5d32a00640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561286e4d0 0x555612c437f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5d200e50a0 tx=0x7f5d20004440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d521225d90406e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.776+0000 7f5d1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:46:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.777+0000 7f5d1cc00640 1 -- 172.21.15.79:0/524103352 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d200c7020 con 0x55561286e4d0 2024-09-21T02:46:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.777+0000 7f5d1cc00640 1 -- 172.21.15.79:0/524103352 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f5d200acb90 con 0x55561286e4d0 2024-09-21T02:46:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.777+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2c036040 con 0x55561286e4d0 2024-09-21T02:46:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.777+0000 7f5d1cc00640 1 -- 172.21.15.79:0/524103352 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5d200b7150 con 0x55561286e4d0 2024-09-21T02:46:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.778+0000 7f5d411fe740 10 client.26557 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.778+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555612cc8b80 con 0x55561286e4d0 2024-09-21T02:46:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.778+0000 7f5d1cc00640 1 -- 172.21.15.79:0/524103352 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d2c036040 con 0x55561286e4d0 2024-09-21T02:46:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.779+0000 7f5d1cc00640 1 -- 172.21.15.79:0/524103352 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5d200cf2f0 con 0x55561286e4d0 2024-09-21T02:46:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.779+0000 7f5d411fe740 10 client.26557 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.779+0000 7f5d411fe740 10 client.26557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.780+0000 7f5d411fe740 20 client.26557 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.780+0000 7f5d411fe740 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5556128231c0 0x555612ccb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.780+0000 7f5d411fe740 4 client.26557 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.780+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555612ba70b0 con 0x5556128231c0 2024-09-21T02:46:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.781+0000 7f5d33400640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5556128231c0 0x555612ccb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.782+0000 7f5d33400640 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5556128231c0 0x555612ccb570 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1506bd1286e849b server_cookie=eae2d94efaca00e8 in_seq=0 out_seq=0 2024-09-21T02:46:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.782+0000 7f5d1cc00640 10 client.26557 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.958+0000 7f5d1cc00640 1 -- 172.21.15.79:0/524103352 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555612ba70b0 con 0x5556128231c0 2024-09-21T02:46:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.958+0000 7f5d1cc00640 10 client.26557 handle_command_reply: tid=0 2024-09-21T02:46:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.958+0000 7f5d411fe740 1 client.26557 shutdown 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561286e4d0 msgr2=0x555612c437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561286e4d0 0x555612c437f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5d200e50a0 tx=0x7f5d20004440 comp rx=0 tx=0).stop 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 shutdown_connections 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5556128231c0 0x555612ccb570 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55561288f1b0 0x555612c44800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55561286e4d0 0x555612c437f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 --2- 172.21.15.79:0/524103352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556128662f0 0x555612c47880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 >> 172.21.15.79:0/524103352 conn(0x555612883300 msgr2=0x555612c314a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d1cc00640 0 client.26557 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 shutdown_connections 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 1 -- 172.21.15.79:0/524103352 wait complete. 2024-09-21T02:46:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.960+0000 7f5d411fe740 20 client.26557 trim_cache size 0 max 16384 2024-09-21T02:46:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:46:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:46:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:46:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:46:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5d180b66e0 msgr2=0x7f5d180b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5d180b66e0 0x7f5d180b8bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c004af0 tx=0x7f5d2c009360 comp rx=0 tx=0).stop 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 msgr2=0x7f5d3419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 0x7f5d3419c740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000ea60 tx=0x7f5d2000ef20 comp rx=0 tx=0).stop 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 shutdown_connections 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f5d180b66e0 0x7f5d180b8bf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d341050d0 0x7f5d3419d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d34104730 0x7f5d3419c740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 --2- 172.21.15.79:0/3780521273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d341036b0 0x7f5d3419c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 >> 172.21.15.79:0/3780521273 conn(0x7f5d340feff0 msgr2=0x7f5d340755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.961+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 shutdown_connections 2024-09-21T02:46:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:11.962+0000 7f5d3a000640 1 -- 172.21.15.79:0/3780521273 wait complete. 2024-09-21T02:46:11.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:11 smithi079 ceph-mon[30788]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 3.0 MiB/s wr, 236 op/s 2024-09-21T02:46:12.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:11 smithi148 ceph-mon[34626]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 3.0 MiB/s wr, 236 op/s 2024-09-21T02:46:12.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:11 smithi098 ceph-mon[34832]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 3.0 MiB/s wr, 236 op/s 2024-09-21T02:46:13.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:13 smithi079 ceph-mon[30788]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 4.8 MiB/s wr, 345 op/s 2024-09-21T02:46:14.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:13 smithi148 ceph-mon[34626]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 4.8 MiB/s wr, 345 op/s 2024-09-21T02:46:14.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:13 smithi098 ceph-mon[34832]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 4.8 MiB/s wr, 345 op/s 2024-09-21T02:46:15.981 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:15 smithi079 ceph-mon[30788]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.8 MiB/s wr, 422 op/s 2024-09-21T02:46:16.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:15 smithi148 ceph-mon[34626]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.8 MiB/s wr, 422 op/s 2024-09-21T02:46:16.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:15 smithi098 ceph-mon[34832]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.8 MiB/s wr, 422 op/s 2024-09-21T02:46:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 620.0 s, 587.4 tps, lat 166.268 ms stddev 196.860 2024-09-21T02:46:16.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:46:16.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:16.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:16.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:16.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:16 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:46:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:16 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:46:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:16 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:17.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:17 smithi079 ceph-mon[30788]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.2 MiB/s wr, 520 op/s 2024-09-21T02:46:17.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:46:17.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:46:17.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:17 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:18.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:17 smithi148 ceph-mon[34626]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.2 MiB/s wr, 520 op/s 2024-09-21T02:46:18.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:46:18.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:46:18.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:17 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:18.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:17 smithi098 ceph-mon[34832]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.2 MiB/s wr, 520 op/s 2024-09-21T02:46:18.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:46:18.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:46:18.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:17 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:46:20.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:19 smithi148 ceph-mon[34626]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.6 MiB/s wr, 504 op/s 2024-09-21T02:46:20.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:19 smithi098 ceph-mon[34832]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.6 MiB/s wr, 504 op/s 2024-09-21T02:46:20.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:19 smithi079 ceph-mon[30788]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.6 MiB/s wr, 504 op/s 2024-09-21T02:46:21.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:20 smithi148 ceph-mon[34626]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 537 op/s 2024-09-21T02:46:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:20 smithi098 ceph-mon[34832]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 537 op/s 2024-09-21T02:46:21.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:20 smithi079 ceph-mon[30788]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 537 op/s 2024-09-21T02:46:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 625.0 s, 579.4 tps, lat 176.158 ms stddev 200.571 2024-09-21T02:46:23.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:22 smithi098 ceph-mon[34832]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 546 op/s 2024-09-21T02:46:23.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:22 smithi079 ceph-mon[30788]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 546 op/s 2024-09-21T02:46:23.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:22 smithi148 ceph-mon[34626]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 546 op/s 2024-09-21T02:46:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:24 smithi098 ceph-mon[34832]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 512 op/s 2024-09-21T02:46:25.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:24 smithi079 ceph-mon[30788]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 512 op/s 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 -- 172.21.15.79:0/1870702883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8641034e0 msgr2=0x7fb864103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 --2- 172.21.15.79:0/1870702883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8641034e0 0x7fb864103950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb85400fb10 tx=0x7fb85402e570 comp rx=0 tx=0).stop 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 -- 172.21.15.79:0/1870702883 shutdown_connections 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 --2- 172.21.15.79:0/1870702883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb864104f00 0x7fb86410b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 --2- 172.21.15.79:0/1870702883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb864104560 0x7fb864104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 --2- 172.21.15.79:0/1870702883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8641034e0 0x7fb864103950 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 -- 172.21.15.79:0/1870702883 >> 172.21.15.79:0/1870702883 conn(0x7fb8640fee20 msgr2=0x7fb8641012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 -- 172.21.15.79:0/1870702883 shutdown_connections 2024-09-21T02:46:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.271+0000 7fb868a00640 1 -- 172.21.15.79:0/1870702883 wait complete. 2024-09-21T02:46:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 Processor -- start 2024-09-21T02:46:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 -- start start 2024-09-21T02:46:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8641034e0 0x7fb864197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb864104560 0x7fb8641981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb864104f00 0x7fb864198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb86410cfc0 con 0x7fb8641034e0 2024-09-21T02:46:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb86410ce40 con 0x7fb864104f00 2024-09-21T02:46:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb868a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb86410d140 con 0x7fb864104560 2024-09-21T02:46:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.273+0000 7fb863e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb864104f00 0x7fb864198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb864104f00 0x7fb864198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:60490/0 (socket says 172.21.15.79:60490) 2024-09-21T02:46:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863e00640 1 -- 172.21.15.79:0/2901583896 learned_addr learned my addr 172.21.15.79:0/2901583896 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863400640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8641034e0 0x7fb864197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb862a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb864104560 0x7fb8641981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863e00640 1 -- 172.21.15.79:0/2901583896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb864104560 msgr2=0x7fb8641981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863e00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb864104560 0x7fb8641981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863e00640 1 -- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8641034e0 msgr2=0x7fb864197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863e00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8641034e0 0x7fb864197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.274+0000 7fb863e00640 1 -- 172.21.15.79:0/2901583896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb864199500 con 0x7fb864104f00 2024-09-21T02:46:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.275+0000 7fb863e00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb864104f00 0x7fb864198d70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00cce0 tx=0x7fb85c00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.275+0000 7fb85be00640 1 -- 172.21.15.79:0/2901583896 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00f450 con 0x7fb864104f00 2024-09-21T02:46:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.275+0000 7fb85be00640 1 -- 172.21.15.79:0/2901583896 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb85c00faa0 con 0x7fb864104f00 2024-09-21T02:46:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.275+0000 7fb85be00640 1 -- 172.21.15.79:0/2901583896 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c018b70 con 0x7fb864104f00 2024-09-21T02:46:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.275+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8641997f0 con 0x7fb864104f00 2024-09-21T02:46:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.276+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86406cde0 con 0x7fb864104f00 2024-09-21T02:46:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.280+0000 7fb8710c2740 1 Processor -- start 2024-09-21T02:46:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.282+0000 7fb8710c2740 1 -- start start 2024-09-21T02:46:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.282+0000 7fb85be00640 1 -- 172.21.15.79:0/2901583896 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb85c018d10 con 0x7fb864104f00 2024-09-21T02:46:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.283+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4ad1b0 0x55c37c8542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.283+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4842f0 0x55c37c854920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.283+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c48c4d0 0x55c37c855470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.283+0000 7fb8710c2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c37c7c76b0 con 0x55c37c48c4d0 2024-09-21T02:46:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.283+0000 7fb8710c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c37c7b6ae0 con 0x55c37c4842f0 2024-09-21T02:46:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.283+0000 7fb8710c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c37c7ba8f0 con 0x55c37c4ad1b0 2024-09-21T02:46:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.284+0000 7fb863400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4842f0 0x55c37c854920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.284+0000 7fb863400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4842f0 0x55c37c854920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:60492/0 (socket says 172.21.15.79:60492) 2024-09-21T02:46:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.284+0000 7fb863400640 1 -- 172.21.15.79:0/1598299024 learned_addr learned my addr 172.21.15.79:0/1598299024 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.284+0000 7fb862a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4ad1b0 0x55c37c8542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.284+0000 7fb862a00640 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c48c4d0 0x55c37c855470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.285+0000 7fb863400640 1 -- 172.21.15.79:0/1598299024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4ad1b0 msgr2=0x55c37c8542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.285+0000 7fb863400640 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4ad1b0 0x55c37c8542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.286+0000 7fb863400640 1 -- 172.21.15.79:0/1598299024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c48c4d0 msgr2=0x55c37c855470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.286+0000 7fb863400640 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c48c4d0 0x55c37c855470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.286+0000 7fb863400640 1 -- 172.21.15.79:0/1598299024 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c783780 con 0x55c37c4842f0 2024-09-21T02:46:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.286+0000 7fb862a00640 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4ad1b0 0x55c37c8542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.287+0000 7fb863400640 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4842f0 0x55c37c854920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb85400fb10 tx=0x7fb854004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28008497d43bc37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.288+0000 7fb84fe00640 1 -- 172.21.15.79:0/1598299024 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854044020 con 0x55c37c4842f0 2024-09-21T02:46:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.288+0000 7fb84fe00640 1 -- 172.21.15.79:0/1598299024 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb85400e5b0 con 0x55c37c4842f0 2024-09-21T02:46:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.288+0000 7fb84fe00640 1 -- 172.21.15.79:0/1598299024 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85400f370 con 0x55c37c4842f0 2024-09-21T02:46:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.288+0000 7fb85be00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb8480b6650 0x7fb8480b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.288+0000 7fb85be00640 1 -- 172.21.15.79:0/2901583896 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb85c0e7b00 con 0x7fb864104f00 2024-09-21T02:46:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.288+0000 7fb862a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb8480b6650 0x7fb8480b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 -- 172.21.15.79:0/1598299024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4842f0 msgr2=0x55c37c854920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4842f0 0x55c37c854920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb85400fb10 tx=0x7fb854004af0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 -- 172.21.15.79:0/1598299024 shutdown_connections 2024-09-21T02:46:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c48c4d0 0x55c37c855470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4842f0 0x55c37c854920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 --2- 172.21.15.79:0/1598299024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4ad1b0 0x55c37c8542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 -- 172.21.15.79:0/1598299024 >> 172.21.15.79:0/1598299024 conn(0x55c37c4a1300 msgr2=0x55c37c84fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 -- 172.21.15.79:0/1598299024 shutdown_connections 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb862a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb8480b6650 0x7fb8480b8b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb850009fd0 tx=0x7fb850005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.289+0000 7fb8710c2740 1 -- 172.21.15.79:0/1598299024 wait complete. 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.290+0000 7fb8710c2740 1 -- start start 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.290+0000 7fb8710c2740 1 Processor -- start 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.290+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c866180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.290+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c866840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.290+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb8710c2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c37c6eeab0 con 0x55c37c4ad1b0 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c866840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb8710c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c37c75d570 con 0x55c37c48c4d0 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb8710c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c37c855f30 con 0x55c37c4842f0 2024-09-21T02:46:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c866840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:60508/0 (socket says 172.21.15.79:60508) 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 -- 172.21.15.79:0/987617449 learned_addr learned my addr 172.21.15.79:0/987617449 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb863400640 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c866180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb8710c2740 10 client.0 _ll_register_callbacks cb 0x55c37c76c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb863e00640 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 -- 172.21.15.79:0/987617449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 msgr2=0x55c37c866180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c866180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 -- 172.21.15.79:0/987617449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 msgr2=0x55c37c8673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.291+0000 7fb862a00640 1 -- 172.21.15.79:0/987617449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37c518790 con 0x55c37c48c4d0 2024-09-21T02:46:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb862a00640 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c866840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb850009940 tx=0x7fb850004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07923a20043fba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb84cc00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:46:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb84cc00640 1 -- 172.21.15.79:0/987617449 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85002d060 con 0x55c37c48c4d0 2024-09-21T02:46:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb85400e5b0 con 0x55c37c48c4d0 2024-09-21T02:46:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb84cc00640 1 -- 172.21.15.79:0/987617449 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb85001e430 con 0x55c37c48c4d0 2024-09-21T02:46:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb84cc00640 1 -- 172.21.15.79:0/987617449 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb850034050 con 0x55c37c48c4d0 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb8710c2740 10 client.26540 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.292+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c37c591620 con 0x55c37c48c4d0 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.293+0000 7fb84cc00640 1 -- 172.21.15.79:0/987617449 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb85400e5b0 con 0x55c37c48c4d0 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.293+0000 7fb84cc00640 1 -- 172.21.15.79:0/987617449 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb85001d460 con 0x55c37c48c4d0 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.294+0000 7fb8710c2740 10 client.26540 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.294+0000 7fb8710c2740 10 client.26540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.294+0000 7fb8710c2740 20 client.26540 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.294+0000 7fb8710c2740 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c46bd80 0x55c37c873a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.294+0000 7fb8710c2740 4 client.26540 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.294+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c37c7c9600 con 0x55c37c46bd80 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.294+0000 7fb863400640 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c46bd80 0x55c37c873a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.295+0000 7fb84cc00640 10 client.26540 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.295+0000 7fb863400640 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c46bd80 0x55c37c873a10 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdc155aee8beb521 server_cookie=4131af20c4fb8a5d in_seq=0 out_seq=0 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.296+0000 7fb84cc00640 1 -- 172.21.15.79:0/987617449 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c37c7c9600 con 0x55c37c46bd80 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.296+0000 7fb84cc00640 10 client.26540 handle_command_reply: tid=0 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.296+0000 7fb8710c2740 1 client.26540 shutdown 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.296+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 msgr2=0x55c37c866840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.296+0000 7fb8710c2740 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c866840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb850009940 tx=0x7fb850004730 comp rx=0 tx=0).stop 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 shutdown_connections 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c46bd80 0x55c37c873a10 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c866840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 --2- 172.21.15.79:0/987617449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c866180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 >> 172.21.15.79:0/987617449 conn(0x55c37c4a1300 msgr2=0x55c37c84e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb84cc00640 0 client.26540 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 shutdown_connections 2024-09-21T02:46:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 1 -- 172.21.15.79:0/987617449 wait complete. 2024-09-21T02:46:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.297+0000 7fb8710c2740 20 client.26540 trim_cache size 0 max 16384 2024-09-21T02:46:25.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:24 smithi148 ceph-mon[34626]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 512 op/s 2024-09-21T02:46:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.320+0000 7fb8710c2740 1 Processor -- start 2024-09-21T02:46:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.320+0000 7fb8710c2740 1 -- start start 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c84f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c84aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb8710c2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb864075250 con 0x55c37c4ad1b0 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb8710c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641b3290 con 0x55c37c48c4d0 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb8710c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641b1080 con 0x55c37c4842f0 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb862a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c84aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb862a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c84aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:60522/0 (socket says 172.21.15.79:60522) 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb862a00640 1 -- 172.21.15.79:0/3200321510 learned_addr learned my addr 172.21.15.79:0/3200321510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb863400640 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c84f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.321+0000 7fb863e00640 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb862a00640 1 -- 172.21.15.79:0/3200321510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 msgr2=0x55c37c84f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb862a00640 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c84f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb862a00640 1 -- 172.21.15.79:0/3200321510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 msgr2=0x55c37c8653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb862a00640 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb862a00640 1 -- 172.21.15.79:0/3200321510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c84a000 con 0x55c37c48c4d0 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb862a00640 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c84aa80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e70 tx=0x7fb850009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd9119ccac287df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb84f400640 1 -- 172.21.15.79:0/3200321510 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85001d3d0 con 0x55c37c48c4d0 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb84f400640 1 -- 172.21.15.79:0/3200321510 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb85001d570 con 0x55c37c48c4d0 2024-09-21T02:46:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.322+0000 7fb84f400640 1 -- 172.21.15.79:0/3200321510 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850003850 con 0x55c37c48c4d0 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.323+0000 7fb8710c2740 1 -- 172.21.15.79:0/3200321510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 msgr2=0x55c37c84aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.323+0000 7fb8710c2740 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c84aa80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e70 tx=0x7fb850009a20 comp rx=0 tx=0).stop 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 -- 172.21.15.79:0/3200321510 shutdown_connections 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4ad1b0 0x55c37c8653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c48c4d0 0x55c37c84aa80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 --2- 172.21.15.79:0/3200321510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c4842f0 0x55c37c84f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 -- 172.21.15.79:0/3200321510 >> 172.21.15.79:0/3200321510 conn(0x55c37c4a1300 msgr2=0x55c37c873960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 -- 172.21.15.79:0/3200321510 shutdown_connections 2024-09-21T02:46:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 -- 172.21.15.79:0/3200321510 wait complete. 2024-09-21T02:46:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.324+0000 7fb8710c2740 1 -- start start 2024-09-21T02:46:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 1 Processor -- start 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4842f0 0x55c37c86afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c48c4d0 0x55c37c86b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4ad1b0 0x55c37c86c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641b1750 con 0x55c37c4842f0 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641b2bc0 con 0x55c37c4ad1b0 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641b1e20 con 0x55c37c48c4d0 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.325+0000 7fb8710c2740 10 client.0 _ll_register_callbacks cb 0x7fb850009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c48c4d0 0x55c37c86b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c48c4d0 0x55c37c86b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:33198/0 (socket says 172.21.15.79:33198) 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb863e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4ad1b0 0x55c37c86c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 -- 172.21.15.79:0/815156250 learned_addr learned my addr 172.21.15.79:0/815156250 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb863400640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4842f0 0x55c37c86afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 -- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4ad1b0 msgr2=0x55c37c86c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4ad1b0 0x55c37c86c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 -- 172.21.15.79:0/815156250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4842f0 msgr2=0x55c37c86afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4842f0 0x55c37c86afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 -- 172.21.15.79:0/815156250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37c86c8e0 con 0x55c37c48c4d0 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb863400640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4842f0 0x55c37c86afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb863e00640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4ad1b0 0x55c37c86c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb862a00640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c48c4d0 0x55c37c86b660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb85001d920 tx=0x7fb8500042d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b445276d7f52635 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.326+0000 7fb84cc00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:46:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.327+0000 7fb84cc00640 1 -- 172.21.15.79:0/815156250 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85003d040 con 0x55c37c48c4d0 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.327+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb85001d570 con 0x55c37c48c4d0 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.327+0000 7fb84cc00640 1 -- 172.21.15.79:0/815156250 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb85001d9f0 con 0x55c37c48c4d0 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.327+0000 7fb84cc00640 1 -- 172.21.15.79:0/815156250 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb85004b050 con 0x55c37c48c4d0 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.327+0000 7fb8710c2740 10 client.26575 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.327+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c37c86dc00 con 0x55c37c48c4d0 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb84cc00640 1 -- 172.21.15.79:0/815156250 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb85001d570 con 0x55c37c48c4d0 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb84cc00640 1 -- 172.21.15.79:0/815156250 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb850040020 con 0x55c37c48c4d0 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb8710c2740 10 client.26575 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb8710c2740 10 client.26575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb8710c2740 20 client.26575 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb8710c2740 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c4411c0 0x55c37c8e0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb8710c2740 4 client.26575 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c37c7c50b0 con 0x55c37c4411c0 2024-09-21T02:46:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.328+0000 7fb863400640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c4411c0 0x55c37c8e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.330+0000 7fb84cc00640 10 client.26575 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.334+0000 7fb863400640 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c4411c0 0x55c37c8e0720 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f886e206dcad8e4 server_cookie=31c2d08a9307dde0 in_seq=0 out_seq=0 2024-09-21T02:46:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.460+0000 7fb84cc00640 1 -- 172.21.15.79:0/815156250 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c37c7c50b0 con 0x55c37c4411c0 2024-09-21T02:46:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.460+0000 7fb84cc00640 10 client.26575 handle_command_reply: tid=0 2024-09-21T02:46:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.460+0000 7fb8710c2740 1 client.26575 shutdown 2024-09-21T02:46:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c48c4d0 msgr2=0x55c37c86b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c48c4d0 0x55c37c86b660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb85001d920 tx=0x7fb8500042d0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 shutdown_connections 2024-09-21T02:46:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c37c4411c0 0x55c37c8e0720 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c37c4ad1b0 0x55c37c86c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c37c48c4d0 0x55c37c86b660 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 --2- 172.21.15.79:0/815156250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c37c4842f0 0x55c37c86afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.461+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 >> 172.21.15.79:0/815156250 conn(0x55c37c4a1300 msgr2=0x55c37c84f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.462+0000 7fb84cc00640 0 client.26575 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.462+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 shutdown_connections 2024-09-21T02:46:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.462+0000 7fb8710c2740 1 -- 172.21.15.79:0/815156250 wait complete. 2024-09-21T02:46:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.462+0000 7fb8710c2740 20 client.26575 trim_cache size 0 max 16384 2024-09-21T02:46:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:46:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:46:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:46:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:46:25.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb8480b6650 msgr2=0x7fb8480b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb8480b6650 0x7fb8480b8b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb850009fd0 tx=0x7fb850005f90 comp rx=0 tx=0).stop 2024-09-21T02:46:25.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb864104f00 msgr2=0x7fb864198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb864104f00 0x7fb864198d70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00cce0 tx=0x7fb85c00a620 comp rx=0 tx=0).stop 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 shutdown_connections 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb8480b6650 0x7fb8480b8b60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb864104f00 0x7fb864198d70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb864104560 0x7fb8641981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 --2- 172.21.15.79:0/2901583896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8641034e0 0x7fb864197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 >> 172.21.15.79:0/2901583896 conn(0x7fb8640fee20 msgr2=0x7fb864107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 shutdown_connections 2024-09-21T02:46:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:25.464+0000 7fb868a00640 1 -- 172.21.15.79:0/2901583896 wait complete. 2024-09-21T02:46:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 630.0 s, 514.8 tps, lat 188.838 ms stddev 215.631 2024-09-21T02:46:27.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:26 smithi098 ceph-mon[34832]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 522 op/s 2024-09-21T02:46:27.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:26 smithi079 ceph-mon[30788]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 522 op/s 2024-09-21T02:46:27.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:26 smithi148 ceph-mon[34626]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 522 op/s 2024-09-21T02:46:29.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:28 smithi098 ceph-mon[34832]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 MiB/s wr, 449 op/s 2024-09-21T02:46:29.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:28 smithi079 ceph-mon[30788]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 MiB/s wr, 449 op/s 2024-09-21T02:46:29.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:28 smithi148 ceph-mon[34626]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 MiB/s wr, 449 op/s 2024-09-21T02:46:31.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:30 smithi098 ceph-mon[34832]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 468 op/s 2024-09-21T02:46:31.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:30 smithi079 ceph-mon[30788]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 468 op/s 2024-09-21T02:46:31.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:30 smithi148 ceph-mon[34626]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 468 op/s 2024-09-21T02:46:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 635.0 s, 528.0 tps, lat 193.824 ms stddev 223.350 2024-09-21T02:46:33.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:32 smithi098 ceph-mon[34832]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 506 op/s 2024-09-21T02:46:33.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:32 smithi079 ceph-mon[30788]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 506 op/s 2024-09-21T02:46:33.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:32 smithi148 ceph-mon[34626]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 506 op/s 2024-09-21T02:46:35.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:34 smithi079 ceph-mon[30788]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.9 MiB/s wr, 465 op/s 2024-09-21T02:46:35.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:34 smithi148 ceph-mon[34626]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.9 MiB/s wr, 465 op/s 2024-09-21T02:46:35.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:34 smithi098 ceph-mon[34832]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.9 MiB/s wr, 465 op/s 2024-09-21T02:46:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 640.0 s, 591.2 tps, lat 172.548 ms stddev 193.825 2024-09-21T02:46:37.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:36 smithi079 ceph-mon[30788]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 496 op/s 2024-09-21T02:46:37.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:36 smithi148 ceph-mon[34626]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 496 op/s 2024-09-21T02:46:37.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:36 smithi098 ceph-mon[34832]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 496 op/s 2024-09-21T02:46:39.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:38 smithi079 ceph-mon[30788]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.5 MiB/s wr, 454 op/s 2024-09-21T02:46:39.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:38 smithi148 ceph-mon[34626]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.5 MiB/s wr, 454 op/s 2024-09-21T02:46:39.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:38 smithi098 ceph-mon[34832]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.5 MiB/s wr, 454 op/s 2024-09-21T02:46:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.154+0000 7f7d95600640 1 -- 172.21.15.79:0/1434140147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d901034c0 msgr2=0x7f7d901038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.154+0000 7f7d95600640 1 --2- 172.21.15.79:0/1434140147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d901034c0 0x7f7d901038d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009900 tx=0x7f7d7c02a410 comp rx=0 tx=0).stop 2024-09-21T02:46:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.155+0000 7f7d95600640 1 -- 172.21.15.79:0/1434140147 shutdown_connections 2024-09-21T02:46:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.155+0000 7f7d95600640 1 --2- 172.21.15.79:0/1434140147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d90103e60 0x7f7d9010a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.155+0000 7f7d95600640 1 --2- 172.21.15.79:0/1434140147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d901034c0 0x7f7d901038d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.155+0000 7f7d95600640 1 --2- 172.21.15.79:0/1434140147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d90102440 0x7f7d901028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.155+0000 7f7d95600640 1 -- 172.21.15.79:0/1434140147 >> 172.21.15.79:0/1434140147 conn(0x7f7d900fdd80 msgr2=0x7f7d90100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.155+0000 7f7d95600640 1 -- 172.21.15.79:0/1434140147 shutdown_connections 2024-09-21T02:46:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.155+0000 7f7d95600640 1 -- 172.21.15.79:0/1434140147 wait complete. 2024-09-21T02:46:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.156+0000 7f7d95600640 1 Processor -- start 2024-09-21T02:46:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.157+0000 7f7d95600640 1 -- start start 2024-09-21T02:46:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.157+0000 7f7d95600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d90102440 0x7f7d90111580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.157+0000 7f7d95600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d901034c0 0x7f7d90111bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.157+0000 7f7d8fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d90102440 0x7f7d90111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.157+0000 7f7d95600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d90103e60 0x7f7d901127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.157+0000 7f7d8fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d90102440 0x7f7d90111580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38888/0 (socket says 172.21.15.79:38888) 2024-09-21T02:46:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d8fe00640 1 -- 172.21.15.79:0/2109835784 learned_addr learned my addr 172.21.15.79:0/2109835784 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90115860 con 0x7f7d901034c0 2024-09-21T02:46:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901156e0 con 0x7f7d90102440 2024-09-21T02:46:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901159e0 con 0x7f7d90103e60 2024-09-21T02:46:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d94c00640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d90103e60 0x7f7d901127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d8fe00640 1 -- 172.21.15.79:0/2109835784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d90103e60 msgr2=0x7f7d901127a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d90103e60 0x7f7d901127a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d8fe00640 1 -- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d901034c0 msgr2=0x7f7d90111bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d901034c0 0x7f7d90111bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.158+0000 7f7d8fe00640 1 -- 172.21.15.79:0/2109835784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d90112fc0 con 0x7f7d90102440 2024-09-21T02:46:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.159+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d90102440 0x7f7d90111580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b4a0 tx=0x7f7d8000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.159+0000 7f7d8cc00640 1 -- 172.21.15.79:0/2109835784 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80014070 con 0x7f7d90102440 2024-09-21T02:46:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.159+0000 7f7d8cc00640 1 -- 172.21.15.79:0/2109835784 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d80010ac0 con 0x7f7d90102440 2024-09-21T02:46:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.159+0000 7f7d8cc00640 1 -- 172.21.15.79:0/2109835784 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80017c30 con 0x7f7d90102440 2024-09-21T02:46:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.161+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d901132b0 con 0x7f7d90102440 2024-09-21T02:46:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.161+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d901139f0 con 0x7f7d90102440 2024-09-21T02:46:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.168+0000 7f7d8cc00640 1 -- 172.21.15.79:0/2109835784 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7d80017070 con 0x7f7d90102440 2024-09-21T02:46:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.168+0000 7f7d9de07740 1 Processor -- start 2024-09-21T02:46:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.168+0000 7f7d9de07740 1 -- start start 2024-09-21T02:46:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.169+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c98348a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.169+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.169+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98348b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.169+0000 7f7d9de07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c9833fd6b0 con 0x55c9830c24d0 2024-09-21T02:46:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.169+0000 7f7d9de07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c9833ecae0 con 0x55c9830ba2f0 2024-09-21T02:46:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.169+0000 7f7d9de07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c9833f08f0 con 0x55c9830e31b0 2024-09-21T02:46:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.169+0000 7f7d8fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c98348a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c98348a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:43106/0 (socket says 172.21.15.79:43106) 2024-09-21T02:46:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38896/0 (socket says 172.21.15.79:38896) 2024-09-21T02:46:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d94c00640 1 -- 172.21.15.79:0/2500550371 learned_addr learned my addr 172.21.15.79:0/2500550371 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8f400640 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98348b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8fe00640 1 -- 172.21.15.79:0/2500550371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 msgr2=0x55c98348a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c98348a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8fe00640 1 -- 172.21.15.79:0/2500550371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 msgr2=0x55c98348b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98348b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8fe00640 1 -- 172.21.15.79:0/2500550371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9833b9780 con 0x55c9830ba2f0 2024-09-21T02:46:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.170+0000 7f7d8cc00640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d740b6590 0x7f7d740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.171+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348a920 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7d800e4030 tx=0x7f7d800ecf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66bc28ab7b3535b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.173+0000 7f7d85200640 1 -- 172.21.15.79:0/2500550371 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d800f5070 con 0x55c9830ba2f0 2024-09-21T02:46:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.173+0000 7f7d85200640 1 -- 172.21.15.79:0/2500550371 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d800eede0 con 0x55c9830ba2f0 2024-09-21T02:46:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.173+0000 7f7d85200640 1 -- 172.21.15.79:0/2500550371 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d800f0810 con 0x55c9830ba2f0 2024-09-21T02:46:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d94c00640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d740b6590 0x7f7d740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d9de07740 1 -- 172.21.15.79:0/2500550371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 msgr2=0x55c98348a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348a920 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7d800e4030 tx=0x7f7d800ecf10 comp rx=0 tx=0).stop 2024-09-21T02:46:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d9de07740 1 -- 172.21.15.79:0/2500550371 shutdown_connections 2024-09-21T02:46:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98348b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348a920 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2500550371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c98348a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.174+0000 7f7d9de07740 1 -- 172.21.15.79:0/2500550371 >> 172.21.15.79:0/2500550371 conn(0x55c9830d7300 msgr2=0x55c983485d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.175+0000 7f7d9de07740 1 -- 172.21.15.79:0/2500550371 shutdown_connections 2024-09-21T02:46:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.175+0000 7f7d9de07740 1 -- 172.21.15.79:0/2500550371 wait complete. 2024-09-21T02:46:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.175+0000 7f7d8cc00640 1 -- 172.21.15.79:0/2109835784 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7d800e6910 con 0x7f7d90102440 2024-09-21T02:46:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.176+0000 7f7d9de07740 1 -- start start 2024-09-21T02:46:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.176+0000 7f7d9de07740 1 Processor -- start 2024-09-21T02:46:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.176+0000 7f7d94c00640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d740b6590 0x7f7d740b8aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009420 tx=0x7f7d8800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830ba2f0 0x55c9834939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830c24d0 0x55c9834940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c983494c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d9de07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c983324ab0 con 0x55c9830ba2f0 2024-09-21T02:46:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d9de07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c983393570 con 0x55c9830c24d0 2024-09-21T02:46:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d9de07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c98348bf90 con 0x55c9830e31b0 2024-09-21T02:46:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c983494c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c983494c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:43116/0 (socket says 172.21.15.79:43116) 2024-09-21T02:46:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d94c00640 1 -- 172.21.15.79:0/500694898 learned_addr learned my addr 172.21.15.79:0/500694898 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.177+0000 7f7d9de07740 10 client.0 _ll_register_callbacks cb 0x55c9833a2100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.178+0000 7f7d8f400640 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830c24d0 0x55c9834940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.178+0000 7f7d94c00640 1 -- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830c24d0 msgr2=0x55c9834940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.178+0000 7f7d94c00640 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830c24d0 0x55c9834940a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.178+0000 7f7d94c00640 1 -- 172.21.15.79:0/500694898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830ba2f0 msgr2=0x55c9834939e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.178+0000 7f7d94c00640 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830ba2f0 0x55c9834939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.178+0000 7f7d94c00640 1 -- 172.21.15.79:0/500694898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c98314e790 con 0x55c9830e31b0 2024-09-21T02:46:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.179+0000 7f7d8f400640 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830c24d0 0x55c9834940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:46:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.179+0000 7f7d94c00640 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c983494c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d880093f0 tx=0x7f7d88004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c254b6dd8883fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.179+0000 7f7d79600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:46:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.181+0000 7f7d79600640 1 -- 172.21.15.79:0/500694898 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d880223f0 con 0x55c9830e31b0 2024-09-21T02:46:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.181+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d800eede0 con 0x55c9830e31b0 2024-09-21T02:46:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.181+0000 7f7d79600640 1 -- 172.21.15.79:0/500694898 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7d88022590 con 0x55c9830e31b0 2024-09-21T02:46:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.182+0000 7f7d79600640 1 -- 172.21.15.79:0/500694898 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7d88022790 con 0x55c9830e31b0 2024-09-21T02:46:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.182+0000 7f7d9de07740 10 client.26584 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.182+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c9831c7620 con 0x55c9830e31b0 2024-09-21T02:46:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.183+0000 7f7d79600640 1 -- 172.21.15.79:0/500694898 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d800eede0 con 0x55c9830e31b0 2024-09-21T02:46:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.187+0000 7f7d79600640 1 -- 172.21.15.79:0/500694898 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7d88022930 con 0x55c9830e31b0 2024-09-21T02:46:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.187+0000 7f7d9de07740 10 client.26584 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.187+0000 7f7d9de07740 10 client.26584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.187+0000 7f7d9de07740 20 client.26584 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.187+0000 7f7d9de07740 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830a1d80 0x55c9834a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.187+0000 7f7d9de07740 4 client.26584 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.187+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9833ff600 con 0x55c9830a1d80 2024-09-21T02:46:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.188+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830a1d80 0x55c9834a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.189+0000 7f7d79600640 10 client.26584 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.189+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830a1d80 0x55c9834a12c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22d5edbd0a7f16aa server_cookie=5b92845df217c1b3 in_seq=0 out_seq=0 2024-09-21T02:46:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.190+0000 7f7d79600640 1 -- 172.21.15.79:0/500694898 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9833ff600 con 0x55c9830a1d80 2024-09-21T02:46:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.190+0000 7f7d79600640 10 client.26584 handle_command_reply: tid=0 2024-09-21T02:46:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.190+0000 7f7d9de07740 1 client.26584 shutdown 2024-09-21T02:46:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.191+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 msgr2=0x55c983494c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.191+0000 7f7d9de07740 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c983494c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d880093f0 tx=0x7f7d88004a80 comp rx=0 tx=0).stop 2024-09-21T02:46:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 shutdown_connections 2024-09-21T02:46:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830a1d80 0x55c9834a12c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c983494c10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830c24d0 0x55c9834940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 --2- 172.21.15.79:0/500694898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830ba2f0 0x55c9834939e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d79600640 0 client.26584 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 >> 172.21.15.79:0/500694898 conn(0x55c9830d7300 msgr2=0x55c983484360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 shutdown_connections 2024-09-21T02:46:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.192+0000 7f7d9de07740 1 -- 172.21.15.79:0/500694898 wait complete. 2024-09-21T02:46:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.193+0000 7f7d9de07740 20 client.26584 trim_cache size 0 max 16384 2024-09-21T02:46:40.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.230+0000 7f7d9de07740 1 Processor -- start 2024-09-21T02:46:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.230+0000 7f7d9de07740 1 -- start start 2024-09-21T02:46:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.231+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.231+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.231+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c9834a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.231+0000 7f7d9de07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901b95b0 con 0x55c9830c24d0 2024-09-21T02:46:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.231+0000 7f7d9de07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901bbe30 con 0x55c9830ba2f0 2024-09-21T02:46:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.231+0000 7f7d9de07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901b9c20 con 0x55c9830e31b0 2024-09-21T02:46:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.232+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c9834a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.232+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c9834a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:43120/0 (socket says 172.21.15.79:43120) 2024-09-21T02:46:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.232+0000 7f7d94c00640 1 -- 172.21.15.79:0/362164696 learned_addr learned my addr 172.21.15.79:0/362164696 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.232+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.232+0000 7f7d94c00640 1 -- 172.21.15.79:0/362164696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 msgr2=0x55c98348ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.232+0000 7f7d94c00640 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.233+0000 7f7d8f400640 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.233+0000 7f7d94c00640 1 -- 172.21.15.79:0/362164696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 msgr2=0x55c98349baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.233+0000 7f7d94c00640 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.233+0000 7f7d94c00640 1 -- 172.21.15.79:0/362164696 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9834866c0 con 0x55c9830e31b0 2024-09-21T02:46:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.233+0000 7f7d94c00640 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c9834a0f30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009670 tx=0x7f7d880229b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7404b92ff456e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.234+0000 7f7d7be00640 1 -- 172.21.15.79:0/362164696 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8803a020 con 0x55c9830e31b0 2024-09-21T02:46:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.235+0000 7f7d7be00640 1 -- 172.21.15.79:0/362164696 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d88027070 con 0x55c9830e31b0 2024-09-21T02:46:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.235+0000 7f7d7be00640 1 -- 172.21.15.79:0/362164696 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88030030 con 0x55c9830e31b0 2024-09-21T02:46:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 -- 172.21.15.79:0/362164696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 msgr2=0x55c9834a0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c9834a0f30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009670 tx=0x7f7d880229b0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 -- 172.21.15.79:0/362164696 shutdown_connections 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830e31b0 0x55c9834a0f30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 --2- 172.21.15.79:0/362164696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830ba2f0 0x55c98348ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 -- 172.21.15.79:0/362164696 >> 172.21.15.79:0/362164696 conn(0x55c9830d7300 msgr2=0x55c983485680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 -- 172.21.15.79:0/362164696 shutdown_connections 2024-09-21T02:46:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.237+0000 7f7d9de07740 1 -- 172.21.15.79:0/362164696 wait complete. 2024-09-21T02:46:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.238+0000 7f7d9de07740 1 -- start start 2024-09-21T02:46:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.238+0000 7f7d9de07740 1 Processor -- start 2024-09-21T02:46:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.241+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830ba2f0 0x55c98349b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d9de07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830e31b0 0x55c98349acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d9de07740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901ba2f0 con 0x55c9830c24d0 2024-09-21T02:46:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d9de07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901bb760 con 0x55c9830e31b0 2024-09-21T02:46:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d9de07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901ba9c0 con 0x55c9830ba2f0 2024-09-21T02:46:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d9de07740 10 client.0 _ll_register_callbacks cb 0x7f7d88009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830e31b0 0x55c98349acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d94c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830e31b0 0x55c98349acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:38926/0 (socket says 172.21.15.79:38926) 2024-09-21T02:46:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d94c00640 1 -- 172.21.15.79:0/2738287183 learned_addr learned my addr 172.21.15.79:0/2738287183 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.242+0000 7f7d8f400640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830ba2f0 0x55c98349b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d94c00640 1 -- 172.21.15.79:0/2738287183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830ba2f0 msgr2=0x55c98349b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d94c00640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830ba2f0 0x55c98349b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d94c00640 1 -- 172.21.15.79:0/2738287183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 msgr2=0x55c98349a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d94c00640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d94c00640 1 -- 172.21.15.79:0/2738287183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9834991c0 con 0x55c9830e31b0 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830ba2f0 0x55c98349b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.243+0000 7f7d94c00640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830e31b0 0x55c98349acf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800a180 tx=0x7f7d8800a1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbcb3ad647de99eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.244+0000 7f7d79600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.244+0000 7f7d79600640 1 -- 172.21.15.79:0/2738287183 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88030030 con 0x55c9830e31b0 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.244+0000 7f7d79600640 1 -- 172.21.15.79:0/2738287183 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f7d88004230 con 0x55c9830e31b0 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.244+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d88027070 con 0x55c9830e31b0 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.245+0000 7f7d79600640 1 -- 172.21.15.79:0/2738287183 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7d8803a040 con 0x55c9830e31b0 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.245+0000 7f7d9de07740 10 client.26561 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.245+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c98350be10 con 0x55c9830e31b0 2024-09-21T02:46:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.245+0000 7f7d79600640 1 -- 172.21.15.79:0/2738287183 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d88027070 con 0x55c9830e31b0 2024-09-21T02:46:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d79600640 1 -- 172.21.15.79:0/2738287183 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7d8802c6d0 con 0x55c9830e31b0 2024-09-21T02:46:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d9de07740 10 client.26561 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d9de07740 10 client.26561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d9de07740 20 client.26561 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830771c0 0x55c98350e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d9de07740 4 client.26561 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9833fb0b0 con 0x55c9830771c0 2024-09-21T02:46:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.248+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830771c0 0x55c98350e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.249+0000 7f7d8fe00640 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830771c0 0x55c98350e7a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5aa31fd3aca4560 server_cookie=b5f3ffc4746c4421 in_seq=0 out_seq=0 2024-09-21T02:46:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.249+0000 7f7d79600640 10 client.26561 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.278+0000 7f7d79600640 1 -- 172.21.15.79:0/2738287183 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9833fb0b0 con 0x55c9830771c0 2024-09-21T02:46:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.278+0000 7f7d79600640 10 client.26561 handle_command_reply: tid=0 2024-09-21T02:46:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.278+0000 7f7d9de07740 1 client.26561 shutdown 2024-09-21T02:46:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.279+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830e31b0 msgr2=0x55c98349acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.279+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830e31b0 0x55c98349acf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800a180 tx=0x7f7d8800a1b0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 shutdown_connections 2024-09-21T02:46:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c9830771c0 0x55c98350e7a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c9830e31b0 0x55c98349acf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c9830c24d0 0x55c98349a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d79600640 0 client.26561 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 --2- 172.21.15.79:0/2738287183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9830ba2f0 0x55c98349b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 >> 172.21.15.79:0/2738287183 conn(0x55c9830d7300 msgr2=0x55c98348eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 shutdown_connections 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 1 -- 172.21.15.79:0/2738287183 wait complete. 2024-09-21T02:46:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.280+0000 7f7d9de07740 20 client.26561 trim_cache size 0 max 16384 2024-09-21T02:46:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:46:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:46:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:46:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d740b6590 msgr2=0x7f7d740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d740b6590 0x7f7d740b8aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009420 tx=0x7f7d8800d040 comp rx=0 tx=0).stop 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d90102440 msgr2=0x7f7d90111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d90102440 0x7f7d90111580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b4a0 tx=0x7f7d8000b960 comp rx=0 tx=0).stop 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 shutdown_connections 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f7d740b6590 0x7f7d740b8aa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d90103e60 0x7f7d901127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d901034c0 0x7f7d90111bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 --2- 172.21.15.79:0/2109835784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d90102440 0x7f7d90111580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 >> 172.21.15.79:0/2109835784 conn(0x7f7d900fdd80 msgr2=0x7f7d901067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 shutdown_connections 2024-09-21T02:46:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:40.281+0000 7f7d95600640 1 -- 172.21.15.79:0/2109835784 wait complete. 2024-09-21T02:46:41.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:40 smithi079 ceph-mon[30788]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 499 op/s 2024-09-21T02:46:41.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:40 smithi148 ceph-mon[34626]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 499 op/s 2024-09-21T02:46:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:40 smithi098 ceph-mon[34832]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 499 op/s 2024-09-21T02:46:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 645.0 s, 535.8 tps, lat 184.707 ms stddev 231.985 2024-09-21T02:46:43.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:42 smithi079 ceph-mon[30788]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-09-21T02:46:43.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:42 smithi148 ceph-mon[34626]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-09-21T02:46:43.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:42 smithi098 ceph-mon[34832]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-09-21T02:46:45.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:44 smithi079 ceph-mon[30788]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 511 op/s 2024-09-21T02:46:45.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:44 smithi148 ceph-mon[34626]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 511 op/s 2024-09-21T02:46:45.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:44 smithi098 ceph-mon[34832]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 511 op/s 2024-09-21T02:46:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 650.0 s, 514.4 tps, lat 187.711 ms stddev 214.948 2024-09-21T02:46:47.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:46 smithi079 ceph-mon[30788]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 548 op/s 2024-09-21T02:46:47.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:46 smithi148 ceph-mon[34626]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 548 op/s 2024-09-21T02:46:47.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:46 smithi098 ceph-mon[34832]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 548 op/s 2024-09-21T02:46:49.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:48 smithi079 ceph-mon[30788]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.8 MiB/s wr, 494 op/s 2024-09-21T02:46:49.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:48 smithi148 ceph-mon[34626]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.8 MiB/s wr, 494 op/s 2024-09-21T02:46:49.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:48 smithi098 ceph-mon[34832]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.8 MiB/s wr, 494 op/s 2024-09-21T02:46:51.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:50 smithi079 ceph-mon[30788]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 524 op/s 2024-09-21T02:46:51.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:50 smithi148 ceph-mon[34626]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 524 op/s 2024-09-21T02:46:51.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:50 smithi098 ceph-mon[34832]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 524 op/s 2024-09-21T02:46:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 655.0 s, 458.8 tps, lat 217.849 ms stddev 282.400 2024-09-21T02:46:53.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:52 smithi148 ceph-mon[34626]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 539 op/s 2024-09-21T02:46:53.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:52 smithi098 ceph-mon[34832]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 539 op/s 2024-09-21T02:46:53.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:52 smithi079 ceph-mon[30788]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 539 op/s 2024-09-21T02:46:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.626+0000 7f9e87000640 1 -- 172.21.15.79:0/2031160168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800770f0 msgr2=0x7f9e800757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.626+0000 7f9e87000640 1 --2- 172.21.15.79:0/2031160168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800770f0 0x7f9e800757b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009900 tx=0x7f9e7002a400 comp rx=0 tx=0).stop 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.627+0000 7f9e87000640 1 -- 172.21.15.79:0/2031160168 shutdown_connections 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.627+0000 7f9e87000640 1 --2- 172.21.15.79:0/2031160168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e8010b630 0x7f9e8010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.627+0000 7f9e87000640 1 --2- 172.21.15.79:0/2031160168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e80075cf0 0x7f9e80076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.627+0000 7f9e87000640 1 --2- 172.21.15.79:0/2031160168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e800770f0 0x7f9e800757b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.627+0000 7f9e87000640 1 -- 172.21.15.79:0/2031160168 >> 172.21.15.79:0/2031160168 conn(0x7f9e800fefe0 msgr2=0x7f9e80101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.627+0000 7f9e87000640 1 -- 172.21.15.79:0/2031160168 shutdown_connections 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.627+0000 7f9e87000640 1 -- 172.21.15.79:0/2031160168 wait complete. 2024-09-21T02:46:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.628+0000 7f9e87000640 1 Processor -- start 2024-09-21T02:46:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.628+0000 7f9e87000640 1 -- start start 2024-09-21T02:46:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e87000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e80075cf0 0x7f9e801035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e87000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e800770f0 0x7f9e80103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e87000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e8010b630 0x7f9e801047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e87000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80111510 con 0x7f9e800770f0 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e87000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80111390 con 0x7f9e8010b630 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e87000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80111690 con 0x7f9e80075cf0 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e8010b630 0x7f9e801047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e8010b630 0x7f9e801047e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58654/0 (socket says 172.21.15.79:58654) 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e7fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e80075cf0 0x7f9e801035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 -- 172.21.15.79:0/3945524432 learned_addr learned my addr 172.21.15.79:0/3945524432 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e7f400640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e800770f0 0x7f9e80103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 -- 172.21.15.79:0/3945524432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e80075cf0 msgr2=0x7f9e801035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e80075cf0 0x7f9e801035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 -- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e800770f0 msgr2=0x7f9e80103c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e800770f0 0x7f9e80103c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.629+0000 7f9e85000640 1 -- 172.21.15.79:0/3945524432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e80104f70 con 0x7f9e8010b630 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.630+0000 7f9e85000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e8010b630 0x7f9e801047e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800cce0 tx=0x7f9e7800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.630+0000 7f9e7cc00640 1 -- 172.21.15.79:0/3945524432 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800f450 con 0x7f9e8010b630 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.630+0000 7f9e7cc00640 1 -- 172.21.15.79:0/3945524432 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e7800faa0 con 0x7f9e8010b630 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.630+0000 7f9e7cc00640 1 -- 172.21.15.79:0/3945524432 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78018b70 con 0x7f9e8010b630 2024-09-21T02:46:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.630+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e80105260 con 0x7f9e8010b630 2024-09-21T02:46:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.630+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e801057d0 con 0x7f9e8010b630 2024-09-21T02:46:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.635+0000 7f9e8e0d9740 1 Processor -- start 2024-09-21T02:46:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e7cc00640 1 -- 172.21.15.79:0/3945524432 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9e78018d10 con 0x7f9e8010b630 2024-09-21T02:46:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e8e0d9740 1 -- start start 2024-09-21T02:46:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dfd2f0 0x5602a51cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4e054d0 0x5602a51ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5602a51406b0 con 0x5602a4e054d0 2024-09-21T02:46:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602a512fae0 con 0x5602a4dfd2f0 2024-09-21T02:46:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5602a51338f0 con 0x5602a4e261b0 2024-09-21T02:46:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.636+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48654/0 (socket says 172.21.15.79:48654) 2024-09-21T02:46:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 -- 172.21.15.79:0/3685051179 learned_addr learned my addr 172.21.15.79:0/3685051179 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dfd2f0 0x5602a51cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4e054d0 0x5602a51ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 -- 172.21.15.79:0/3685051179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dfd2f0 msgr2=0x5602a51cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dfd2f0 0x5602a51cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 -- 172.21.15.79:0/3685051179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4e054d0 msgr2=0x5602a51ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4e054d0 0x5602a51ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 -- 172.21.15.79:0/3685051179 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a50fc780 con 0x5602a4e261b0 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.637+0000 7f9e7f400640 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51cd0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c011850 tx=0x7f9e6c0097f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14b93c34c75add3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.638+0000 7f9e75600640 1 -- 172.21.15.79:0/3685051179 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c004030 con 0x5602a4e261b0 2024-09-21T02:46:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.638+0000 7f9e75600640 1 -- 172.21.15.79:0/3685051179 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6c005020 con 0x5602a4e261b0 2024-09-21T02:46:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.638+0000 7f9e75600640 1 -- 172.21.15.79:0/3685051179 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c004a00 con 0x5602a4e261b0 2024-09-21T02:46:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.638+0000 7f9e7cc00640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9e640b65d0 0x7f9e640b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.638+0000 7f9e7cc00640 1 -- 172.21.15.79:0/3945524432 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9e780e79f0 con 0x7f9e8010b630 2024-09-21T02:46:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9e640b65d0 0x7f9e640b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3685051179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 msgr2=0x5602a51cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51cd0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c011850 tx=0x7f9e6c0097f0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3685051179 shutdown_connections 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4e054d0 0x5602a51ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dfd2f0 0x5602a51cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3685051179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51cd0d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3685051179 >> 172.21.15.79:0/3685051179 conn(0x5602a4e1a300 msgr2=0x5602a51c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3685051179 shutdown_connections 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.639+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3685051179 wait complete. 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.640+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9e640b65d0 0x7f9e640b8ae0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9e70031500 tx=0x7f9e70000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.640+0000 7f9e8e0d9740 1 -- start start 2024-09-21T02:46:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.640+0000 7f9e8e0d9740 1 Processor -- start 2024-09-21T02:46:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.641+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.641+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.641+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.641+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5602a5067ab0 con 0x5602a4dfd2f0 2024-09-21T02:46:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.641+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602a50d6570 con 0x5602a4e054d0 2024-09-21T02:46:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.641+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5602a51cedb0 con 0x5602a4e261b0 2024-09-21T02:46:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.641+0000 7f9e8e0d9740 10 client.0 _ll_register_callbacks cb 0x5602a50e5100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.642+0000 7f9e7fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58674/0 (socket says 172.21.15.79:58674) 2024-09-21T02:46:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e7f400640 1 -- 172.21.15.79:0/4085096769 learned_addr learned my addr 172.21.15.79:0/4085096769 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e85000640 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e85000640 1 -- 172.21.15.79:0/4085096769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 msgr2=0x5602a51d6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e85000640 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e85000640 1 -- 172.21.15.79:0/4085096769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 msgr2=0x5602a51d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e85000640 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51d67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.643+0000 7f9e85000640 1 -- 172.21.15.79:0/4085096769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a4e91790 con 0x5602a4e261b0 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.644+0000 7f9e85000640 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d79d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9e780e5190 tx=0x7f9e780ad1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=587d67a3c04a42c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.644+0000 7f9e6a000640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.644+0000 7f9e6a000640 1 -- 172.21.15.79:0/4085096769 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780b22b0 con 0x5602a4e261b0 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.644+0000 7f9e6a000640 1 -- 172.21.15.79:0/4085096769 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9e780aca30 con 0x5602a4e261b0 2024-09-21T02:46:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.644+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e6c005020 con 0x5602a4e261b0 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.644+0000 7f9e6a000640 1 -- 172.21.15.79:0/4085096769 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9e780b71f0 con 0x5602a4e261b0 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.645+0000 7f9e8e0d9740 10 client.26602 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.645+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5602a4f0a620 con 0x5602a4e261b0 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.645+0000 7f9e6a000640 1 -- 172.21.15.79:0/4085096769 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6c005020 con 0x5602a4e261b0 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.645+0000 7f9e6a000640 1 -- 172.21.15.79:0/4085096769 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9e780ac4a0 con 0x5602a4e261b0 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.645+0000 7f9e8e0d9740 10 client.26602 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.645+0000 7f9e8e0d9740 10 client.26602 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.645+0000 7f9e8e0d9740 20 client.26602 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.646+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a4de4d80 0x5602a51e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.646+0000 7f9e8e0d9740 4 client.26602 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.646+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602a5142600 con 0x5602a4de4d80 2024-09-21T02:46:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.647+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a4de4d80 0x5602a51e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.648+0000 7f9e6a000640 10 client.26602 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.648+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a4de4d80 0x5602a51e3ea0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5e7dcd8db3f86f server_cookie=3d7e1f56507f14e1 in_seq=0 out_seq=0 2024-09-21T02:46:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e6a000640 1 -- 172.21.15.79:0/4085096769 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602a5142600 con 0x5602a4de4d80 2024-09-21T02:46:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e6a000640 10 client.26602 handle_command_reply: tid=0 2024-09-21T02:46:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 client.26602 shutdown 2024-09-21T02:46:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 msgr2=0x5602a51d79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d79d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9e780e5190 tx=0x7f9e780ad1e0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 shutdown_connections 2024-09-21T02:46:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a4de4d80 0x5602a51e3ea0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d79d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/4085096769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51d67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 >> 172.21.15.79:0/4085096769 conn(0x5602a4e1a300 msgr2=0x5602a51c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:53.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.649+0000 7f9e6a000640 0 client.26602 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:53.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.650+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 shutdown_connections 2024-09-21T02:46:53.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.650+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/4085096769 wait complete. 2024-09-21T02:46:53.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.651+0000 7f9e8e0d9740 20 client.26602 trim_cache size 0 max 16384 2024-09-21T02:46:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.678+0000 7f9e8e0d9740 1 Processor -- start 2024-09-21T02:46:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e8e0d9740 1 -- start start 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801a2430 con 0x5602a4dfd2f0 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801bbcf0 con 0x5602a4e054d0 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801a2aa0 con 0x5602a4e261b0 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.680+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:58690/0 (socket says 172.21.15.79:58690) 2024-09-21T02:46:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 -- 172.21.15.79:0/629839025 learned_addr learned my addr 172.21.15.79:0/629839025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e85000640 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 -- 172.21.15.79:0/629839025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 msgr2=0x5602a51d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 -- 172.21.15.79:0/629839025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 msgr2=0x5602a51ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 -- 172.21.15.79:0/629839025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a51d4930 con 0x5602a4e054d0 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.681+0000 7f9e7f400640 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d60d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc71555a779faaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.682+0000 7f9e74c00640 1 -- 172.21.15.79:0/629839025 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c005570 con 0x5602a4e054d0 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.682+0000 7f9e74c00640 1 -- 172.21.15.79:0/629839025 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6c00fc40 con 0x5602a4e054d0 2024-09-21T02:46:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.682+0000 7f9e74c00640 1 -- 172.21.15.79:0/629839025 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c003c00 con 0x5602a4e054d0 2024-09-21T02:46:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.684+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/629839025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 msgr2=0x5602a51d60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.684+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d60d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c005040 comp rx=0 tx=0).stop 2024-09-21T02:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.685+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/629839025 shutdown_connections 2024-09-21T02:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.685+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.685+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4e054d0 0x5602a51d60d0 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c005040 comp rx=0 tx=0).stop 2024-09-21T02:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.685+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/629839025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.685+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/629839025 >> 172.21.15.79:0/629839025 conn(0x5602a4e1a300 msgr2=0x5602a51d59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.687+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/629839025 shutdown_connections 2024-09-21T02:46:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.687+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/629839025 wait complete. 2024-09-21T02:46:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.688+0000 7f9e8e0d9740 1 -- start start 2024-09-21T02:46:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.688+0000 7f9e8e0d9740 1 Processor -- start 2024-09-21T02:46:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.689+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51de340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.689+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51da230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.689+0000 7f9e8e0d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dba1c0 0x5602a51da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.689+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801a3170 con 0x5602a4dfd2f0 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.689+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801bb620 con 0x5602a4dba1c0 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.689+0000 7f9e8e0d9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801a3840 con 0x5602a4e261b0 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.689+0000 7f9e8e0d9740 10 client.0 _ll_register_callbacks cb 0x7f9e78018510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.690+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51da230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.690+0000 7f9e7f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51da230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:48684/0 (socket says 172.21.15.79:48684) 2024-09-21T02:46:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.690+0000 7f9e7f400640 1 -- 172.21.15.79:0/3994485740 learned_addr learned my addr 172.21.15.79:0/3994485740 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:46:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.691+0000 7f9e85000640 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dba1c0 0x5602a51da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.691+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.694+0000 7f9e85000640 1 -- 172.21.15.79:0/3994485740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 msgr2=0x5602a51da230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.694+0000 7f9e85000640 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51da230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.694+0000 7f9e85000640 1 -- 172.21.15.79:0/3994485740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 msgr2=0x5602a51de340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.694+0000 7f9e85000640 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51de340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.694+0000 7f9e85000640 1 -- 172.21.15.79:0/3994485740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a51dacb0 con 0x5602a4dba1c0 2024-09-21T02:46:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.694+0000 7f9e85000640 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dba1c0 0x5602a51da770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800ccb0 tx=0x7f9e780b21c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d580817679687b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.695+0000 7f9e6a000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.695+0000 7f9e6a000640 1 -- 172.21.15.79:0/3994485740 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780c7020 con 0x5602a4dba1c0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.695+0000 7f9e6a000640 1 -- 172.21.15.79:0/3994485740 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f9e780b3670 con 0x5602a4dba1c0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.695+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e6c00fc40 con 0x5602a4dba1c0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.695+0000 7f9e6a000640 1 -- 172.21.15.79:0/3994485740 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9e780b22b0 con 0x5602a4dba1c0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.695+0000 7f9e8e0d9740 10 client.26579 fetch_fsmap learned FSMap version 21 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.695+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5602a525f900 con 0x5602a4dba1c0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e6a000640 1 -- 172.21.15.79:0/3994485740 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e7805b020 con 0x5602a4dba1c0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e6a000640 1 -- 172.21.15.79:0/3994485740 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9e780a9240 con 0x5602a4dba1c0 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e8e0d9740 10 client.26579 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e8e0d9740 10 client.26579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e8e0d9740 20 client.26579 populate_metadata read hostname 'smithi079' 2024-09-21T02:46:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a5260120 0x5602a5262580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e8e0d9740 4 client.26579 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.696+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9e6c00fc40 con 0x5602a5260120 2024-09-21T02:46:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.700+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a5260120 0x5602a5262580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.700+0000 7f9e7fe00640 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a5260120 0x5602a5262580 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=509eac7780205a56 server_cookie=c2fab001a48afd6c in_seq=0 out_seq=0 2024-09-21T02:46:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.700+0000 7f9e6a000640 10 client.26579 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.932+0000 7f9e6a000640 1 -- 172.21.15.79:0/3994485740 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f9e6c00fc40 con 0x5602a5260120 2024-09-21T02:46:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e6a000640 10 client.26579 handle_command_reply: tid=0 2024-09-21T02:46:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 client.26579 shutdown 2024-09-21T02:46:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dba1c0 msgr2=0x5602a51da770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dba1c0 0x5602a51da770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800ccb0 tx=0x7f9e780b21c0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 shutdown_connections 2024-09-21T02:46:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602a5260120 0x5602a5262580 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602a4dba1c0 0x5602a51da770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602a4e261b0 0x5602a51da230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 --2- 172.21.15.79:0/3994485740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602a4dfd2f0 0x5602a51de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 >> 172.21.15.79:0/3994485740 conn(0x5602a4e1a300 msgr2=0x5602a51d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.933+0000 7f9e6a000640 0 client.26579 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:46:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.934+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 shutdown_connections 2024-09-21T02:46:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.934+0000 7f9e8e0d9740 1 -- 172.21.15.79:0/3994485740 wait complete. 2024-09-21T02:46:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.934+0000 7f9e8e0d9740 20 client.26579 trim_cache size 0 max 16384 2024-09-21T02:46:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:46:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:46:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:46:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9e640b65d0 msgr2=0x7f9e640b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9e640b65d0 0x7f9e640b8ae0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9e70031500 tx=0x7f9e70000bc0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e8010b630 msgr2=0x7f9e801047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e8010b630 0x7f9e801047e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800cce0 tx=0x7f9e7800a620 comp rx=0 tx=0).stop 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 shutdown_connections 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f9e640b65d0 0x7f9e640b8ae0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e8010b630 0x7f9e801047e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e800770f0 0x7f9e80103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 --2- 172.21.15.79:0/3945524432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e80075cf0 0x7f9e801035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 >> 172.21.15.79:0/3945524432 conn(0x7f9e800fefe0 msgr2=0x7f9e80107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 shutdown_connections 2024-09-21T02:46:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:46:53.935+0000 7f9e87000640 1 -- 172.21.15.79:0/3945524432 wait complete. 2024-09-21T02:46:55.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:54 smithi148 ceph-mon[34626]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 492 op/s 2024-09-21T02:46:55.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:54 smithi098 ceph-mon[34832]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 492 op/s 2024-09-21T02:46:55.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:54 smithi079 ceph-mon[30788]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 492 op/s 2024-09-21T02:46:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 660.0 s, 476.2 tps, lat 209.681 ms stddev 244.250 2024-09-21T02:46:57.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:57 smithi148 ceph-mon[34626]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 504 op/s 2024-09-21T02:46:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:57 smithi098 ceph-mon[34832]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 504 op/s 2024-09-21T02:46:57.481 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:57 smithi079 ceph-mon[30788]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 504 op/s 2024-09-21T02:46:59.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:46:59 smithi148 ceph-mon[34626]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 448 op/s 2024-09-21T02:46:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:46:59 smithi098 ceph-mon[34832]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 448 op/s 2024-09-21T02:46:59.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:46:59 smithi079 ceph-mon[30788]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 448 op/s 2024-09-21T02:47:01.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:01 smithi148 ceph-mon[34626]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.9 MiB/s wr, 474 op/s 2024-09-21T02:47:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:01 smithi098 ceph-mon[34832]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.9 MiB/s wr, 474 op/s 2024-09-21T02:47:01.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:01 smithi079 ceph-mon[30788]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.9 MiB/s wr, 474 op/s 2024-09-21T02:47:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 665.0 s, 493.8 tps, lat 204.004 ms stddev 279.452 2024-09-21T02:47:03.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:03 smithi148 ceph-mon[34626]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 480 op/s 2024-09-21T02:47:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:03 smithi098 ceph-mon[34832]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 480 op/s 2024-09-21T02:47:03.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:03 smithi079 ceph-mon[30788]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 480 op/s 2024-09-21T02:47:05.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:05 smithi148 ceph-mon[34626]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.5 MiB/s wr, 468 op/s 2024-09-21T02:47:05.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:05 smithi098 ceph-mon[34832]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.5 MiB/s wr, 468 op/s 2024-09-21T02:47:05.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:05 smithi079 ceph-mon[30788]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.5 MiB/s wr, 468 op/s 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 670.0 s, 430.0 tps, lat 239.756 ms stddev 306.228 2024-09-21T02:47:07.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:07 smithi148 ceph-mon[34626]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 489 op/s 2024-09-21T02:47:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.315+0000 7fb42a800640 1 -- 172.21.15.79:0/3477543161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb42410fe20 msgr2=0x7fb424112240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.316+0000 7fb42a800640 1 --2- 172.21.15.79:0/3477543161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb42410fe20 0x7fb424112240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009900 tx=0x7fb41c02a410 comp rx=0 tx=0).stop 2024-09-21T02:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.318+0000 7fb42a800640 1 -- 172.21.15.79:0/3477543161 shutdown_connections 2024-09-21T02:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.319+0000 7fb42a800640 1 --2- 172.21.15.79:0/3477543161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb42410fe20 0x7fb424112240 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.319+0000 7fb42a800640 1 --2- 172.21.15.79:0/3477543161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb424075cf0 0x7fb424076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.319+0000 7fb42a800640 1 --2- 172.21.15.79:0/3477543161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4240770f0 0x7fb4240757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.319+0000 7fb42a800640 1 -- 172.21.15.79:0/3477543161 >> 172.21.15.79:0/3477543161 conn(0x7fb4240fefe0 msgr2=0x7fb424101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.320+0000 7fb42a800640 1 -- 172.21.15.79:0/3477543161 shutdown_connections 2024-09-21T02:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.320+0000 7fb42a800640 1 -- 172.21.15.79:0/3477543161 wait complete. 2024-09-21T02:47:07.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.324+0000 7fb42a800640 1 Processor -- start 2024-09-21T02:47:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.324+0000 7fb42a800640 1 -- start start 2024-09-21T02:47:07.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.325+0000 7fb42a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb424075cf0 0x7fb42410cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb42a800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4240770f0 0x7fb42410d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb42a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb42410fe20 0x7fb42410dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb423400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb424075cf0 0x7fb42410cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb423400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb424075cf0 0x7fb42410cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49644/0 (socket says 172.21.15.79:49644) 2024-09-21T02:47:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb423400640 1 -- 172.21.15.79:0/650431499 learned_addr learned my addr 172.21.15.79:0/650431499 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb424115930 con 0x7fb4240770f0 2024-09-21T02:47:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb4241157b0 con 0x7fb42410fe20 2024-09-21T02:47:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.326+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb424115ab0 con 0x7fb424075cf0 2024-09-21T02:47:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.327+0000 7fb423400640 1 -- 172.21.15.79:0/650431499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb42410fe20 msgr2=0x7fb42410dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.327+0000 7fb423400640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb42410fe20 0x7fb42410dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.327+0000 7fb423400640 1 -- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4240770f0 msgr2=0x7fb42410d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.327+0000 7fb422a00640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4240770f0 0x7fb42410d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.327+0000 7fb423400640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4240770f0 0x7fb42410d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.327+0000 7fb423400640 1 -- 172.21.15.79:0/650431499 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42410e550 con 0x7fb424075cf0 2024-09-21T02:47:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.327+0000 7fb422a00640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4240770f0 0x7fb42410d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:47:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.328+0000 7fb423400640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb424075cf0 0x7fb42410cb10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb41400ba50 tx=0x7fb41400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.328+0000 7fb41be00640 1 -- 172.21.15.79:0/650431499 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414019070 con 0x7fb424075cf0 2024-09-21T02:47:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.328+0000 7fb41be00640 1 -- 172.21.15.79:0/650431499 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41400cbe0 con 0x7fb424075cf0 2024-09-21T02:47:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.328+0000 7fb41be00640 1 -- 172.21.15.79:0/650431499 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140075d0 con 0x7fb424075cf0 2024-09-21T02:47:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.328+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42410e840 con 0x7fb424075cf0 2024-09-21T02:47:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.329+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42410ef80 con 0x7fb424075cf0 2024-09-21T02:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.338+0000 7fb431889740 1 Processor -- start 2024-09-21T02:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.338+0000 7fb431889740 1 -- start start 2024-09-21T02:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.338+0000 7fb431889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6f51b0 0x55edaca9c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb431889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6cc2f0 0x55edaca9c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb431889740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6d44d0 0x55edaca9d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb431889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55edaca0f6b0 con 0x55edac6f51b0 2024-09-21T02:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb431889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55edac9feae0 con 0x55edac6cc2f0 2024-09-21T02:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb431889740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55edaca028f0 con 0x55edac6d44d0 2024-09-21T02:47:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb423e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6f51b0 0x55edaca9c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb422a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6d44d0 0x55edaca9d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb422a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6d44d0 0x55edaca9d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49660/0 (socket says 172.21.15.79:49660) 2024-09-21T02:47:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.339+0000 7fb422a00640 1 -- 172.21.15.79:0/1388339304 learned_addr learned my addr 172.21.15.79:0/1388339304 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.340+0000 7fb423e00640 1 -- 172.21.15.79:0/1388339304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6d44d0 msgr2=0x55edaca9d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.340+0000 7fb423e00640 1 --2- 172.21.15.79:0/1388339304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6d44d0 0x55edaca9d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.340+0000 7fb423e00640 1 -- 172.21.15.79:0/1388339304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6cc2f0 msgr2=0x55edaca9c740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.340+0000 7fb423e00640 1 --2- 172.21.15.79:0/1388339304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6cc2f0 0x55edaca9c740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.340+0000 7fb423e00640 1 -- 172.21.15.79:0/1388339304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edac9cb780 con 0x55edac6f51b0 2024-09-21T02:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.341+0000 7fb423e00640 1 --2- 172.21.15.79:0/1388339304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6f51b0 0x55edaca9c0d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb41c02a930 tx=0x7fb41c032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7012cdaf04b1bcca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.342+0000 7fb41be00640 1 -- 172.21.15.79:0/650431499 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb414007830 con 0x7fb424075cf0 2024-09-21T02:47:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.345+0000 7fb41be00640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4080b6590 0x7fb4080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.345+0000 7fb418c00640 1 -- 172.21.15.79:0/1388339304 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c040070 con 0x55edac6f51b0 2024-09-21T02:47:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.345+0000 7fb418c00640 1 -- 172.21.15.79:0/1388339304 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41c004020 con 0x55edac6f51b0 2024-09-21T02:47:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.345+0000 7fb418c00640 1 -- 172.21.15.79:0/1388339304 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c035040 con 0x55edac6f51b0 2024-09-21T02:47:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.346+0000 7fb41be00640 1 -- 172.21.15.79:0/650431499 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb4140e6b90 con 0x7fb424075cf0 2024-09-21T02:47:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.346+0000 7fb431889740 1 -- 172.21.15.79:0/1388339304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6f51b0 msgr2=0x55edaca9c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.346+0000 7fb431889740 1 --2- 172.21.15.79:0/1388339304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6f51b0 0x55edaca9c0d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb41c02a930 tx=0x7fb41c032bd0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.347+0000 7fb423400640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4080b6590 0x7fb4080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.348+0000 7fb423400640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4080b6590 0x7fb4080b8aa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb4140ac900 tx=0x7fb414004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.349+0000 7fb431889740 1 -- 172.21.15.79:0/1388339304 shutdown_connections 2024-09-21T02:47:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.349+0000 7fb431889740 1 --2- 172.21.15.79:0/1388339304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6d44d0 0x55edaca9d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.349+0000 7fb431889740 1 --2- 172.21.15.79:0/1388339304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6cc2f0 0x55edaca9c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.349+0000 7fb431889740 1 --2- 172.21.15.79:0/1388339304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6f51b0 0x55edaca9c0d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.349+0000 7fb431889740 1 -- 172.21.15.79:0/1388339304 >> 172.21.15.79:0/1388339304 conn(0x55edac6e9300 msgr2=0x55edaca97b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.349+0000 7fb431889740 1 -- 172.21.15.79:0/1388339304 shutdown_connections 2024-09-21T02:47:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.349+0000 7fb431889740 1 -- 172.21.15.79:0/1388339304 wait complete. 2024-09-21T02:47:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.350+0000 7fb431889740 1 -- start start 2024-09-21T02:47:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.350+0000 7fb431889740 1 Processor -- start 2024-09-21T02:47:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.353+0000 7fb431889740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6cc2f0 0x55edacaa5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.353+0000 7fb431889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6d44d0 0x55edacaa5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.353+0000 7fb431889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6f51b0 0x55edacaa6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.353+0000 7fb431889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55edac936ab0 con 0x55edac6d44d0 2024-09-21T02:47:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.353+0000 7fb431889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55edac9a5570 con 0x55edac6f51b0 2024-09-21T02:47:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.353+0000 7fb431889740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55edaca9dd50 con 0x55edac6cc2f0 2024-09-21T02:47:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.354+0000 7fb431889740 10 client.0 _ll_register_callbacks cb 0x55edac9b4100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.354+0000 7fb423e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6f51b0 0x55edacaa6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.354+0000 7fb423e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6f51b0 0x55edacaa6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51616/0 (socket says 172.21.15.79:51616) 2024-09-21T02:47:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.354+0000 7fb423e00640 1 -- 172.21.15.79:0/3444000141 learned_addr learned my addr 172.21.15.79:0/3444000141 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.354+0000 7fb422a00640 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6d44d0 0x55edacaa5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.355+0000 7fb423e00640 1 -- 172.21.15.79:0/3444000141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6cc2f0 msgr2=0x55edacaa5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.355+0000 7fb423e00640 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6cc2f0 0x55edacaa5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.355+0000 7fb423e00640 1 -- 172.21.15.79:0/3444000141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6d44d0 msgr2=0x55edacaa5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.355+0000 7fb423e00640 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6d44d0 0x55edacaa5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.355+0000 7fb423e00640 1 -- 172.21.15.79:0/3444000141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edac760790 con 0x55edac6f51b0 2024-09-21T02:47:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.355+0000 7fb423e00640 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6f51b0 0x55edacaa6990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb41c005620 tx=0x7fb41c032f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68cf716c732a808 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.355+0000 7fb40d600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.356+0000 7fb40d600640 1 -- 172.21.15.79:0/3444000141 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c04c060 con 0x55edac6f51b0 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.356+0000 7fb40d600640 1 -- 172.21.15.79:0/3444000141 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb41c0317a0 con 0x55edac6f51b0 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.356+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb41c004020 con 0x55edac6f51b0 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.356+0000 7fb40d600640 1 -- 172.21.15.79:0/3444000141 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb41c040030 con 0x55edac6f51b0 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.356+0000 7fb431889740 10 client.26585 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.356+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55edac7d9620 con 0x55edac6f51b0 2024-09-21T02:47:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.358+0000 7fb40d600640 1 -- 172.21.15.79:0/3444000141 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41c004020 con 0x55edac6f51b0 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.358+0000 7fb40d600640 1 -- 172.21.15.79:0/3444000141 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb41c003a00 con 0x55edac6f51b0 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.358+0000 7fb431889740 10 client.26585 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.359+0000 7fb431889740 10 client.26585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.359+0000 7fb431889740 20 client.26585 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.359+0000 7fb431889740 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6b3d80 0x55edacab2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.359+0000 7fb431889740 4 client.26585 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.359+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edaca11600 con 0x55edac6b3d80 2024-09-21T02:47:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.360+0000 7fb422a00640 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6b3d80 0x55edacab2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.360+0000 7fb422a00640 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6b3d80 0x55edacab2a70 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83873114b333ffe2 server_cookie=cbce13ad5da9ac6 in_seq=0 out_seq=0 2024-09-21T02:47:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.361+0000 7fb40d600640 10 client.26585 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb40d600640 1 -- 172.21.15.79:0/3444000141 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edaca11600 con 0x55edac6b3d80 2024-09-21T02:47:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb40d600640 10 client.26585 handle_command_reply: tid=0 2024-09-21T02:47:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb431889740 1 client.26585 shutdown 2024-09-21T02:47:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6f51b0 msgr2=0x55edacaa6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb431889740 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6f51b0 0x55edacaa6990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb41c005620 tx=0x7fb41c032f00 comp rx=0 tx=0).stop 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 shutdown_connections 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb431889740 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6b3d80 0x55edacab2a70 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.362+0000 7fb431889740 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6f51b0 0x55edacaa6990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.363+0000 7fb40d600640 0 client.26585 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.363+0000 7fb431889740 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6d44d0 0x55edacaa5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.363+0000 7fb431889740 1 --2- 172.21.15.79:0/3444000141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6cc2f0 0x55edacaa5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.363+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 >> 172.21.15.79:0/3444000141 conn(0x55edac6e9300 msgr2=0x55edaca960e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.363+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 shutdown_connections 2024-09-21T02:47:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.364+0000 7fb431889740 1 -- 172.21.15.79:0/3444000141 wait complete. 2024-09-21T02:47:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.364+0000 7fb431889740 20 client.26585 trim_cache size 0 max 16384 2024-09-21T02:47:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.403+0000 7fb431889740 1 Processor -- start 2024-09-21T02:47:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.403+0000 7fb431889740 1 -- start start 2024-09-21T02:47:07.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:07 smithi098 ceph-mon[34832]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 489 op/s 2024-09-21T02:47:07.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb431889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaa43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb431889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edaca9cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb431889740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaa4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb431889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb4241b9480 con 0x55edac6cc2f0 2024-09-21T02:47:07.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb431889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb4241bbd00 con 0x55edac6d44d0 2024-09-21T02:47:07.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb431889740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb4241b9af0 con 0x55edac6f51b0 2024-09-21T02:47:07.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb422a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edaca9cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb422a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edaca9cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51620/0 (socket says 172.21.15.79:51620) 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.404+0000 7fb422a00640 1 -- 172.21.15.79:0/4108627781 learned_addr learned my addr 172.21.15.79:0/4108627781 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.405+0000 7fb422a00640 1 -- 172.21.15.79:0/4108627781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 msgr2=0x55edacaa4980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.405+0000 7fb422a00640 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaa4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.405+0000 7fb422a00640 1 -- 172.21.15.79:0/4108627781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 msgr2=0x55edacaa43c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.405+0000 7fb423e00640 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaa43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.405+0000 7fb422a00640 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaa43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.405+0000 7fb422a00640 1 -- 172.21.15.79:0/4108627781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edacab2de0 con 0x55edac6d44d0 2024-09-21T02:47:07.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.405+0000 7fb423e00640 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaa43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:47:07.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.408+0000 7fb422a00640 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edaca9cfe0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55edacab3180 tx=0x7fb410012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=149ebcee3090ff3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:07.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.408+0000 7fb40fe00640 1 -- 172.21.15.79:0/4108627781 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4100120d0 con 0x55edac6d44d0 2024-09-21T02:47:07.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.408+0000 7fb40fe00640 1 -- 172.21.15.79:0/4108627781 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb410012270 con 0x55edac6d44d0 2024-09-21T02:47:07.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.408+0000 7fb40fe00640 1 -- 172.21.15.79:0/4108627781 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410010720 con 0x55edac6d44d0 2024-09-21T02:47:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.409+0000 7fb431889740 1 -- 172.21.15.79:0/4108627781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 msgr2=0x55edaca9cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.409+0000 7fb431889740 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edaca9cfe0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55edacab3180 tx=0x7fb410012820 comp rx=0 tx=0).stop 2024-09-21T02:47:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.411+0000 7fb431889740 1 -- 172.21.15.79:0/4108627781 shutdown_connections 2024-09-21T02:47:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.411+0000 7fb431889740 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaa4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.411+0000 7fb431889740 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edaca9cfe0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.411+0000 7fb431889740 1 --2- 172.21.15.79:0/4108627781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaa43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.411+0000 7fb431889740 1 -- 172.21.15.79:0/4108627781 >> 172.21.15.79:0/4108627781 conn(0x55edac6e9300 msgr2=0x55edacaa3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.411+0000 7fb431889740 1 -- 172.21.15.79:0/4108627781 shutdown_connections 2024-09-21T02:47:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.411+0000 7fb431889740 1 -- 172.21.15.79:0/4108627781 wait complete. 2024-09-21T02:47:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.412+0000 7fb431889740 1 -- start start 2024-09-21T02:47:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.412+0000 7fb431889740 1 Processor -- start 2024-09-21T02:47:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.413+0000 7fb431889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.413+0000 7fb431889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edacaac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb431889740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb431889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb4241ba1c0 con 0x55edac6cc2f0 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb431889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb4241bb630 con 0x55edac6d44d0 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb431889740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb4241ba890 con 0x55edac6f51b0 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb431889740 10 client.0 _ll_register_callbacks cb 0x7fb41c032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb423e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb423e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:49678/0 (socket says 172.21.15.79:49678) 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb423e00640 1 -- 172.21.15.79:0/1997827394 learned_addr learned my addr 172.21.15.79:0/1997827394 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.414+0000 7fb423e00640 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.415+0000 7fb423e00640 1 -- 172.21.15.79:0/1997827394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 msgr2=0x55edacaac090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.415+0000 7fb423e00640 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edacaac090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.415+0000 7fb423e00640 1 -- 172.21.15.79:0/1997827394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 msgr2=0x55edacaad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.415+0000 7fb423e00640 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.415+0000 7fb423e00640 1 -- 172.21.15.79:0/1997827394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edacaacbc0 con 0x55edac6f51b0 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.416+0000 7fb423e00640 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaac5d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0059d0 tx=0x7fb41c031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3da45f086e25947c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:07.417 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.416+0000 7fb40d600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:47:07.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.420+0000 7fb40d600640 1 -- 172.21.15.79:0/1997827394 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c056080 con 0x55edac6f51b0 2024-09-21T02:47:07.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.420+0000 7fb40d600640 1 -- 172.21.15.79:0/1997827394 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb41c0037f0 con 0x55edac6f51b0 2024-09-21T02:47:07.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.421+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb410012270 con 0x55edac6f51b0 2024-09-21T02:47:07.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.421+0000 7fb40d600640 1 -- 172.21.15.79:0/1997827394 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb41c066050 con 0x55edac6f51b0 2024-09-21T02:47:07.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.421+0000 7fb431889740 10 client.26617 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:07.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.421+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55edacaaba10 con 0x55edac6f51b0 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb40d600640 1 -- 172.21.15.79:0/1997827394 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb410012270 con 0x55edac6f51b0 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb40d600640 1 -- 172.21.15.79:0/1997827394 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb41c044ca0 con 0x55edac6f51b0 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb431889740 10 client.26617 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb431889740 10 client.26617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb431889740 20 client.26617 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb431889740 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6891c0 0x55edacb1fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb431889740 4 client.26617 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.422+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edaca0d0b0 con 0x55edac6891c0 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.423+0000 7fb422a00640 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6891c0 0x55edacb1fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.423+0000 7fb40d600640 10 client.26617 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:07.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.428+0000 7fb422a00640 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6891c0 0x55edacb1fc00 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fec5f13aefb1a2e server_cookie=e975599288c59d8 in_seq=0 out_seq=0 2024-09-21T02:47:07.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:07 smithi079 ceph-mon[30788]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 489 op/s 2024-09-21T02:47:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.870+0000 7fb40d600640 1 -- 172.21.15.79:0/1997827394 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edaca0d0b0 con 0x55edac6891c0 2024-09-21T02:47:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.870+0000 7fb40d600640 10 client.26617 handle_command_reply: tid=0 2024-09-21T02:47:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.870+0000 7fb431889740 1 client.26617 shutdown 2024-09-21T02:47:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.870+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 msgr2=0x55edacaac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.870+0000 7fb431889740 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaac5d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0059d0 tx=0x7fb41c031400 comp rx=0 tx=0).stop 2024-09-21T02:47:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.871+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 shutdown_connections 2024-09-21T02:47:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.871+0000 7fb431889740 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55edac6891c0 0x55edacb1fc00 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.871+0000 7fb431889740 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edac6f51b0 0x55edacaac5d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.871+0000 7fb431889740 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55edac6d44d0 0x55edacaac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.871+0000 7fb431889740 1 --2- 172.21.15.79:0/1997827394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55edac6cc2f0 0x55edacaad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.871+0000 7fb40d600640 0 client.26617 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.871+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 >> 172.21.15.79:0/1997827394 conn(0x55edac6e9300 msgr2=0x55edacaa4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.872+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 shutdown_connections 2024-09-21T02:47:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.872+0000 7fb431889740 1 -- 172.21.15.79:0/1997827394 wait complete. 2024-09-21T02:47:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.872+0000 7fb431889740 20 client.26617 trim_cache size 0 max 16384 2024-09-21T02:47:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:47:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:47:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:47:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:47:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.873+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4080b6590 msgr2=0x7fb4080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4080b6590 0x7fb4080b8aa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb4140ac900 tx=0x7fb414004a40 comp rx=0 tx=0).stop 2024-09-21T02:47:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb424075cf0 msgr2=0x7fb42410cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb424075cf0 0x7fb42410cb10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb41400ba50 tx=0x7fb41400bf10 comp rx=0 tx=0).stop 2024-09-21T02:47:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 shutdown_connections 2024-09-21T02:47:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4080b6590 0x7fb4080b8aa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb42410fe20 0x7fb42410dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4240770f0 0x7fb42410d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 --2- 172.21.15.79:0/650431499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb424075cf0 0x7fb42410cb10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 >> 172.21.15.79:0/650431499 conn(0x7fb4240fefe0 msgr2=0x7fb424103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 shutdown_connections 2024-09-21T02:47:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:07.874+0000 7fb42a800640 1 -- 172.21.15.79:0/650431499 wait complete. 2024-09-21T02:47:09.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:09 smithi098 ceph-mon[34832]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.9 MiB/s wr, 435 op/s 2024-09-21T02:47:09.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:09 smithi079 ceph-mon[30788]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.9 MiB/s wr, 435 op/s 2024-09-21T02:47:09.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:09 smithi148 ceph-mon[34626]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.9 MiB/s wr, 435 op/s 2024-09-21T02:47:11.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:11 smithi098 ceph-mon[34832]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.4 MiB/s wr, 453 op/s 2024-09-21T02:47:11.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:11 smithi079 ceph-mon[30788]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.4 MiB/s wr, 453 op/s 2024-09-21T02:47:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 675.0 s, 494.0 tps, lat 200.660 ms stddev 223.134 2024-09-21T02:47:11.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:11 smithi148 ceph-mon[34626]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.4 MiB/s wr, 453 op/s 2024-09-21T02:47:13.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:13 smithi098 ceph-mon[34832]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 5.7 MiB/s wr, 459 op/s 2024-09-21T02:47:13.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:13 smithi079 ceph-mon[30788]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 5.7 MiB/s wr, 459 op/s 2024-09-21T02:47:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:13 smithi148 ceph-mon[34626]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 5.7 MiB/s wr, 459 op/s 2024-09-21T02:47:15.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:15 smithi098 ceph-mon[34832]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.6 MiB/s wr, 445 op/s 2024-09-21T02:47:15.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:15 smithi079 ceph-mon[30788]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.6 MiB/s wr, 445 op/s 2024-09-21T02:47:15.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:15 smithi148 ceph-mon[34626]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.6 MiB/s wr, 445 op/s 2024-09-21T02:47:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 680.0 s, 610.0 tps, lat 160.436 ms stddev 192.561 2024-09-21T02:47:17.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:17 smithi098 ceph-mon[34832]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 6.7 MiB/s wr, 508 op/s 2024-09-21T02:47:17.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:17 smithi079 ceph-mon[30788]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 6.7 MiB/s wr, 508 op/s 2024-09-21T02:47:17.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:17 smithi148 ceph-mon[34626]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 6.7 MiB/s wr, 508 op/s 2024-09-21T02:47:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:47:18.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:47:18.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:47:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:19 smithi098 ceph-mon[34832]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 6.2 MiB/s wr, 477 op/s 2024-09-21T02:47:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:19 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:47:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:19 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:47:19.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:19 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:47:19.481 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:19 smithi079 ceph-mon[30788]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 6.2 MiB/s wr, 477 op/s 2024-09-21T02:47:19.481 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:19 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:47:19.481 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:19 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:47:19.481 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:19 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:47:19.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:19 smithi148 ceph-mon[34626]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 6.2 MiB/s wr, 477 op/s 2024-09-21T02:47:19.578 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:19 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:47:19.578 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:19 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:47:19.578 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:19 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:47:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.256+0000 7fa7eb800640 1 -- 172.21.15.79:0/4109316150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e41050d0 msgr2=0x7fa7e410ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.256+0000 7fa7eb800640 1 --2- 172.21.15.79:0/4109316150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e41050d0 0x7fa7e410ba70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009ca0 tx=0x7fa7dc02a8b0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.257+0000 7fa7eb800640 1 -- 172.21.15.79:0/4109316150 shutdown_connections 2024-09-21T02:47:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.257+0000 7fa7eb800640 1 --2- 172.21.15.79:0/4109316150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e41050d0 0x7fa7e410ba70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.257+0000 7fa7eb800640 1 --2- 172.21.15.79:0/4109316150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7e4104730 0x7fa7e4104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.257+0000 7fa7eb800640 1 --2- 172.21.15.79:0/4109316150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 0x7fa7e4103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.257+0000 7fa7eb800640 1 -- 172.21.15.79:0/4109316150 >> 172.21.15.79:0/4109316150 conn(0x7fa7e40feff0 msgr2=0x7fa7e41014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.258+0000 7fa7eb800640 1 -- 172.21.15.79:0/4109316150 shutdown_connections 2024-09-21T02:47:21.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.258+0000 7fa7eb800640 1 -- 172.21.15.79:0/4109316150 wait complete. 2024-09-21T02:47:21.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.259+0000 7fa7eb800640 1 Processor -- start 2024-09-21T02:47:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.259+0000 7fa7eb800640 1 -- start start 2024-09-21T02:47:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.260+0000 7fa7eb800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 0x7fa7e4076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.260+0000 7fa7eb800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e4104730 0x7fa7e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.260+0000 7fa7eb800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7e41050d0 0x7fa7e4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.260+0000 7fa7eb800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e410f3b0 con 0x7fa7e41050d0 2024-09-21T02:47:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.260+0000 7fa7eb800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e410f230 con 0x7fa7e4104730 2024-09-21T02:47:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.260+0000 7fa7eb800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e410f530 con 0x7fa7e41036b0 2024-09-21T02:47:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.260+0000 7fa7e8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 0x7fa7e4076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e9800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7e41050d0 0x7fa7e4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 0x7fa7e4076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41922/0 (socket says 172.21.15.79:41922) 2024-09-21T02:47:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e8e00640 1 -- 172.21.15.79:0/928396566 learned_addr learned my addr 172.21.15.79:0/928396566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e4104730 0x7fa7e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e8e00640 1 -- 172.21.15.79:0/928396566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e4104730 msgr2=0x7fa7e4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e4104730 0x7fa7e4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e8e00640 1 -- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7e41050d0 msgr2=0x7fa7e4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7e41050d0 0x7fa7e4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.261+0000 7fa7e8e00640 1 -- 172.21.15.79:0/928396566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e4076380 con 0x7fa7e41036b0 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.262+0000 7fa7e9800640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7e41050d0 0x7fa7e4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.262+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 0x7fa7e4076e50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800d950 tx=0x7fa7d800dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.262+0000 7fa7e1600640 1 -- 172.21.15.79:0/928396566 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8017070 con 0x7fa7e41036b0 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.262+0000 7fa7e1600640 1 -- 172.21.15.79:0/928396566 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7d800de80 con 0x7fa7e41036b0 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.262+0000 7fa7e1600640 1 -- 172.21.15.79:0/928396566 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800f620 con 0x7fa7e41036b0 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.262+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e4199b80 con 0x7fa7e41036b0 2024-09-21T02:47:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.263+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e419a1a0 con 0x7fa7e41036b0 2024-09-21T02:47:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.269+0000 7fa7e1600640 1 -- 172.21.15.79:0/928396566 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa7d8010460 con 0x7fa7e41036b0 2024-09-21T02:47:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.271+0000 7fa7e1600640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa7cc0beda0 0x7fa7cc0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.272+0000 7fa7e1600640 1 -- 172.21.15.79:0/928396566 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa7d80e7230 con 0x7fa7e41036b0 2024-09-21T02:47:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.274+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa7cc0beda0 0x7fa7cc0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.276 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.275+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa7cc0beda0 0x7fa7cc0c12b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009990 tx=0x7fa7d0009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.281+0000 7fa7f2807740 1 Processor -- start 2024-09-21T02:47:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.282+0000 7fa7f2807740 1 -- start start 2024-09-21T02:47:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.282+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9dd81b0 0x564daa17f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.282+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9daf2f0 0x564daa17f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.282+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 0x564daa180290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.282+0000 7fa7f2807740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564daa0f26b0 con 0x564da9daf2f0 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.282+0000 7fa7f2807740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564daa0e1ae0 con 0x564da9db74d0 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.282+0000 7fa7f2807740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564daa0e58f0 con 0x564da9dd81b0 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.283+0000 7fa7e8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9dd81b0 0x564daa17f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.283+0000 7fa7e8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9dd81b0 0x564daa17f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41936/0 (socket says 172.21.15.79:41936) 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.283+0000 7fa7e8e00640 1 -- 172.21.15.79:0/864859686 learned_addr learned my addr 172.21.15.79:0/864859686 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.283+0000 7fa7e9800640 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 0x564daa180290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.284+0000 7fa7e8e00640 1 -- 172.21.15.79:0/864859686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 msgr2=0x564daa180290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.284+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 0x564daa180290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.284+0000 7fa7e8e00640 1 -- 172.21.15.79:0/864859686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9daf2f0 msgr2=0x564daa17f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.284+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9daf2f0 0x564daa17f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.284+0000 7fa7e8e00640 1 -- 172.21.15.79:0/864859686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daa0ae780 con 0x564da9dd81b0 2024-09-21T02:47:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.286+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9dd81b0 0x564daa17f0d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005fd0 tx=0x7fa7d80acea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5dcf715a4533b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.286+0000 7fa7d6000640 1 -- 172.21.15.79:0/864859686 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8020070 con 0x564da9dd81b0 2024-09-21T02:47:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.286+0000 7fa7d6000640 1 -- 172.21.15.79:0/864859686 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7d80ad710 con 0x564da9dd81b0 2024-09-21T02:47:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.286+0000 7fa7d6000640 1 -- 172.21.15.79:0/864859686 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80a8bc0 con 0x564da9dd81b0 2024-09-21T02:47:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.288+0000 7fa7f2807740 1 -- 172.21.15.79:0/864859686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9dd81b0 msgr2=0x564daa17f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.288+0000 7fa7f2807740 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9dd81b0 0x564daa17f0d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005fd0 tx=0x7fa7d80acea0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.290+0000 7fa7f2807740 1 -- 172.21.15.79:0/864859686 shutdown_connections 2024-09-21T02:47:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.290+0000 7fa7f2807740 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 0x564daa180290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.290+0000 7fa7f2807740 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9daf2f0 0x564daa17f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.290+0000 7fa7f2807740 1 --2- 172.21.15.79:0/864859686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9dd81b0 0x564daa17f0d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.290+0000 7fa7f2807740 1 -- 172.21.15.79:0/864859686 >> 172.21.15.79:0/864859686 conn(0x564da9dcc300 msgr2=0x564daa17ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.293+0000 7fa7f2807740 1 -- 172.21.15.79:0/864859686 shutdown_connections 2024-09-21T02:47:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.293+0000 7fa7f2807740 1 -- 172.21.15.79:0/864859686 wait complete. 2024-09-21T02:47:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.294+0000 7fa7f2807740 1 -- start start 2024-09-21T02:47:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.294+0000 7fa7f2807740 1 Processor -- start 2024-09-21T02:47:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.296+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa199880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.296+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 0x564daa199f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.296+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.296+0000 7fa7e8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.296+0000 7fa7e8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41940/0 (socket says 172.21.15.79:41940) 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.297+0000 7fa7f2807740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564daa019ab0 con 0x564da9dd81b0 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.297+0000 7fa7f2807740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564daa088570 con 0x564da9db74d0 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.297+0000 7fa7f2807740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564daa180db0 con 0x564da9daf2f0 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.297+0000 7fa7f2807740 10 client.0 _ll_register_callbacks cb 0x564daa097100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.297+0000 7fa7e9800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.297+0000 7fa7e9800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54174/0 (socket says 172.21.15.79:54174) 2024-09-21T02:47:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.297+0000 7fa7e9800640 1 -- 172.21.15.79:0/391517682 learned_addr learned my addr 172.21.15.79:0/391517682 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.298+0000 7fa7e8e00640 1 -- 172.21.15.79:0/391517682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 msgr2=0x564daa199f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:47:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.298+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 0x564daa199f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.298+0000 7fa7e8e00640 1 -- 172.21.15.79:0/391517682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 msgr2=0x564daa19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.298+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.298+0000 7fa7e8e00640 1 -- 172.21.15.79:0/391517682 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da9e43790 con 0x564da9daf2f0 2024-09-21T02:47:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.298+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa199880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005fd0 tx=0x7fa7d80acc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33858bbcbb1cd3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.298+0000 7fa7caa00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:47:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.299+0000 7fa7caa00640 1 -- 172.21.15.79:0/391517682 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8020070 con 0x564da9daf2f0 2024-09-21T02:47:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.299+0000 7fa7caa00640 1 -- 172.21.15.79:0/391517682 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa7d80ac470 con 0x564da9daf2f0 2024-09-21T02:47:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.299+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7d80ad710 con 0x564da9daf2f0 2024-09-21T02:47:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.300+0000 7fa7caa00640 1 -- 172.21.15.79:0/391517682 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa7d80983e0 con 0x564da9daf2f0 2024-09-21T02:47:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.300+0000 7fa7f2807740 10 client.26629 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.300+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564da9ebc620 con 0x564da9daf2f0 2024-09-21T02:47:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7caa00640 1 -- 172.21.15.79:0/391517682 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7d80ad710 con 0x564da9daf2f0 2024-09-21T02:47:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7caa00640 1 -- 172.21.15.79:0/391517682 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa7d80b2c80 con 0x564da9daf2f0 2024-09-21T02:47:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7f2807740 10 client.26629 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7f2807740 10 client.26629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7f2807740 20 client.26629 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7f2807740 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d96d80 0x564daa1a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7f2807740 4 client.26629 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:47:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.304+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564daa0f4600 con 0x564da9d96d80 2024-09-21T02:47:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.305+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d96d80 0x564daa1a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.306+0000 7fa7caa00640 10 client.26629 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.306+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d96d80 0x564daa1a6b90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f0adefb4958897 server_cookie=d78ba15a41f1613f in_seq=0 out_seq=0 2024-09-21T02:47:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.306+0000 7fa7caa00640 1 -- 172.21.15.79:0/391517682 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564daa0f4600 con 0x564da9d96d80 2024-09-21T02:47:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.306+0000 7fa7caa00640 10 client.26629 handle_command_reply: tid=0 2024-09-21T02:47:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 client.26629 shutdown 2024-09-21T02:47:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 msgr2=0x564daa199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa199880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005fd0 tx=0x7fa7d80acc50 comp rx=0 tx=0).stop 2024-09-21T02:47:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 shutdown_connections 2024-09-21T02:47:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d96d80 0x564daa1a6b90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9db74d0 0x564daa199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 --2- 172.21.15.79:0/391517682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa199880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7caa00640 0 client.26629 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.307+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 >> 172.21.15.79:0/391517682 conn(0x564da9dcc300 msgr2=0x564daa1790e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.308+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 shutdown_connections 2024-09-21T02:47:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.308+0000 7fa7f2807740 1 -- 172.21.15.79:0/391517682 wait complete. 2024-09-21T02:47:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.308+0000 7fa7f2807740 20 client.26629 trim_cache size 0 max 16384 2024-09-21T02:47:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.332+0000 7fa7f2807740 1 Processor -- start 2024-09-21T02:47:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.332+0000 7fa7f2807740 1 -- start start 2024-09-21T02:47:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa198250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9db74d0 0x564daa17a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9dd81b0 0x564daa198a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7f2807740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e40715c0 con 0x564da9db74d0 2024-09-21T02:47:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7f2807740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4073e40 con 0x564da9dd81b0 2024-09-21T02:47:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7f2807740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4071c30 con 0x564da9daf2f0 2024-09-21T02:47:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7e3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9db74d0 0x564daa17a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.333+0000 7fa7e8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.334+0000 7fa7e9800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9dd81b0 0x564daa198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.334+0000 7fa7e9800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9dd81b0 0x564daa198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33804/0 (socket says 172.21.15.79:33804) 2024-09-21T02:47:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.334+0000 7fa7e9800640 1 -- 172.21.15.79:0/3643440815 learned_addr learned my addr 172.21.15.79:0/3643440815 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.335+0000 7fa7e8e00640 1 -- 172.21.15.79:0/3643440815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9dd81b0 msgr2=0x564daa198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.335+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9dd81b0 0x564daa198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.335+0000 7fa7e8e00640 1 -- 172.21.15.79:0/3643440815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9db74d0 msgr2=0x564daa17a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.335+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9db74d0 0x564daa17a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.335+0000 7fa7e8e00640 1 -- 172.21.15.79:0/3643440815 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daa17fb40 con 0x564da9daf2f0 2024-09-21T02:47:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.335+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9db74d0 0x564daa17a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.335+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa198250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80acd10 tx=0x7fa7d8010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d3a2ce237cb4dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.336+0000 7fa7d5600640 1 -- 172.21.15.79:0/3643440815 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80a8eb0 con 0x564da9daf2f0 2024-09-21T02:47:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.336+0000 7fa7d5600640 1 -- 172.21.15.79:0/3643440815 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7d8014070 con 0x564da9daf2f0 2024-09-21T02:47:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.336+0000 7fa7d5600640 1 -- 172.21.15.79:0/3643440815 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b6a30 con 0x564da9daf2f0 2024-09-21T02:47:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.337+0000 7fa7f2807740 1 -- 172.21.15.79:0/3643440815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 msgr2=0x564daa198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.337+0000 7fa7f2807740 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa198250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80acd10 tx=0x7fa7d8010bd0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.337+0000 7fa7f2807740 1 -- 172.21.15.79:0/3643440815 shutdown_connections 2024-09-21T02:47:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.337+0000 7fa7f2807740 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9dd81b0 0x564daa198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.338+0000 7fa7f2807740 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9db74d0 0x564daa17a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.338+0000 7fa7f2807740 1 --2- 172.21.15.79:0/3643440815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9daf2f0 0x564daa198250 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.338+0000 7fa7f2807740 1 -- 172.21.15.79:0/3643440815 >> 172.21.15.79:0/3643440815 conn(0x564da9dcc300 msgr2=0x564daa180030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.338+0000 7fa7f2807740 1 -- 172.21.15.79:0/3643440815 shutdown_connections 2024-09-21T02:47:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.338+0000 7fa7f2807740 1 -- 172.21.15.79:0/3643440815 wait complete. 2024-09-21T02:47:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.338+0000 7fa7f2807740 1 -- start start 2024-09-21T02:47:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.338+0000 7fa7f2807740 1 Processor -- start 2024-09-21T02:47:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9daf2f0 0x564daa1a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9db74d0 0x564daa1a0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7f2807740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa1a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7f2807740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4072300 con 0x564da9dd81b0 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7f2807740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4073770 con 0x564da9daf2f0 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7f2807740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e40729d0 con 0x564da9db74d0 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7f2807740 10 client.0 _ll_register_callbacks cb 0x7fa7dc030cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7e3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9db74d0 0x564daa1a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7e9800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa1a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7e3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9db74d0 0x564daa1a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41958/0 (socket says 172.21.15.79:41958) 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7e3e00640 1 -- 172.21.15.79:0/4067738108 learned_addr learned my addr 172.21.15.79:0/4067738108 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.339+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9daf2f0 0x564daa1a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.340+0000 7fa7e3e00640 1 -- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9daf2f0 msgr2=0x564daa1a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.340+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9daf2f0 0x564daa1a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.340+0000 7fa7e3e00640 1 -- 172.21.15.79:0/4067738108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 msgr2=0x564daa1a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.340+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa1a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.340+0000 7fa7e3e00640 1 -- 172.21.15.79:0/4067738108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564daa1a0b00 con 0x564da9db74d0 2024-09-21T02:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.340+0000 7fa7e3e00640 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9db74d0 0x564daa1a0080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0006e90 tx=0x7fa7d00047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad7738b62691c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.340+0000 7fa7caa00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.341+0000 7fa7caa00640 1 -- 172.21.15.79:0/4067738108 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d002b020 con 0x564da9db74d0 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.341+0000 7fa7caa00640 1 -- 172.21.15.79:0/4067738108 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa7d0022610 con 0x564da9db74d0 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.341+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7d8014070 con 0x564da9db74d0 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.341+0000 7fa7caa00640 1 -- 172.21.15.79:0/4067738108 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa7d0036050 con 0x564da9db74d0 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.341+0000 7fa7f2807740 10 client.26635 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.341+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564daa19f9c0 con 0x564da9db74d0 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7caa00640 1 -- 172.21.15.79:0/4067738108 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7d8014070 con 0x564da9db74d0 2024-09-21T02:47:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7caa00640 1 -- 172.21.15.79:0/4067738108 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa7d0026030 con 0x564da9db74d0 2024-09-21T02:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7f2807740 10 client.26635 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7f2807740 10 client.26635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7f2807740 20 client.26635 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7f2807740 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d6c1c0 0x564daa213c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7f2807740 4 client.26635 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.343+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564daa0f00b0 con 0x564da9d6c1c0 2024-09-21T02:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.344+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d6c1c0 0x564daa213c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.344+0000 7fa7e8e00640 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d6c1c0 0x564daa213c00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f78014f215c1b3f6 server_cookie=13ea79ad3e0b4abc in_seq=0 out_seq=0 2024-09-21T02:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.345+0000 7fa7caa00640 10 client.26635 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:21 smithi098 ceph-mon[34832]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-09-21T02:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.408+0000 7fa7caa00640 1 -- 172.21.15.79:0/4067738108 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564daa0f00b0 con 0x564da9d6c1c0 2024-09-21T02:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.408+0000 7fa7caa00640 10 client.26635 handle_command_reply: tid=0 2024-09-21T02:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.408+0000 7fa7f2807740 1 client.26635 shutdown 2024-09-21T02:47:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.408+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9db74d0 msgr2=0x564daa1a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9db74d0 0x564daa1a0080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0006e90 tx=0x7fa7d00047d0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 shutdown_connections 2024-09-21T02:47:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564da9d6c1c0 0x564daa213c00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564da9dd81b0 0x564daa1a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7caa00640 0 client.26635 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564da9db74d0 0x564daa1a0080 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 --2- 172.21.15.79:0/4067738108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564da9daf2f0 0x564daa1a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 >> 172.21.15.79:0/4067738108 conn(0x564da9dcc300 msgr2=0x564daa17ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 shutdown_connections 2024-09-21T02:47:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.409+0000 7fa7f2807740 1 -- 172.21.15.79:0/4067738108 wait complete. 2024-09-21T02:47:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.412+0000 7fa7f2807740 20 client.26635 trim_cache size 0 max 16384 2024-09-21T02:47:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:47:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:47:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:47:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa7cc0beda0 msgr2=0x7fa7cc0c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa7cc0beda0 0x7fa7cc0c12b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009990 tx=0x7fa7d0009110 comp rx=0 tx=0).stop 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 msgr2=0x7fa7e4076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 0x7fa7e4076e50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800d950 tx=0x7fa7d800dd50 comp rx=0 tx=0).stop 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 shutdown_connections 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa7cc0beda0 0x7fa7cc0c12b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7e41050d0 0x7fa7e4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.415 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7e4104730 0x7fa7e4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 --2- 172.21.15.79:0/928396566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7e41036b0 0x7fa7e4076e50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.413+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 >> 172.21.15.79:0/928396566 conn(0x7fa7e40feff0 msgr2=0x7fa7e4107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.415+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 shutdown_connections 2024-09-21T02:47:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:21.418+0000 7fa7eb800640 1 -- 172.21.15.79:0/928396566 wait complete. 2024-09-21T02:47:21.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:21 smithi079 ceph-mon[30788]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-09-21T02:47:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 685.0 s, 531.2 tps, lat 185.608 ms stddev 260.462 2024-09-21T02:47:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:21 smithi148 ceph-mon[34626]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-09-21T02:47:23.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:23 smithi098 ceph-mon[34832]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.7 MiB/s wr, 547 op/s 2024-09-21T02:47:23.482 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:23 smithi079 ceph-mon[30788]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.7 MiB/s wr, 547 op/s 2024-09-21T02:47:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:23 smithi148 ceph-mon[34626]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.7 MiB/s wr, 547 op/s 2024-09-21T02:47:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:25 smithi098 ceph-mon[34832]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 6.7 MiB/s wr, 535 op/s 2024-09-21T02:47:25.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:25 smithi079 ceph-mon[30788]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 6.7 MiB/s wr, 535 op/s 2024-09-21T02:47:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:25 smithi148 ceph-mon[34626]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 6.7 MiB/s wr, 535 op/s 2024-09-21T02:47:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 690.0 s, 567.8 tps, lat 181.680 ms stddev 223.508 2024-09-21T02:47:27.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:27 smithi079 ceph-mon[30788]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 7.3 MiB/s wr, 597 op/s 2024-09-21T02:47:27.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:27 smithi148 ceph-mon[34626]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 7.3 MiB/s wr, 597 op/s 2024-09-21T02:47:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:27 smithi098 ceph-mon[34832]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 7.3 MiB/s wr, 597 op/s 2024-09-21T02:47:29.457 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:29 smithi098 ceph-mon[34832]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2024-09-21T02:47:29.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:29 smithi079 ceph-mon[30788]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2024-09-21T02:47:29.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:29 smithi148 ceph-mon[34626]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2024-09-21T02:47:31.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:31 smithi079 ceph-mon[30788]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 6.5 MiB/s wr, 570 op/s 2024-09-21T02:47:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 695.0 s, 529.7 tps, lat 186.443 ms stddev 212.540 2024-09-21T02:47:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:31 smithi148 ceph-mon[34626]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 6.5 MiB/s wr, 570 op/s 2024-09-21T02:47:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:31 smithi098 ceph-mon[34832]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 6.5 MiB/s wr, 570 op/s 2024-09-21T02:47:33.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:33 smithi079 ceph-mon[30788]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.1 MiB/s wr, 569 op/s 2024-09-21T02:47:33.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:33 smithi148 ceph-mon[34626]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.1 MiB/s wr, 569 op/s 2024-09-21T02:47:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:33 smithi098 ceph-mon[34832]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 7.1 MiB/s wr, 569 op/s 2024-09-21T02:47:34.723 INFO:tasks.quiescer.fs.[cephfs]:Total duration (35.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T02:47:34.723 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.8 2024-09-21T02:47:34.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:47:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.109+0000 7feedfe00640 1 -- 172.21.15.79:0/2035782674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee01034e0 msgr2=0x7feee0103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.109+0000 7feedfe00640 1 --2- 172.21.15.79:0/2035782674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee01034e0 0x7feee0103950 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feecc009860 tx=0x7feecc02a340 comp rx=0 tx=0).stop 2024-09-21T02:47:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.109+0000 7feedfe00640 1 -- 172.21.15.79:0/2035782674 shutdown_connections 2024-09-21T02:47:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.109+0000 7feedfe00640 1 --2- 172.21.15.79:0/2035782674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feee0104f00 0x7feee010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.109+0000 7feedfe00640 1 --2- 172.21.15.79:0/2035782674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee0104560 0x7feee0104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.109+0000 7feedfe00640 1 --2- 172.21.15.79:0/2035782674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee01034e0 0x7feee0103950 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.110+0000 7feedfe00640 1 -- 172.21.15.79:0/2035782674 >> 172.21.15.79:0/2035782674 conn(0x7feee00fee20 msgr2=0x7feee01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.110+0000 7feedfe00640 1 -- 172.21.15.79:0/2035782674 shutdown_connections 2024-09-21T02:47:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.111+0000 7feedfe00640 1 -- 172.21.15.79:0/2035782674 wait complete. 2024-09-21T02:47:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.113+0000 7feedfe00640 1 Processor -- start 2024-09-21T02:47:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.113+0000 7feedfe00640 1 -- start start 2024-09-21T02:47:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedfe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01034e0 0x7feee01a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedfe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee0104560 0x7feee01a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feee0104f00 0x7feee01a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedfe00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feee0076be0 con 0x7feee0104560 2024-09-21T02:47:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedfe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feee0076a60 con 0x7feee01034e0 2024-09-21T02:47:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedfe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feee0076d60 con 0x7feee0104f00 2024-09-21T02:47:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01034e0 0x7feee01a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01034e0 0x7feee01a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52540/0 (socket says 172.21.15.79:52540) 2024-09-21T02:47:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feee0104f00 0x7feee01a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feedea00640 1 -- 172.21.15.79:0/85942998 learned_addr learned my addr 172.21.15.79:0/85942998 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.114+0000 7feede000640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee0104560 0x7feee01a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.115+0000 7feedea00640 1 -- 172.21.15.79:0/85942998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feee0104f00 msgr2=0x7feee01a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.115+0000 7feedea00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feee0104f00 0x7feee01a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.115+0000 7feedea00640 1 -- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee0104560 msgr2=0x7feee01a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.115+0000 7feedea00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee0104560 0x7feee01a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.115+0000 7feedea00640 1 -- 172.21.15.79:0/85942998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee01a1db0 con 0x7feee01034e0 2024-09-21T02:47:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.117+0000 7feedea00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01034e0 0x7feee01a0370 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feecc005e00 tx=0x7feecc032e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.118+0000 7feed7400640 1 -- 172.21.15.79:0/85942998 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc037040 con 0x7feee01034e0 2024-09-21T02:47:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.118+0000 7feed7400640 1 -- 172.21.15.79:0/85942998 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc030d90 con 0x7feee01034e0 2024-09-21T02:47:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.118+0000 7feed7400640 1 -- 172.21.15.79:0/85942998 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc003920 con 0x7feee01034e0 2024-09-21T02:47:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.118+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee01a2040 con 0x7feee01034e0 2024-09-21T02:47:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.119+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee01a85b0 con 0x7feee01034e0 2024-09-21T02:47:35.132 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.128+0000 7feed7400640 1 -- 172.21.15.79:0/85942998 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7feecc043020 con 0x7feee01034e0 2024-09-21T02:47:35.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.134+0000 7feed7400640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7feec40b6590 0x7feec40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.135+0000 7feed7400640 1 -- 172.21.15.79:0/85942998 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7feecc106ba0 con 0x7feee01034e0 2024-09-21T02:47:35.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.135+0000 7feede000640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7feec40b6590 0x7feec40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.138 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.136+0000 7feede000640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7feec40b6590 0x7feec40b8aa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feed0005fd0 tx=0x7feed0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.141+0000 7feeec879740 1 Processor -- start 2024-09-21T02:47:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.142+0000 7feeec879740 1 -- start start 2024-09-21T02:47:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feeec879740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x5612911e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feeec879740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e192f0 0x5612911e9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feeec879740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e214d0 0x5612911ea470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feeec879740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56129115c6b0 con 0x561290e192f0 2024-09-21T02:47:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feeec879740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56129114bae0 con 0x561290e214d0 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feeec879740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56129114f8f0 con 0x561290e421b0 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feede000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e192f0 0x5612911e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feede000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e192f0 0x5612911e9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38352/0 (socket says 172.21.15.79:38352) 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feede000640 1 -- 172.21.15.79:0/2000206177 learned_addr learned my addr 172.21.15.79:0/2000206177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.143+0000 7feedea00640 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x5612911e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.144+0000 7feedf400640 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e214d0 0x5612911ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.144+0000 7feedea00640 1 -- 172.21.15.79:0/2000206177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e214d0 msgr2=0x5612911ea470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.144+0000 7feedea00640 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e214d0 0x5612911ea470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.144+0000 7feedea00640 1 -- 172.21.15.79:0/2000206177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e192f0 msgr2=0x5612911e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.144+0000 7feedea00640 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e192f0 0x5612911e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.144+0000 7feedea00640 1 -- 172.21.15.79:0/2000206177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561291118780 con 0x561290e421b0 2024-09-21T02:47:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.144+0000 7feedea00640 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x5612911e92b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feecc104340 tx=0x7feecc02a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa02e1329e4bce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.148+0000 7feecbe00640 1 -- 172.21.15.79:0/2000206177 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc0cc520 con 0x561290e421b0 2024-09-21T02:47:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.148+0000 7feecbe00640 1 -- 172.21.15.79:0/2000206177 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc0cd110 con 0x561290e421b0 2024-09-21T02:47:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.148+0000 7feecbe00640 1 -- 172.21.15.79:0/2000206177 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc004000 con 0x561290e421b0 2024-09-21T02:47:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.149+0000 7feeec879740 1 -- 172.21.15.79:0/2000206177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 msgr2=0x5612911e92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.149+0000 7feeec879740 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x5612911e92b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feecc104340 tx=0x7feecc02a340 comp rx=0 tx=0).stop 2024-09-21T02:47:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.150+0000 7feeec879740 1 -- 172.21.15.79:0/2000206177 shutdown_connections 2024-09-21T02:47:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.150+0000 7feeec879740 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e214d0 0x5612911ea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.150+0000 7feeec879740 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e192f0 0x5612911e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.150+0000 7feeec879740 1 --2- 172.21.15.79:0/2000206177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x5612911e92b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.150+0000 7feeec879740 1 -- 172.21.15.79:0/2000206177 >> 172.21.15.79:0/2000206177 conn(0x561290e36300 msgr2=0x5612911e4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.150+0000 7feeec879740 1 -- 172.21.15.79:0/2000206177 shutdown_connections 2024-09-21T02:47:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.150+0000 7feeec879740 1 -- 172.21.15.79:0/2000206177 wait complete. 2024-09-21T02:47:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.151+0000 7feeec879740 1 -- start start 2024-09-21T02:47:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.152+0000 7feeec879740 1 Processor -- start 2024-09-21T02:47:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.152+0000 7feeec879740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.152+0000 7feeec879740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x561291203d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.152+0000 7feeec879740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612912048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feedea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feede000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x561291203d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feedea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52564/0 (socket says 172.21.15.79:52564) 2024-09-21T02:47:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feede000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x561291203d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50116/0 (socket says 172.21.15.79:50116) 2024-09-21T02:47:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feedf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612912048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feedf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612912048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38354/0 (socket says 172.21.15.79:38354) 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561291083ab0 con 0x561290e421b0 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feedea00640 1 -- 172.21.15.79:0/2780881228 learned_addr learned my addr 172.21.15.79:0/2780881228 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612910f2570 con 0x561290e192f0 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5612911ead50 con 0x561290e214d0 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feeec879740 10 client.0 _ll_register_callbacks cb 0x561291101100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feedea00640 1 -- 172.21.15.79:0/2780881228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 msgr2=0x561291203d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.153+0000 7feedea00640 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x561291203d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.154+0000 7feedea00640 1 -- 172.21.15.79:0/2780881228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 msgr2=0x5612912048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.154+0000 7feedea00640 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612912048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.154+0000 7feedea00640 1 -- 172.21.15.79:0/2780881228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561290ead790 con 0x561290e192f0 2024-09-21T02:47:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.154+0000 7feedea00640 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912036c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feecc0cd2c0 tx=0x7feecc0d13e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d69f670d9d7a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.155+0000 7feec8c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:47:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.156+0000 7feec8c00640 1 -- 172.21.15.79:0/2780881228 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc0cc520 con 0x561290e192f0 2024-09-21T02:47:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.156+0000 7feec8c00640 1 -- 172.21.15.79:0/2780881228 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7feecc0cbe70 con 0x561290e192f0 2024-09-21T02:47:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.156+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feecc0cd110 con 0x561290e192f0 2024-09-21T02:47:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.156+0000 7feec8c00640 1 -- 172.21.15.79:0/2780881228 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7feecc004210 con 0x561290e192f0 2024-09-21T02:47:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.156+0000 7feeec879740 10 client.26615 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.156+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561290f26620 con 0x561290e192f0 2024-09-21T02:47:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.156+0000 7feec8c00640 1 -- 172.21.15.79:0/2780881228 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc0cd110 con 0x561290e192f0 2024-09-21T02:47:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feec8c00640 1 -- 172.21.15.79:0/2780881228 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7feecc030710 con 0x561290e192f0 2024-09-21T02:47:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feeec879740 10 client.26615 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feeec879740 10 client.26615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feeec879740 20 client.26615 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feeec879740 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290e00d80 0x5612912109f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feeec879740 4 client.26615 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:47:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56129115e600 con 0x561290e00d80 2024-09-21T02:47:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.159+0000 7feede000640 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290e00d80 0x5612912109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.161+0000 7feec8c00640 10 client.26615 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.161+0000 7feede000640 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290e00d80 0x5612912109f0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5d09cfc2ea54dd server_cookie=92ab09e1eb81e351 in_seq=0 out_seq=0 2024-09-21T02:47:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.162+0000 7feec8c00640 1 -- 172.21.15.79:0/2780881228 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56129115e600 con 0x561290e00d80 2024-09-21T02:47:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.162+0000 7feec8c00640 10 client.26615 handle_command_reply: tid=0 2024-09-21T02:47:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.163+0000 7feeec879740 1 client.26615 shutdown 2024-09-21T02:47:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.163+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 msgr2=0x5612912036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.163+0000 7feeec879740 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912036c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feecc0cd2c0 tx=0x7feecc0d13e0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 shutdown_connections 2024-09-21T02:47:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feeec879740 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290e00d80 0x5612912109f0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feeec879740 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612912048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feeec879740 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x561291203d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feeec879740 1 --2- 172.21.15.79:0/2780881228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912036c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 >> 172.21.15.79:0/2780881228 conn(0x561290e36300 msgr2=0x5612911ea320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feec8c00640 0 client.26615 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.164+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 shutdown_connections 2024-09-21T02:47:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.165+0000 7feeec879740 1 -- 172.21.15.79:0/2780881228 wait complete. 2024-09-21T02:47:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.165+0000 7feeec879740 20 client.26615 trim_cache size 0 max 16384 2024-09-21T02:47:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.204+0000 7feeec879740 1 Processor -- start 2024-09-21T02:47:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.204+0000 7feeec879740 1 -- start start 2024-09-21T02:47:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.205+0000 7feeec879740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612911e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.205+0000 7feeec879740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x5612911eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.205+0000 7feeec879740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612911eb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.205+0000 7feeec879740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feee0075130 con 0x561290e421b0 2024-09-21T02:47:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.205+0000 7feeec879740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feee01aac10 con 0x561290e192f0 2024-09-21T02:47:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.205+0000 7feeec879740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feee01a8a00 con 0x561290e214d0 2024-09-21T02:47:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.206+0000 7feedea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612911e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.206+0000 7feedea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612911e4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52576/0 (socket says 172.21.15.79:52576) 2024-09-21T02:47:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.206+0000 7feedea00640 1 -- 172.21.15.79:0/2049084576 learned_addr learned my addr 172.21.15.79:0/2049084576 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.206+0000 7feedf400640 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612911eb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.206+0000 7feedea00640 1 -- 172.21.15.79:0/2049084576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 msgr2=0x5612911eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.207+0000 7feede000640 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x5612911eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.207+0000 7feedea00640 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x5612911eb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.207+0000 7feedea00640 1 -- 172.21.15.79:0/2049084576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 msgr2=0x5612911eb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.207+0000 7feedea00640 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612911eb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.207+0000 7feedea00640 1 -- 172.21.15.79:0/2049084576 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612911f08b0 con 0x561290e192f0 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.207+0000 7feedf400640 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612911eb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.207+0000 7feede000640 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x5612911eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.208+0000 7feedea00640 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612911e4d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feecc0c8fe0 tx=0x7feecc02a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b869d61b772ac0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.208+0000 7feecb400640 1 -- 172.21.15.79:0/2049084576 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc0cc360 con 0x561290e192f0 2024-09-21T02:47:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.208+0000 7feecb400640 1 -- 172.21.15.79:0/2049084576 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc004210 con 0x561290e192f0 2024-09-21T02:47:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.208+0000 7feecb400640 1 -- 172.21.15.79:0/2049084576 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc0cba90 con 0x561290e192f0 2024-09-21T02:47:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.209+0000 7feeec879740 1 -- 172.21.15.79:0/2049084576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 msgr2=0x5612911e4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.209+0000 7feeec879740 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612911e4d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feecc0c8fe0 tx=0x7feecc02a340 comp rx=0 tx=0).stop 2024-09-21T02:47:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.210+0000 7feeec879740 1 -- 172.21.15.79:0/2049084576 shutdown_connections 2024-09-21T02:47:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.210+0000 7feeec879740 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e421b0 0x5612911eb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.210+0000 7feeec879740 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e214d0 0x5612911eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.210+0000 7feeec879740 1 --2- 172.21.15.79:0/2049084576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612911e4d90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.210+0000 7feeec879740 1 -- 172.21.15.79:0/2049084576 >> 172.21.15.79:0/2049084576 conn(0x561290e36300 msgr2=0x5612911e4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.210+0000 7feeec879740 1 -- 172.21.15.79:0/2049084576 shutdown_connections 2024-09-21T02:47:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.210+0000 7feeec879740 1 -- 172.21.15.79:0/2049084576 wait complete. 2024-09-21T02:47:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.211+0000 7feeec879740 1 -- start start 2024-09-21T02:47:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.212+0000 7feeec879740 1 Processor -- start 2024-09-21T02:47:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.213+0000 7feeec879740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.213+0000 7feeec879740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e214d0 0x561291207090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.213+0000 7feeec879740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x561291207bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.213+0000 7feeec879740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feee01a90d0 con 0x561290e214d0 2024-09-21T02:47:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.213+0000 7feeec879740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feee01aa540 con 0x561290e192f0 2024-09-21T02:47:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.213+0000 7feeec879740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feee01a97a0 con 0x561290e421b0 2024-09-21T02:47:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.214+0000 7feeec879740 10 client.0 _ll_register_callbacks cb 0x7feecc032f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.214+0000 7feedea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.214+0000 7feedf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x561291207bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.214+0000 7feedf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x561291207bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50124/0 (socket says 172.21.15.79:50124) 2024-09-21T02:47:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.214+0000 7feedf400640 1 -- 172.21.15.79:0/4266055916 learned_addr learned my addr 172.21.15.79:0/4266055916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.215+0000 7feede000640 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e214d0 0x561291207090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.215+0000 7feedf400640 1 -- 172.21.15.79:0/4266055916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 msgr2=0x5612912069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.215+0000 7feedf400640 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.215+0000 7feedf400640 1 -- 172.21.15.79:0/4266055916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e214d0 msgr2=0x561291207090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.215+0000 7feedf400640 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e214d0 0x561291207090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.215+0000 7feedf400640 1 -- 172.21.15.79:0/4266055916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561291208310 con 0x561290e421b0 2024-09-21T02:47:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.216+0000 7feedf400640 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x561291207bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feed800fee0 tx=0x7feed800c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46bd4c27d0b18913 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.216+0000 7feec8c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:47:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.218+0000 7feec8c00640 1 -- 172.21.15.79:0/4266055916 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8009e60 con 0x561290e421b0 2024-09-21T02:47:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.218+0000 7feec8c00640 1 -- 172.21.15.79:0/4266055916 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7feed8004b20 con 0x561290e421b0 2024-09-21T02:47:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.218+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feecc004210 con 0x561290e421b0 2024-09-21T02:47:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.220+0000 7feec8c00640 1 -- 172.21.15.79:0/4266055916 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7feed8004d20 con 0x561290e421b0 2024-09-21T02:47:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.220+0000 7feeec879740 10 client.26650 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.220+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56129120b680 con 0x561290e421b0 2024-09-21T02:47:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.220+0000 7feec8c00640 1 -- 172.21.15.79:0/4266055916 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc004210 con 0x561290e421b0 2024-09-21T02:47:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.222+0000 7feec8c00640 1 -- 172.21.15.79:0/4266055916 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7feed800b040 con 0x561290e421b0 2024-09-21T02:47:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.222+0000 7feeec879740 10 client.26650 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.222+0000 7feeec879740 10 client.26650 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.222+0000 7feeec879740 20 client.26650 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.222+0000 7feeec879740 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290dd61c0 0x56129127d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.222+0000 7feeec879740 4 client.26650 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:47:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.222+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56129115a0b0 con 0x561290dd61c0 2024-09-21T02:47:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.223+0000 7feedea00640 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290dd61c0 0x56129127d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.223+0000 7feedea00640 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290dd61c0 0x56129127d890 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1224229cbc28aca5 server_cookie=f82d38c6e125dad in_seq=0 out_seq=0 2024-09-21T02:47:35.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.223+0000 7feec8c00640 10 client.26650 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.552+0000 7feec8c00640 1 -- 172.21.15.79:0/4266055916 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56129115a0b0 con 0x561290dd61c0 2024-09-21T02:47:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.552+0000 7feec8c00640 10 client.26650 handle_command_reply: tid=0 2024-09-21T02:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.553+0000 7feeec879740 1 client.26650 shutdown 2024-09-21T02:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.554+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 msgr2=0x561291207bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.554+0000 7feeec879740 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x561291207bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feed800fee0 tx=0x7feed800c7a0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.555+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 shutdown_connections 2024-09-21T02:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.555+0000 7feeec879740 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x561290dd61c0 0x56129127d890 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.555+0000 7feeec879740 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561290e421b0 0x561291207bb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.555+0000 7feeec879740 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561290e214d0 0x561291207090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.555+0000 7feeec879740 1 --2- 172.21.15.79:0/4266055916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561290e192f0 0x5612912069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.555+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 >> 172.21.15.79:0/4266055916 conn(0x561290e36300 msgr2=0x561291215ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.555+0000 7feec8c00640 0 client.26650 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.556+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 shutdown_connections 2024-09-21T02:47:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.556+0000 7feeec879740 1 -- 172.21.15.79:0/4266055916 wait complete. 2024-09-21T02:47:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.556+0000 7feeec879740 20 client.26650 trim_cache size 0 max 16384 2024-09-21T02:47:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:47:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:47:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:47:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:47:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.559+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7feec40b6590 msgr2=0x7feec40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.559+0000 7feedfe00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7feec40b6590 0x7feec40b8aa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feed0005fd0 tx=0x7feed0005850 comp rx=0 tx=0).stop 2024-09-21T02:47:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.559+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01034e0 msgr2=0x7feee01a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.560+0000 7feedfe00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01034e0 0x7feee01a0370 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feecc005e00 tx=0x7feecc032e90 comp rx=0 tx=0).stop 2024-09-21T02:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.560+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 shutdown_connections 2024-09-21T02:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.560+0000 7feedfe00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7feec40b6590 0x7feec40b8aa0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.560+0000 7feedfe00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feee0104f00 0x7feee01a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.560+0000 7feedfe00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feee0104560 0x7feee01a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.560+0000 7feedfe00640 1 --2- 172.21.15.79:0/85942998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01034e0 0x7feee01a0370 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.560+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 >> 172.21.15.79:0/85942998 conn(0x7feee00fee20 msgr2=0x7feee010fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.561+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 shutdown_connections 2024-09-21T02:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:35.561+0000 7feedfe00640 1 -- 172.21.15.79:0/85942998 wait complete. 2024-09-21T02:47:35.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:35 smithi079 ceph-mon[30788]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-09-21T02:47:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:35.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:35 smithi098 ceph-mon[34832]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-09-21T02:47:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:35 smithi148 ceph-mon[34626]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-09-21T02:47:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 700.0 s, 507.5 tps, lat 201.489 ms stddev 256.828 2024-09-21T02:47:36.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.667+0000 7fada9600640 1 -- 172.21.15.79:0/1912504264 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad980308f0 con 0x7fadac1092f0 2024-09-21T02:47:36.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.668+0000 7fadabe00640 1 -- 172.21.15.79:0/1912504264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac1092f0 msgr2=0x7fadac109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.668+0000 7fadabe00640 1 --2- 172.21.15.79:0/1912504264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac1092f0 0x7fadac109700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad98009860 tx=0x7fad9802a380 comp rx=0 tx=0).stop 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.668+0000 7fadabe00640 1 -- 172.21.15.79:0/1912504264 shutdown_connections 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.668+0000 7fadabe00640 1 --2- 172.21.15.79:0/1912504264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac109c40 0x7fadac110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.668+0000 7fadabe00640 1 --2- 172.21.15.79:0/1912504264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac1092f0 0x7fadac109700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.668+0000 7fadabe00640 1 --2- 172.21.15.79:0/1912504264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadac1039b0 0x7fadac103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.668+0000 7fadabe00640 1 -- 172.21.15.79:0/1912504264 >> 172.21.15.79:0/1912504264 conn(0x7fadac0ff440 msgr2=0x7fadac101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.669+0000 7fadabe00640 1 -- 172.21.15.79:0/1912504264 shutdown_connections 2024-09-21T02:47:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.669+0000 7fadabe00640 1 -- 172.21.15.79:0/1912504264 wait complete. 2024-09-21T02:47:36.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.670+0000 7fadabe00640 1 Processor -- start 2024-09-21T02:47:36.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.670+0000 7fadabe00640 1 -- start start 2024-09-21T02:47:36.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.671+0000 7fadabe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadac1039b0 0x7fadac10d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:36.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.671+0000 7fadabe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac1092f0 0x7fadac10d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:36.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.671+0000 7fadabe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac109c40 0x7fadac1a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:36.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.671+0000 7fadabe00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadac076790 con 0x7fadac1092f0 2024-09-21T02:47:36.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.671+0000 7fadabe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fadac076610 con 0x7fadac1039b0 2024-09-21T02:47:36.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.671+0000 7fadabe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadac076910 con 0x7fadac109c40 2024-09-21T02:47:36.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.672+0000 7fadaaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadac1039b0 0x7fadac10d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:36.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.672+0000 7fadaaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadac1039b0 0x7fadac10d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52592/0 (socket says 172.21.15.79:52592) 2024-09-21T02:47:36.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.672+0000 7fadaaa00640 1 -- 172.21.15.79:0/2587158358 learned_addr learned my addr 172.21.15.79:0/2587158358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:36.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.672+0000 7fadab400640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac109c40 0x7fadac1a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:36.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.672+0000 7fadaa000640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac1092f0 0x7fadac10d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:36.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadab400640 1 -- 172.21.15.79:0/2587158358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadac1039b0 msgr2=0x7fadac10d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:36.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadab400640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadac1039b0 0x7fadac10d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:36.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadab400640 1 -- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac1092f0 msgr2=0x7fadac10d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadab400640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac1092f0 0x7fadac10d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadab400640 1 -- 172.21.15.79:0/2587158358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac1a57a0 con 0x7fadac109c40 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadab400640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac109c40 0x7fadac1a50a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fada400e940 tx=0x7fada400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadb0a00640 1 -- 172.21.15.79:0/2587158358 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4004d20 con 0x7fadac109c40 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.673+0000 7fadb0a00640 1 -- 172.21.15.79:0/2587158358 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fada4005020 con 0x7fadac109c40 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.674+0000 7fadb0a00640 1 -- 172.21.15.79:0/2587158358 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada40116b0 con 0x7fadac109c40 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.674+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac1a5a90 con 0x7fadac109c40 2024-09-21T02:47:36.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.674+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac06cde0 con 0x7fadac109c40 2024-09-21T02:47:36.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.676+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadac104c30 con 0x7fadac109c40 2024-09-21T02:47:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.681+0000 7fadb0a00640 1 -- 172.21.15.79:0/2587158358 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fada4005480 con 0x7fadac109c40 2024-09-21T02:47:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.689+0000 7fadb0a00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad900b65c0 0x7fad900b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.689+0000 7fadb0a00640 1 -- 172.21.15.79:0/2587158358 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fada40e7c80 con 0x7fadac109c40 2024-09-21T02:47:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.690+0000 7fadaaa00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad900b65c0 0x7fad900b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.690+0000 7fadb0a00640 1 -- 172.21.15.79:0/2587158358 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fada4016030 con 0x7fadac109c40 2024-09-21T02:47:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:36.692+0000 7fadaaa00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad900b65c0 0x7fad900b8ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad9c005fd0 tx=0x7fad9c00b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:37.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.104+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadac103dc0 con 0x7fadac109c40 2024-09-21T02:47:37.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.105+0000 7fadb0a00640 1 -- 172.21.15.79:0/2587158358 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fada40ae100 con 0x7fadac109c40 2024-09-21T02:47:37.108 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:47:37.108 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:47:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:47:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad900b65c0 msgr2=0x7fad900b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad900b65c0 0x7fad900b8ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad9c005fd0 tx=0x7fad9c00b480 comp rx=0 tx=0).stop 2024-09-21T02:47:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac109c40 msgr2=0x7fadac1a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac109c40 0x7fadac1a50a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fada400e940 tx=0x7fada400ee00 comp rx=0 tx=0).stop 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 shutdown_connections 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fad900b65c0 0x7fad900b8ad0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadac109c40 0x7fadac1a50a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadac1092f0 0x7fadac10d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 --2- 172.21.15.79:0/2587158358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadac1039b0 0x7fadac10d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 >> 172.21.15.79:0/2587158358 conn(0x7fadac0ff440 msgr2=0x7fadac105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 shutdown_connections 2024-09-21T02:47:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:37.114+0000 7fadabe00640 1 -- 172.21.15.79:0/2587158358 wait complete. 2024-09-21T02:47:37.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:37 smithi079 ceph-mon[30788]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.3 MiB/s wr, 558 op/s 2024-09-21T02:47:37.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:37 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2587158358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:37 smithi148 ceph-mon[34626]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.3 MiB/s wr, 558 op/s 2024-09-21T02:47:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:37 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2587158358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:38.144 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0' 2024-09-21T02:47:38.144 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0 2024-09-21T02:47:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:37 smithi098 ceph-mon[34832]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.3 MiB/s wr, 558 op/s 2024-09-21T02:47:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:37 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2587158358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:38.776 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:39.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:39 smithi079 ceph-mon[30788]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 5.9 MiB/s wr, 528 op/s 2024-09-21T02:47:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:39 smithi148 ceph-mon[34626]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 5.9 MiB/s wr, 528 op/s 2024-09-21T02:47:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:39 smithi098 ceph-mon[34832]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 5.9 MiB/s wr, 528 op/s 2024-09-21T02:47:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.605+0000 7fd0a7200640 1 -- 172.21.15.79:0/981459943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 msgr2=0x7fd09c0a8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.605+0000 7fd0a7200640 1 --2- 172.21.15.79:0/981459943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 0x7fd09c0a8eb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd094009900 tx=0x7fd09402a400 comp rx=0 tx=0).stop 2024-09-21T02:47:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.607+0000 7fd0a7200640 1 -- 172.21.15.79:0/981459943 shutdown_connections 2024-09-21T02:47:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.607+0000 7fd0a7200640 1 --2- 172.21.15.79:0/981459943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 0x7fd09c0a8eb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.607+0000 7fd0a7200640 1 --2- 172.21.15.79:0/981459943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd09c007390 0x7fd09c0077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.607+0000 7fd0a7200640 1 --2- 172.21.15.79:0/981459943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd09c008940 0x7fd09c006d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.607+0000 7fd0a7200640 1 -- 172.21.15.79:0/981459943 >> 172.21.15.79:0/981459943 conn(0x7fd09c091b60 msgr2=0x7fd09c093fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.609+0000 7fd0a7200640 1 -- 172.21.15.79:0/981459943 shutdown_connections 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.610+0000 7fd0a7200640 1 -- 172.21.15.79:0/981459943 wait complete. 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.611+0000 7fd0a7200640 1 Processor -- start 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.612+0000 7fd0a7200640 1 -- start start 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.612+0000 7fd0a7200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd09c007390 0x7fd09c0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.612+0000 7fd0a7200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd09c008940 0x7fd09c09f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.612+0000 7fd0a7200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 0x7fd09c09f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.612+0000 7fd0a7200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c0ac750 con 0x7fd09c008940 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.612+0000 7fd0a7200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c0ac5d0 con 0x7fd09c0a69e0 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.612+0000 7fd0a7200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c0ac8d0 con 0x7fd09c007390 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd09c007390 0x7fd09c0a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd09c007390 0x7fd09c0a6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50176/0 (socket says 172.21.15.79:50176) 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a5e00640 1 -- 172.21.15.79:0/2156231954 learned_addr learned my addr 172.21.15.79:0/2156231954 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a6800640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 0x7fd09c09f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd09c008940 0x7fd09c09f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a6800640 1 -- 172.21.15.79:0/2156231954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd09c007390 msgr2=0x7fd09c0a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a6800640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd09c007390 0x7fd09c0a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.613+0000 7fd0a6800640 1 -- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd09c008940 msgr2=0x7fd09c09f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.614+0000 7fd0a6800640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd09c008940 0x7fd09c09f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.614+0000 7fd0a6800640 1 -- 172.21.15.79:0/2156231954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c0a01d0 con 0x7fd09c0a69e0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.614+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd09c008940 0x7fd09c09f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.614+0000 7fd0a6800640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 0x7fd09c09f9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd094006010 tx=0x7fd094003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.615+0000 7fd09aa00640 1 -- 172.21.15.79:0/2156231954 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09403f070 con 0x7fd09c0a69e0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.615+0000 7fd09aa00640 1 -- 172.21.15.79:0/2156231954 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd09403bd20 con 0x7fd09c0a69e0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.615+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c0a4e30 con 0x7fd09c0a69e0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.615+0000 7fd09aa00640 1 -- 172.21.15.79:0/2156231954 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094035030 con 0x7fd09c0a69e0 2024-09-21T02:47:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.616+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c0a53e0 con 0x7fd09c0a69e0 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.621+0000 7fd0af41a740 1 Processor -- start 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.622+0000 7fd09aa00640 1 -- 172.21.15.79:0/2156231954 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd094042070 con 0x7fd09c0a69e0 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.622+0000 7fd0af41a740 1 -- start start 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.623+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa535500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.624+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa535a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.624+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa535f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.624+0000 7fd0af41a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5639fa4aaca0 con 0x5639fa164980 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.624+0000 7fd0af41a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5639fa49a0d0 con 0x5639fa18d840 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.624+0000 7fd0af41a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5639fa49dee0 con 0x5639fa16cb60 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.625+0000 7fd09aa00640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd0880b6590 0x7fd0880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.625+0000 7fd09aa00640 1 -- 172.21.15.79:0/2156231954 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fd094107ea0 con 0x7fd09c0a69e0 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.625+0000 7fd0a5e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa535a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.625+0000 7fd0a5e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa535a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38436/0 (socket says 172.21.15.79:38436) 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.625+0000 7fd0a5e00640 1 -- 172.21.15.79:0/1977169850 learned_addr learned my addr 172.21.15.79:0/1977169850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.626+0000 7fd0a6800640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd0880b6590 0x7fd0880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.626+0000 7fd0a5400640 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa535500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.626+0000 7fd0a5400640 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa535f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.627+0000 7fd0a5e00640 1 -- 172.21.15.79:0/1977169850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 msgr2=0x5639fa535f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.627+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa535f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.627+0000 7fd0a5e00640 1 -- 172.21.15.79:0/1977169850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 msgr2=0x5639fa535500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.627+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa535500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.627+0000 7fd0a5e00640 1 -- 172.21.15.79:0/1977169850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639fa44c400 con 0x5639fa164980 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.627+0000 7fd0a5400640 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa535500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.627+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa535a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00519e0 tx=0x7fd0a006a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb63eab64c09036 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.628+0000 7fd0a6800640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd0880b6590 0x7fd0880b8aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd094005f70 tx=0x7fd094031810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:40.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.629+0000 7fd08f000640 1 -- 172.21.15.79:0/1977169850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0088070 con 0x5639fa164980 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.629+0000 7fd08f000640 1 -- 172.21.15.79:0/1977169850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0a0075e30 con 0x5639fa164980 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.630+0000 7fd08f000640 1 -- 172.21.15.79:0/1977169850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0081350 con 0x5639fa164980 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.630+0000 7fd0af41a740 1 -- 172.21.15.79:0/1977169850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 msgr2=0x5639fa535a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.630+0000 7fd0af41a740 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa535a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00519e0 tx=0x7fd0a006a3e0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.631+0000 7fd0af41a740 1 -- 172.21.15.79:0/1977169850 shutdown_connections 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.631+0000 7fd0af41a740 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa535f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.631+0000 7fd0af41a740 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa535a40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.631+0000 7fd0af41a740 1 --2- 172.21.15.79:0/1977169850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa535500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.631+0000 7fd0af41a740 1 -- 172.21.15.79:0/1977169850 >> 172.21.15.79:0/1977169850 conn(0x5639fa181990 msgr2=0x5639fa5333f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.631+0000 7fd0af41a740 1 -- 172.21.15.79:0/1977169850 shutdown_connections 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.631+0000 7fd0af41a740 1 -- 172.21.15.79:0/1977169850 wait complete. 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.632+0000 7fd0af41a740 1 -- start start 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.633+0000 7fd0af41a740 1 Processor -- start 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.634+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa540ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.634+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa540ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.634+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa541530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.634+0000 7fd0af41a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5639fa2fb7a0 con 0x5639fa164980 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.634+0000 7fd0af41a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5639fa43fa10 con 0x5639fa18d840 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.634+0000 7fd0af41a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5639fa543ce0 con 0x5639fa16cb60 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.634+0000 7fd0af41a740 10 client.0 _ll_register_callbacks cb 0x5639fa44fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.635+0000 7fd0a5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa540ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.635+0000 7fd0a5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa540ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50198/0 (socket says 172.21.15.79:50198) 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.635+0000 7fd0a5e00640 1 -- 172.21.15.79:0/3629277150 learned_addr learned my addr 172.21.15.79:0/3629277150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.635+0000 7fd0a5400640 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa540ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.635+0000 7fd0a5400640 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa541530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.636+0000 7fd0a5e00640 1 -- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 msgr2=0x5639fa541530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.636+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa541530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.636+0000 7fd0a5e00640 1 -- 172.21.15.79:0/3629277150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 msgr2=0x5639fa540ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.636+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa540ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.636+0000 7fd0a5e00640 1 -- 172.21.15.79:0/3629277150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639fa207b90 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.637+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa540ff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00694d0 tx=0x7fd0a0083f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75d10b62076bfe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.637+0000 7fd083400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.637+0000 7fd083400640 1 -- 172.21.15.79:0/3629277150 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0088040 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.637+0000 7fd083400640 1 -- 172.21.15.79:0/3629277150 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fd0a0075c00 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.638+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0a0075e30 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.638+0000 7fd083400640 1 -- 172.21.15.79:0/3629277150 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd0a006b030 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.638+0000 7fd0af41a740 10 client.26665 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.640+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5639fa54f920 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.641+0000 7fd083400640 1 -- 172.21.15.79:0/3629277150 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0a0075e30 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.642+0000 7fd083400640 1 -- 172.21.15.79:0/3629277150 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd0a0094030 con 0x5639fa16cb60 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.642+0000 7fd0af41a740 10 client.26665 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.642+0000 7fd0af41a740 10 client.26665 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.642+0000 7fd0af41a740 20 client.26665 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.642+0000 7fd0af41a740 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa14c1c0 0x5639fa552c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.642+0000 7fd0af41a740 4 client.26665 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:47:40.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.642+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639fa4acbf0 con 0x5639fa14c1c0 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.643+0000 7fd0a5400640 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa14c1c0 0x5639fa552c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.644+0000 7fd0a5400640 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa14c1c0 0x5639fa552c80 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc98f80b4b296b10 server_cookie=f18b6f242c31564e in_seq=0 out_seq=0 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.644+0000 7fd083400640 10 client.26665 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.644+0000 7fd083400640 1 -- 172.21.15.79:0/3629277150 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639fa4acbf0 con 0x5639fa14c1c0 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.644+0000 7fd083400640 10 client.26665 handle_command_reply: tid=0 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.644+0000 7fd0af41a740 1 client.26665 shutdown 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 msgr2=0x5639fa540ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa540ff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00694d0 tx=0x7fd0a0083f60 comp rx=0 tx=0).stop 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 shutdown_connections 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa14c1c0 0x5639fa552c80 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa18d840 0x5639fa541530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa16cb60 0x5639fa540ff0 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00694d0 tx=0x7fd0a0083f60 comp rx=0 tx=0).stop 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 --2- 172.21.15.79:0/3629277150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa164980 0x5639fa540ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd083400640 0 client.26665 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 >> 172.21.15.79:0/3629277150 conn(0x5639fa181990 msgr2=0x5639fa531bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 shutdown_connections 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.645+0000 7fd0af41a740 1 -- 172.21.15.79:0/3629277150 wait complete. 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.646+0000 7fd0af41a740 20 client.26665 trim_cache size 0 max 16384 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.665+0000 7fd0af41a740 1 Processor -- start 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.665+0000 7fd0af41a740 1 -- start start 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.665+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa164980 0x5639fa53f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa541470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa121570 0x5639fa536c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0af41a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c150020 con 0x5639fa18d840 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0af41a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1528a0 con 0x5639fa164980 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0af41a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c150690 con 0x5639fa121570 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa164980 0x5639fa53f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa164980 0x5639fa53f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52646/0 (socket says 172.21.15.79:52646) 2024-09-21T02:47:40.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0a5400640 1 -- 172.21.15.79:0/2134611565 learned_addr learned my addr 172.21.15.79:0/2134611565 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa121570 0x5639fa536c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.666+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa541470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.667+0000 7fd0a5400640 1 -- 172.21.15.79:0/2134611565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa121570 msgr2=0x5639fa536c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.667+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa121570 0x5639fa536c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.667+0000 7fd0a5400640 1 -- 172.21.15.79:0/2134611565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 msgr2=0x5639fa541470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.667+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa541470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.667+0000 7fd0a5400640 1 -- 172.21.15.79:0/2134611565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639fa537a20 con 0x5639fa164980 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.667+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa164980 0x5639fa53f9a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd090004810 tx=0x7fd090008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4db9ca8a8aa148 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.667+0000 7fd08e600640 1 -- 172.21.15.79:0/2134611565 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090028040 con 0x5639fa164980 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd08e600640 1 -- 172.21.15.79:0/2134611565 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd090029040 con 0x5639fa164980 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd08e600640 1 -- 172.21.15.79:0/2134611565 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09000f040 con 0x5639fa164980 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd0af41a740 1 -- 172.21.15.79:0/2134611565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa164980 msgr2=0x5639fa53f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa164980 0x5639fa53f9a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd090004810 tx=0x7fd090008040 comp rx=0 tx=0).stop 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd0af41a740 1 -- 172.21.15.79:0/2134611565 shutdown_connections 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa121570 0x5639fa536c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa541470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2134611565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa164980 0x5639fa53f9a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.668+0000 7fd0af41a740 1 -- 172.21.15.79:0/2134611565 >> 172.21.15.79:0/2134611565 conn(0x5639fa181990 msgr2=0x5639fa536530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.669+0000 7fd0af41a740 1 -- 172.21.15.79:0/2134611565 shutdown_connections 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.669+0000 7fd0af41a740 1 -- 172.21.15.79:0/2134611565 wait complete. 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.669+0000 7fd0af41a740 1 -- start start 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.669+0000 7fd0af41a740 1 Processor -- start 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa121570 0x5639fa545220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa164980 0x5639fa545760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0af41a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa5bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0af41a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c150d60 con 0x5639fa18d840 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0af41a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1521d0 con 0x5639fa121570 2024-09-21T02:47:40.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0af41a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c151430 con 0x5639fa164980 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0af41a740 10 client.0 _ll_register_callbacks cb 0x7fd0a0086070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa121570 0x5639fa545220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0a5400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa121570 0x5639fa545220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:52656/0 (socket says 172.21.15.79:52656) 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0a5400640 1 -- 172.21.15.79:0/2289761197 learned_addr learned my addr 172.21.15.79:0/2289761197 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa164980 0x5639fa545760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.670+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa5bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0a5e00640 1 -- 172.21.15.79:0/2289761197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa121570 msgr2=0x5639fa545220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa121570 0x5639fa545220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0a5e00640 1 -- 172.21.15.79:0/2289761197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 msgr2=0x5639fa5bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa5bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0a5e00640 1 -- 172.21.15.79:0/2289761197 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639fa545f70 con 0x5639fa164980 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa5bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0a5e00640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa164980 0x5639fa545760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0068d40 tx=0x7fd0a0083b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8a6c48b56f24a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd083400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:47:40.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd083400640 1 -- 172.21.15.79:0/2289761197 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0088040 con 0x5639fa164980 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd083400640 1 -- 172.21.15.79:0/2289761197 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fd0a0075980 con 0x5639fa164980 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.671+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd090029040 con 0x5639fa164980 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd083400640 1 -- 172.21.15.79:0/2289761197 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd0a0075b80 con 0x5639fa164980 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 10 client.26671 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5639fa5bd900 con 0x5639fa164980 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd083400640 1 -- 172.21.15.79:0/2289761197 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd090029040 con 0x5639fa164980 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd083400640 1 -- 172.21.15.79:0/2289761197 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd0a0094040 con 0x5639fa164980 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 10 client.26671 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 10 client.26671 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 20 client.26671 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa5be000 0x5639fa5c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 4 client.26671 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}] 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.672+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}) -- 0x5639fa4a86a0 con 0x5639fa5be000 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.673+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa5be000 0x5639fa5c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.673+0000 7fd0a5400640 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa5be000 0x5639fa5c0420 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=562ba0303b967e82 server_cookie=ab0ecb0e8431da58 in_seq=0 out_seq=0 2024-09-21T02:47:40.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.673+0000 7fd083400640 10 client.26671 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd083400640 1 -- 172.21.15.79:0/2289761197 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5639fa4a86a0 con 0x5639fa5be000 2024-09-21T02:47:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd083400640 10 client.26671 handle_command_reply: tid=0 2024-09-21T02:47:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 client.26671 shutdown 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa164980 msgr2=0x5639fa545760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa164980 0x5639fa545760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0068d40 tx=0x7fd0a0083b10 comp rx=0 tx=0).stop 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 shutdown_connections 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5639fa5be000 0x5639fa5c0420 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5639fa18d840 0x5639fa5bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5639fa164980 0x5639fa545760 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 --2- 172.21.15.79:0/2289761197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5639fa121570 0x5639fa545220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd083400640 0 client.26671 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.979+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 >> 172.21.15.79:0/2289761197 conn(0x5639fa181990 msgr2=0x5639fa541240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.980+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 shutdown_connections 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.980+0000 7fd0af41a740 1 -- 172.21.15.79:0/2289761197 wait complete. 2024-09-21T02:47:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.980+0000 7fd0af41a740 20 client.26671 trim_cache size 0 max 16384 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 46, 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "4877b84c": { 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 46, 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:47:40.984 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 137.8, 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:40.985 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd0880b6590 msgr2=0x7fd0880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd0880b6590 0x7fd0880b8aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd094005f70 tx=0x7fd094031810 comp rx=0 tx=0).stop 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 msgr2=0x7fd09c09f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 0x7fd09c09f9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd094006010 tx=0x7fd094003cd0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 shutdown_connections 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd0880b6590 0x7fd0880b8aa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd09c0a69e0 0x7fd09c09f9b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd09c008940 0x7fd09c09f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 --2- 172.21.15.79:0/2156231954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd09c007390 0x7fd09c0a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 >> 172.21.15.79:0/2156231954 conn(0x7fd09c091b60 msgr2=0x7fd09c095b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 shutdown_connections 2024-09-21T02:47:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:40.981+0000 7fd0a7200640 1 -- 172.21.15.79:0/2156231954 wait complete. 2024-09-21T02:47:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 705.0 s, 350.8 tps, lat 244.933 ms stddev 295.541 2024-09-21T02:47:41.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:41 smithi079 ceph-mon[30788]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.1 MiB/s wr, 532 op/s 2024-09-21T02:47:41.974 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4877b84c', quiesce took 7.3 seconds. Will release after: 10.5 2024-09-21T02:47:42.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:41 smithi148 ceph-mon[34626]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.1 MiB/s wr, 532 op/s 2024-09-21T02:47:42.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:41 smithi098 ceph-mon[34832]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.1 MiB/s wr, 532 op/s 2024-09-21T02:47:43.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:43 smithi079 ceph-mon[30788]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 5.3 MiB/s wr, 488 op/s 2024-09-21T02:47:44.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:43 smithi148 ceph-mon[34626]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 5.3 MiB/s wr, 488 op/s 2024-09-21T02:47:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:43 smithi098 ceph-mon[34832]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 5.3 MiB/s wr, 488 op/s 2024-09-21T02:47:45.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:45 smithi079 ceph-mon[30788]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 4.4 MiB/s wr, 427 op/s 2024-09-21T02:47:46.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:45 smithi148 ceph-mon[34626]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 4.4 MiB/s wr, 427 op/s 2024-09-21T02:47:46.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:45 smithi098 ceph-mon[34832]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 4.4 MiB/s wr, 427 op/s 2024-09-21T02:47:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:47:47.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:47 smithi079 ceph-mon[30788]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 4.0 MiB/s wr, 381 op/s 2024-09-21T02:47:48.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:47 smithi148 ceph-mon[34626]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 4.0 MiB/s wr, 381 op/s 2024-09-21T02:47:48.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:47 smithi098 ceph-mon[34832]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 4.0 MiB/s wr, 381 op/s 2024-09-21T02:47:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 -- 172.21.15.79:0/319867886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 msgr2=0x7f4c64105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 --2- 172.21.15.79:0/319867886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c64105d40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009900 tx=0x7f4c5402a410 comp rx=0 tx=0).stop 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 -- 172.21.15.79:0/319867886 shutdown_connections 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 --2- 172.21.15.79:0/319867886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c641072f0 0x7f4c6410dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 --2- 172.21.15.79:0/319867886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c64106950 0x7f4c64106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 --2- 172.21.15.79:0/319867886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c64105d40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 -- 172.21.15.79:0/319867886 >> 172.21.15.79:0/319867886 conn(0x7f4c64101230 msgr2=0x7f4c641036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 -- 172.21.15.79:0/319867886 shutdown_connections 2024-09-21T02:47:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.784+0000 7f4c69200640 1 -- 172.21.15.79:0/319867886 wait complete. 2024-09-21T02:47:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.785+0000 7f4c69200640 1 Processor -- start 2024-09-21T02:47:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.785+0000 7f4c69200640 1 -- start start 2024-09-21T02:47:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c69200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c6419c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c69200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c64106950 0x7f4c6419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c69200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c641072f0 0x7f4c6419d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c69200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c64111510 con 0x7f4c641058d0 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c69200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c64111390 con 0x7f4c64106950 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c69200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c64111690 con 0x7f4c641072f0 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c6419c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c6419c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44210/0 (socket says 172.21.15.79:44210) 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c5be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c64106950 0x7f4c6419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 -- 172.21.15.79:0/559261133 learned_addr learned my addr 172.21.15.79:0/559261133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c62800640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c641072f0 0x7f4c6419d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 -- 172.21.15.79:0/559261133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c641072f0 msgr2=0x7f4c6419d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c641072f0 0x7f4c6419d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 -- 172.21.15.79:0/559261133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c64106950 msgr2=0x7f4c6419c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c64106950 0x7f4c6419c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.786+0000 7f4c61e00640 1 -- 172.21.15.79:0/559261133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6419dba0 con 0x7f4c641058d0 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.787+0000 7f4c61e00640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c6419c160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4c54006010 tx=0x7f4c540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.787+0000 7f4c5aa00640 1 -- 172.21.15.79:0/559261133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5403f030 con 0x7f4c641058d0 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.787+0000 7f4c5aa00640 1 -- 172.21.15.79:0/559261133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c54032e50 con 0x7f4c641058d0 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.787+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6419de30 con 0x7f4c641058d0 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.787+0000 7f4c5aa00640 1 -- 172.21.15.79:0/559261133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c54035070 con 0x7f4c641058d0 2024-09-21T02:47:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.787+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6419e140 con 0x7f4c641058d0 2024-09-21T02:47:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.790+0000 7f4c70276740 1 Processor -- start 2024-09-21T02:47:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.790+0000 7f4c70276740 1 -- start start 2024-09-21T02:47:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c5aa00640 1 -- 172.21.15.79:0/559261133 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4c54042030 con 0x7f4c641058d0 2024-09-21T02:47:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c70276740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x5636397660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c70276740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639766740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c70276740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639767290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c70276740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5636396d96b0 con 0x5636393962f0 2024-09-21T02:47:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c70276740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5636396c8ae0 con 0x5636393bf1b0 2024-09-21T02:47:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c70276740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5636396cc8f0 con 0x56363939e4d0 2024-09-21T02:47:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639766740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c62800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x5636397660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c61e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639766740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44226/0 (socket says 172.21.15.79:44226) 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c61e00640 1 -- 172.21.15.79:0/2735238865 learned_addr learned my addr 172.21.15.79:0/2735238865 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.791+0000 7f4c5be00640 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639767290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c62800640 1 -- 172.21.15.79:0/2735238865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 msgr2=0x563639767290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c62800640 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639767290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c62800640 1 -- 172.21.15.79:0/2735238865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 msgr2=0x563639766740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c62800640 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639766740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c62800640 1 -- 172.21.15.79:0/2735238865 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563639695780 con 0x5636393bf1b0 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c62800640 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x5636397660d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009f10 tx=0x7f4c5c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875d5feae9155153 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c53400640 1 -- 172.21.15.79:0/2735238865 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c004d20 con 0x5636393bf1b0 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c53400640 1 -- 172.21.15.79:0/2735238865 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c5c004030 con 0x5636393bf1b0 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c53400640 1 -- 172.21.15.79:0/2735238865 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c005280 con 0x5636393bf1b0 2024-09-21T02:47:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.792+0000 7f4c5aa00640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c480b6510 0x7f4c480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.793+0000 7f4c61e00640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c480b6510 0x7f4c480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.793+0000 7f4c5aa00640 1 -- 172.21.15.79:0/559261133 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4c54107c20 con 0x7f4c641058d0 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.793+0000 7f4c70276740 1 -- 172.21.15.79:0/2735238865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 msgr2=0x5636397660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.793+0000 7f4c61e00640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c480b6510 0x7f4c480b8a20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4c54032ab0 tx=0x7f4c5410b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.793+0000 7f4c70276740 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x5636397660d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009f10 tx=0x7f4c5c011810 comp rx=0 tx=0).stop 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.793+0000 7f4c70276740 1 -- 172.21.15.79:0/2735238865 shutdown_connections 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.793+0000 7f4c70276740 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639767290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.794+0000 7f4c70276740 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639766740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.794+0000 7f4c70276740 1 --2- 172.21.15.79:0/2735238865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x5636397660d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.794+0000 7f4c70276740 1 -- 172.21.15.79:0/2735238865 >> 172.21.15.79:0/2735238865 conn(0x5636393b3300 msgr2=0x563639761b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.794+0000 7f4c70276740 1 -- 172.21.15.79:0/2735238865 shutdown_connections 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.794+0000 7f4c70276740 1 -- 172.21.15.79:0/2735238865 wait complete. 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.794+0000 7f4c70276740 1 -- start start 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.794+0000 7f4c70276740 1 Processor -- start 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c70276740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393962f0 0x56363976f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c70276740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x56363976fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c70276740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393bf1b0 0x563639770930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c70276740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563639600ab0 con 0x5636393bf1b0 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c70276740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56363966f570 con 0x56363939e4d0 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c70276740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563639767db0 con 0x5636393962f0 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c70276740 10 client.0 _ll_register_callbacks cb 0x56363967e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c62800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393bf1b0 0x563639770930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c5be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x56363976fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c5be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x56363976fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:56012/0 (socket says 172.21.15.79:56012) 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c5be00640 1 -- 172.21.15.79:0/1244391058 learned_addr learned my addr 172.21.15.79:0/1244391058 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.795+0000 7f4c62800640 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393962f0 0x56363976f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c62800640 1 -- 172.21.15.79:0/1244391058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393962f0 msgr2=0x56363976f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c62800640 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393962f0 0x56363976f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c62800640 1 -- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 msgr2=0x56363976fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c62800640 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x56363976fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c62800640 1 -- 172.21.15.79:0/1244391058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363942a790 con 0x5636393bf1b0 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c5be00640 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x56363976fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c62800640 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393bf1b0 0x563639770930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009b80 tx=0x7f4c5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ef7c5225d9936e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c47e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c47e00640 1 -- 172.21.15.79:0/1244391058 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c01e040 con 0x5636393bf1b0 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c47e00640 1 -- 172.21.15.79:0/1244391058 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4c5c004a40 con 0x5636393bf1b0 2024-09-21T02:47:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.796+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c5c004030 con 0x5636393bf1b0 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c47e00640 1 -- 172.21.15.79:0/1244391058 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4c5c004c40 con 0x5636393bf1b0 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 10 client.16386 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5636394a3620 con 0x5636393bf1b0 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c47e00640 1 -- 172.21.15.79:0/1244391058 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c5c004030 con 0x5636393bf1b0 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c47e00640 1 -- 172.21.15.79:0/1244391058 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4c5c024070 con 0x5636393bf1b0 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 10 client.16386 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 10 client.16386 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 20 client.16386 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56363937dd80 0x56363977cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 4 client.16386 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.797+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636396db600 con 0x56363937dd80 2024-09-21T02:47:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.798+0000 7f4c5be00640 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56363937dd80 0x56363977cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.798+0000 7f4c5be00640 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56363937dd80 0x56363977cbf0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d149f269566f762a server_cookie=8b749f1cfd242ff9 in_seq=0 out_seq=0 2024-09-21T02:47:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.798+0000 7f4c47e00640 10 client.16386 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.799+0000 7f4c47e00640 1 -- 172.21.15.79:0/1244391058 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5636396db600 con 0x56363937dd80 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.799+0000 7f4c47e00640 10 client.16386 handle_command_reply: tid=0 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.799+0000 7f4c70276740 1 client.16386 shutdown 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.799+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393bf1b0 msgr2=0x563639770930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.799+0000 7f4c70276740 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393bf1b0 0x563639770930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009b80 tx=0x7f4c5c009bf0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 shutdown_connections 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56363937dd80 0x56363977cbf0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393bf1b0 0x563639770930 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x56363976fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 --2- 172.21.15.79:0/1244391058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393962f0 0x56363976f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c47e00640 0 client.16386 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 >> 172.21.15.79:0/1244391058 conn(0x5636393b3300 msgr2=0x563639767140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 shutdown_connections 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 1 -- 172.21.15.79:0/1244391058 wait complete. 2024-09-21T02:47:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.800+0000 7f4c70276740 20 client.16386 trim_cache size 0 max 16384 2024-09-21T02:47:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 Processor -- start 2024-09-21T02:47:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 -- start start 2024-09-21T02:47:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x56363976e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x563639761330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393bf1b0 0x563639761870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c641ac930 con 0x5636393962f0 2024-09-21T02:47:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c641af1b0 con 0x56363939e4d0 2024-09-21T02:47:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c70276740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c641acfa0 con 0x5636393bf1b0 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c62800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x56363976e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c62800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x56363976e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44244/0 (socket says 172.21.15.79:44244) 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.815+0000 7f4c62800640 1 -- 172.21.15.79:0/3780977960 learned_addr learned my addr 172.21.15.79:0/3780977960 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c5be00640 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x563639761330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c62800640 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393bf1b0 0x563639761870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c62800640 1 -- 172.21.15.79:0/3780977960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393bf1b0 msgr2=0x563639761870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c62800640 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393bf1b0 0x563639761870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c62800640 1 -- 172.21.15.79:0/3780977960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 msgr2=0x563639761330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c62800640 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x563639761330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c62800640 1 -- 172.21.15.79:0/3780977960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363976d880 con 0x5636393962f0 2024-09-21T02:47:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c62800640 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x56363976e950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c005d70 tx=0x7f4c5c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89dc6859a347da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c52a00640 1 -- 172.21.15.79:0/3780977960 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c005970 con 0x5636393962f0 2024-09-21T02:47:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c52a00640 1 -- 172.21.15.79:0/3780977960 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c5c005290 con 0x5636393962f0 2024-09-21T02:47:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.816+0000 7f4c52a00640 1 -- 172.21.15.79:0/3780977960 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0046d0 con 0x5636393962f0 2024-09-21T02:47:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 -- 172.21.15.79:0/3780977960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 msgr2=0x56363976e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x56363976e950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c005d70 tx=0x7f4c5c0043d0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 -- 172.21.15.79:0/3780977960 shutdown_connections 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5636393bf1b0 0x563639761870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56363939e4d0 0x563639761330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 --2- 172.21.15.79:0/3780977960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x56363976e950 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 -- 172.21.15.79:0/3780977960 >> 172.21.15.79:0/3780977960 conn(0x5636393b3300 msgr2=0x56363976e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 -- 172.21.15.79:0/3780977960 shutdown_connections 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.817+0000 7f4c70276740 1 -- 172.21.15.79:0/3780977960 wait complete. 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 -- start start 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 Processor -- start 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639777180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639777840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x563639773140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c641ad670 con 0x5636393962f0 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c641aeae0 con 0x5636393bf1b0 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c641add40 con 0x56363939e4d0 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.818+0000 7f4c70276740 10 client.0 _ll_register_callbacks cb 0x7f4c5410b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639777180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c5be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639777840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639777180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44256/0 (socket says 172.21.15.79:44256) 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 -- 172.21.15.79:0/2886303120 learned_addr learned my addr 172.21.15.79:0/2886303120 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x563639773140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 -- 172.21.15.79:0/2886303120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 msgr2=0x563639777840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639777840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 -- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 msgr2=0x563639773140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x563639773140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 -- 172.21.15.79:0/2886303120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636397738d0 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c5be00640 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639777840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c62800640 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639777180 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00fa30 tx=0x7f4c5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff998c5975701e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c47e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.819+0000 7f4c47e00640 1 -- 172.21.15.79:0/2886303120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c042020 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c47e00640 1 -- 172.21.15.79:0/2886303120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4c5c00fd30 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c5c005290 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c47e00640 1 -- 172.21.15.79:0/2886303120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4c5c00f480 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 10 client.16392 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5636397e7580 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c47e00640 1 -- 172.21.15.79:0/2886303120 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c5c005290 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c47e00640 1 -- 172.21.15.79:0/2886303120 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4c5c024040 con 0x5636393962f0 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 10 client.16392 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 10 client.16392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:47:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 20 client.16392 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5636393531c0 0x5636397e9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 4 client.16392 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:47:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.820+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5636396d70b0 con 0x5636393531c0 2024-09-21T02:47:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.821+0000 7f4c5be00640 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5636393531c0 0x5636397e9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.821+0000 7f4c5be00640 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5636393531c0 0x5636397e9d30 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88a4438f8e4a424 server_cookie=6a5fccef45913f71 in_seq=0 out_seq=0 2024-09-21T02:47:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.821+0000 7f4c47e00640 10 client.16392 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c47e00640 1 -- 172.21.15.79:0/2886303120 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5636396d70b0 con 0x5636393531c0 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c47e00640 10 client.16392 handle_command_reply: tid=0 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 client.16392 shutdown 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 msgr2=0x563639777180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639777180 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00fa30 tx=0x7f4c5c009bf0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 shutdown_connections 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5636393531c0 0x5636397e9d30 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636393bf1b0 0x563639773140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56363939e4d0 0x563639777840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c47e00640 0 client.16392 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 --2- 172.21.15.79:0/2886303120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5636393962f0 0x563639777180 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 >> 172.21.15.79:0/2886303120 conn(0x5636393b3300 msgr2=0x5636397600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 shutdown_connections 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 1 -- 172.21.15.79:0/2886303120 wait complete. 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.844+0000 7f4c70276740 20 client.16392 trim_cache size 0 max 16384 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:47:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:47:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c480b6510 msgr2=0x7f4c480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c480b6510 0x7f4c480b8a20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4c54032ab0 tx=0x7f4c5410b700 comp rx=0 tx=0).stop 2024-09-21T02:47:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 msgr2=0x7f4c6419c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c6419c160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4c54006010 tx=0x7f4c540042f0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 shutdown_connections 2024-09-21T02:47:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c480b6510 0x7f4c480b8a20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c641072f0 0x7f4c6419d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c64106950 0x7f4c6419c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 --2- 172.21.15.79:0/559261133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c641058d0 0x7f4c6419c160 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 >> 172.21.15.79:0/559261133 conn(0x7f4c64101230 msgr2=0x7f4c64109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 shutdown_connections 2024-09-21T02:47:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:47:48.845+0000 7f4c69200640 1 -- 172.21.15.79:0/559261133 wait complete. 2024-09-21T02:47:49.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:49 smithi079 ceph-mon[30788]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.4 MiB/s wr, 309 op/s 2024-09-21T02:47:50.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:49 smithi148 ceph-mon[34626]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.4 MiB/s wr, 309 op/s 2024-09-21T02:47:50.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:49 smithi098 ceph-mon[34832]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.4 MiB/s wr, 309 op/s 2024-09-21T02:47:51.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:47:51.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:51 smithi079 ceph-mon[30788]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 2.3 MiB/s wr, 211 op/s 2024-09-21T02:47:52.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:51 smithi148 ceph-mon[34626]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 2.3 MiB/s wr, 211 op/s 2024-09-21T02:47:52.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:51 smithi098 ceph-mon[34832]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 2.3 MiB/s wr, 211 op/s 2024-09-21T02:47:52.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:47:52.861 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 -- 172.21.15.79:0/3889892485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6178076100 msgr2=0x7f617810fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 --2- 172.21.15.79:0/3889892485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6178076100 0x7f617810fb90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6164009900 tx=0x7f616402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 -- 172.21.15.79:0/3889892485 shutdown_connections 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 --2- 172.21.15.79:0/3889892485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61781100d0 0x7f6178112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 --2- 172.21.15.79:0/3889892485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6178076100 0x7f617810fb90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 --2- 172.21.15.79:0/3889892485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61780757b0 0x7f6178075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 -- 172.21.15.79:0/3889892485 >> 172.21.15.79:0/3889892485 conn(0x7f61780ff5e0 msgr2=0x7f6178101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 -- 172.21.15.79:0/3889892485 shutdown_connections 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.493+0000 7f617d200640 1 -- 172.21.15.79:0/3889892485 wait complete. 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.494+0000 7f617d200640 1 Processor -- start 2024-09-21T02:47:53.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.494+0000 7f617d200640 1 -- start start 2024-09-21T02:47:53.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f617d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61780757b0 0x7f617819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:53.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f617d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6178076100 0x7f617819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:53.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f617d200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61781100d0 0x7f61781a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f617d200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6178115c80 con 0x7f61781100d0 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f617d200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6178115b00 con 0x7f61780757b0 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f617d200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6178115e00 con 0x7f6178076100 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f6175e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61780757b0 0x7f617819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f6175400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6178076100 0x7f617819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f6175e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61780757b0 0x7f617819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:56056/0 (socket says 172.21.15.79:56056) 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f6176800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61781100d0 0x7f61781a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.495+0000 7f6175e00640 1 -- 172.21.15.79:0/2979893158 learned_addr learned my addr 172.21.15.79:0/2979893158 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f6175400640 1 -- 172.21.15.79:0/2979893158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61780757b0 msgr2=0x7f617819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f6175400640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61780757b0 0x7f617819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f6175400640 1 -- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61781100d0 msgr2=0x7f61781a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:53.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f6175400640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61781100d0 0x7f61781a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f6175400640 1 -- 172.21.15.79:0/2979893158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61781a2640 con 0x7f6178076100 2024-09-21T02:47:53.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f6175400640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6178076100 0x7f617819cc70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6164006010 tx=0x7f6164004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:53.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f616ea00640 1 -- 172.21.15.79:0/2979893158 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616403f070 con 0x7f6178076100 2024-09-21T02:47:53.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f616ea00640 1 -- 172.21.15.79:0/2979893158 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6164003ca0 con 0x7f6178076100 2024-09-21T02:47:53.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61781a28d0 con 0x7f6178076100 2024-09-21T02:47:53.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.496+0000 7f616ea00640 1 -- 172.21.15.79:0/2979893158 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164035070 con 0x7f6178076100 2024-09-21T02:47:53.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.497+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61781a9090 con 0x7f6178076100 2024-09-21T02:47:53.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.498+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6178076cc0 con 0x7f6178076100 2024-09-21T02:47:53.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.500+0000 7f616ea00640 1 -- 172.21.15.79:0/2979893158 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f616403b460 con 0x7f6178076100 2024-09-21T02:47:53.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.502+0000 7f616ea00640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f615c0b6510 0x7f615c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:53.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.503+0000 7f616ea00640 1 -- 172.21.15.79:0/2979893158 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f6164107cd0 con 0x7f6178076100 2024-09-21T02:47:53.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.503+0000 7f6175e00640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f615c0b6510 0x7f615c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:53.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.504+0000 7f6175e00640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f615c0b6510 0x7f615c0b8a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6168009cd0 tx=0x7f6168005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:53.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.504+0000 7f616ea00640 1 -- 172.21.15.79:0/2979893158 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61640d2530 con 0x7f6178076100 2024-09-21T02:47:53.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.736+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61781a9260 con 0x7f6178076100 2024-09-21T02:47:53.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.737+0000 7f616ea00640 1 -- 172.21.15.79:0/2979893158 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f61640d7470 con 0x7f6178076100 2024-09-21T02:47:53.739 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:47:53.739 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:47:53.739 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:47:53.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f615c0b6510 msgr2=0x7f615c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f615c0b6510 0x7f615c0b8a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6168009cd0 tx=0x7f6168005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6178076100 msgr2=0x7f617819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6178076100 0x7f617819cc70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6164006010 tx=0x7f6164004060 comp rx=0 tx=0).stop 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 shutdown_connections 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f615c0b6510 0x7f615c0b8a20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61781100d0 0x7f61781a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6178076100 0x7f617819cc70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 --2- 172.21.15.79:0/2979893158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61780757b0 0x7f617819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 >> 172.21.15.79:0/2979893158 conn(0x7f61780ff5e0 msgr2=0x7f6178108b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 shutdown_connections 2024-09-21T02:47:53.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:53.740+0000 7f617d200640 1 -- 172.21.15.79:0/2979893158 wait complete. 2024-09-21T02:47:53.761 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:53 smithi079 ceph-mon[30788]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-09-21T02:47:54.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:53 smithi148 ceph-mon[34626]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-09-21T02:47:54.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:53 smithi098 ceph-mon[34832]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-09-21T02:47:54.548 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 4877b84c --release --await' 2024-09-21T02:47:54.549 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 4877b84c --release --await 2024-09-21T02:47:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:54.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:54 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2979893158' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:55.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:54 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2979893158' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:55.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:54 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2979893158' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 -- 172.21.15.79:0/622941025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f792410b6d0 msgr2=0x7f792410bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 --2- 172.21.15.79:0/622941025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f792410b6d0 0x7f792410bae0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7910009900 tx=0x7f791002a410 comp rx=0 tx=0).stop 2024-09-21T02:47:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 -- 172.21.15.79:0/622941025 shutdown_connections 2024-09-21T02:47:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 --2- 172.21.15.79:0/622941025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f792410c020 0x7f7924112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 --2- 172.21.15.79:0/622941025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f792410b6d0 0x7f792410bae0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 --2- 172.21.15.79:0/622941025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7924105d90 0x7f79241061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 -- 172.21.15.79:0/622941025 >> 172.21.15.79:0/622941025 conn(0x7f7924101860 msgr2=0x7f7924103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:55.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 -- 172.21.15.79:0/622941025 shutdown_connections 2024-09-21T02:47:55.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.563+0000 7f792a000640 1 -- 172.21.15.79:0/622941025 wait complete. 2024-09-21T02:47:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.564+0000 7f792a000640 1 Processor -- start 2024-09-21T02:47:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.564+0000 7f792a000640 1 -- start start 2024-09-21T02:47:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f792a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924105d90 0x7f792419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f792a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f792410b6d0 0x7f792419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f792a000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f792410c020 0x7f79241a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f792a000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7924115d30 con 0x7f7924105d90 2024-09-21T02:47:55.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f792a000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7924115bb0 con 0x7f792410c020 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f792a000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7924115eb0 con 0x7f792410b6d0 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f7923400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924105d90 0x7f792419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f7923400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924105d90 0x7f792419c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45302/0 (socket says 172.21.15.79:45302) 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f7923400640 1 -- 172.21.15.79:0/2320914566 learned_addr learned my addr 172.21.15.79:0/2320914566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f7922a00640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f792410b6d0 0x7f792419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.565+0000 7f7923e00640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f792410c020 0x7f79241a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f7923400640 1 -- 172.21.15.79:0/2320914566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f792410b6d0 msgr2=0x7f792419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f7923400640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f792410b6d0 0x7f792419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f7923400640 1 -- 172.21.15.79:0/2320914566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f792410c020 msgr2=0x7f79241a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f7923400640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f792410c020 0x7f79241a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f7923400640 1 -- 172.21.15.79:0/2320914566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79241a2650 con 0x7f7924105d90 2024-09-21T02:47:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f7923e00640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f792410c020 0x7f79241a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:47:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f7923400640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924105d90 0x7f792419c6e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f791400e9f0 tx=0x7f791400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f791be00640 1 -- 172.21.15.79:0/2320914566 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791400cd80 con 0x7f7924105d90 2024-09-21T02:47:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f791be00640 1 -- 172.21.15.79:0/2320914566 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79140108e0 con 0x7f7924105d90 2024-09-21T02:47:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79241a2940 con 0x7f7924105d90 2024-09-21T02:47:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.566+0000 7f791be00640 1 -- 172.21.15.79:0/2320914566 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914018980 con 0x7f7924105d90 2024-09-21T02:47:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.567+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79241a90a0 con 0x7f7924105d90 2024-09-21T02:47:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.570+0000 7f7930c3e740 1 Processor -- start 2024-09-21T02:47:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7930c3e740 1 -- start start 2024-09-21T02:47:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e9a1520 0x56554ed481c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e978660 0x56554ed48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed48c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7930c3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56554ecbf290 con 0x56554e980840 2024-09-21T02:47:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7930c3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56554ecae6c0 con 0x56554e978660 2024-09-21T02:47:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7930c3e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56554ecb24d0 con 0x56554e9a1520 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7922a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed48c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7922a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed48c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45306/0 (socket says 172.21.15.79:45306) 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7922a00640 1 -- 172.21.15.79:0/1770128635 learned_addr learned my addr 172.21.15.79:0/1770128635 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.571+0000 7f7923e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e9a1520 0x56554ed481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f7922a00640 1 -- 172.21.15.79:0/1770128635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e9a1520 msgr2=0x56554ed481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f7922a00640 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e9a1520 0x56554ed481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f7922a00640 1 -- 172.21.15.79:0/1770128635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e978660 msgr2=0x56554ed48700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f7922a00640 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e978660 0x56554ed48700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f7922a00640 1 -- 172.21.15.79:0/1770128635 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56554ec3b460 con 0x56554e980840 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f7923e00640 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e9a1520 0x56554ed481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f791be00640 1 -- 172.21.15.79:0/2320914566 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7914010430 con 0x7f7924105d90 2024-09-21T02:47:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.572+0000 7f7922a00640 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed48c40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7910005ab0 tx=0x7f7910004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c821d3f52955858 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.573+0000 7f790fe00640 1 -- 172.21.15.79:0/1770128635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910035040 con 0x56554e980840 2024-09-21T02:47:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.573+0000 7f790fe00640 1 -- 172.21.15.79:0/1770128635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79100054f0 con 0x56554e980840 2024-09-21T02:47:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.573+0000 7f790fe00640 1 -- 172.21.15.79:0/1770128635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79100035f0 con 0x56554e980840 2024-09-21T02:47:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 -- 172.21.15.79:0/1770128635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 msgr2=0x56554ed48c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed48c40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7910005ab0 tx=0x7f7910004040 comp rx=0 tx=0).stop 2024-09-21T02:47:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 -- 172.21.15.79:0/1770128635 shutdown_connections 2024-09-21T02:47:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed48c40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e978660 0x56554ed48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1770128635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e9a1520 0x56554ed481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 -- 172.21.15.79:0/1770128635 >> 172.21.15.79:0/1770128635 conn(0x56554e995910 msgr2=0x56554ed460b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 -- 172.21.15.79:0/1770128635 shutdown_connections 2024-09-21T02:47:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f791be00640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f79080b6540 0x7f79080b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f7930c3e740 1 -- 172.21.15.79:0/1770128635 wait complete. 2024-09-21T02:47:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.574+0000 7f791be00640 1 -- 172.21.15.79:0/2320914566 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f79140e7a10 con 0x7f7924105d90 2024-09-21T02:47:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.575+0000 7f7922a00640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f79080b6540 0x7f79080b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.575+0000 7f7930c3e740 1 -- start start 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.575+0000 7f7930c3e740 1 Processor -- start 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.575+0000 7f7922a00640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f79080b6540 0x7f79080b8a50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79100057c0 tx=0x7f7910031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed53db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed54330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed5fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7930c3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56554eb0fbb0 con 0x56554e980840 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7930c3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56554ec496c0 con 0x56554e9a1520 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7930c3e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56554ed56940 con 0x56554e978660 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7930c3e740 10 client.0 _ll_register_callbacks cb 0x56554ec64490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7922a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed54330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7922a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed54330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45314/0 (socket says 172.21.15.79:45314) 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7922a00640 1 -- 172.21.15.79:0/1152169251 learned_addr learned my addr 172.21.15.79:0/1152169251 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7923400640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed53db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.576+0000 7f7923e00640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed5fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7922a00640 1 -- 172.21.15.79:0/1152169251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 msgr2=0x56554ed53db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7922a00640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed53db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7922a00640 1 -- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 msgr2=0x56554ed5fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7922a00640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed5fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7922a00640 1 -- 172.21.15.79:0/1152169251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56554ea0cb00 con 0x56554e980840 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7923e00640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed5fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7923400640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed53db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7922a00640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed54330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7910004520 tx=0x7f7910000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05b0cc3b1dd10cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f790cc00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f790cc00640 1 -- 172.21.15.79:0/1152169251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910059070 con 0x56554e980840 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79100054f0 con 0x56554e980840 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.577+0000 7f790cc00640 1 -- 172.21.15.79:0/1152169251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f79100050e0 con 0x56554e980840 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.578+0000 7f790cc00640 1 -- 172.21.15.79:0/1152169251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7910035040 con 0x56554e980840 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.578+0000 7f7930c3e740 10 client.16410 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.578+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56554ea83960 con 0x56554e980840 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.578+0000 7f790cc00640 1 -- 172.21.15.79:0/1152169251 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79100054f0 con 0x56554e980840 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f790cc00640 1 -- 172.21.15.79:0/1152169251 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f791004c070 con 0x56554e980840 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f7930c3e740 10 client.16410 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f7930c3e740 10 client.16410 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f7930c3e740 20 client.16410 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e95fea0 0x56554ed65b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f7930c3e740 4 client.16410 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56554ecc11e0 con 0x56554e95fea0 2024-09-21T02:47:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.579+0000 7f7923400640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e95fea0 0x56554ed65b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.580+0000 7f7923400640 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e95fea0 0x56554ed65b30 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b70d206ca16b93c server_cookie=69e9f9045810bc0a in_seq=0 out_seq=0 2024-09-21T02:47:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.580+0000 7f790cc00640 10 client.16410 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f790cc00640 1 -- 172.21.15.79:0/1152169251 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56554ecc11e0 con 0x56554e95fea0 2024-09-21T02:47:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f790cc00640 10 client.16410 handle_command_reply: tid=0 2024-09-21T02:47:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 client.16410 shutdown 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 msgr2=0x56554ed54330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed54330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7910004520 tx=0x7f7910000bc0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 shutdown_connections 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e95fea0 0x56554ed65b30 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed5fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed54330 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1152169251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed53db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 >> 172.21.15.79:0/1152169251 conn(0x56554e995910 msgr2=0x56554ed4b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:55.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f790cc00640 0 client.16410 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 shutdown_connections 2024-09-21T02:47:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.581+0000 7f7930c3e740 1 -- 172.21.15.79:0/1152169251 wait complete. 2024-09-21T02:47:55.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.582+0000 7f7930c3e740 20 client.16410 trim_cache size 0 max 16384 2024-09-21T02:47:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.599+0000 7f7930c3e740 1 Processor -- start 2024-09-21T02:47:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.599+0000 7f7930c3e740 1 -- start start 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed5fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e980840 0x56554ed4d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e9a1520 0x56554ed4d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7930c3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b0e30 con 0x56554e9a1520 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7930c3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b36b0 con 0x56554e980840 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7930c3e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b14a0 con 0x56554e978660 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7923400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed5fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7923400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed5fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50060/0 (socket says 172.21.15.79:50060) 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7923e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e9a1520 0x56554ed4d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7923400640 1 -- 172.21.15.79:0/1173794378 learned_addr learned my addr 172.21.15.79:0/1173794378 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.600+0000 7f7922a00640 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e980840 0x56554ed4d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f7923400640 1 -- 172.21.15.79:0/1173794378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e980840 msgr2=0x56554ed4d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f7923400640 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e980840 0x56554ed4d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f7923400640 1 -- 172.21.15.79:0/1173794378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e9a1520 msgr2=0x56554ed4d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f7923400640 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e9a1520 0x56554ed4d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f7923400640 1 -- 172.21.15.79:0/1173794378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56554ed46e70 con 0x56554e978660 2024-09-21T02:47:55.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f7923400640 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed5fba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f79140097b0 tx=0x7f791400cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1485af4957579e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:55.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f790f400640 1 -- 172.21.15.79:0/1173794378 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79140d2070 con 0x56554e978660 2024-09-21T02:47:55.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f790f400640 1 -- 172.21.15.79:0/1173794378 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79140adef0 con 0x56554e978660 2024-09-21T02:47:55.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.601+0000 7f790f400640 1 -- 172.21.15.79:0/1173794378 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914018d80 con 0x56554e978660 2024-09-21T02:47:55.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 -- 172.21.15.79:0/1173794378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 msgr2=0x56554ed5fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed5fba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f79140097b0 tx=0x7f791400cf20 comp rx=0 tx=0).stop 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 -- 172.21.15.79:0/1173794378 shutdown_connections 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e9a1520 0x56554ed4d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e980840 0x56554ed4d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1173794378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed5fba0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 -- 172.21.15.79:0/1173794378 >> 172.21.15.79:0/1173794378 conn(0x56554e995910 msgr2=0x56554ed52450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 -- 172.21.15.79:0/1173794378 shutdown_connections 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.602+0000 7f7930c3e740 1 -- 172.21.15.79:0/1173794378 wait complete. 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 -- start start 2024-09-21T02:47:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 Processor -- start 2024-09-21T02:47:55.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed66c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed67160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b1b70 con 0x56554e980840 2024-09-21T02:47:55.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b2fe0 con 0x56554e9a1520 2024-09-21T02:47:55.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.603+0000 7f7930c3e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b2240 con 0x56554e978660 2024-09-21T02:47:55.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7930c3e740 10 client.0 _ll_register_callbacks cb 0x7f791c0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7923400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed66c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7923400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed66c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50068/0 (socket says 172.21.15.79:50068) 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7923400640 1 -- 172.21.15.79:0/1386794888 learned_addr learned my addr 172.21.15.79:0/1386794888 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7922a00640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed67160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7923e00640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7922a00640 1 -- 172.21.15.79:0/1386794888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 msgr2=0x56554ed66c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7922a00640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed66c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7922a00640 1 -- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 msgr2=0x56554ed676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7922a00640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7922a00640 1 -- 172.21.15.79:0/1386794888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56554edcf330 con 0x56554e980840 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.604+0000 7f7923400640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed66c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f7922a00640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed67160 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7910005ab0 tx=0x7f7910005110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f29486d020114e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:55.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f790cc00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f790cc00640 1 -- 172.21.15.79:0/1386794888 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910067020 con 0x56554e980840 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f790cc00640 1 -- 172.21.15.79:0/1386794888 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f79100319f0 con 0x56554e980840 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79140adef0 con 0x56554e980840 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f790cc00640 1 -- 172.21.15.79:0/1386794888 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f791006f050 con 0x56554e980840 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f7930c3e740 10 client.16416 fetch_fsmap learned FSMap version 21 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56554edd05f0 con 0x56554e980840 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.605+0000 7f790cc00640 1 -- 172.21.15.79:0/1386794888 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79140adef0 con 0x56554e980840 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f790cc00640 1 -- 172.21.15.79:0/1386794888 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f791004c040 con 0x56554e980840 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f7930c3e740 10 client.16416 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f7930c3e740 10 client.16416 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f7930c3e740 20 client.16416 populate_metadata read hostname 'smithi079' 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e935250 0x56554edd2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f7930c3e740 4 client.16416 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4877b84c", "release": true, "await": true}] 2024-09-21T02:47:55.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4877b84c", "release": true, "await": true}) -- 0x56554ecbcc90 con 0x56554e935250 2024-09-21T02:47:55.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.606+0000 7f7923400640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e935250 0x56554edd2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:55.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.607+0000 7f7923400640 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e935250 0x56554edd2c90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ee0ff352fc4b30 server_cookie=7e516acc2d314e6e in_seq=0 out_seq=0 2024-09-21T02:47:55.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.607+0000 7f790cc00640 10 client.16416 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.691+0000 7f790cc00640 1 -- 172.21.15.79:0/1386794888 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56554ecbcc90 con 0x56554e935250 2024-09-21T02:47:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.691+0000 7f790cc00640 10 client.16416 handle_command_reply: tid=0 2024-09-21T02:47:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.691+0000 7f7930c3e740 1 client.16416 shutdown 2024-09-21T02:47:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.692+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 msgr2=0x56554ed67160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.692+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed67160 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7910005ab0 tx=0x7f7910005110 comp rx=0 tx=0).stop 2024-09-21T02:47:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 shutdown_connections 2024-09-21T02:47:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56554e935250 0x56554edd2c90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56554e9a1520 0x56554ed676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56554e980840 0x56554ed67160 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 --2- 172.21.15.79:0/1386794888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56554e978660 0x56554ed66c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f790cc00640 0 client.16416 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:47:55.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 >> 172.21.15.79:0/1386794888 conn(0x56554e995910 msgr2=0x56554ed491f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 48, 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout: "4877b84c": { 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 48, 2024-09-21T02:47:55.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 137.8, 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:55.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:55.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:55.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:47:55.699 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:47:55.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 shutdown_connections 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.694+0000 7f7930c3e740 1 -- 172.21.15.79:0/1386794888 wait complete. 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.695+0000 7f7930c3e740 20 client.16416 trim_cache size 0 max 16384 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f79080b6540 msgr2=0x7f79080b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f79080b6540 0x7f79080b8a50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79100057c0 tx=0x7f7910031400 comp rx=0 tx=0).stop 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924105d90 msgr2=0x7f792419c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924105d90 0x7f792419c6e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f791400e9f0 tx=0x7f791400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 shutdown_connections 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f79080b6540 0x7f79080b8a50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f792410c020 0x7f79241a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f792410b6d0 0x7f792419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 --2- 172.21.15.79:0/2320914566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7924105d90 0x7f792419c6e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.696+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 >> 172.21.15.79:0/2320914566 conn(0x7f7924101860 msgr2=0x7f792410ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.697+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 shutdown_connections 2024-09-21T02:47:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:55.697+0000 7f792a000640 1 -- 172.21.15.79:0/2320914566 wait complete. 2024-09-21T02:47:55.964 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:55 smithi148 ceph-mon[34626]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 803 KiB/s wr, 67 op/s 2024-09-21T02:47:55.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:55 smithi079 ceph-mon[30788]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 803 KiB/s wr, 67 op/s 2024-09-21T02:47:56.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:55 smithi098 ceph-mon[34832]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 803 KiB/s wr, 67 op/s 2024-09-21T02:47:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 720.0 s, 65.9 tps, lat 4415.009 ms stddev 6820.845 2024-09-21T02:47:56.654 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4877b84c', total seconds elapsed: 21.9 2024-09-21T02:47:56.655 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.8 2024-09-21T02:47:56.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:47:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:57.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:57 smithi079 ceph-mon[30788]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 259 KiB/s wr, 34 op/s 2024-09-21T02:47:58.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:57 smithi148 ceph-mon[34626]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 259 KiB/s wr, 34 op/s 2024-09-21T02:47:58.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 -- 172.21.15.79:0/320426552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 msgr2=0x7f1ec4116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:58.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 --2- 172.21.15.79:0/320426552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 0x7f1ec4116750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009900 tx=0x7f1eb802a440 comp rx=0 tx=0).stop 2024-09-21T02:47:58.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 -- 172.21.15.79:0/320426552 shutdown_connections 2024-09-21T02:47:58.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 --2- 172.21.15.79:0/320426552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 0x7f1ec4116750 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 --2- 172.21.15.79:0/320426552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4075dd0 0x7f1ec40761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 --2- 172.21.15.79:0/320426552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ec4077380 0x7f1ec40757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 -- 172.21.15.79:0/320426552 >> 172.21.15.79:0/320426552 conn(0x7f1ec40ff440 msgr2=0x7f1ec4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:58.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.092+0000 7f1ecac00640 1 -- 172.21.15.79:0/320426552 shutdown_connections 2024-09-21T02:47:58.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.093+0000 7f1ecac00640 1 -- 172.21.15.79:0/320426552 wait complete. 2024-09-21T02:47:58.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.094+0000 7f1ecac00640 1 Processor -- start 2024-09-21T02:47:58.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.094+0000 7f1ecac00640 1 -- start start 2024-09-21T02:47:58.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ecac00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ec4075dd0 0x7f1ec41a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ecac00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4077380 0x7f1ec41a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ecac00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 0x7f1ec41a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ecac00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec4119f10 con 0x7f1ec4114280 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ecac00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec4119d90 con 0x7f1ec4075dd0 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ecac00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec411a090 con 0x7f1ec4077380 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ec8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4077380 0x7f1ec41a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ec8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4077380 0x7f1ec41a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50086/0 (socket says 172.21.15.79:50086) 2024-09-21T02:47:58.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.095+0000 7f1ec8e00640 1 -- 172.21.15.79:0/1138534924 learned_addr learned my addr 172.21.15.79:0/1138534924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:47:58.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.096+0000 7f1ec9800640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ec4075dd0 0x7f1ec41a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:58.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.096+0000 7f1eca200640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 0x7f1ec41a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:58.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.096+0000 7f1ec8e00640 1 -- 172.21.15.79:0/1138534924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ec4075dd0 msgr2=0x7f1ec41a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:58.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.096+0000 7f1ec8e00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ec4075dd0 0x7f1ec41a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.096+0000 7f1ec8e00640 1 -- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 msgr2=0x7f1ec41a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:58.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.096+0000 7f1ec8e00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 0x7f1ec41a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.096+0000 7f1ec8e00640 1 -- 172.21.15.79:0/1138534924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec41a67f0 con 0x7f1ec4077380 2024-09-21T02:47:58.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.097+0000 7f1ec8e00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4077380 0x7f1ec41a0e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400e9c0 tx=0x7f1eb400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:58.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.097+0000 7f1ec2000640 1 -- 172.21.15.79:0/1138534924 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400cd80 con 0x7f1ec4077380 2024-09-21T02:47:58.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.097+0000 7f1ec2000640 1 -- 172.21.15.79:0/1138534924 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb40054d0 con 0x7f1ec4077380 2024-09-21T02:47:58.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.097+0000 7f1ec2000640 1 -- 172.21.15.79:0/1138534924 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4010430 con 0x7f1ec4077380 2024-09-21T02:47:58.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.098+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec41a6ae0 con 0x7f1ec4077380 2024-09-21T02:47:58.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.098+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec41ad240 con 0x7f1ec4077380 2024-09-21T02:47:58.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.101+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec40761e0 con 0x7f1ec4077380 2024-09-21T02:47:58.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.105+0000 7f1ec2000640 1 -- 172.21.15.79:0/1138534924 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1eb40105d0 con 0x7f1ec4077380 2024-09-21T02:47:58.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.108+0000 7f1ec2000640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1eac0b66e0 0x7f1eac0b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:58.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.108+0000 7f1ec2000640 1 -- 172.21.15.79:0/1138534924 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1eb40e7a20 con 0x7f1ec4077380 2024-09-21T02:47:58.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.109+0000 7f1ec9800640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1eac0b66e0 0x7f1eac0b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:58.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.110+0000 7f1ec9800640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1eac0b66e0 0x7f1eac0b8bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005fd0 tx=0x7f1ebc009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:58.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.110+0000 7f1ec2000640 1 -- 172.21.15.79:0/1138534924 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1eb40adea0 con 0x7f1ec4077380 2024-09-21T02:47:58.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:57 smithi098 ceph-mon[34832]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 259 KiB/s wr, 34 op/s 2024-09-21T02:47:58.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.503+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ec402e640 con 0x7f1ec4077380 2024-09-21T02:47:58.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.504+0000 7f1ec2000640 1 -- 172.21.15.79:0/1138534924 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f1eb40b2280 con 0x7f1ec4077380 2024-09-21T02:47:58.506 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:47:58.506 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:47:58.506 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:47:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1eac0b66e0 msgr2=0x7f1eac0b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1eac0b66e0 0x7f1eac0b8bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005fd0 tx=0x7f1ebc009680 comp rx=0 tx=0).stop 2024-09-21T02:47:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4077380 msgr2=0x7f1ec41a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4077380 0x7f1ec41a0e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400e9c0 tx=0x7f1eb400ee80 comp rx=0 tx=0).stop 2024-09-21T02:47:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 shutdown_connections 2024-09-21T02:47:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1eac0b66e0 0x7f1eac0b8bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4114280 0x7f1ec41a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec4077380 0x7f1ec41a0e20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 --2- 172.21.15.79:0/1138534924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ec4075dd0 0x7f1ec41a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.507+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 >> 172.21.15.79:0/1138534924 conn(0x7f1ec40ff440 msgr2=0x7f1ec4110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.508+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 shutdown_connections 2024-09-21T02:47:58.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:47:58.508+0000 7f1ecac00640 1 -- 172.21.15.79:0/1138534924 wait complete. 2024-09-21T02:47:58.965 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:58 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1138534924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:59.056 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:58 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1138534924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:59.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:58 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1138534924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:59.543 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0' 2024-09-21T02:47:59.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0 2024-09-21T02:47:59.722 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:47:59 smithi079 ceph-mon[30788]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 233 KiB/s wr, 30 op/s 2024-09-21T02:48:00.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:47:59 smithi148 ceph-mon[34626]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 233 KiB/s wr, 30 op/s 2024-09-21T02:48:00.067 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:48:00.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:47:59 smithi098 ceph-mon[34832]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 233 KiB/s wr, 30 op/s 2024-09-21T02:48:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.009+0000 7f84e9400640 1 -- 172.21.15.79:0/4231723972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e4105140 msgr2=0x7f84e410d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.009+0000 7f84e9400640 1 --2- 172.21.15.79:0/4231723972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e4105140 0x7f84e410d690 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009860 tx=0x7f84d402a360 comp rx=0 tx=0).stop 2024-09-21T02:48:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.010+0000 7f84e9400640 1 -- 172.21.15.79:0/4231723972 shutdown_connections 2024-09-21T02:48:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.010+0000 7f84e9400640 1 --2- 172.21.15.79:0/4231723972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e410dc50 0x7f84e4110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.010+0000 7f84e9400640 1 --2- 172.21.15.79:0/4231723972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e4105140 0x7f84e410d690 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.010+0000 7f84e9400640 1 --2- 172.21.15.79:0/4231723972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e41047f0 0x7f84e4104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.011+0000 7f84e9400640 1 -- 172.21.15.79:0/4231723972 >> 172.21.15.79:0/4231723972 conn(0x7f84e40fe330 msgr2=0x7f84e4100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.012+0000 7f84e9400640 1 -- 172.21.15.79:0/4231723972 shutdown_connections 2024-09-21T02:48:01.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.012+0000 7f84e9400640 1 -- 172.21.15.79:0/4231723972 wait complete. 2024-09-21T02:48:01.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.014+0000 7f84e9400640 1 Processor -- start 2024-09-21T02:48:01.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.016+0000 7f84e9400640 1 -- start start 2024-09-21T02:48:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.017+0000 7f84e9400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e41047f0 0x7f84e4198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e9400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4105140 0x7f84e4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e41047f0 0x7f84e4198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e9400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e410dc50 0x7f84e419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e9400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41138b0 con 0x7f84e4105140 2024-09-21T02:48:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e9400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4113730 con 0x7f84e41047f0 2024-09-21T02:48:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e9400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4113a30 con 0x7f84e410dc50 2024-09-21T02:48:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e410dc50 0x7f84e419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e410dc50 0x7f84e419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50108/0 (socket says 172.21.15.79:50108) 2024-09-21T02:48:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.018+0000 7f84e8a00640 1 -- 172.21.15.79:0/4277459342 learned_addr learned my addr 172.21.15.79:0/4277459342 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.019+0000 7f84e8a00640 1 -- 172.21.15.79:0/4277459342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e41047f0 msgr2=0x7f84e4198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.020+0000 7f84e8a00640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e41047f0 0x7f84e4198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.020+0000 7f84e8a00640 1 -- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4105140 msgr2=0x7f84e4199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.020+0000 7f84e8a00640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4105140 0x7f84e4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.020+0000 7f84e8a00640 1 -- 172.21.15.79:0/4277459342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41a02e0 con 0x7f84e410dc50 2024-09-21T02:48:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.020+0000 7f84e3e00640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e41047f0 0x7f84e4198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:48:01.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.024+0000 7f84e8a00640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e410dc50 0x7f84e419fda0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009fd0 tx=0x7f84dc00b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:01.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.026+0000 7f84e0c00640 1 -- 172.21.15.79:0/4277459342 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc017070 con 0x7f84e410dc50 2024-09-21T02:48:01.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.026+0000 7f84e0c00640 1 -- 172.21.15.79:0/4277459342 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84dc003e20 con 0x7f84e410dc50 2024-09-21T02:48:01.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.026+0000 7f84e0c00640 1 -- 172.21.15.79:0/4277459342 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0106c0 con 0x7f84e410dc50 2024-09-21T02:48:01.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.026+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e41a05d0 con 0x7f84e410dc50 2024-09-21T02:48:01.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.026+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41a0ac0 con 0x7f84e410dc50 2024-09-21T02:48:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.038+0000 7f84e0c00640 1 -- 172.21.15.79:0/4277459342 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f84dc010860 con 0x7f84e410dc50 2024-09-21T02:48:01.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.043+0000 7f84e0c00640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f84c80b6600 0x7f84c80b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.043+0000 7f84e0c00640 1 -- 172.21.15.79:0/4277459342 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f84dc0e7ab0 con 0x7f84e410dc50 2024-09-21T02:48:01.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.044+0000 7f84e3e00640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f84c80b6600 0x7f84c80b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.044+0000 7f84f17e2740 1 Processor -- start 2024-09-21T02:48:01.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.045+0000 7f84e3e00640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f84c80b6600 0x7f84c80b8b10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f84e410d8a0 tx=0x7f84d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:01.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.045+0000 7f84f17e2740 1 -- start start 2024-09-21T02:48:01.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.046+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c647500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.046+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c276980 0x55b52c647a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.046+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c647f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c647500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84f17e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b52c5bcca0 con 0x55b52c276980 2024-09-21T02:48:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84f17e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b52c5ac0d0 con 0x55b52c29f840 2024-09-21T02:48:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84f17e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b52c5afee0 con 0x55b52c27eb60 2024-09-21T02:48:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c647500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:34756/0 (socket says 172.21.15.79:34756) 2024-09-21T02:48:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 -- 172.21.15.79:0/2216620872 learned_addr learned my addr 172.21.15.79:0/2216620872 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e8a00640 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c647f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3400640 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c276980 0x55b52c647a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 -- 172.21.15.79:0/2216620872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 msgr2=0x55b52c647f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c647f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 -- 172.21.15.79:0/2216620872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c276980 msgr2=0x55b52c647a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c276980 0x55b52c647a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3e00640 1 -- 172.21.15.79:0/2216620872 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52c55e400 con 0x55b52c29f840 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e8a00640 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c647f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.047+0000 7f84e3400640 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c276980 0x55b52c647a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.048+0000 7f84e3e00640 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c647500 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f84d0010e60 tx=0x7f84d0013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47f3c5c30aab43c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.048+0000 7f84d9200640 1 -- 172.21.15.79:0/2216620872 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0023070 con 0x55b52c29f840 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.048+0000 7f84d9200640 1 -- 172.21.15.79:0/2216620872 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d0010e90 con 0x55b52c29f840 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.048+0000 7f84d9200640 1 -- 172.21.15.79:0/2216620872 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d001f6b0 con 0x55b52c29f840 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.050+0000 7f84f17e2740 1 -- 172.21.15.79:0/2216620872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 msgr2=0x55b52c647500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.050+0000 7f84f17e2740 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c647500 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f84d0010e60 tx=0x7f84d0013000 comp rx=0 tx=0).stop 2024-09-21T02:48:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.050+0000 7f84f17e2740 1 -- 172.21.15.79:0/2216620872 shutdown_connections 2024-09-21T02:48:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.050+0000 7f84f17e2740 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c647f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.050+0000 7f84f17e2740 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c276980 0x55b52c647a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.050+0000 7f84f17e2740 1 --2- 172.21.15.79:0/2216620872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c647500 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.050+0000 7f84f17e2740 1 -- 172.21.15.79:0/2216620872 >> 172.21.15.79:0/2216620872 conn(0x55b52c293990 msgr2=0x55b52c6453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.051+0000 7f84f17e2740 1 -- 172.21.15.79:0/2216620872 shutdown_connections 2024-09-21T02:48:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.051+0000 7f84f17e2740 1 -- 172.21.15.79:0/2216620872 wait complete. 2024-09-21T02:48:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.054+0000 7f84f17e2740 1 -- start start 2024-09-21T02:48:01.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.054+0000 7f84f17e2740 1 Processor -- start 2024-09-21T02:48:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.056+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c652ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.056+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c6530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.056+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c29f840 0x55b52c653660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84e3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c6530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84f17e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b52c40d7a0 con 0x55b52c29f840 2024-09-21T02:48:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84f17e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b52c551a10 con 0x55b52c276980 2024-09-21T02:48:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84f17e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b52c655ce0 con 0x55b52c27eb60 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84e3400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c6530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50126/0 (socket says 172.21.15.79:50126) 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84e3400640 1 -- 172.21.15.79:0/1274147146 learned_addr learned my addr 172.21.15.79:0/1274147146 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84f17e2740 10 client.0 _ll_register_callbacks cb 0x55b52c561be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.058+0000 7f84e3400640 1 -- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 msgr2=0x55b52c652ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.057+0000 7f84e3e00640 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c652ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.058+0000 7f84e3400640 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c652ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.058+0000 7f84e3400640 1 -- 172.21.15.79:0/1274147146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c29f840 msgr2=0x55b52c653660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.058+0000 7f84e3400640 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c29f840 0x55b52c653660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.060+0000 7f84e3400640 1 -- 172.21.15.79:0/1274147146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52c319b90 con 0x55b52c27eb60 2024-09-21T02:48:01.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.060+0000 7f84e3e00640 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c652ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:48:01.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.061+0000 7f84cd600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:48:01.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.061+0000 7f84e3400640 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c6530e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84d402a950 tx=0x7f84d4004560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38622448851baa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:01.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.062+0000 7f84cd600640 1 -- 172.21.15.79:0/1274147146 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4037070 con 0x55b52c27eb60 2024-09-21T02:48:01.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.062+0000 7f84cd600640 1 -- 172.21.15.79:0/1274147146 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f84d4005350 con 0x55b52c27eb60 2024-09-21T02:48:01.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.063+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d0010e90 con 0x55b52c27eb60 2024-09-21T02:48:01.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.064+0000 7f84cd600640 1 -- 172.21.15.79:0/1274147146 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f84d404b050 con 0x55b52c27eb60 2024-09-21T02:48:01.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.064+0000 7f84f17e2740 10 client.26731 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:01.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.064+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b52c6619d0 con 0x55b52c27eb60 2024-09-21T02:48:01.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.065+0000 7f84cd600640 1 -- 172.21.15.79:0/1274147146 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d0010e90 con 0x55b52c27eb60 2024-09-21T02:48:01.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.065+0000 7f84cd600640 1 -- 172.21.15.79:0/1274147146 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f84d4003830 con 0x55b52c27eb60 2024-09-21T02:48:01.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.066+0000 7f84f17e2740 10 client.26731 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:01.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.066+0000 7f84f17e2740 10 client.26731 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:48:01.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.066+0000 7f84f17e2740 20 client.26731 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:01.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.066+0000 7f84f17e2740 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c25e1c0 0x55b52c665390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.066+0000 7f84f17e2740 4 client.26731 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:48:01.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.066+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b52c5bebf0 con 0x55b52c25e1c0 2024-09-21T02:48:01.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.066+0000 7f84e3e00640 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c25e1c0 0x55b52c665390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.068+0000 7f84cd600640 10 client.26731 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:01.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.068+0000 7f84e3e00640 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c25e1c0 0x55b52c665390 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb413f9b2498305 server_cookie=e031f0865c87d0d6 in_seq=0 out_seq=0 2024-09-21T02:48:01.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.069+0000 7f84cd600640 1 -- 172.21.15.79:0/1274147146 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b52c5bebf0 con 0x55b52c25e1c0 2024-09-21T02:48:01.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.069+0000 7f84cd600640 10 client.26731 handle_command_reply: tid=0 2024-09-21T02:48:01.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.069+0000 7f84f17e2740 1 client.26731 shutdown 2024-09-21T02:48:01.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.069+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 msgr2=0x55b52c6530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c6530e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84d402a950 tx=0x7f84d4004560 comp rx=0 tx=0).stop 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 shutdown_connections 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c25e1c0 0x55b52c665390 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c29f840 0x55b52c653660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c27eb60 0x55b52c6530e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84cd600640 0 client.26731 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 --2- 172.21.15.79:0/1274147146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c652ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 >> 172.21.15.79:0/1274147146 conn(0x55b52c293990 msgr2=0x55b52c643bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 shutdown_connections 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 1 -- 172.21.15.79:0/1274147146 wait complete. 2024-09-21T02:48:01.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.070+0000 7f84f17e2740 20 client.26731 trim_cache size 0 max 16384 2024-09-21T02:48:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.089+0000 7f84f17e2740 1 Processor -- start 2024-09-21T02:48:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.089+0000 7f84f17e2740 1 -- start start 2024-09-21T02:48:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c276980 0x55b52c644260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c654a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c648c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84f17e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84c400dcd0 con 0x55b52c27eb60 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84f17e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4010550 con 0x55b52c29f840 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84f17e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84c400e340 con 0x55b52c276980 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c654a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c276980 0x55b52c644260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c276980 0x55b52c644260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50128/0 (socket says 172.21.15.79:50128) 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 -- 172.21.15.79:0/366318257 learned_addr learned my addr 172.21.15.79:0/366318257 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e8a00640 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c648c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 -- 172.21.15.79:0/366318257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 msgr2=0x55b52c648c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c648c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 -- 172.21.15.79:0/366318257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 msgr2=0x55b52c654a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c654a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.090+0000 7f84e3e00640 1 -- 172.21.15.79:0/366318257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52c649ae0 con 0x55b52c276980 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.091+0000 7f84e3e00640 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c276980 0x55b52c644260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f84d0010e30 tx=0x7f84d0003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2393330d1bad108c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.091+0000 7f84cfe00640 1 -- 172.21.15.79:0/366318257 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0016040 con 0x55b52c276980 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.091+0000 7f84cfe00640 1 -- 172.21.15.79:0/366318257 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d0036020 con 0x55b52c276980 2024-09-21T02:48:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.091+0000 7f84cfe00640 1 -- 172.21.15.79:0/366318257 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0023040 con 0x55b52c276980 2024-09-21T02:48:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 -- 172.21.15.79:0/366318257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c276980 msgr2=0x55b52c644260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c276980 0x55b52c644260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f84d0010e30 tx=0x7f84d0003c60 comp rx=0 tx=0).stop 2024-09-21T02:48:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 -- 172.21.15.79:0/366318257 shutdown_connections 2024-09-21T02:48:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c29f840 0x55b52c648c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c654a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 --2- 172.21.15.79:0/366318257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c276980 0x55b52c644260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 -- 172.21.15.79:0/366318257 >> 172.21.15.79:0/366318257 conn(0x55b52c293990 msgr2=0x55b52c648530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 -- 172.21.15.79:0/366318257 shutdown_connections 2024-09-21T02:48:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 -- 172.21.15.79:0/366318257 wait complete. 2024-09-21T02:48:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.092+0000 7f84f17e2740 1 -- start start 2024-09-21T02:48:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 1 Processor -- start 2024-09-21T02:48:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c657670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c657bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c29f840 0x55b52c6ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84c400ea10 con 0x55b52c27eb60 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84c400fe80 con 0x55b52c276980 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84c400f0e0 con 0x55b52c29f840 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.093+0000 7f84f17e2740 10 client.0 _ll_register_callbacks cb 0x7f84d4035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c657670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c657bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c29f840 0x55b52c6ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c657670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:34796/0 (socket says 172.21.15.79:34796) 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 -- 172.21.15.79:0/735466635 learned_addr learned my addr 172.21.15.79:0/735466635 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e8a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c29f840 0x55b52c6ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50142/0 (socket says 172.21.15.79:50142) 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 -- 172.21.15.79:0/735466635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c29f840 msgr2=0x55b52c6ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c29f840 0x55b52c6ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 -- 172.21.15.79:0/735466635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 msgr2=0x55b52c657bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c657bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 -- 172.21.15.79:0/735466635 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52c6cf290 con 0x55b52c276980 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84e3e00640 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c657670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009320 tx=0x7f84d00053e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a697e9cae48eec1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.094+0000 7f84cd600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.095+0000 7f84cd600640 1 -- 172.21.15.79:0/735466635 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d003f020 con 0x55b52c276980 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.095+0000 7f84cd600640 1 -- 172.21.15.79:0/735466635 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f84d0003690 con 0x55b52c276980 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.095+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d0036020 con 0x55b52c276980 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.095+0000 7f84cd600640 1 -- 172.21.15.79:0/735466635 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f84d004a050 con 0x55b52c276980 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.095+0000 7f84f17e2740 10 client.26702 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.095+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b52c6d04f0 con 0x55b52c276980 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.095+0000 7f84cd600640 1 -- 172.21.15.79:0/735466635 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d0036020 con 0x55b52c276980 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84cd600640 1 -- 172.21.15.79:0/735466635 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f84d000f040 con 0x55b52c276980 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84f17e2740 10 client.26702 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84f17e2740 10 client.26702 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84f17e2740 20 client.26702 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84f17e2740 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c233570 0x55b52c6d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84f17e2740 4 client.26702 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}] 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}) -- 0x55b52c5ba6a0 con 0x55b52c233570 2024-09-21T02:48:01.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84e3400640 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c233570 0x55b52c6d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84e3400640 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c233570 0x55b52c6d2c30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39371381b91cbb3 server_cookie=5124ace53915066 in_seq=0 out_seq=0 2024-09-21T02:48:01.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.096+0000 7f84cd600640 10 client.26702 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.476+0000 7f84cd600640 1 -- 172.21.15.79:0/735466635 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b52c5ba6a0 con 0x55b52c233570 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.476+0000 7f84cd600640 10 client.26702 handle_command_reply: tid=0 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 client.26702 shutdown 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 msgr2=0x55b52c657670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c657670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009320 tx=0x7f84d00053e0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 shutdown_connections 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b52c233570 0x55b52c6d2c30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b52c29f840 0x55b52c6ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b52c27eb60 0x55b52c657bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84cd600640 0 client.26702 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 --2- 172.21.15.79:0/735466635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b52c276980 0x55b52c657670 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 >> 172.21.15.79:0/735466635 conn(0x55b52c293990 msgr2=0x55b52c65e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 shutdown_connections 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 1 -- 172.21.15.79:0/735466635 wait complete. 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.477+0000 7f84f17e2740 20 client.26702 trim_cache size 0 max 16384 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:48:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 50, 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "1d9c12ea": { 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 50, 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 137.8, 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:48:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:01.482 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f84c80b6600 msgr2=0x7f84c80b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f84c80b6600 0x7f84c80b8b10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f84e410d8a0 tx=0x7f84d0009260 comp rx=0 tx=0).stop 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e410dc50 msgr2=0x7f84e419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e410dc50 0x7f84e419fda0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009fd0 tx=0x7f84dc00b260 comp rx=0 tx=0).stop 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 shutdown_connections 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f84c80b6600 0x7f84c80b8b10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84e410dc50 0x7f84e419fda0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4105140 0x7f84e4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 --2- 172.21.15.79:0/4277459342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e41047f0 0x7f84e4198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 >> 172.21.15.79:0/4277459342 conn(0x7f84e40fe330 msgr2=0x7f84e4102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 shutdown_connections 2024-09-21T02:48:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:01.478+0000 7f84e9400640 1 -- 172.21.15.79:0/4277459342 wait complete. 2024-09-21T02:48:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 725.0 s, 370.4 tps, lat 306.026 ms stddev 1039.705 2024-09-21T02:48:01.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:01 smithi079 ceph-mon[30788]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 852 KiB/s wr, 82 op/s 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 -- 172.21.15.79:0/328505064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 msgr2=0x7fa5141038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 --2- 172.21.15.79:0/328505064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 0x7fa5141038d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009900 tx=0x7fa4fc02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 -- 172.21.15.79:0/328505064 shutdown_connections 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 --2- 172.21.15.79:0/328505064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa514103e60 0x7fa51410a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 --2- 172.21.15.79:0/328505064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 0x7fa5141038d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 --2- 172.21.15.79:0/328505064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 0x7fa5141028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 -- 172.21.15.79:0/328505064 >> 172.21.15.79:0/328505064 conn(0x7fa5140fdd80 msgr2=0x7fa514100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 -- 172.21.15.79:0/328505064 shutdown_connections 2024-09-21T02:48:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.031+0000 7fa513200640 1 -- 172.21.15.79:0/328505064 wait complete. 2024-09-21T02:48:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.032+0000 7fa513200640 1 Processor -- start 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.032+0000 7fa513200640 1 -- start start 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa513200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 0x7fa51419bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa513200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 0x7fa51419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa513200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa514103e60 0x7fa51419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa513200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410f150 con 0x7fa514102440 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa513200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410efd0 con 0x7fa514103e60 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa513200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410f2d0 con 0x7fa5141034c0 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 0x7fa51419bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 0x7fa51419bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45418/0 (socket says 172.21.15.79:45418) 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 -- 172.21.15.79:0/2465194195 learned_addr learned my addr 172.21.15.79:0/2465194195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa509400640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 0x7fa51419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa512800640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa514103e60 0x7fa51419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 -- 172.21.15.79:0/2465194195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 msgr2=0x7fa51419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 0x7fa51419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 -- 172.21.15.79:0/2465194195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa514103e60 msgr2=0x7fa51419d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa514103e60 0x7fa51419d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.033+0000 7fa511e00640 1 -- 172.21.15.79:0/2465194195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51419d980 con 0x7fa514102440 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.034+0000 7fa511e00640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 0x7fa51419bfb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa50400e9f0 tx=0x7fa50400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.034+0000 7fa50b400640 1 -- 172.21.15.79:0/2465194195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50400cd80 con 0x7fa514102440 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.034+0000 7fa50b400640 1 -- 172.21.15.79:0/2465194195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5040108e0 con 0x7fa514102440 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.034+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51419dc70 con 0x7fa514102440 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.034+0000 7fa50b400640 1 -- 172.21.15.79:0/2465194195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504018980 con 0x7fa514102440 2024-09-21T02:48:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.034+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5141a4360 con 0x7fa514102440 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.037+0000 7fa51fe13740 1 Processor -- start 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa51fe13740 1 -- start start 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820951b0 0x564f8243c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8243c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f8243d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa51fe13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f823af6b0 con 0x564f820951b0 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa51fe13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564f8239eae0 con 0x564f8206c2f0 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa51fe13740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564f823a28f0 con 0x564f820744d0 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa50b400640 1 -- 172.21.15.79:0/2465194195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa504010430 con 0x7fa514102440 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa512800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820951b0 0x564f8243c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa512800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820951b0 0x564f8243c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45430/0 (socket says 172.21.15.79:45430) 2024-09-21T02:48:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa512800640 1 -- 172.21.15.79:0/1702251980 learned_addr learned my addr 172.21.15.79:0/1702251980 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa511e00640 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8243c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.038+0000 7fa509400640 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f8243d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa512800640 1 -- 172.21.15.79:0/1702251980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 msgr2=0x564f8243d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa512800640 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f8243d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa512800640 1 -- 172.21.15.79:0/1702251980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 msgr2=0x564f8243c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa512800640 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8243c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa512800640 1 -- 172.21.15.79:0/1702251980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8236b780 con 0x564f820951b0 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa512800640 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820951b0 0x564f8243c2b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009fd0 tx=0x7fa50c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bb3256d0e22ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa503000640 1 -- 172.21.15.79:0/1702251980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c004d20 con 0x564f820951b0 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa503000640 1 -- 172.21.15.79:0/1702251980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa50c004050 con 0x564f820951b0 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.039+0000 7fa503000640 1 -- 172.21.15.79:0/1702251980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c005220 con 0x564f820951b0 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa50b400640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa4f80b6590 0x7fa4f80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 -- 172.21.15.79:0/1702251980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820951b0 msgr2=0x564f8243c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820951b0 0x564f8243c2b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009fd0 tx=0x7fa50c0118d0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 -- 172.21.15.79:0/1702251980 shutdown_connections 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa50b400640 1 -- 172.21.15.79:0/2465194195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa5040e7920 con 0x7fa514102440 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f8243d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8243c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1702251980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820951b0 0x564f8243c2b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 -- 172.21.15.79:0/1702251980 >> 172.21.15.79:0/1702251980 conn(0x564f82089300 msgr2=0x564f82437d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa511e00640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa4f80b6590 0x7fa4f80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 -- 172.21.15.79:0/1702251980 shutdown_connections 2024-09-21T02:48:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.040+0000 7fa51fe13740 1 -- 172.21.15.79:0/1702251980 wait complete. 2024-09-21T02:48:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 -- start start 2024-09-21T02:48:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa511e00640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa4f80b6590 0x7fa4f80b8aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa5040ad740 tx=0x7fa5040ed550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 Processor -- start 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f8206c2f0 0x564f82445910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f82445fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f820951b0 0x564f82446b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f822d6ab0 con 0x564f8206c2f0 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564f82345570 con 0x564f820951b0 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.041+0000 7fa51fe13740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564f8243df90 con 0x564f820744d0 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa51fe13740 10 client.0 _ll_register_callbacks cb 0x564f82354100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa512800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f8206c2f0 0x564f82445910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f82445fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f82445fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50176/0 (socket says 172.21.15.79:50176) 2024-09-21T02:48:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 -- 172.21.15.79:0/630979262 learned_addr learned my addr 172.21.15.79:0/630979262 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa512800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f8206c2f0 0x564f82445910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45438/0 (socket says 172.21.15.79:45438) 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa512800640 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f820951b0 0x564f82446b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 -- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f820951b0 msgr2=0x564f82446b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f820951b0 0x564f82446b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 -- 172.21.15.79:0/630979262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f8206c2f0 msgr2=0x564f82445910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f8206c2f0 0x564f82445910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 -- 172.21.15.79:0/630979262 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f82100790 con 0x564f820744d0 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa509400640 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f82445fd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc02a910 tx=0x7fa4fc031840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eae59eb5e69ac5b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.042+0000 7fa4f7400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.043+0000 7fa4f7400640 1 -- 172.21.15.79:0/630979262 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc035040 con 0x564f820744d0 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.043+0000 7fa4f7400640 1 -- 172.21.15.79:0/630979262 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa4fc004240 con 0x564f820744d0 2024-09-21T02:48:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.043+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa50c004050 con 0x564f820744d0 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.043+0000 7fa4f7400640 1 -- 172.21.15.79:0/630979262 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa4fc04e050 con 0x564f820744d0 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.043+0000 7fa51fe13740 10 client.26749 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.043+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f82179620 con 0x564f820744d0 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.043+0000 7fa4f7400640 1 -- 172.21.15.79:0/630979262 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa50c004050 con 0x564f820744d0 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa4f7400640 1 -- 172.21.15.79:0/630979262 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa4fc031ce0 con 0x564f820744d0 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa51fe13740 10 client.26749 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa51fe13740 10 client.26749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa51fe13740 20 client.26749 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa51fe13740 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f82053d80 0x564f824530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa51fe13740 4 client.26749 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f823b1600 con 0x564f82053d80 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.044+0000 7fa512800640 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f82053d80 0x564f824530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.045+0000 7fa512800640 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f82053d80 0x564f824530a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9739f55a5f50a253 server_cookie=8436a6212ed13bb3 in_seq=0 out_seq=0 2024-09-21T02:48:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.045+0000 7fa4f7400640 10 client.26749 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.045+0000 7fa4f7400640 1 -- 172.21.15.79:0/630979262 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f823b1600 con 0x564f82053d80 2024-09-21T02:48:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.045+0000 7fa4f7400640 10 client.26749 handle_command_reply: tid=0 2024-09-21T02:48:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 client.26749 shutdown 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 msgr2=0x564f82445fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f82445fd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc02a910 tx=0x7fa4fc031840 comp rx=0 tx=0).stop 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 shutdown_connections 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f82053d80 0x564f824530a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f820951b0 0x564f82446b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820744d0 0x564f82445fd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 --2- 172.21.15.79:0/630979262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f8206c2f0 0x564f82445910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 >> 172.21.15.79:0/630979262 conn(0x564f82089300 msgr2=0x564f8243d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa4f7400640 0 client.26749 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 shutdown_connections 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 1 -- 172.21.15.79:0/630979262 wait complete. 2024-09-21T02:48:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.046+0000 7fa51fe13740 20 client.26749 trim_cache size 0 max 16384 2024-09-21T02:48:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.061+0000 7fa51fe13740 1 Processor -- start 2024-09-21T02:48:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.061+0000 7fa51fe13740 1 -- start start 2024-09-21T02:48:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.061+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f82436d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f82440c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8243d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa51fe13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141ac760 con 0x564f820744d0 2024-09-21T02:48:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa51fe13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141aefe0 con 0x564f8206c2f0 2024-09-21T02:48:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa51fe13740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141acdd0 con 0x564f820951b0 2024-09-21T02:48:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f82440c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa512800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f82436d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f82440c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45446/0 (socket says 172.21.15.79:45446) 2024-09-21T02:48:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 -- 172.21.15.79:0/2208176593 learned_addr learned my addr 172.21.15.79:0/2208176593 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa512800640 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8243d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.065 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:01 smithi148 ceph-mon[34626]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 852 KiB/s wr, 82 op/s 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 -- 172.21.15.79:0/2208176593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 msgr2=0x564f8243d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8243d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 -- 172.21.15.79:0/2208176593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 msgr2=0x564f82436d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f82436d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 -- 172.21.15.79:0/2208176593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8243de70 con 0x564f820744d0 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.062+0000 7fa509400640 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f82440c60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc03c650 tx=0x7fa4fc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba637c714972d9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.063+0000 7fa502600640 1 -- 172.21.15.79:0/2208176593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc057070 con 0x564f820744d0 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.063+0000 7fa502600640 1 -- 172.21.15.79:0/2208176593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4fc03ca40 con 0x564f820744d0 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.063+0000 7fa502600640 1 -- 172.21.15.79:0/2208176593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc035070 con 0x564f820744d0 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.063+0000 7fa51fe13740 1 -- 172.21.15.79:0/2208176593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 msgr2=0x564f82440c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.063+0000 7fa51fe13740 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f82440c60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc03c650 tx=0x7fa4fc001e70 comp rx=0 tx=0).stop 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 -- 172.21.15.79:0/2208176593 shutdown_connections 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8243d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f82440c60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 --2- 172.21.15.79:0/2208176593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f82436d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 -- 172.21.15.79:0/2208176593 >> 172.21.15.79:0/2208176593 conn(0x564f82089300 msgr2=0x564f8243bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 -- 172.21.15.79:0/2208176593 shutdown_connections 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 -- 172.21.15.79:0/2208176593 wait complete. 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 -- start start 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.064+0000 7fa51fe13740 1 Processor -- start 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8244d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f8244d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa51fe13740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8244bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa51fe13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141ad4a0 con 0x564f820744d0 2024-09-21T02:48:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa51fe13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141ae910 con 0x564f8206c2f0 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa51fe13740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141adb70 con 0x564f820951b0 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa51fe13740 10 client.0 _ll_register_callbacks cb 0x7fa4fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa509400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f8244d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8244bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8244bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:50196/0 (socket says 172.21.15.79:50196) 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 -- 172.21.15.79:0/1038660151 learned_addr learned my addr 172.21.15.79:0/1038660151 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8244d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 -- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 msgr2=0x564f8244d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8244d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 -- 172.21.15.79:0/1038660151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 msgr2=0x564f8244d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f8244d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 -- 172.21.15.79:0/1038660151 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8244c6a0 con 0x564f820951b0 2024-09-21T02:48:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa509400640 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f8244d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa512800640 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8244bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa50c003f20 tx=0x7fa50c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3685d2e13d9914e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.065+0000 7fa4f7400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa4f7400640 1 -- 172.21.15.79:0/1038660151 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c004590 con 0x564f820951b0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa4f7400640 1 -- 172.21.15.79:0/1038660151 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa50c020040 con 0x564f820951b0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4fc03ca40 con 0x564f820951b0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa4f7400640 1 -- 172.21.15.79:0/1038660151 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa50c0049a0 con 0x564f820951b0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 10 client.26755 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f8244b570 con 0x564f820951b0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa4f7400640 1 -- 172.21.15.79:0/1038660151 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4fc03ca40 con 0x564f820951b0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa4f7400640 1 -- 172.21.15.79:0/1038660151 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa50c025040 con 0x564f820951b0 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 10 client.26755 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 10 client.26755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 20 client.26755 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f820291c0 0x564f824bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 4 client.26755 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:48:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.066+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f823ad0b0 con 0x564f820291c0 2024-09-21T02:48:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.067+0000 7fa509400640 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f820291c0 0x564f824bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.067+0000 7fa4f7400640 10 client.26755 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.067+0000 7fa509400640 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f820291c0 0x564f824bff30 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fab97a36e32b4c37 server_cookie=61f19034eca03962 in_seq=0 out_seq=0 2024-09-21T02:48:02.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.099+0000 7fa4f7400640 1 -- 172.21.15.79:0/1038660151 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f823ad0b0 con 0x564f820291c0 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.099+0000 7fa4f7400640 10 client.26755 handle_command_reply: tid=0 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.099+0000 7fa51fe13740 1 client.26755 shutdown 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 msgr2=0x564f8244bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8244bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa50c003f20 tx=0x7fa50c0118d0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 shutdown_connections 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x564f820291c0 0x564f824bff30 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f820951b0 0x564f8244bf30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f820744d0 0x564f8244d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa4f7400640 0 client.26755 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 --2- 172.21.15.79:0/1038660151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564f8206c2f0 0x564f8244d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 >> 172.21.15.79:0/1038660151 conn(0x564f82089300 msgr2=0x564f8243bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 shutdown_connections 2024-09-21T02:48:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 1 -- 172.21.15.79:0/1038660151 wait complete. 2024-09-21T02:48:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.100+0000 7fa51fe13740 20 client.26755 trim_cache size 0 max 16384 2024-09-21T02:48:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:48:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:48:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:48:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:48:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa4f80b6590 msgr2=0x7fa4f80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa4f80b6590 0x7fa4f80b8aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa5040ad740 tx=0x7fa5040ed550 comp rx=0 tx=0).stop 2024-09-21T02:48:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 msgr2=0x7fa51419bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 0x7fa51419bfb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa50400e9f0 tx=0x7fa50400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 shutdown_connections 2024-09-21T02:48:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa4f80b6590 0x7fa4f80b8aa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa514103e60 0x7fa51419d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141034c0 0x7fa51419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 --2- 172.21.15.79:0/2465194195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa514102440 0x7fa51419bfb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 >> 172.21.15.79:0/2465194195 conn(0x7fa5140fdd80 msgr2=0x7fa51410b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 shutdown_connections 2024-09-21T02:48:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:02.101+0000 7fa513200640 1 -- 172.21.15.79:0/2465194195 wait complete. 2024-09-21T02:48:02.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:01 smithi098 ceph-mon[34832]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 852 KiB/s wr, 82 op/s 2024-09-21T02:48:03.207 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1d9c12ea', quiesce took 6.6 seconds. Will release after: 11.200000000000001 2024-09-21T02:48:03.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:03 smithi079 ceph-mon[30788]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2024-09-21T02:48:04.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:03 smithi148 ceph-mon[34626]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2024-09-21T02:48:04.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:03 smithi098 ceph-mon[34832]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2024-09-21T02:48:06.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:05 smithi148 ceph-mon[34626]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.1 MiB/s wr, 187 op/s 2024-09-21T02:48:06.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:05 smithi098 ceph-mon[34832]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.1 MiB/s wr, 187 op/s 2024-09-21T02:48:06.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:05 smithi079 ceph-mon[30788]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.1 MiB/s wr, 187 op/s 2024-09-21T02:48:06.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:48:08.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:07 smithi148 ceph-mon[34626]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.3 MiB/s wr, 220 op/s 2024-09-21T02:48:08.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:07 smithi098 ceph-mon[34832]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.3 MiB/s wr, 220 op/s 2024-09-21T02:48:08.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:07 smithi079 ceph-mon[30788]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.3 MiB/s wr, 220 op/s 2024-09-21T02:48:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:09 smithi148 ceph-mon[34626]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 220 op/s 2024-09-21T02:48:10.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:09 smithi098 ceph-mon[34832]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 220 op/s 2024-09-21T02:48:10.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:09 smithi079 ceph-mon[30788]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 220 op/s 2024-09-21T02:48:11.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:48:12.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:11 smithi148 ceph-mon[34626]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-21T02:48:12.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:11 smithi098 ceph-mon[34832]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-21T02:48:12.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:11 smithi079 ceph-mon[30788]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-21T02:48:14.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:13 smithi148 ceph-mon[34626]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-09-21T02:48:14.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:13 smithi098 ceph-mon[34832]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-09-21T02:48:14.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:13 smithi079 ceph-mon[30788]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-09-21T02:48:14.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:48:14.803 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:48:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 -- 172.21.15.79:0/456496921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 msgr2=0x7f34b810dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 --2- 172.21.15.79:0/456496921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 0x7f34b810dab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009be0 tx=0x7f34b002a6d0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 -- 172.21.15.79:0/456496921 shutdown_connections 2024-09-21T02:48:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 --2- 172.21.15.79:0/456496921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 0x7f34b810dab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 --2- 172.21.15.79:0/456496921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b8106770 0x7f34b8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 --2- 172.21.15.79:0/456496921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 0x7f34b8105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 -- 172.21.15.79:0/456496921 >> 172.21.15.79:0/456496921 conn(0x7f34b8101050 msgr2=0x7f34b81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.304+0000 7f34be200640 1 -- 172.21.15.79:0/456496921 shutdown_connections 2024-09-21T02:48:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.305+0000 7f34be200640 1 -- 172.21.15.79:0/456496921 wait complete. 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 Processor -- start 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 -- start start 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 0x7f34b819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b8106770 0x7f34b819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 0x7f34b819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34b8111320 con 0x7f34b8106770 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81111a0 con 0x7f34b81056f0 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34be200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81114a0 con 0x7f34b8107110 2024-09-21T02:48:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b8106770 0x7f34b819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34bce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 0x7f34b819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34bce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 0x7f34b819bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51048/0 (socket says 172.21.15.79:51048) 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34bce00640 1 -- 172.21.15.79:0/3306295252 learned_addr learned my addr 172.21.15.79:0/3306295252 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.306+0000 7f34bd800640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 0x7f34b819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34bce00640 1 -- 172.21.15.79:0/3306295252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 msgr2=0x7f34b819d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34bce00640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 0x7f34b819d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34bce00640 1 -- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b8106770 msgr2=0x7f34b819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34bce00640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b8106770 0x7f34b819c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34bce00640 1 -- 172.21.15.79:0/3306295252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b819d950 con 0x7f34b81056f0 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34b7e00640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b8106770 0x7f34b819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34bce00640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 0x7f34b819bf10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00ea60 tx=0x7f34ac00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34b5600640 1 -- 172.21.15.79:0/3306295252 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00cde0 con 0x7f34b81056f0 2024-09-21T02:48:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b819dc40 con 0x7f34b81056f0 2024-09-21T02:48:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34b5600640 1 -- 172.21.15.79:0/3306295252 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34ac0035f0 con 0x7f34b81056f0 2024-09-21T02:48:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34b5600640 1 -- 172.21.15.79:0/3306295252 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac010690 con 0x7f34b81056f0 2024-09-21T02:48:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.307+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b81a4330 con 0x7f34b81056f0 2024-09-21T02:48:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.310+0000 7f34c68b9740 1 Processor -- start 2024-09-21T02:48:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.310+0000 7f34c68b9740 1 -- start start 2024-09-21T02:48:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba8c1b0 0x55f17be332b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be33920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be34470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34c68b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f17bda66b0 con 0x55f17ba8c1b0 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34c68b9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f17bd95ae0 con 0x55f17ba632f0 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34c68b9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f17bd998f0 con 0x55f17ba6b4d0 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34b5600640 1 -- 172.21.15.79:0/3306295252 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f34ac0037a0 con 0x7f34b81056f0 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34bd800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba8c1b0 0x55f17be332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34bd800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba8c1b0 0x55f17be332b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37726/0 (socket says 172.21.15.79:37726) 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34bd800640 1 -- 172.21.15.79:0/1067690 learned_addr learned my addr 172.21.15.79:0/1067690 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34b7e00640 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be34470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.311+0000 7f34bce00640 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be33920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34bd800640 1 -- 172.21.15.79:0/1067690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 msgr2=0x55f17be34470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34bd800640 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be34470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34bd800640 1 -- 172.21.15.79:0/1067690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 msgr2=0x55f17be33920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34bd800640 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be33920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34bd800640 1 -- 172.21.15.79:0/1067690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17bd62780 con 0x55f17ba8c1b0 2024-09-21T02:48:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34bd800640 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba8c1b0 0x55f17be332b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009be0 tx=0x7f34b0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88ec9544a4f2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34aa000640 1 -- 172.21.15.79:0/1067690 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0041030 con 0x55f17ba8c1b0 2024-09-21T02:48:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34aa000640 1 -- 172.21.15.79:0/1067690 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34b0030530 con 0x55f17ba8c1b0 2024-09-21T02:48:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.312+0000 7f34aa000640 1 -- 172.21.15.79:0/1067690 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0036040 con 0x55f17ba8c1b0 2024-09-21T02:48:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34b5600640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f34a00b6510 0x7f34a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34b5600640 1 -- 172.21.15.79:0/3306295252 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f34ac0e7980 con 0x7f34b81056f0 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34bce00640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f34a00b6510 0x7f34a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34c68b9740 1 -- 172.21.15.79:0/1067690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba8c1b0 msgr2=0x55f17be332b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba8c1b0 0x55f17be332b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009be0 tx=0x7f34b0005fd0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34c68b9740 1 -- 172.21.15.79:0/1067690 shutdown_connections 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be34470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be33920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1067690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba8c1b0 0x55f17be332b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.313+0000 7f34c68b9740 1 -- 172.21.15.79:0/1067690 >> 172.21.15.79:0/1067690 conn(0x55f17ba80300 msgr2=0x55f17be2ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.314+0000 7f34c68b9740 1 -- 172.21.15.79:0/1067690 shutdown_connections 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.314+0000 7f34c68b9740 1 -- 172.21.15.79:0/1067690 wait complete. 2024-09-21T02:48:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.314+0000 7f34bce00640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f34a00b6510 0x7f34a00b8a20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0a9d30 tx=0x7f34ac00ef90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.314+0000 7f34c68b9740 1 -- start start 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.314+0000 7f34c68b9740 1 Processor -- start 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba632f0 0x55f17be3c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be3cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be3dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34c68b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f17bccdab0 con 0x55f17ba6b4d0 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34c68b9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f17bd3c570 con 0x55f17ba8c1b0 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34c68b9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f17be34f30 con 0x55f17ba632f0 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34c68b9740 10 client.0 _ll_register_callbacks cb 0x55f17bd4b100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be3cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be3cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37736/0 (socket says 172.21.15.79:37736) 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34b7e00640 1 -- 172.21.15.79:0/1054090415 learned_addr learned my addr 172.21.15.79:0/1054090415 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34bd800640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be3dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.315+0000 7f34bd800640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba632f0 0x55f17be3c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34b7e00640 1 -- 172.21.15.79:0/1054090415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba632f0 msgr2=0x55f17be3c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34b7e00640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba632f0 0x55f17be3c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34b7e00640 1 -- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 msgr2=0x55f17be3dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34b7e00640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be3dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34b7e00640 1 -- 172.21.15.79:0/1054090415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17baf7790 con 0x55f17ba6b4d0 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34bd800640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be3dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34b7e00640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be3cf50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f34a4012d20 tx=0x7f34a400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcd2d607b88d5cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f349ea00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f349ea00640 1 -- 172.21.15.79:0/1054090415 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a400fe20 con 0x55f17ba6b4d0 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f349ea00640 1 -- 172.21.15.79:0/1054090415 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f34a4010430 con 0x55f17ba6b4d0 2024-09-21T02:48:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34b0030530 con 0x55f17ba6b4d0 2024-09-21T02:48:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f349ea00640 1 -- 172.21.15.79:0/1054090415 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f34a4010630 con 0x55f17ba6b4d0 2024-09-21T02:48:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34c68b9740 10 client.16464 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.316+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f17bb70620 con 0x55f17ba6b4d0 2024-09-21T02:48:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f349ea00640 1 -- 172.21.15.79:0/1054090415 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34b0030530 con 0x55f17ba6b4d0 2024-09-21T02:48:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f349ea00640 1 -- 172.21.15.79:0/1054090415 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f34a401c720 con 0x55f17ba6b4d0 2024-09-21T02:48:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f34c68b9740 10 client.16464 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f34c68b9740 10 client.16464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f34c68b9740 20 client.16464 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba4ad80 0x55f17be4a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f34c68b9740 4 client.16464 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f17bda8600 con 0x55f17ba4ad80 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.317+0000 7f34bd800640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba4ad80 0x55f17be4a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.318+0000 7f349ea00640 10 client.16464 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.318+0000 7f34bd800640 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba4ad80 0x55f17be4a0d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=860d79dfa544ee27 server_cookie=dc70390525a1beb2 in_seq=0 out_seq=0 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f349ea00640 1 -- 172.21.15.79:0/1054090415 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f17bda8600 con 0x55f17ba4ad80 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f349ea00640 10 client.16464 handle_command_reply: tid=0 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 client.16464 shutdown 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 msgr2=0x55f17be3cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be3cf50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f34a4012d20 tx=0x7f34a400f790 comp rx=0 tx=0).stop 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 shutdown_connections 2024-09-21T02:48:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba4ad80 0x55f17be4a0d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be3dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be3cf50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 --2- 172.21.15.79:0/1054090415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba632f0 0x55f17be3c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f349ea00640 0 client.16464 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 >> 172.21.15.79:0/1054090415 conn(0x55f17ba80300 msgr2=0x55f17be34320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 shutdown_connections 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 1 -- 172.21.15.79:0/1054090415 wait complete. 2024-09-21T02:48:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.319+0000 7f34c68b9740 20 client.16464 trim_cache size 0 max 16384 2024-09-21T02:48:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.334+0000 7f34c68b9740 1 Processor -- start 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.334+0000 7f34c68b9740 1 -- start start 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.334+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be3cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.334+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be2da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba8c1b0 0x55f17be353b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34c68b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81ac670 con 0x55f17ba6b4d0 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34c68b9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81aeef0 con 0x55f17ba632f0 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34c68b9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81acce0 con 0x55f17ba8c1b0 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be2da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be2da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37752/0 (socket says 172.21.15.79:37752) 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 -- 172.21.15.79:0/2823278401 learned_addr learned my addr 172.21.15.79:0/2823278401 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34bd800640 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be3cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34bd800640 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba8c1b0 0x55f17be353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 -- 172.21.15.79:0/2823278401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba8c1b0 msgr2=0x55f17be353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba8c1b0 0x55f17be353b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 -- 172.21.15.79:0/2823278401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 msgr2=0x55f17be3cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be3cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 -- 172.21.15.79:0/2823278401 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17be46920 con 0x55f17ba6b4d0 2024-09-21T02:48:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34bd800640 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba8c1b0 0x55f17be353b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:48:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34b7e00640 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be2da70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f34a4012cf0 tx=0x7f34a4005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8496273b29b504a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.335+0000 7f34a9600640 1 -- 172.21.15.79:0/2823278401 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4010430 con 0x55f17ba6b4d0 2024-09-21T02:48:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34a9600640 1 -- 172.21.15.79:0/2823278401 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a401c8d0 con 0x55f17ba6b4d0 2024-09-21T02:48:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34a9600640 1 -- 172.21.15.79:0/2823278401 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4010d30 con 0x55f17ba6b4d0 2024-09-21T02:48:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 -- 172.21.15.79:0/2823278401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 msgr2=0x55f17be2da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be2da70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f34a4012cf0 tx=0x7f34a4005e70 comp rx=0 tx=0).stop 2024-09-21T02:48:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 -- 172.21.15.79:0/2823278401 shutdown_connections 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba8c1b0 0x55f17be353b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba6b4d0 0x55f17be2da70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2823278401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba632f0 0x55f17be3cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 -- 172.21.15.79:0/2823278401 >> 172.21.15.79:0/2823278401 conn(0x55f17ba80300 msgr2=0x55f17be2d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 -- 172.21.15.79:0/2823278401 shutdown_connections 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.336+0000 7f34c68b9740 1 -- 172.21.15.79:0/2823278401 wait complete. 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 -- start start 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 Processor -- start 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba632f0 0x55f17be44690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be43350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be43890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81ad3b0 con 0x55f17ba632f0 2024-09-21T02:48:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81ae820 con 0x55f17ba8c1b0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81ada80 con 0x55f17ba6b4d0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.337+0000 7f34c68b9740 10 client.0 _ll_register_callbacks cb 0x7f34a4012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba632f0 0x55f17be44690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba632f0 0x55f17be44690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37760/0 (socket says 172.21.15.79:37760) 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 -- 172.21.15.79:0/2792268386 learned_addr learned my addr 172.21.15.79:0/2792268386 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34b7e00640 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be43350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be43890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 -- 172.21.15.79:0/2792268386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 msgr2=0x55f17be43350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be43350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 -- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 msgr2=0x55f17be43890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be43890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 -- 172.21.15.79:0/2792268386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17be44020 con 0x55f17ba632f0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f34bd800640 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba632f0 0x55f17be44690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f34b0003ba0 tx=0x7f34b0048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fea7bf9975cbb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f349ea00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.338+0000 7f349ea00640 1 -- 172.21.15.79:0/2792268386 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0036040 con 0x55f17ba632f0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34a401c8d0 con 0x55f17ba632f0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f349ea00640 1 -- 172.21.15.79:0/2792268386 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f34b0054f90 con 0x55f17ba632f0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f349ea00640 1 -- 172.21.15.79:0/2792268386 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f34b0041040 con 0x55f17ba632f0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 10 client.16470 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f17beb4ad0 con 0x55f17ba632f0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f349ea00640 1 -- 172.21.15.79:0/2792268386 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a401c8d0 con 0x55f17ba632f0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f349ea00640 1 -- 172.21.15.79:0/2792268386 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f34b005b070 con 0x55f17ba632f0 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 10 client.16470 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 10 client.16470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 20 client.16470 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba201c0 0x55f17beb6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 4 client.16470 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:48:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.339+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f17bda40b0 con 0x55f17ba201c0 2024-09-21T02:48:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.340+0000 7f34b7e00640 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba201c0 0x55f17beb6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.340+0000 7f349ea00640 10 client.16470 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.340+0000 7f34b7e00640 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba201c0 0x55f17beb6f30 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4e276862c1f9b77 server_cookie=9e8564c895246b40 in_seq=0 out_seq=0 2024-09-21T02:48:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f349ea00640 1 -- 172.21.15.79:0/2792268386 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f17bda40b0 con 0x55f17ba201c0 2024-09-21T02:48:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f349ea00640 10 client.16470 handle_command_reply: tid=0 2024-09-21T02:48:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 client.16470 shutdown 2024-09-21T02:48:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba632f0 msgr2=0x55f17be44690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba632f0 0x55f17be44690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f34b0003ba0 tx=0x7f34b0048040 comp rx=0 tx=0).stop 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 shutdown_connections 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f17ba201c0 0x55f17beb6f30 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f17ba8c1b0 0x55f17be43890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f17ba6b4d0 0x55f17be43350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 --2- 172.21.15.79:0/2792268386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f17ba632f0 0x55f17be44690 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.450+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 >> 172.21.15.79:0/2792268386 conn(0x55f17ba80300 msgr2=0x55f17be32ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f349ea00640 0 client.16470 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 shutdown_connections 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f34c68b9740 1 -- 172.21.15.79:0/2792268386 wait complete. 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f34c68b9740 20 client.16470 trim_cache size 0 max 16384 2024-09-21T02:48:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:48:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:48:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:48:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:48:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f34a00b6510 msgr2=0x7f34a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f34be200640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f34a00b6510 0x7f34a00b8a20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0a9d30 tx=0x7f34ac00ef90 comp rx=0 tx=0).stop 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 msgr2=0x7f34b819bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.451+0000 7f34be200640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 0x7f34b819bf10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00ea60 tx=0x7f34ac00ef20 comp rx=0 tx=0).stop 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 shutdown_connections 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f34a00b6510 0x7f34a00b8a20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b8107110 0x7f34b819d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b8106770 0x7f34b819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 --2- 172.21.15.79:0/3306295252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34b81056f0 0x7f34b819bf10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 >> 172.21.15.79:0/3306295252 conn(0x7f34b8101050 msgr2=0x7f34b8109a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 shutdown_connections 2024-09-21T02:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:15.452+0000 7f34be200640 1 -- 172.21.15.79:0/3306295252 wait complete. 2024-09-21T02:48:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 -- 172.21.15.79:0/221819601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 msgr2=0x7fdc5810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 --2- 172.21.15.79:0/221819601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 0x7fdc5810b910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009900 tx=0x7fdc4402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 -- 172.21.15.79:0/221819601 shutdown_connections 2024-09-21T02:48:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 --2- 172.21.15.79:0/221819601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc5810be50 0x7fdc58112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 --2- 172.21.15.79:0/221819601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 0x7fdc5810b910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 --2- 172.21.15.79:0/221819601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 0x7fdc58105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 -- 172.21.15.79:0/221819601 >> 172.21.15.79:0/221819601 conn(0x7fdc58101670 msgr2=0x7fdc58103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 -- 172.21.15.79:0/221819601 shutdown_connections 2024-09-21T02:48:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.952+0000 7fdc5f000640 1 -- 172.21.15.79:0/221819601 wait complete. 2024-09-21T02:48:15.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:15 smithi079 ceph-mon[30788]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 872 KiB/s wr, 86 op/s 2024-09-21T02:48:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.953+0000 7fdc5f000640 1 Processor -- start 2024-09-21T02:48:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5f000640 1 -- start start 2024-09-21T02:48:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5f000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 0x7fdc5819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5f000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 0x7fdc5819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5f000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc5810be50 0x7fdc581a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5f000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58115b60 con 0x7fdc58105bc0 2024-09-21T02:48:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5f000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581159e0 con 0x7fdc5810b500 2024-09-21T02:48:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5f000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58115ce0 con 0x7fdc5810be50 2024-09-21T02:48:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 0x7fdc5819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5dc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 0x7fdc5819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 0x7fdc5819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51110/0 (socket says 172.21.15.79:51110) 2024-09-21T02:48:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5dc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 0x7fdc5819c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37792/0 (socket says 172.21.15.79:37792) 2024-09-21T02:48:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.954+0000 7fdc5d200640 1 -- 172.21.15.79:0/3230468689 learned_addr learned my addr 172.21.15.79:0/3230468689 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5e600640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc5810be50 0x7fdc581a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5e600640 1 -- 172.21.15.79:0/3230468689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 msgr2=0x7fdc5819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5e600640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 0x7fdc5819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5e600640 1 -- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 msgr2=0x7fdc5819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5e600640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 0x7fdc5819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5e600640 1 -- 172.21.15.79:0/3230468689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc581a2560 con 0x7fdc5810be50 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5dc00640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 0x7fdc5819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.955+0000 7fdc5e600640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc5810be50 0x7fdc581a1e30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009fd0 tx=0x7fdc5000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.956+0000 7fdc56000640 1 -- 172.21.15.79:0/3230468689 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000ce20 con 0x7fdc5810be50 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.956+0000 7fdc56000640 1 -- 172.21.15.79:0/3230468689 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc50005020 con 0x7fdc5810be50 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.956+0000 7fdc56000640 1 -- 172.21.15.79:0/3230468689 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50010690 con 0x7fdc5810be50 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.956+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc581a2850 con 0x7fdc5810be50 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.956+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581a8fb0 con 0x7fdc5810be50 2024-09-21T02:48:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.957+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc58105fd0 con 0x7fdc5810be50 2024-09-21T02:48:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.959+0000 7fdc56000640 1 -- 172.21.15.79:0/3230468689 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdc500054d0 con 0x7fdc5810be50 2024-09-21T02:48:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.961+0000 7fdc56000640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc400b6590 0x7fdc400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.961+0000 7fdc56000640 1 -- 172.21.15.79:0/3230468689 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fdc500e7c50 con 0x7fdc5810be50 2024-09-21T02:48:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.961+0000 7fdc5dc00640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc400b6590 0x7fdc400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:15.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.962+0000 7fdc5dc00640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc400b6590 0x7fdc400b8aa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0095f0 tx=0x7fdc4c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:15.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:15.963+0000 7fdc56000640 1 -- 172.21.15.79:0/3230468689 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc500ae0d0 con 0x7fdc5810be50 2024-09-21T02:48:16.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:15 smithi148 ceph-mon[34626]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 872 KiB/s wr, 86 op/s 2024-09-21T02:48:16.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:15 smithi098 ceph-mon[34832]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 872 KiB/s wr, 86 op/s 2024-09-21T02:48:16.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.186+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc5810dc70 con 0x7fdc5810be50 2024-09-21T02:48:16.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.188+0000 7fdc56000640 1 -- 172.21.15.79:0/3230468689 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fdc500b24b0 con 0x7fdc5810be50 2024-09-21T02:48:16.189 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:48:16.190 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:48:16.190 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:48:16.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc400b6590 msgr2=0x7fdc400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc400b6590 0x7fdc400b8aa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0095f0 tx=0x7fdc4c005f90 comp rx=0 tx=0).stop 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc5810be50 msgr2=0x7fdc581a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc5810be50 0x7fdc581a1e30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009fd0 tx=0x7fdc5000ef10 comp rx=0 tx=0).stop 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 shutdown_connections 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fdc400b6590 0x7fdc400b8aa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc5810be50 0x7fdc581a1e30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc5810b500 0x7fdc5819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 --2- 172.21.15.79:0/3230468689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc58105bc0 0x7fdc5819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 >> 172.21.15.79:0/3230468689 conn(0x7fdc58101670 msgr2=0x7fdc5810ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 shutdown_connections 2024-09-21T02:48:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:16.190+0000 7fdc5f000640 1 -- 172.21.15.79:0/3230468689 wait complete. 2024-09-21T02:48:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:48:17.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:16 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3230468689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:48:17.069 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:16 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3230468689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:48:17.110 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 1d9c12ea --release --await' 2024-09-21T02:48:17.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 1d9c12ea --release --await 2024-09-21T02:48:17.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:16 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3230468689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:48:17.484 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:48:17.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:17 smithi079 ceph-mon[30788]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 237 KiB/s wr, 40 op/s 2024-09-21T02:48:18.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:17 smithi148 ceph-mon[34626]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 237 KiB/s wr, 40 op/s 2024-09-21T02:48:18.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:17 smithi098 ceph-mon[34832]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 237 KiB/s wr, 40 op/s 2024-09-21T02:48:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 -- 172.21.15.79:0/3601209671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 msgr2=0x7fe2a01096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3601209671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 0x7fe2a01096e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009900 tx=0x7fe28c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 -- 172.21.15.79:0/3601209671 shutdown_connections 2024-09-21T02:48:18.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3601209671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0109c20 0x7fe2a0110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3601209671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 0x7fe2a01096e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3601209671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a0103990 0x7fe2a0103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 -- 172.21.15.79:0/3601209671 >> 172.21.15.79:0/3601209671 conn(0x7fe2a00ff3e0 msgr2=0x7fe2a0101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 -- 172.21.15.79:0/3601209671 shutdown_connections 2024-09-21T02:48:18.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.165+0000 7fe29fe00640 1 -- 172.21.15.79:0/3601209671 wait complete. 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.166+0000 7fe29fe00640 1 Processor -- start 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29fe00640 1 -- start start 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0103990 0x7fe2a019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 0x7fe2a019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a0109c20 0x7fe2a019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29fe00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01138e0 con 0x7fe2a01092d0 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29fe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0113760 con 0x7fe2a0103990 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29fe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0113a60 con 0x7fe2a0109c20 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 0x7fe2a019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0103990 0x7fe2a019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 0x7fe2a019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37814/0 (socket says 172.21.15.79:37814) 2024-09-21T02:48:18.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29e000640 1 -- 172.21.15.79:0/3035993792 learned_addr learned my addr 172.21.15.79:0/3035993792 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:18.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.167+0000 7fe29f400640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a0109c20 0x7fe2a019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe29ea00640 1 -- 172.21.15.79:0/3035993792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a0109c20 msgr2=0x7fe2a019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe29ea00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a0109c20 0x7fe2a019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe29ea00640 1 -- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 msgr2=0x7fe2a019a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe29ea00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 0x7fe2a019a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe29ea00640 1 -- 172.21.15.79:0/3035993792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a01a0260 con 0x7fe2a0103990 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe29ea00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0103990 0x7fe2a019a2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e9f0 tx=0x7fe29000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe297400640 1 -- 172.21.15.79:0/3035993792 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29000ccc0 con 0x7fe2a0103990 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a01a0550 con 0x7fe2a0103990 2024-09-21T02:48:18.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.168+0000 7fe297400640 1 -- 172.21.15.79:0/3035993792 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe290005020 con 0x7fe2a0103990 2024-09-21T02:48:18.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.169+0000 7fe297400640 1 -- 172.21.15.79:0/3035993792 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290004a00 con 0x7fe2a0103990 2024-09-21T02:48:18.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.169+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a01a6cb0 con 0x7fe2a0103990 2024-09-21T02:48:18.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.171+0000 7fe2ac7f1740 1 Processor -- start 2024-09-21T02:48:18.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe2ac7f1740 1 -- start start 2024-09-21T02:48:18.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2e21520 0x55a3a31c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2df8660 0x55a3a31c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a3a313f290 con 0x55a3a2df8660 2024-09-21T02:48:18.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3a312e6c0 con 0x55a3a2e00840 2024-09-21T02:48:18.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a3a31324d0 con 0x55a3a2e21520 2024-09-21T02:48:18.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe29f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2e21520 0x55a3a31c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe297400640 1 -- 172.21.15.79:0/3035993792 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe290004ba0 con 0x7fe2a0103990 2024-09-21T02:48:18.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe29f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2e21520 0x55a3a31c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52082/0 (socket says 172.21.15.79:52082) 2024-09-21T02:48:18.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.172+0000 7fe29e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29f400640 1 -- 172.21.15.79:0/1422786670 learned_addr learned my addr 172.21.15.79:0/1422786670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29ea00640 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2df8660 0x55a3a31c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29f400640 1 -- 172.21.15.79:0/1422786670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 msgr2=0x55a3a31c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29f400640 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29f400640 1 -- 172.21.15.79:0/1422786670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2df8660 msgr2=0x55a3a31c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29f400640 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2df8660 0x55a3a31c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29f400640 1 -- 172.21.15.79:0/1422786670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a30bb460 con 0x55a3a2e21520 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29e000640 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.173+0000 7fe29f400640 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2e21520 0x55a3a31c8340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe298009fd0 tx=0x7fe2980118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df2544b512f23259 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.174+0000 7fe28be00640 1 -- 172.21.15.79:0/1422786670 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298004d20 con 0x55a3a2e21520 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.174+0000 7fe28be00640 1 -- 172.21.15.79:0/1422786670 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe298004050 con 0x55a3a2e21520 2024-09-21T02:48:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.174+0000 7fe28be00640 1 -- 172.21.15.79:0/1422786670 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298005280 con 0x55a3a2e21520 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.174+0000 7fe297400640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2840b6510 0x7fe2840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.174+0000 7fe297400640 1 -- 172.21.15.79:0/3035993792 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe2900e7660 con 0x7fe2a0103990 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe29ea00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2840b6510 0x7fe2840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/1422786670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2e21520 msgr2=0x55a3a31c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2e21520 0x55a3a31c8340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe298009fd0 tx=0x7fe2980118d0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/1422786670 shutdown_connections 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2df8660 0x55a3a31c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/1422786670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2e21520 0x55a3a31c8340 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/1422786670 >> 172.21.15.79:0/1422786670 conn(0x55a3a2e15910 msgr2=0x55a3a31c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/1422786670 shutdown_connections 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/1422786670 wait complete. 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.175+0000 7fe29ea00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2840b6510 0x7fe2840b8a20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad370 tx=0x7fe290005460 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 -- start start 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 Processor -- start 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31e4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a3a2f8fbb0 con 0x55a3a2e21520 2024-09-21T02:48:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3a30c96c0 con 0x55a3a2e00840 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a3a31d6b20 con 0x55a3a2df8660 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.176+0000 7fe2ac7f1740 10 client.0 _ll_register_callbacks cb 0x55a3a30e4490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51136/0 (socket says 172.21.15.79:51136) 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 -- 172.21.15.79:0/3530667554 learned_addr learned my addr 172.21.15.79:0/3530667554 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 -- 172.21.15.79:0/3530667554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 msgr2=0x55a3a31d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 -- 172.21.15.79:0/3530667554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 msgr2=0x55a3a31e4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31e4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.177+0000 7fe29e000640 1 -- 172.21.15.79:0/3530667554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a2e8cb00 con 0x55a3a2e00840 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe29e000640 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d43a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009230 tx=0x7fe28c031e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad68d48c4513d388 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe288c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:48:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe288c00640 1 -- 172.21.15.79:0/3530667554 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c035040 con 0x55a3a2e00840 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe298004050 con 0x55a3a2e00840 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe288c00640 1 -- 172.21.15.79:0/3530667554 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe28c031760 con 0x55a3a2e00840 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe288c00640 1 -- 172.21.15.79:0/3530667554 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe28c004040 con 0x55a3a2e00840 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe2ac7f1740 10 client.26756 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.178+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a3a2f03960 con 0x55a3a2e00840 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe288c00640 1 -- 172.21.15.79:0/3530667554 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe298004050 con 0x55a3a2e00840 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe288c00640 1 -- 172.21.15.79:0/3530667554 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe28c0047a0 con 0x55a3a2e00840 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe2ac7f1740 10 client.26756 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe2ac7f1740 10 client.26756 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe2ac7f1740 20 client.26756 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2ddfea0 0x55a3a31ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe2ac7f1740 4 client.26756 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3a31411e0 con 0x55a3a2ddfea0 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.179+0000 7fe29f400640 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2ddfea0 0x55a3a31ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.180+0000 7fe29f400640 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2ddfea0 0x55a3a31ea270 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66b954a287e35016 server_cookie=74c2dbb576c322fa in_seq=0 out_seq=0 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.180+0000 7fe288c00640 10 client.26756 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe288c00640 1 -- 172.21.15.79:0/3530667554 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3a31411e0 con 0x55a3a2ddfea0 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe288c00640 10 client.26756 handle_command_reply: tid=0 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 client.26756 shutdown 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 msgr2=0x55a3a31d43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d43a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009230 tx=0x7fe28c031e80 comp rx=0 tx=0).stop 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 shutdown_connections 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2ddfea0 0x55a3a31ea270 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31e4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe288c00640 0 client.26756 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d43a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3530667554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.181+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 >> 172.21.15.79:0/3530667554 conn(0x55a3a2e15910 msgr2=0x55a3a31cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.182+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 shutdown_connections 2024-09-21T02:48:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.182+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3530667554 wait complete. 2024-09-21T02:48:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.182+0000 7fe2ac7f1740 20 client.26756 trim_cache size 0 max 16384 2024-09-21T02:48:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.199+0000 7fe2ac7f1740 1 Processor -- start 2024-09-21T02:48:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.199+0000 7fe2ac7f1740 1 -- start start 2024-09-21T02:48:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e00840 0x55a3a31e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e21520 0x55a3a31e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ac770 con 0x55a3a2e00840 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01aeff0 con 0x55a3a2e21520 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01acde0 con 0x55a3a2df8660 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe29e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e00840 0x55a3a31e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe29f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe29e000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e00840 0x55a3a31e41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37844/0 (socket says 172.21.15.79:37844) 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe29f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52096/0 (socket says 172.21.15.79:52096) 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe29e000640 1 -- 172.21.15.79:0/841945299 learned_addr learned my addr 172.21.15.79:0/841945299 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.200+0000 7fe29f400640 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e21520 0x55a3a31e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe29f400640 1 -- 172.21.15.79:0/841945299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e21520 msgr2=0x55a3a31e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe29f400640 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e21520 0x55a3a31e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe29f400640 1 -- 172.21.15.79:0/841945299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e00840 msgr2=0x55a3a31e41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe29f400640 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e00840 0x55a3a31e41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe29f400640 1 -- 172.21.15.79:0/841945299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a31cf4f0 con 0x55a3a2df8660 2024-09-21T02:48:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe29e000640 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e00840 0x55a3a31e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe29f400640 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31cbb50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2980048b0 tx=0x7fe298009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b57220cd59c96b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe28b400640 1 -- 172.21.15.79:0/841945299 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298003f90 con 0x55a3a2df8660 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe28b400640 1 -- 172.21.15.79:0/841945299 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2980045e0 con 0x55a3a2df8660 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.201+0000 7fe28b400640 1 -- 172.21.15.79:0/841945299 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29800fd10 con 0x55a3a2df8660 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/841945299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 msgr2=0x55a3a31cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31cbb50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2980048b0 tx=0x7fe298009500 comp rx=0 tx=0).stop 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/841945299 shutdown_connections 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e21520 0x55a3a31e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e00840 0x55a3a31e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/841945299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31cbb50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/841945299 >> 172.21.15.79:0/841945299 conn(0x55a3a2e15910 msgr2=0x55a3a31cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/841945299 shutdown_connections 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.202+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/841945299 wait complete. 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 -- start start 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 Processor -- start 2024-09-21T02:48:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ad4b0 con 0x55a3a2e21520 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ae920 con 0x55a3a2e00840 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01adb80 con 0x55a3a2df8660 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.203+0000 7fe2ac7f1740 10 client.0 _ll_register_callbacks cb 0x7fe28c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51156/0 (socket says 172.21.15.79:51156) 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 -- 172.21.15.79:0/3028548829 learned_addr learned my addr 172.21.15.79:0/3028548829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 -- 172.21.15.79:0/3028548829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 msgr2=0x55a3a31d6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 -- 172.21.15.79:0/3028548829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 msgr2=0x55a3a31dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.204+0000 7fe29e000640 1 -- 172.21.15.79:0/3028548829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a31e0410 con 0x55a3a2e00840 2024-09-21T02:48:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe29e000640 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d7510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe28c004d60 tx=0x7fe28c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54739dfd9392f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe288c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:48:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe288c00640 1 -- 172.21.15.79:0/3028548829 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c035070 con 0x55a3a2e00840 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe288c00640 1 -- 172.21.15.79:0/3028548829 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe28c031560 con 0x55a3a2e00840 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2980045e0 con 0x55a3a2e00840 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe288c00640 1 -- 172.21.15.79:0/3028548829 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe28c061050 con 0x55a3a2e00840 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe2ac7f1740 10 client.26762 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.205+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a3a3259940 con 0x55a3a2e00840 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe288c00640 1 -- 172.21.15.79:0/3028548829 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2980045e0 con 0x55a3a2e00840 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe288c00640 1 -- 172.21.15.79:0/3028548829 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe28c05c030 con 0x55a3a2e00840 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe2ac7f1740 10 client.26762 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe2ac7f1740 10 client.26762 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe2ac7f1740 20 client.26762 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2db5250 0x55a3a325c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe2ac7f1740 4 client.26762 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1d9c12ea", "release": true, "await": true}] 2024-09-21T02:48:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1d9c12ea", "release": true, "await": true}) -- 0x55a3a313cc90 con 0x55a3a2db5250 2024-09-21T02:48:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.206+0000 7fe29f400640 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2db5250 0x55a3a325c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.207+0000 7fe29f400640 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2db5250 0x55a3a325c180 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bfb95559425b2b server_cookie=d8d9003db9dfcb6 in_seq=0 out_seq=0 2024-09-21T02:48:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.207+0000 7fe288c00640 10 client.26762 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:18.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.255+0000 7fe288c00640 1 -- 172.21.15.79:0/3028548829 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a3a313cc90 con 0x55a3a2db5250 2024-09-21T02:48:18.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.255+0000 7fe288c00640 10 client.26762 handle_command_reply: tid=0 2024-09-21T02:48:18.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.256+0000 7fe2ac7f1740 1 client.26762 shutdown 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 msgr2=0x55a3a31d7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d7510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe28c004d60 tx=0x7fe28c005fd0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 shutdown_connections 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55a3a2db5250 0x55a3a325c180 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3a2e21520 0x55a3a31dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3a2e00840 0x55a3a31d7510 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 --2- 172.21.15.79:0/3028548829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3a2df8660 0x55a3a31d6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe288c00640 0 client.26762 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.260+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 >> 172.21.15.79:0/3028548829 conn(0x55a3a2e15910 msgr2=0x55a3a31c5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:18.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.262+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 shutdown_connections 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 52, 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout: "1d9c12ea": { 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 52, 2024-09-21T02:48:18.271 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 137.8, 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:18.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.266+0000 7fe2ac7f1740 1 -- 172.21.15.79:0/3028548829 wait complete. 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.267+0000 7fe2ac7f1740 20 client.26762 trim_cache size 0 max 16384 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2840b6510 msgr2=0x7fe2840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2840b6510 0x7fe2840b8a20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad370 tx=0x7fe290005460 comp rx=0 tx=0).stop 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0103990 msgr2=0x7fe2a019a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:18.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0103990 0x7fe2a019a2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e9f0 tx=0x7fe29000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 shutdown_connections 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe2840b6510 0x7fe2840b8a20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a0109c20 0x7fe2a019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2a01092d0 0x7fe2a019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 --2- 172.21.15.79:0/3035993792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2a0103990 0x7fe2a019a2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 >> 172.21.15.79:0/3035993792 conn(0x7fe2a00ff3e0 msgr2=0x7fe2a0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.269+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 shutdown_connections 2024-09-21T02:48:18.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:48:18.271+0000 7fe29fe00640 1 -- 172.21.15.79:0/3035993792 wait complete. 2024-09-21T02:48:19.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:18 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:48:19.115 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:18 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:48:19.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:18 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:48:19.345 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1d9c12ea', total seconds elapsed: 22.7 2024-09-21T02:48:19.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:19 smithi079 ceph-mon[30788]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-21T02:48:20.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:19 smithi148 ceph-mon[34626]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-21T02:48:20.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:19 smithi098 ceph-mon[34832]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-21T02:48:21.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:48:21.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:48:21.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:48:21.088 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:48:21.088 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:48:21.088 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:48:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:48:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:48:21.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:48:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 745.0 s, 262.5 tps, lat 1557.592 ms stddev 4654.558 2024-09-21T02:48:22.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:21 smithi148 ceph-mon[34626]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 93 KiB/s wr, 19 op/s 2024-09-21T02:48:22.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:21 smithi098 ceph-mon[34832]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 93 KiB/s wr, 19 op/s 2024-09-21T02:48:22.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:21 smithi079 ceph-mon[30788]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 93 KiB/s wr, 19 op/s 2024-09-21T02:48:23.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:22 smithi098 ceph-mon[34832]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-21T02:48:23.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:22 smithi079 ceph-mon[30788]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-21T02:48:23.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:22 smithi148 ceph-mon[34626]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-09-21T02:48:25.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:24 smithi079 ceph-mon[30788]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-21T02:48:25.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:24 smithi148 ceph-mon[34626]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-21T02:48:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:24 smithi098 ceph-mon[34832]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-09-21T02:48:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 750.0 s, 492.8 tps, lat 205.953 ms stddev 237.399 2024-09-21T02:48:27.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:26 smithi079 ceph-mon[30788]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-21T02:48:27.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:26 smithi148 ceph-mon[34626]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-21T02:48:27.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:26 smithi098 ceph-mon[34832]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-21T02:48:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.773+0000 7f46ca400640 1 -- 172.21.15.79:0/675898944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c4104f00 msgr2=0x7f46c410b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.773+0000 7f46ca400640 1 --2- 172.21.15.79:0/675898944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c4104f00 0x7f46c410b8a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009ca0 tx=0x7f46bc02e9a0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.775+0000 7f46ca400640 1 -- 172.21.15.79:0/675898944 shutdown_connections 2024-09-21T02:48:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.775+0000 7f46ca400640 1 --2- 172.21.15.79:0/675898944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c4104f00 0x7f46c410b8a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.775+0000 7f46ca400640 1 --2- 172.21.15.79:0/675898944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c4104560 0x7f46c4104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.775+0000 7f46ca400640 1 --2- 172.21.15.79:0/675898944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c41034e0 0x7f46c4103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.775+0000 7f46ca400640 1 -- 172.21.15.79:0/675898944 >> 172.21.15.79:0/675898944 conn(0x7f46c40fee20 msgr2=0x7f46c41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.776+0000 7f46ca400640 1 -- 172.21.15.79:0/675898944 shutdown_connections 2024-09-21T02:48:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.776+0000 7f46ca400640 1 -- 172.21.15.79:0/675898944 wait complete. 2024-09-21T02:48:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.778+0000 7f46ca400640 1 Processor -- start 2024-09-21T02:48:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.779+0000 7f46ca400640 1 -- start start 2024-09-21T02:48:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46ca400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c41034e0 0x7f46c4197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46ca400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c4104560 0x7f46c41981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46ca400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c4104f00 0x7f46c4198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46ca400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46c410cfe0 con 0x7f46c4104f00 2024-09-21T02:48:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46ca400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46c410ce60 con 0x7f46c4104560 2024-09-21T02:48:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46ca400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46c410d160 con 0x7f46c41034e0 2024-09-21T02:48:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46c3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c4104560 0x7f46c41981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46c9a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c4104f00 0x7f46c4198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46c9a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c4104f00 0x7f46c4198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50570/0 (socket says 172.21.15.79:50570) 2024-09-21T02:48:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46c9a00640 1 -- 172.21.15.79:0/1710147539 learned_addr learned my addr 172.21.15.79:0/1710147539 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.780+0000 7f46c9000640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c41034e0 0x7f46c4197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.781+0000 7f46c9a00640 1 -- 172.21.15.79:0/1710147539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c41034e0 msgr2=0x7f46c4197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.781+0000 7f46c9a00640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c41034e0 0x7f46c4197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.781+0000 7f46c9a00640 1 -- 172.21.15.79:0/1710147539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c4104560 msgr2=0x7f46c41981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.781+0000 7f46c9a00640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c4104560 0x7f46c41981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.781+0000 7f46c9a00640 1 -- 172.21.15.79:0/1710147539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c4199590 con 0x7f46c4104f00 2024-09-21T02:48:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.782+0000 7f46c9a00640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c4104f00 0x7f46c4198d70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0098d0 tx=0x7f46bc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.782+0000 7f46c1600640 1 -- 172.21.15.79:0/1710147539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc04a070 con 0x7f46c4104f00 2024-09-21T02:48:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.782+0000 7f46c1600640 1 -- 172.21.15.79:0/1710147539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46bc03a6d0 con 0x7f46c4104f00 2024-09-21T02:48:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.782+0000 7f46c1600640 1 -- 172.21.15.79:0/1710147539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc037070 con 0x7f46c4104f00 2024-09-21T02:48:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.782+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c4199820 con 0x7f46c4104f00 2024-09-21T02:48:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.782+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c419ff70 con 0x7f46c4104f00 2024-09-21T02:48:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.789+0000 7f46d2a17740 1 Processor -- start 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46d2a17740 1 -- start start 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a98e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a98e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a98f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46d2a17740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56251a9016b0 con 0x56251a5c64d0 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46d2a17740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56251a8f0ae0 con 0x56251a5be2f0 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46d2a17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56251a8f48f0 con 0x56251a5e71b0 2024-09-21T02:48:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.793+0000 7f46c1600640 1 -- 172.21.15.79:0/1710147539 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f46bc04d070 con 0x7f46c4104f00 2024-09-21T02:48:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a98e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a98e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53780/0 (socket says 172.21.15.79:53780) 2024-09-21T02:48:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 -- 172.21.15.79:0/2890099827 learned_addr learned my addr 172.21.15.79:0/2890099827 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c3e00640 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a98e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 -- 172.21.15.79:0/2890099827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 msgr2=0x56251a98e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a98e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 -- 172.21.15.79:0/2890099827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 msgr2=0x56251a98f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a98f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.794+0000 7f46c9000640 1 -- 172.21.15.79:0/2890099827 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56251a8bd780 con 0x56251a5be2f0 2024-09-21T02:48:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.795+0000 7f46c9000640 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a98e920 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b820 tx=0x7f46b000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c563dbf72870555c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.795+0000 7f46b6000640 1 -- 172.21.15.79:0/2890099827 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b000d950 con 0x56251a5be2f0 2024-09-21T02:48:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.796+0000 7f46b6000640 1 -- 172.21.15.79:0/2890099827 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b0019070 con 0x56251a5be2f0 2024-09-21T02:48:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.796+0000 7f46b6000640 1 -- 172.21.15.79:0/2890099827 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b00123e0 con 0x56251a5be2f0 2024-09-21T02:48:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.796+0000 7f46c1600640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f46ac0b6610 0x7f46ac0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.797+0000 7f46c1600640 1 -- 172.21.15.79:0/1710147539 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f46bc10bd70 con 0x7f46c4104f00 2024-09-21T02:48:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.797+0000 7f46d2a17740 1 -- 172.21.15.79:0/2890099827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 msgr2=0x56251a98e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.797+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a98e920 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b820 tx=0x7f46b000bce0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.798+0000 7f46d2a17740 1 -- 172.21.15.79:0/2890099827 shutdown_connections 2024-09-21T02:48:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.798+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a98f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.798+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a98e920 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.798+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2890099827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a98e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.798+0000 7f46d2a17740 1 -- 172.21.15.79:0/2890099827 >> 172.21.15.79:0/2890099827 conn(0x56251a5db300 msgr2=0x56251a989d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.798+0000 7f46c3e00640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f46ac0b6610 0x7f46ac0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.798+0000 7f46d2a17740 1 -- 172.21.15.79:0/2890099827 shutdown_connections 2024-09-21T02:48:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.799+0000 7f46d2a17740 1 -- 172.21.15.79:0/2890099827 wait complete. 2024-09-21T02:48:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.799+0000 7f46c3e00640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f46ac0b6610 0x7f46ac0b8b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009b90 tx=0x7f46b80046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.799+0000 7f46d2a17740 1 -- start start 2024-09-21T02:48:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.800+0000 7f46d2a17740 1 Processor -- start 2024-09-21T02:48:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.802+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5be2f0 0x56251a9a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.803+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.803+0000 7f46c9000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5be2f0 0x56251a9a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.803+0000 7f46c9000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5be2f0 0x56251a9a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55204/0 (socket says 172.21.15.79:55204) 2024-09-21T02:48:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.804+0000 7f46c9000640 1 -- 172.21.15.79:0/1384023688 learned_addr learned my addr 172.21.15.79:0/1384023688 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.804+0000 7f46c3e00640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.804+0000 7f46d2a17740 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5e71b0 0x56251a9a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.805+0000 7f46c9a00640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5e71b0 0x56251a9a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.806+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56251a828ab0 con 0x56251a5c64d0 2024-09-21T02:48:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.806+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56251a897570 con 0x56251a5e71b0 2024-09-21T02:48:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.806+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56251a98ff90 con 0x56251a5be2f0 2024-09-21T02:48:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.807+0000 7f46d2a17740 10 client.0 _ll_register_callbacks cb 0x56251a8a6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.807+0000 7f46c3e00640 1 -- 172.21.15.79:0/1384023688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5be2f0 msgr2=0x56251a9a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.807+0000 7f46c3e00640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5be2f0 0x56251a9a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.807+0000 7f46c3e00640 1 -- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5e71b0 msgr2=0x56251a9a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.807+0000 7f46c3e00640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5e71b0 0x56251a9a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.808+0000 7f46c3e00640 1 -- 172.21.15.79:0/1384023688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56251a652790 con 0x56251a5c64d0 2024-09-21T02:48:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.808+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46b0019070 con 0x56251a5c64d0 2024-09-21T02:48:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.808+0000 7f46c9000640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5be2f0 0x56251a9a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.811+0000 7f46c3e00640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a0830 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009fd0 tx=0x7f46b8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2aff0c5af4906a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.811+0000 7f46aaa00640 10 client.16500 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:48:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.814+0000 7f46aaa00640 1 -- 172.21.15.79:0/1384023688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8027440 con 0x56251a5c64d0 2024-09-21T02:48:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.814+0000 7f46aaa00640 1 -- 172.21.15.79:0/1384023688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f46b80275e0 con 0x56251a5c64d0 2024-09-21T02:48:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.814+0000 7f46aaa00640 1 -- 172.21.15.79:0/1384023688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f46b8027820 con 0x56251a5c64d0 2024-09-21T02:48:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.814+0000 7f46d2a17740 10 client.16500 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.814+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=21}) -- 0x56251a6cb620 con 0x56251a5c64d0 2024-09-21T02:48:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.815+0000 7f46aaa00640 1 -- 172.21.15.79:0/1384023688 <== mon.0 v2:172.21.15.79:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f46b8025070 con 0x56251a5c64d0 2024-09-21T02:48:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.818+0000 7f46d2a17740 10 client.16500 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.818+0000 7f46d2a17740 10 client.16500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.818+0000 7f46d2a17740 20 client.16500 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.818+0000 7f46d2a17740 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a5a5d80 0x56251a9ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.818+0000 7f46d2a17740 4 client.16500 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:48:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.818+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56251a903600 con 0x56251a5a5d80 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.818+0000 7f46c9000640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a5a5d80 0x56251a9ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.819+0000 7f46aaa00640 10 client.16500 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.819+0000 7f46c9000640 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a5a5d80 0x56251a9ad760 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6278df0d5115ce02 server_cookie=7373884d7e26cda in_seq=0 out_seq=0 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46aaa00640 1 -- 172.21.15.79:0/1384023688 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56251a903600 con 0x56251a5a5d80 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46aaa00640 10 client.16500 handle_command_reply: tid=0 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 client.16500 shutdown 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 msgr2=0x56251a9a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a0830 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009fd0 tx=0x7f46b8005f90 comp rx=0 tx=0).stop 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 shutdown_connections 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a5a5d80 0x56251a9ad760 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5e71b0 0x56251a9a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a0830 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 --2- 172.21.15.79:0/1384023688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5be2f0 0x56251a9a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 >> 172.21.15.79:0/1384023688 conn(0x56251a5db300 msgr2=0x56251a988360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.820+0000 7f46aaa00640 0 client.16500 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.821+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 shutdown_connections 2024-09-21T02:48:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.821+0000 7f46d2a17740 1 -- 172.21.15.79:0/1384023688 wait complete. 2024-09-21T02:48:28.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.821+0000 7f46d2a17740 20 client.16500 trim_cache size 0 max 16384 2024-09-21T02:48:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 Processor -- start 2024-09-21T02:48:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 -- start start 2024-09-21T02:48:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5be2f0 0x56251a9ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5c64d0 0x56251a99f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a988360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46a400dce0 con 0x56251a5be2f0 2024-09-21T02:48:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4010560 con 0x56251a5c64d0 2024-09-21T02:48:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46d2a17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46a400e350 con 0x56251a5e71b0 2024-09-21T02:48:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46c3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5c64d0 0x56251a99f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46c3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5c64d0 0x56251a99f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:53804/0 (socket says 172.21.15.79:53804) 2024-09-21T02:48:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46c3e00640 1 -- 172.21.15.79:0/2401581725 learned_addr learned my addr 172.21.15.79:0/2401581725 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.862+0000 7f46c9a00640 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a988360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.863+0000 7f46c3e00640 1 -- 172.21.15.79:0/2401581725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 msgr2=0x56251a988360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.863+0000 7f46c3e00640 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a988360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.863+0000 7f46c3e00640 1 -- 172.21.15.79:0/2401581725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5be2f0 msgr2=0x56251a9ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.863+0000 7f46c3e00640 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5be2f0 0x56251a9ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.863+0000 7f46c3e00640 1 -- 172.21.15.79:0/2401581725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56251a993130 con 0x56251a5c64d0 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.863+0000 7f46c9a00640 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a988360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.863+0000 7f46c3e00640 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5c64d0 0x56251a99f370 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46b8010960 tx=0x7f46b8021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e7bcdd7ca20c203 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.864+0000 7f46b5600640 1 -- 172.21.15.79:0/2401581725 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8027640 con 0x56251a5c64d0 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.864+0000 7f46b5600640 1 -- 172.21.15.79:0/2401581725 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b0019070 con 0x56251a5c64d0 2024-09-21T02:48:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.864+0000 7f46b5600640 1 -- 172.21.15.79:0/2401581725 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b801d430 con 0x56251a5c64d0 2024-09-21T02:48:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.865+0000 7f46d2a17740 1 -- 172.21.15.79:0/2401581725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5c64d0 msgr2=0x56251a99f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.865+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5c64d0 0x56251a99f370 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46b8010960 tx=0x7f46b8021000 comp rx=0 tx=0).stop 2024-09-21T02:48:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.866+0000 7f46d2a17740 1 -- 172.21.15.79:0/2401581725 shutdown_connections 2024-09-21T02:48:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.866+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a988360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.866+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5c64d0 0x56251a99f370 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.866+0000 7f46d2a17740 1 --2- 172.21.15.79:0/2401581725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5be2f0 0x56251a9ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.866+0000 7f46d2a17740 1 -- 172.21.15.79:0/2401581725 >> 172.21.15.79:0/2401581725 conn(0x56251a5db300 msgr2=0x56251a989680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.867+0000 7f46d2a17740 1 -- 172.21.15.79:0/2401581725 shutdown_connections 2024-09-21T02:48:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.867+0000 7f46d2a17740 1 -- 172.21.15.79:0/2401581725 wait complete. 2024-09-21T02:48:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.867+0000 7f46d2a17740 1 -- start start 2024-09-21T02:48:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.867+0000 7f46d2a17740 1 Processor -- start 2024-09-21T02:48:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a9a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46d2a17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a9a7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46d2a17740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46a400ea20 con 0x56251a5c64d0 2024-09-21T02:48:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46d2a17740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46a400fe90 con 0x56251a5be2f0 2024-09-21T02:48:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46d2a17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46a400f0f0 con 0x56251a5e71b0 2024-09-21T02:48:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46d2a17740 10 client.0 _ll_register_callbacks cb 0x7f46b80099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.868+0000 7f46c9a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a9a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a9a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:55230/0 (socket says 172.21.15.79:55230) 2024-09-21T02:48:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9a00640 1 -- 172.21.15.79:0/3259567019 learned_addr learned my addr 172.21.15.79:0/3259567019 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9000640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a9a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c3e00640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9a00640 1 -- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 msgr2=0x56251a9a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9a00640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a9a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9a00640 1 -- 172.21.15.79:0/3259567019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 msgr2=0x56251a9a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9a00640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9a00640 1 -- 172.21.15.79:0/3259567019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56251a9a55c0 con 0x56251a5e71b0 2024-09-21T02:48:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.869+0000 7f46c9000640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a9a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.873+0000 7f46c9a00640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a9a7090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0ce0c0 tx=0x7f46bc0cd990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d81750fa694fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.873+0000 7f46aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:48:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.873+0000 7f46aaa00640 1 -- 172.21.15.79:0/3259567019 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc033e60 con 0x56251a5e71b0 2024-09-21T02:48:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.873+0000 7f46aaa00640 1 -- 172.21.15.79:0/3259567019 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f46bc0d6210 con 0x56251a5e71b0 2024-09-21T02:48:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.873+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46b0019070 con 0x56251a5e71b0 2024-09-21T02:48:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.874+0000 7f46aaa00640 1 -- 172.21.15.79:0/3259567019 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f46bc0d1260 con 0x56251a5e71b0 2024-09-21T02:48:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.874+0000 7f46d2a17740 10 client.26809 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.874+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56251aa18380 con 0x56251a5e71b0 2024-09-21T02:48:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.874+0000 7f46aaa00640 1 -- 172.21.15.79:0/3259567019 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b0019070 con 0x56251a5e71b0 2024-09-21T02:48:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.874+0000 7f46aaa00640 1 -- 172.21.15.79:0/3259567019 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f46bc0f3b00 con 0x56251a5e71b0 2024-09-21T02:48:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.874+0000 7f46d2a17740 10 client.26809 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.874+0000 7f46d2a17740 10 client.26809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.875+0000 7f46d2a17740 20 client.26809 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.875+0000 7f46d2a17740 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a57b1c0 0x56251aa1ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.875+0000 7f46d2a17740 4 client.26809 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:48:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.875+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56251a9851c0 con 0x56251a57b1c0 2024-09-21T02:48:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.875+0000 7f46c9000640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a57b1c0 0x56251aa1ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.876+0000 7f46aaa00640 10 client.26809 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:28.876+0000 7f46c9000640 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a57b1c0 0x56251aa1ad70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4e2ddac413c6d3 server_cookie=844f09cdb0df5129 in_seq=0 out_seq=0 2024-09-21T02:48:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.002+0000 7f46aaa00640 1 -- 172.21.15.79:0/3259567019 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56251a9851c0 con 0x56251a57b1c0 2024-09-21T02:48:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.002+0000 7f46aaa00640 10 client.26809 handle_command_reply: tid=0 2024-09-21T02:48:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.002+0000 7f46d2a17740 1 client.26809 shutdown 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.002+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 msgr2=0x56251a9a7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.002+0000 7f46d2a17740 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a9a7090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0ce0c0 tx=0x7f46bc0cd990 comp rx=0 tx=0).stop 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.002+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 shutdown_connections 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.002+0000 7f46d2a17740 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56251a57b1c0 0x56251aa1ad70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46d2a17740 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56251a5e71b0 0x56251a9a7090 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46d2a17740 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56251a5c64d0 0x56251a9a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46d2a17740 1 --2- 172.21.15.79:0/3259567019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56251a5be2f0 0x56251a9a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 >> 172.21.15.79:0/3259567019 conn(0x56251a5db300 msgr2=0x56251a98dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46aaa00640 0 client.26809 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 shutdown_connections 2024-09-21T02:48:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46d2a17740 1 -- 172.21.15.79:0/3259567019 wait complete. 2024-09-21T02:48:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.003+0000 7f46d2a17740 20 client.26809 trim_cache size 0 max 16384 2024-09-21T02:48:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:48:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:48:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:48:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:48:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.004+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f46ac0b6610 msgr2=0x7f46ac0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.004+0000 7f46ca400640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f46ac0b6610 0x7f46ac0b8b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009b90 tx=0x7f46b80046c0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.004+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c4104f00 msgr2=0x7f46c4198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.004+0000 7f46ca400640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c4104f00 0x7f46c4198d70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0098d0 tx=0x7f46bc003ba0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.005+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 shutdown_connections 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.005+0000 7f46ca400640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f46ac0b6610 0x7f46ac0b8b20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.005+0000 7f46ca400640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c4104f00 0x7f46c4198d70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.005+0000 7f46ca400640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c4104560 0x7f46c41981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.005+0000 7f46ca400640 1 --2- 172.21.15.79:0/1710147539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c41034e0 0x7f46c4197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.005+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 >> 172.21.15.79:0/1710147539 conn(0x7f46c40fee20 msgr2=0x7f46c4107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.007+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 shutdown_connections 2024-09-21T02:48:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:29.007+0000 7f46ca400640 1 -- 172.21.15.79:0/1710147539 wait complete. 2024-09-21T02:48:29.207 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:28 smithi098 ceph-mon[34832]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-09-21T02:48:29.232 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:28 smithi079 ceph-mon[30788]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-09-21T02:48:29.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:28 smithi148 ceph-mon[34626]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-09-21T02:48:31.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:30 smithi079 ceph-mon[30788]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.4 MiB/s wr, 373 op/s 2024-09-21T02:48:31.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:30 smithi148 ceph-mon[34626]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.4 MiB/s wr, 373 op/s 2024-09-21T02:48:31.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:30 smithi098 ceph-mon[34832]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.4 MiB/s wr, 373 op/s 2024-09-21T02:48:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 755.0 s, 478.4 tps, lat 207.743 ms stddev 234.505 2024-09-21T02:48:33.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:32 smithi079 ceph-mon[30788]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 4.8 MiB/s wr, 435 op/s 2024-09-21T02:48:33.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:32 smithi148 ceph-mon[34626]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 4.8 MiB/s wr, 435 op/s 2024-09-21T02:48:33.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:32 smithi098 ceph-mon[34832]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 4.8 MiB/s wr, 435 op/s 2024-09-21T02:48:35.033 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:34 smithi079 ceph-mon[30788]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 4.5 MiB/s wr, 458 op/s 2024-09-21T02:48:35.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:34 smithi148 ceph-mon[34626]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 4.5 MiB/s wr, 458 op/s 2024-09-21T02:48:35.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:34 smithi098 ceph-mon[34832]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 4.5 MiB/s wr, 458 op/s 2024-09-21T02:48:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 760.0 s, 630.0 tps, lat 158.692 ms stddev 214.625 2024-09-21T02:48:37.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:36 smithi079 ceph-mon[30788]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 6.2 MiB/s wr, 558 op/s 2024-09-21T02:48:37.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:36 smithi148 ceph-mon[34626]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 6.2 MiB/s wr, 558 op/s 2024-09-21T02:48:37.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:36 smithi098 ceph-mon[34832]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 6.2 MiB/s wr, 558 op/s 2024-09-21T02:48:39.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:38 smithi079 ceph-mon[30788]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 5.9 MiB/s wr, 533 op/s 2024-09-21T02:48:39.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:38 smithi148 ceph-mon[34626]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 5.9 MiB/s wr, 533 op/s 2024-09-21T02:48:39.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:38 smithi098 ceph-mon[34832]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 5.9 MiB/s wr, 533 op/s 2024-09-21T02:48:41.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:41 smithi148 ceph-mon[34626]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.1 MiB/s wr, 521 op/s 2024-09-21T02:48:41.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:41 smithi098 ceph-mon[34832]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.1 MiB/s wr, 521 op/s 2024-09-21T02:48:41.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:41 smithi079 ceph-mon[30788]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.1 MiB/s wr, 521 op/s 2024-09-21T02:48:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 765.0 s, 631.8 tps, lat 154.333 ms stddev 174.321 2024-09-21T02:48:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 -- 172.21.15.79:0/1679754786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e5010fe30 msgr2=0x7f4e50112250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 --2- 172.21.15.79:0/1679754786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e5010fe30 0x7f4e50112250 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009ca0 tx=0x7f4e4802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 -- 172.21.15.79:0/1679754786 shutdown_connections 2024-09-21T02:48:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 --2- 172.21.15.79:0/1679754786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e5010fe30 0x7f4e50112250 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 --2- 172.21.15.79:0/1679754786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e50075cf0 0x7f4e50076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 --2- 172.21.15.79:0/1679754786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e500770f0 0x7f4e500757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 -- 172.21.15.79:0/1679754786 >> 172.21.15.79:0/1679754786 conn(0x7f4e500feff0 msgr2=0x7f4e501014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.317+0000 7f4e56600640 1 -- 172.21.15.79:0/1679754786 shutdown_connections 2024-09-21T02:48:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.318+0000 7f4e56600640 1 -- 172.21.15.79:0/1679754786 wait complete. 2024-09-21T02:48:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.319+0000 7f4e56600640 1 Processor -- start 2024-09-21T02:48:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.319+0000 7f4e56600640 1 -- start start 2024-09-21T02:48:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e56600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e50075cf0 0x7f4e501a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e56600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e500770f0 0x7f4e501a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e56600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5010fe30 0x7f4e501a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e56600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501159b0 con 0x7f4e50075cf0 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e56600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50115830 con 0x7f4e5010fe30 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e56600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50115b30 con 0x7f4e500770f0 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e500770f0 0x7f4e501a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e4fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5010fe30 0x7f4e501a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e500770f0 0x7f4e501a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34912/0 (socket says 172.21.15.79:34912) 2024-09-21T02:48:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.320+0000 7f4e4ea00640 1 -- 172.21.15.79:0/1563638405 learned_addr learned my addr 172.21.15.79:0/1563638405 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.321+0000 7f4e4f400640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e50075cf0 0x7f4e501a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.321+0000 7f4e4ea00640 1 -- 172.21.15.79:0/1563638405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5010fe30 msgr2=0x7f4e501a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.321+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5010fe30 0x7f4e501a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.321+0000 7f4e4ea00640 1 -- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e50075cf0 msgr2=0x7f4e501a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.321+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e50075cf0 0x7f4e501a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.321+0000 7f4e4ea00640 1 -- 172.21.15.79:0/1563638405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e501a1f70 con 0x7f4e500770f0 2024-09-21T02:48:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.322+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e500770f0 0x7f4e501a0c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000e9f0 tx=0x7f4e4000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.322+0000 7f4e47e00640 1 -- 172.21.15.79:0/1563638405 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000cd80 con 0x7f4e500770f0 2024-09-21T02:48:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.322+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e501a2260 con 0x7f4e500770f0 2024-09-21T02:48:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.322+0000 7f4e47e00640 1 -- 172.21.15.79:0/1563638405 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e400054d0 con 0x7f4e500770f0 2024-09-21T02:48:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.322+0000 7f4e47e00640 1 -- 172.21.15.79:0/1563638405 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40010690 con 0x7f4e500770f0 2024-09-21T02:48:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.322+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501a8950 con 0x7f4e500770f0 2024-09-21T02:48:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.327+0000 7f4e47e00640 1 -- 172.21.15.79:0/1563638405 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4e40004e90 con 0x7f4e500770f0 2024-09-21T02:48:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.329+0000 7f4e5d6a3740 1 Processor -- start 2024-09-21T02:48:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.330+0000 7f4e47e00640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4e340b6610 0x7f4e340b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.330+0000 7f4e47e00640 1 -- 172.21.15.79:0/1563638405 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4e400e7c20 con 0x7f4e500770f0 2024-09-21T02:48:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.331+0000 7f4e5d6a3740 1 -- start start 2024-09-21T02:48:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.332+0000 7f4e4fe00640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4e340b6610 0x7f4e340b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.333+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x5576559590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.335+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655959740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.335+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x55765595a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.335+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5576558cc6b0 con 0x5576555b21b0 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.335+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5576558bbae0 con 0x5576555914d0 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.335+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5576558bf8f0 con 0x5576555892f0 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.334+0000 7f4e4f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x5576559590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.335+0000 7f4e4f400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x5576559590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55020/0 (socket says 172.21.15.79:55020) 2024-09-21T02:48:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.335+0000 7f4e4f400640 1 -- 172.21.15.79:0/1520013415 learned_addr learned my addr 172.21.15.79:0/1520013415 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.336+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655959740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.336+0000 7f4e4ea00640 1 -- 172.21.15.79:0/1520013415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 msgr2=0x55765595a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.336+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x55765595a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.336+0000 7f4e4ea00640 1 -- 172.21.15.79:0/1520013415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 msgr2=0x5576559590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.336+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x5576559590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.336+0000 7f4e4ea00640 1 -- 172.21.15.79:0/1520013415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557655888780 con 0x5576555892f0 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.336+0000 7f4e4f400640 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x5576559590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:48:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.337+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655959740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000e9c0 tx=0x7f4e400ad2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7160735220e6083e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.337+0000 7f4e4fe00640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4e340b6610 0x7f4e340b8b20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4e48031b50 tx=0x7f4e480093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.337+0000 7f4e44c00640 1 -- 172.21.15.79:0/1520013415 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400b2020 con 0x5576555892f0 2024-09-21T02:48:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.337+0000 7f4e44c00640 1 -- 172.21.15.79:0/1520013415 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e400ad4b0 con 0x5576555892f0 2024-09-21T02:48:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.337+0000 7f4e44c00640 1 -- 172.21.15.79:0/1520013415 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400b73c0 con 0x5576555892f0 2024-09-21T02:48:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.338+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/1520013415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 msgr2=0x557655959740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.338+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655959740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000e9c0 tx=0x7f4e400ad2f0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.339+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/1520013415 shutdown_connections 2024-09-21T02:48:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.339+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x55765595a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.339+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655959740 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.339+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/1520013415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x5576559590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.339+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/1520013415 >> 172.21.15.79:0/1520013415 conn(0x5576555a6300 msgr2=0x557655954b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.339+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/1520013415 shutdown_connections 2024-09-21T02:48:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.339+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/1520013415 wait complete. 2024-09-21T02:48:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.340+0000 7f4e5d6a3740 1 -- start start 2024-09-21T02:48:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.340+0000 7f4e5d6a3740 1 Processor -- start 2024-09-21T02:48:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.341+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655962850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.341+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x557655962f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.341+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x557655963a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.341+0000 7f4e4f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655962850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.341+0000 7f4e4f400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655962850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34922/0 (socket says 172.21.15.79:34922) 2024-09-21T02:48:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.341+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x557655962f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.342+0000 7f4e4fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x557655963a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.342+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5576557f3ab0 con 0x5576555b21b0 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.342+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557655862570 con 0x5576555914d0 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.342+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x557655962f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47914/0 (socket says 172.21.15.79:47914) 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.342+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3539516524 learned_addr learned my addr 172.21.15.79:0/3539516524 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.342+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55765595ae00 con 0x5576555892f0 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.342+0000 7f4e5d6a3740 10 client.0 _ll_register_callbacks cb 0x557655871100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3539516524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 msgr2=0x557655962850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655962850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3539516524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 msgr2=0x557655963a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x557655963a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3539516524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55765561d790 con 0x5576555914d0 2024-09-21T02:48:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x557655962f10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e400a9f20 tx=0x7f4e400ad420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e3a8d533355c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e39600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:48:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e39600640 1 -- 172.21.15.79:0/3539516524 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400b2050 con 0x5576555914d0 2024-09-21T02:48:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.343+0000 7f4e39600640 1 -- 172.21.15.79:0/3539516524 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4e400c3b50 con 0x5576555914d0 2024-09-21T02:48:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.344+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e400ad4b0 con 0x5576555914d0 2024-09-21T02:48:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.344+0000 7f4e39600640 1 -- 172.21.15.79:0/3539516524 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4e400b73c0 con 0x5576555914d0 2024-09-21T02:48:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.344+0000 7f4e5d6a3740 10 client.26789 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.344+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557655696620 con 0x5576555914d0 2024-09-21T02:48:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.345+0000 7f4e39600640 1 -- 172.21.15.79:0/3539516524 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e400ad4b0 con 0x5576555914d0 2024-09-21T02:48:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.346+0000 7f4e39600640 1 -- 172.21.15.79:0/3539516524 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4e400a94b0 con 0x5576555914d0 2024-09-21T02:48:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.347+0000 7f4e5d6a3740 10 client.26789 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.347+0000 7f4e5d6a3740 10 client.26789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.347+0000 7f4e5d6a3740 20 client.26789 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.347+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557655570d80 0x55765596fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.347+0000 7f4e5d6a3740 4 client.26789 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:48:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.347+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576558ce600 con 0x557655570d80 2024-09-21T02:48:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.347+0000 7f4e4f400640 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557655570d80 0x55765596fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.353+0000 7f4e4f400640 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557655570d80 0x55765596fb60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35fd2d8f298054a9 server_cookie=9f7e130b9e33565 in_seq=0 out_seq=0 2024-09-21T02:48:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.353+0000 7f4e39600640 10 client.26789 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.354+0000 7f4e39600640 1 -- 172.21.15.79:0/3539516524 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576558ce600 con 0x557655570d80 2024-09-21T02:48:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.354+0000 7f4e39600640 10 client.26789 handle_command_reply: tid=0 2024-09-21T02:48:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.354+0000 7f4e5d6a3740 1 client.26789 shutdown 2024-09-21T02:48:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 msgr2=0x557655962f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x557655962f10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e400a9f20 tx=0x7f4e400ad420 comp rx=0 tx=0).stop 2024-09-21T02:48:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 shutdown_connections 2024-09-21T02:48:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557655570d80 0x55765596fb60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555b21b0 0x557655963a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555914d0 0x557655962f10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3539516524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x557655962850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 >> 172.21.15.79:0/3539516524 conn(0x5576555a6300 msgr2=0x5576559530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e39600640 0 client.26789 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 shutdown_connections 2024-09-21T02:48:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.355+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3539516524 wait complete. 2024-09-21T02:48:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.356+0000 7f4e5d6a3740 20 client.26789 trim_cache size 0 max 16384 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.393+0000 7f4e5d6a3740 1 Processor -- start 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.393+0000 7f4e5d6a3740 1 -- start start 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.393+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555892f0 0x557655956300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.393+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555b21b0 0x55765596a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.393+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x557655958cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.393+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501b0c10 con 0x5576555461c0 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501b33e0 con 0x5576555892f0 2024-09-21T02:48:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501b11d0 con 0x5576555b21b0 2024-09-21T02:48:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555892f0 0x557655956300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555b21b0 0x55765596a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555892f0 0x557655956300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47916/0 (socket says 172.21.15.79:47916) 2024-09-21T02:48:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 -- 172.21.15.79:0/2668091256 learned_addr learned my addr 172.21.15.79:0/2668091256 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4fe00640 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x557655958cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 -- 172.21.15.79:0/2668091256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555b21b0 msgr2=0x55765596a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555b21b0 0x55765596a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 -- 172.21.15.79:0/2668091256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 msgr2=0x557655958cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x557655958cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.394+0000 7f4e4f400640 1 -- 172.21.15.79:0/2668091256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557655962f60 con 0x5576555892f0 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.395+0000 7f4e4f400640 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555892f0 0x557655956300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00d8c0 tx=0x7f4e3c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1cdebfbc54aee6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.395+0000 7f4e3be00640 1 -- 172.21.15.79:0/2668091256 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0169b0 con 0x5576555892f0 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.395+0000 7f4e3be00640 1 -- 172.21.15.79:0/2668091256 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e3c025430 con 0x5576555892f0 2024-09-21T02:48:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.395+0000 7f4e3be00640 1 -- 172.21.15.79:0/2668091256 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0143b0 con 0x5576555892f0 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/2668091256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555892f0 msgr2=0x557655956300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555892f0 0x557655956300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00d8c0 tx=0x7f4e3c008040 comp rx=0 tx=0).stop 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/2668091256 shutdown_connections 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x557655958cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555b21b0 0x55765596a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/2668091256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555892f0 0x557655956300 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/2668091256 >> 172.21.15.79:0/2668091256 conn(0x5576555a6300 msgr2=0x557655962850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/2668091256 shutdown_connections 2024-09-21T02:48:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/2668091256 wait complete. 2024-09-21T02:48:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.396+0000 7f4e5d6a3740 1 -- start start 2024-09-21T02:48:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 1 Processor -- start 2024-09-21T02:48:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x55765596a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x5576559691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555b21b0 0x5576559696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501b18a0 con 0x5576555461c0 2024-09-21T02:48:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501b2d10 con 0x5576555b21b0 2024-09-21T02:48:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501b1f70 con 0x5576555892f0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e5d6a3740 10 client.0 _ll_register_callbacks cb 0x7f4e400a9930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x5576559691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x5576559691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34940/0 (socket says 172.21.15.79:34940) 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3343967843 learned_addr learned my addr 172.21.15.79:0/3343967843 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.397+0000 7f4e4f400640 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x55765596a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e4fe00640 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555b21b0 0x5576559696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555b21b0 msgr2=0x5576559696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555b21b0 0x5576559696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3343967843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 msgr2=0x55765596a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x55765596a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e4ea00640 1 -- 172.21.15.79:0/3343967843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557655969cf0 con 0x5576555892f0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e4ea00640 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x5576559691a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x557655962550 tx=0x7f4e40004990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8883eb0bf76b6d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e39600640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e39600640 1 -- 172.21.15.79:0/3343967843 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400ad110 con 0x5576555892f0 2024-09-21T02:48:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e39600640 1 -- 172.21.15.79:0/3343967843 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4e400cf040 con 0x5576555892f0 2024-09-21T02:48:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.398+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e3c025430 con 0x5576555892f0 2024-09-21T02:48:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.399+0000 7f4e39600640 1 -- 172.21.15.79:0/3343967843 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4e400ad4b0 con 0x5576555892f0 2024-09-21T02:48:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.399+0000 7f4e5d6a3740 10 client.26827 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.399+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557655968b40 con 0x5576555892f0 2024-09-21T02:48:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.399+0000 7f4e39600640 1 -- 172.21.15.79:0/3343967843 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e3c025430 con 0x5576555892f0 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.399+0000 7f4e39600640 1 -- 172.21.15.79:0/3343967843 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4e400ac670 con 0x5576555892f0 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.400+0000 7f4e5d6a3740 10 client.26827 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.400+0000 7f4e5d6a3740 10 client.26827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.400+0000 7f4e5d6a3740 20 client.26827 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.400+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5576559da950 0x5576559dcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.400+0000 7f4e5d6a3740 4 client.26827 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.400+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576558ca0b0 con 0x5576559da950 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.400+0000 7f4e4f400640 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5576559da950 0x5576559dcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.401+0000 7f4e39600640 10 client.26827 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.401+0000 7f4e4f400640 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5576559da950 0x5576559dcd70 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c6f12e7aed3a53 server_cookie=9ffa0542aef93e02 in_seq=0 out_seq=0 2024-09-21T02:48:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.416+0000 7f4e39600640 1 -- 172.21.15.79:0/3343967843 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576558ca0b0 con 0x5576559da950 2024-09-21T02:48:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.416+0000 7f4e39600640 10 client.26827 handle_command_reply: tid=0 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.416+0000 7f4e5d6a3740 1 client.26827 shutdown 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 msgr2=0x5576559691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x5576559691a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x557655962550 tx=0x7f4e40004990 comp rx=0 tx=0).stop 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 shutdown_connections 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5576559da950 0x5576559dcd70 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5576555b21b0 0x5576559696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576555892f0 0x5576559691a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e39600640 0 client.26827 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 --2- 172.21.15.79:0/3343967843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576555461c0 0x55765596a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 >> 172.21.15.79:0/3343967843 conn(0x5576555a6300 msgr2=0x557655962820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 shutdown_connections 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 1 -- 172.21.15.79:0/3343967843 wait complete. 2024-09-21T02:48:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.417+0000 7f4e5d6a3740 20 client.26827 trim_cache size 0 max 16384 2024-09-21T02:48:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:48:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:48:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:48:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:48:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4e340b6610 msgr2=0x7f4e340b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4e340b6610 0x7f4e340b8b20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4e48031b50 tx=0x7f4e480093f0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e500770f0 msgr2=0x7f4e501a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e500770f0 0x7f4e501a0c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000e9f0 tx=0x7f4e4000edf0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 shutdown_connections 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4e340b6610 0x7f4e340b8b20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e5010fe30 0x7f4e501a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e500770f0 0x7f4e501a0c10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 --2- 172.21.15.79:0/1563638405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e50075cf0 0x7f4e501a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 >> 172.21.15.79:0/1563638405 conn(0x7f4e500feff0 msgr2=0x7f4e50103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 shutdown_connections 2024-09-21T02:48:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:42.418+0000 7f4e56600640 1 -- 172.21.15.79:0/1563638405 wait complete. 2024-09-21T02:48:43.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:43 smithi148 ceph-mon[34626]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.8 MiB/s wr, 558 op/s 2024-09-21T02:48:43.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:43 smithi098 ceph-mon[34832]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.8 MiB/s wr, 558 op/s 2024-09-21T02:48:43.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:43 smithi079 ceph-mon[30788]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.8 MiB/s wr, 558 op/s 2024-09-21T02:48:45.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:45 smithi148 ceph-mon[34626]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 6.3 MiB/s wr, 566 op/s 2024-09-21T02:48:45.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:45 smithi098 ceph-mon[34832]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 6.3 MiB/s wr, 566 op/s 2024-09-21T02:48:45.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:45 smithi079 ceph-mon[30788]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 6.3 MiB/s wr, 566 op/s 2024-09-21T02:48:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 770.0 s, 481.8 tps, lat 215.048 ms stddev 268.506 2024-09-21T02:48:47.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:47 smithi148 ceph-mon[34626]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 6.5 MiB/s wr, 567 op/s 2024-09-21T02:48:47.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:47 smithi098 ceph-mon[34832]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 6.5 MiB/s wr, 567 op/s 2024-09-21T02:48:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:47 smithi079 ceph-mon[30788]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 6.5 MiB/s wr, 567 op/s 2024-09-21T02:48:49.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:49 smithi148 ceph-mon[34626]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.0 MiB/s wr, 495 op/s 2024-09-21T02:48:49.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:49 smithi098 ceph-mon[34832]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.0 MiB/s wr, 495 op/s 2024-09-21T02:48:49.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:49 smithi079 ceph-mon[30788]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.0 MiB/s wr, 495 op/s 2024-09-21T02:48:51.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:51 smithi148 ceph-mon[34626]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-09-21T02:48:51.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:51 smithi098 ceph-mon[34832]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-09-21T02:48:51.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:51 smithi079 ceph-mon[30788]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-09-21T02:48:51.494 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 775.0 s, 436.6 tps, lat 224.140 ms stddev 263.531 2024-09-21T02:48:53.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:53 smithi148 ceph-mon[34626]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 5.7 MiB/s wr, 564 op/s 2024-09-21T02:48:53.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:53 smithi098 ceph-mon[34832]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 5.7 MiB/s wr, 564 op/s 2024-09-21T02:48:53.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:53 smithi079 ceph-mon[30788]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 5.7 MiB/s wr, 564 op/s 2024-09-21T02:48:55.280 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:55 smithi079 ceph-mon[30788]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-09-21T02:48:55.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:55 smithi148 ceph-mon[34626]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-09-21T02:48:55.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:55 smithi098 ceph-mon[34832]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 5.2 MiB/s wr, 529 op/s 2024-09-21T02:48:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.796+0000 7f384be00640 1 -- 172.21.15.79:0/2368779431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10fc60 msgr2=0x7f384c112170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.796+0000 7f384be00640 1 --2- 172.21.15.79:0/2368779431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10fc60 0x7f384c112170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3844009be0 tx=0x7f384402a6c0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.797+0000 7f384be00640 1 -- 172.21.15.79:0/2368779431 shutdown_connections 2024-09-21T02:48:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.797+0000 7f384be00640 1 --2- 172.21.15.79:0/2368779431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10fc60 0x7f384c112170 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.797+0000 7f384be00640 1 --2- 172.21.15.79:0/2368779431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 0x7f384c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.797+0000 7f384be00640 1 --2- 172.21.15.79:0/2368779431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c10a5a0 0x7f384c10ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.797+0000 7f384be00640 1 -- 172.21.15.79:0/2368779431 >> 172.21.15.79:0/2368779431 conn(0x7f384c070aa0 msgr2=0x7f384c072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.797+0000 7f384be00640 1 -- 172.21.15.79:0/2368779431 shutdown_connections 2024-09-21T02:48:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.797+0000 7f384be00640 1 -- 172.21.15.79:0/2368779431 wait complete. 2024-09-21T02:48:55.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.798+0000 7f384be00640 1 Processor -- start 2024-09-21T02:48:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f384be00640 1 -- start start 2024-09-21T02:48:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f384be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10a5a0 0x7f384c1a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f384be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 0x7f384c1a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f384be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c10fc60 0x7f384c1a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f3843e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 0x7f384c1a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f384aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10a5a0 0x7f384c1a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f3843e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 0x7f384c1a2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35712/0 (socket says 172.21.15.79:35712) 2024-09-21T02:48:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.799+0000 7f384aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10a5a0 0x7f384c1a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34838/0 (socket says 172.21.15.79:34838) 2024-09-21T02:48:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f3843e00640 1 -- 172.21.15.79:0/3417178998 learned_addr learned my addr 172.21.15.79:0/3417178998 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f384c117950 con 0x7f384c10fc60 2024-09-21T02:48:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1177d0 con 0x7f384c10d040 2024-09-21T02:48:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f384c117ad0 con 0x7f384c10a5a0 2024-09-21T02:48:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f384b400640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c10fc60 0x7f384c1a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f3843e00640 1 -- 172.21.15.79:0/3417178998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10a5a0 msgr2=0x7f384c1a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f3843e00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10a5a0 0x7f384c1a2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f3843e00640 1 -- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c10fc60 msgr2=0x7f384c1a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f3843e00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c10fc60 0x7f384c1a3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f3843e00640 1 -- 172.21.15.79:0/3417178998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c1a3f70 con 0x7f384c10d040 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.800+0000 7f384aa00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10a5a0 0x7f384c1a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.801+0000 7f3843e00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 0x7f384c1a2ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f383400a9b0 tx=0x7f38340095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.801+0000 7f3843400640 1 -- 172.21.15.79:0/3417178998 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834023070 con 0x7f384c10d040 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.801+0000 7f3843400640 1 -- 172.21.15.79:0/3417178998 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3834016050 con 0x7f384c10d040 2024-09-21T02:48:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.801+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384c1a4260 con 0x7f384c10d040 2024-09-21T02:48:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.801+0000 7f3843400640 1 -- 172.21.15.79:0/3417178998 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383401e690 con 0x7f384c10d040 2024-09-21T02:48:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.801+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384c113db0 con 0x7f384c10d040 2024-09-21T02:48:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.811+0000 7f3858a2d740 1 Processor -- start 2024-09-21T02:48:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.814+0000 7f3843400640 1 -- 172.21.15.79:0/3417178998 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3834026070 con 0x7f384c10d040 2024-09-21T02:48:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.814+0000 7f3858a2d740 1 -- start start 2024-09-21T02:48:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.814+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cc962b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.814+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc96920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.814+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc97470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.815+0000 7f3858a2d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56338cc096b0 con 0x56338c8ef1b0 2024-09-21T02:48:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.815+0000 7f3858a2d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56338cbf8ae0 con 0x56338c8ce4d0 2024-09-21T02:48:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.815+0000 7f3858a2d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56338cbfc8f0 con 0x56338c8c62f0 2024-09-21T02:48:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.815+0000 7f3843e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc97470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.815+0000 7f3843e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc97470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35722/0 (socket says 172.21.15.79:35722) 2024-09-21T02:48:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.815+0000 7f3843e00640 1 -- 172.21.15.79:0/2457514466 learned_addr learned my addr 172.21.15.79:0/2457514466 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.816+0000 7f384aa00640 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc96920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.816+0000 7f3843e00640 1 -- 172.21.15.79:0/2457514466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 msgr2=0x56338cc96920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.816+0000 7f3843e00640 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc96920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.816+0000 7f3843e00640 1 -- 172.21.15.79:0/2457514466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 msgr2=0x56338cc962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.816+0000 7f3843e00640 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cc962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.816+0000 7f3843e00640 1 -- 172.21.15.79:0/2457514466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338cbc5780 con 0x56338c8ce4d0 2024-09-21T02:48:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.817+0000 7f3843400640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38300b6590 0x7f38300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.817+0000 7f3843400640 1 -- 172.21.15.79:0/3417178998 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f38340eef90 con 0x7f384c10d040 2024-09-21T02:48:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.817+0000 7f3843e00640 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc97470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f38340f2fd0 tx=0x7f38340f7640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a54b299b3e2343e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.818+0000 7f383be00640 1 -- 172.21.15.79:0/2457514466 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b0c10 con 0x56338c8ce4d0 2024-09-21T02:48:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.818+0000 7f383be00640 1 -- 172.21.15.79:0/2457514466 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38340b4880 con 0x56338c8ce4d0 2024-09-21T02:48:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.818+0000 7f383be00640 1 -- 172.21.15.79:0/2457514466 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b44e0 con 0x56338c8ce4d0 2024-09-21T02:48:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.819+0000 7f3858a2d740 1 -- 172.21.15.79:0/2457514466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 msgr2=0x56338cc97470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.819+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc97470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f38340f2fd0 tx=0x7f38340f7640 comp rx=0 tx=0).stop 2024-09-21T02:48:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.819+0000 7f384b400640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38300b6590 0x7f38300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.820+0000 7f3858a2d740 1 -- 172.21.15.79:0/2457514466 shutdown_connections 2024-09-21T02:48:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.820+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc97470 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.820+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc96920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.820+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2457514466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cc962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.820+0000 7f3858a2d740 1 -- 172.21.15.79:0/2457514466 >> 172.21.15.79:0/2457514466 conn(0x56338c8e3300 msgr2=0x56338cc91d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.821+0000 7f384b400640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38300b6590 0x7f38300b8aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3844006010 tx=0x7f3844030990 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.822+0000 7f3858a2d740 1 -- 172.21.15.79:0/2457514466 shutdown_connections 2024-09-21T02:48:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.822+0000 7f3858a2d740 1 -- 172.21.15.79:0/2457514466 wait complete. 2024-09-21T02:48:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.823+0000 7f3858a2d740 1 -- start start 2024-09-21T02:48:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.824+0000 7f3858a2d740 1 Processor -- start 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc9f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc9fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cca0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f3858a2d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56338cb30ab0 con 0x56338c8ef1b0 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f3858a2d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56338cb9f570 con 0x56338c8ce4d0 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f3858a2d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56338cc97e10 con 0x56338c8c62f0 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f3858a2d740 10 client.0 _ll_register_callbacks cb 0x56338cbae100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f384aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc9f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f384aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc9f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34856/0 (socket says 172.21.15.79:34856) 2024-09-21T02:48:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.825+0000 7f384aa00640 1 -- 172.21.15.79:0/2845054643 learned_addr learned my addr 172.21.15.79:0/2845054643 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f3843e00640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc9fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f384b400640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cca0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f384aa00640 1 -- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 msgr2=0x56338cc9fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f384aa00640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc9fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f384aa00640 1 -- 172.21.15.79:0/2845054643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 msgr2=0x56338cca0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f384aa00640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cca0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f384aa00640 1 -- 172.21.15.79:0/2845054643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56338c95a790 con 0x56338c8c62f0 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.826+0000 7f384b400640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cca0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.827+0000 7f384aa00640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc9f7e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f383c0139f0 tx=0x7f383c013eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4aace6d21053f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.827+0000 7f3838c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:48:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.827+0000 7f3838c00640 1 -- 172.21.15.79:0/2845054643 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c020060 con 0x56338c8c62f0 2024-09-21T02:48:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.827+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38340b4880 con 0x56338c8c62f0 2024-09-21T02:48:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.827+0000 7f3838c00640 1 -- 172.21.15.79:0/2845054643 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f383c011db0 con 0x56338c8c62f0 2024-09-21T02:48:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.828+0000 7f3838c00640 1 -- 172.21.15.79:0/2845054643 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f383c027050 con 0x56338c8c62f0 2024-09-21T02:48:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.828+0000 7f3858a2d740 10 client.26836 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.828+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56338c9d3620 con 0x56338c8c62f0 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.828+0000 7f3838c00640 1 -- 172.21.15.79:0/2845054643 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38340b4880 con 0x56338c8c62f0 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.828+0000 7f3838c00640 1 -- 172.21.15.79:0/2845054643 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f383c00f450 con 0x56338c8c62f0 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.829+0000 7f3858a2d740 10 client.26836 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.829+0000 7f3858a2d740 10 client.26836 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.829+0000 7f3858a2d740 20 client.26836 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.829+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8add80 0x56338ccad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.829+0000 7f3858a2d740 4 client.26836 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.829+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56338cc0b600 con 0x56338c8add80 2024-09-21T02:48:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.829+0000 7f3843e00640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8add80 0x56338ccad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.830+0000 7f3838c00640 10 client.26836 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.830+0000 7f3843e00640 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8add80 0x56338ccad030 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dab8e35f55cf08f3 server_cookie=84c06a2ed5f6d0a7 in_seq=0 out_seq=0 2024-09-21T02:48:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.831+0000 7f3838c00640 1 -- 172.21.15.79:0/2845054643 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56338cc0b600 con 0x56338c8add80 2024-09-21T02:48:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.831+0000 7f3838c00640 10 client.26836 handle_command_reply: tid=0 2024-09-21T02:48:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.831+0000 7f3858a2d740 1 client.26836 shutdown 2024-09-21T02:48:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.831+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 msgr2=0x56338cc9f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.831+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc9f7e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f383c0139f0 tx=0x7f383c013eb0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 shutdown_connections 2024-09-21T02:48:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8add80 0x56338ccad030 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8ef1b0 0x56338cca0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ce4d0 0x56338cc9fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 --2- 172.21.15.79:0/2845054643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8c62f0 0x56338cc9f7e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3838c00640 0 client.26836 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 >> 172.21.15.79:0/2845054643 conn(0x56338c8e3300 msgr2=0x56338cc90360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 shutdown_connections 2024-09-21T02:48:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 1 -- 172.21.15.79:0/2845054643 wait complete. 2024-09-21T02:48:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.832+0000 7f3858a2d740 20 client.26836 trim_cache size 0 max 16384 2024-09-21T02:48:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.851+0000 7f3858a2d740 1 Processor -- start 2024-09-21T02:48:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3858a2d740 1 -- start start 2024-09-21T02:48:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cc90360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cc908a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3858a2d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1b0bd0 con 0x56338c8c62f0 2024-09-21T02:48:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3858a2d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1b3450 con 0x56338c8ef1b0 2024-09-21T02:48:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3858a2d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1b1240 con 0x56338c8ce4d0 2024-09-21T02:48:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3843e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3843e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34864/0 (socket says 172.21.15.79:34864) 2024-09-21T02:48:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f384b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cc908a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f3843e00640 1 -- 172.21.15.79:0/1450151880 learned_addr learned my addr 172.21.15.79:0/1450151880 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.852+0000 7f384aa00640 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cc90360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f3843e00640 1 -- 172.21.15.79:0/1450151880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 msgr2=0x56338cc908a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f3843e00640 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cc908a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f3843e00640 1 -- 172.21.15.79:0/1450151880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 msgr2=0x56338cc90360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f3843e00640 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cc90360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f3843e00640 1 -- 172.21.15.79:0/1450151880 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338cca0d80 con 0x56338c8ce4d0 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f384b400640 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cc908a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f384aa00640 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cc90360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f3843e00640 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca78f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38340eca50 tx=0x7f3834009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d45463bf0f72fc7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f383b400640 1 -- 172.21.15.79:0/1450151880 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b46c0 con 0x56338c8ce4d0 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f383b400640 1 -- 172.21.15.79:0/1450151880 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38340f2ce0 con 0x56338c8ce4d0 2024-09-21T02:48:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.853+0000 7f383b400640 1 -- 172.21.15.79:0/1450151880 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b4b40 con 0x56338c8ce4d0 2024-09-21T02:48:55.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 -- 172.21.15.79:0/1450151880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 msgr2=0x56338cca78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca78f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38340eca50 tx=0x7f3834009f90 comp rx=0 tx=0).stop 2024-09-21T02:48:55.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 -- 172.21.15.79:0/1450151880 shutdown_connections 2024-09-21T02:48:55.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cc908a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca78f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 --2- 172.21.15.79:0/1450151880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cc90360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 -- 172.21.15.79:0/1450151880 >> 172.21.15.79:0/1450151880 conn(0x56338c8e3300 msgr2=0x56338cc9dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 -- 172.21.15.79:0/1450151880 shutdown_connections 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.854+0000 7f3858a2d740 1 -- 172.21.15.79:0/1450151880 wait complete. 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 -- start start 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 Processor -- start 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cca75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cca6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1b1910 con 0x56338c8c62f0 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1b2d80 con 0x56338c8ef1b0 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1b1fe0 con 0x56338c8ce4d0 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.855+0000 7f3858a2d740 10 client.0 _ll_register_callbacks cb 0x7f383c009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:48:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34868/0 (socket says 172.21.15.79:34868) 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 -- 172.21.15.79:0/3234500559 learned_addr learned my addr 172.21.15.79:0/3234500559 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f384b400640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cca6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f384aa00640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cca75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 -- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 msgr2=0x56338cca6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cca6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 -- 172.21.15.79:0/3234500559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 msgr2=0x56338cca75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cca75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f3843e00640 1 -- 172.21.15.79:0/3234500559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56338cca6fe0 con 0x56338c8ce4d0 2024-09-21T02:48:55.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.856+0000 7f384aa00640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cca75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:48:55.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.860+0000 7f3843e00640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca62b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f383400a980 tx=0x7f383400ab80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5830e308857a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:48:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.860+0000 7f3838c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:48:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.860+0000 7f3838c00640 1 -- 172.21.15.79:0/3234500559 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834064070 con 0x56338c8ce4d0 2024-09-21T02:48:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.860+0000 7f3838c00640 1 -- 172.21.15.79:0/3234500559 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3834064210 con 0x56338c8ce4d0 2024-09-21T02:48:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.860+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38340f2ce0 con 0x56338c8ce4d0 2024-09-21T02:48:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3838c00640 1 -- 172.21.15.79:0/3234500559 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f38340b4b40 con 0x56338c8ce4d0 2024-09-21T02:48:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3858a2d740 10 client.26842 fetch_fsmap learned FSMap version 21 2024-09-21T02:48:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56338cd179f0 con 0x56338c8ce4d0 2024-09-21T02:48:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3838c00640 1 -- 172.21.15.79:0/3234500559 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38340f2ce0 con 0x56338c8ce4d0 2024-09-21T02:48:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3838c00640 1 -- 172.21.15.79:0/3234500559 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f38340f21b0 con 0x56338c8ce4d0 2024-09-21T02:48:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3858a2d740 10 client.26842 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:48:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3858a2d740 10 client.26842 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:48:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.861+0000 7f3858a2d740 20 client.26842 populate_metadata read hostname 'smithi079' 2024-09-21T02:48:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.862+0000 7f3858a2d740 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8831c0 0x56338cd19e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:48:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.862+0000 7f3858a2d740 4 client.26842 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:48:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.862+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56338cc070b0 con 0x56338c8831c0 2024-09-21T02:48:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.862+0000 7f384aa00640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8831c0 0x56338cd19e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:48:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.862+0000 7f384aa00640 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8831c0 0x56338cd19e30 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4369e786ae3ec51 server_cookie=1c806a62f38fc881 in_seq=0 out_seq=0 2024-09-21T02:48:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.862+0000 7f3838c00640 10 client.26842 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.968+0000 7f3838c00640 1 -- 172.21.15.79:0/3234500559 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56338cc070b0 con 0x56338c8831c0 2024-09-21T02:48:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.968+0000 7f3838c00640 10 client.26842 handle_command_reply: tid=0 2024-09-21T02:48:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.968+0000 7f3858a2d740 1 client.26842 shutdown 2024-09-21T02:48:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.970+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 msgr2=0x56338cca62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.970+0000 7f3858a2d740 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca62b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f383400a980 tx=0x7f383400ab80 comp rx=0 tx=0).stop 2024-09-21T02:48:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 shutdown_connections 2024-09-21T02:48:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x56338c8831c0 0x56338cd19e30 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56338c8ef1b0 0x56338cca6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56338c8ce4d0 0x56338cca62b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 --2- 172.21.15.79:0/3234500559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56338c8c62f0 0x56338cca75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3838c00640 0 client.26842 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:48:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 >> 172.21.15.79:0/3234500559 conn(0x56338c8e3300 msgr2=0x56338cc9a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 shutdown_connections 2024-09-21T02:48:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 1 -- 172.21.15.79:0/3234500559 wait complete. 2024-09-21T02:48:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.974+0000 7f3858a2d740 20 client.26842 trim_cache size 0 max 16384 2024-09-21T02:48:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:48:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:48:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:48:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:48:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38300b6590 msgr2=0x7f38300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38300b6590 0x7f38300b8aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3844006010 tx=0x7f3844030990 comp rx=0 tx=0).stop 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 msgr2=0x7f384c1a2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 0x7f384c1a2ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f383400a9b0 tx=0x7f38340095b0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 shutdown_connections 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f38300b6590 0x7f38300b8aa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f384c10fc60 0x7f384c1a3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f384c10d040 0x7f384c1a2ba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 --2- 172.21.15.79:0/3417178998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f384c10a5a0 0x7f384c1a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 >> 172.21.15.79:0/3417178998 conn(0x7f384c070aa0 msgr2=0x7f384c10b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 shutdown_connections 2024-09-21T02:48:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:48:55.976+0000 7f384be00640 1 -- 172.21.15.79:0/3417178998 wait complete. 2024-09-21T02:48:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 780.0 s, 455.6 tps, lat 222.846 ms stddev 281.637 2024-09-21T02:48:57.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:57 smithi148 ceph-mon[34626]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-09-21T02:48:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:57 smithi098 ceph-mon[34832]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-09-21T02:48:57.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:57 smithi079 ceph-mon[30788]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-09-21T02:48:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:48:59 smithi098 ceph-mon[34832]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 4.6 MiB/s wr, 504 op/s 2024-09-21T02:48:59.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:48:59 smithi079 ceph-mon[30788]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 4.6 MiB/s wr, 504 op/s 2024-09-21T02:48:59.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:48:59 smithi148 ceph-mon[34626]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 4.6 MiB/s wr, 504 op/s 2024-09-21T02:49:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:01 smithi098 ceph-mon[34832]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2024-09-21T02:49:01.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:01 smithi079 ceph-mon[30788]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2024-09-21T02:49:01.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 785.0 s, 480.6 tps, lat 202.317 ms stddev 235.477 2024-09-21T02:49:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:01 smithi148 ceph-mon[34626]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2024-09-21T02:49:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:03 smithi098 ceph-mon[34832]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 5.3 MiB/s wr, 521 op/s 2024-09-21T02:49:03.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:03 smithi079 ceph-mon[30788]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 5.3 MiB/s wr, 521 op/s 2024-09-21T02:49:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:03 smithi148 ceph-mon[34626]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 5.3 MiB/s wr, 521 op/s 2024-09-21T02:49:05.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:05 smithi098 ceph-mon[34832]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 4.8 MiB/s wr, 485 op/s 2024-09-21T02:49:05.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:05 smithi079 ceph-mon[30788]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 4.8 MiB/s wr, 485 op/s 2024-09-21T02:49:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:05 smithi148 ceph-mon[34626]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 4.8 MiB/s wr, 485 op/s 2024-09-21T02:49:06.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 790.0 s, 481.0 tps, lat 207.261 ms stddev 238.269 2024-09-21T02:49:07.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:07 smithi098 ceph-mon[34832]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2024-09-21T02:49:07.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:07 smithi079 ceph-mon[30788]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2024-09-21T02:49:07.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:07 smithi148 ceph-mon[34626]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2024-09-21T02:49:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.303+0000 7fde7d400640 1 --2- 172.21.15.79:0/2397296636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde8006e2a0 0x7fde8006e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:49:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.304+0000 7fde85000640 1 -- 172.21.15.79:0/2397296636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 msgr2=0x7fde8006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.304+0000 7fde85000640 1 --2- 172.21.15.79:0/2397296636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde8006d690 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde7004c450 comp rx=0 tx=0).stop 2024-09-21T02:49:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.305+0000 7fde85000640 1 -- 172.21.15.79:0/2397296636 shutdown_connections 2024-09-21T02:49:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.305+0000 7fde85000640 1 --2- 172.21.15.79:0/2397296636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8006ec40 0x7fde80113040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.305+0000 7fde85000640 1 --2- 172.21.15.79:0/2397296636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde8006e2a0 0x7fde8006e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.305+0000 7fde85000640 1 --2- 172.21.15.79:0/2397296636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde8006d690 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.305+0000 7fde85000640 1 -- 172.21.15.79:0/2397296636 >> 172.21.15.79:0/2397296636 conn(0x7fde800fddd0 msgr2=0x7fde80100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.306+0000 7fde85000640 1 -- 172.21.15.79:0/2397296636 shutdown_connections 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.306+0000 7fde85000640 1 -- 172.21.15.79:0/2397296636 wait complete. 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.308+0000 7fde85000640 1 Processor -- start 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.308+0000 7fde85000640 1 -- start start 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.308+0000 7fde85000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde801127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.308+0000 7fde85000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8006e2a0 0x7fde80112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.308+0000 7fde85000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde8006ec40 0x7fde801022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde85000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010c230 con 0x7fde8006ec40 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde85000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010c0b0 con 0x7fde8006d220 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde85000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010c3b0 con 0x7fde8006e2a0 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde801127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde801127d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59436/0 (socket says 172.21.15.79:59436) 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 -- 172.21.15.79:0/1664371404 learned_addr learned my addr 172.21.15.79:0/1664371404 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7d400640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8006e2a0 0x7fde80112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7e800640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde8006ec40 0x7fde801022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 -- 172.21.15.79:0/1664371404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8006e2a0 msgr2=0x7fde80112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8006e2a0 0x7fde80112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 -- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde8006ec40 msgr2=0x7fde801022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde8006ec40 0x7fde801022c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.309+0000 7fde7de00640 1 -- 172.21.15.79:0/1664371404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde80102a50 con 0x7fde8006d220 2024-09-21T02:49:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.314+0000 7fde7de00640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde801127d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fde70000c00 tx=0x7fde70003e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.314+0000 7fde76a00640 1 -- 172.21.15.79:0/1664371404 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70062030 con 0x7fde8006d220 2024-09-21T02:49:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.314+0000 7fde76a00640 1 -- 172.21.15.79:0/1664371404 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde70005160 con 0x7fde8006d220 2024-09-21T02:49:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.314+0000 7fde76a00640 1 -- 172.21.15.79:0/1664371404 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7005e810 con 0x7fde8006d220 2024-09-21T02:49:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.315+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde80102ce0 con 0x7fde8006d220 2024-09-21T02:49:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.315+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde801092e0 con 0x7fde8006d220 2024-09-21T02:49:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.320+0000 7fde8c056740 1 Processor -- start 2024-09-21T02:49:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.320+0000 7fde8c056740 1 -- start start 2024-09-21T02:49:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.320+0000 7fde8c056740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae0c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde8c056740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae0c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde8c056740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa444d0 0x5567dae0d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde8c056740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5567dad7f6b0 con 0x5567daa651b0 2024-09-21T02:49:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde8c056740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5567dad6eae0 con 0x5567daa3c2f0 2024-09-21T02:49:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde7e800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae0c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde8c056740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5567dad728f0 con 0x5567daa444d0 2024-09-21T02:49:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde7d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa444d0 0x5567dae0d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde7d400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa444d0 0x5567dae0d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40072/0 (socket says 172.21.15.79:40072) 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.321+0000 7fde7d400640 1 -- 172.21.15.79:0/1593679401 learned_addr learned my addr 172.21.15.79:0/1593679401 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.322+0000 7fde7e800640 1 -- 172.21.15.79:0/1593679401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa444d0 msgr2=0x5567dae0d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.322+0000 7fde7e800640 1 --2- 172.21.15.79:0/1593679401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa444d0 0x5567dae0d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.322+0000 7fde7e800640 1 -- 172.21.15.79:0/1593679401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 msgr2=0x5567dae0c920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.322+0000 7fde7e800640 1 --2- 172.21.15.79:0/1593679401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae0c920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.323+0000 7fde7e800640 1 -- 172.21.15.79:0/1593679401 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dad3b780 con 0x5567daa651b0 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.323+0000 7fde7e800640 1 --2- 172.21.15.79:0/1593679401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae0c2b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fde78009f00 tx=0x7fde78011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a3218b1d539103 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.324+0000 7fde76a00640 1 -- 172.21.15.79:0/1664371404 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fde70065030 con 0x7fde8006d220 2024-09-21T02:49:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.324+0000 7fde6b400640 1 -- 172.21.15.79:0/1593679401 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78004d20 con 0x5567daa651b0 2024-09-21T02:49:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.324+0000 7fde6b400640 1 -- 172.21.15.79:0/1593679401 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde78004030 con 0x5567daa651b0 2024-09-21T02:49:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.325+0000 7fde8c056740 1 -- 172.21.15.79:0/1593679401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 msgr2=0x5567dae0c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.325+0000 7fde8c056740 1 --2- 172.21.15.79:0/1593679401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae0c2b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fde78009f00 tx=0x7fde78011810 comp rx=0 tx=0).stop 2024-09-21T02:49:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.326+0000 7fde8c056740 1 -- 172.21.15.79:0/1593679401 shutdown_connections 2024-09-21T02:49:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.326+0000 7fde8c056740 1 --2- 172.21.15.79:0/1593679401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa444d0 0x5567dae0d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.326+0000 7fde8c056740 1 --2- 172.21.15.79:0/1593679401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae0c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.326+0000 7fde8c056740 1 --2- 172.21.15.79:0/1593679401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae0c2b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.326+0000 7fde8c056740 1 -- 172.21.15.79:0/1593679401 >> 172.21.15.79:0/1593679401 conn(0x5567daa59300 msgr2=0x5567dae07d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.331+0000 7fde8c056740 1 -- 172.21.15.79:0/1593679401 shutdown_connections 2024-09-21T02:49:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.331+0000 7fde8c056740 1 -- 172.21.15.79:0/1593679401 wait complete. 2024-09-21T02:49:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.332+0000 7fde8c056740 1 -- start start 2024-09-21T02:49:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.332+0000 7fde8c056740 1 Processor -- start 2024-09-21T02:49:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.332+0000 7fde76a00640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde640b64d0 0x7fde640b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.333+0000 7fde76a00640 1 -- 172.21.15.79:0/1664371404 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fde70129d60 con 0x7fde8006d220 2024-09-21T02:49:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.333+0000 7fde7e800640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde640b64d0 0x7fde640b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.334+0000 7fde7e800640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde640b64d0 0x7fde640b89e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fde78011d10 tx=0x7fde78005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.335+0000 7fde8c056740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa3c2f0 0x5567dae15940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.335+0000 7fde8c056740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae16000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.335+0000 7fde8c056740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae16b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.335+0000 7fde8c056740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5567daca6ab0 con 0x5567daa651b0 2024-09-21T02:49:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.335+0000 7fde8c056740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5567dad15570 con 0x5567daa444d0 2024-09-21T02:49:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.335+0000 7fde8c056740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5567dae0dfe0 con 0x5567daa3c2f0 2024-09-21T02:49:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.335+0000 7fde8c056740 10 client.0 _ll_register_callbacks cb 0x5567dad24100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.336+0000 7fde7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae16000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.336+0000 7fde7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae16000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59444/0 (socket says 172.21.15.79:59444) 2024-09-21T02:49:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.336+0000 7fde7d400640 1 -- 172.21.15.79:0/2280799386 learned_addr learned my addr 172.21.15.79:0/2280799386 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.337+0000 7fde7de00640 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa3c2f0 0x5567dae15940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.337+0000 7fde7de00640 1 -- 172.21.15.79:0/2280799386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 msgr2=0x5567dae16000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.337+0000 7fde7de00640 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae16000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.337+0000 7fde7de00640 1 -- 172.21.15.79:0/2280799386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 msgr2=0x5567dae16b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.337+0000 7fde7de00640 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae16b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.337+0000 7fde7de00640 1 -- 172.21.15.79:0/2280799386 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567daad0790 con 0x5567daa3c2f0 2024-09-21T02:49:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.338+0000 7fde7de00640 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa3c2f0 0x5567dae15940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fde70127450 tx=0x7fde700ef970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61fe94471978de49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.338+0000 7fde5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:49:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.339+0000 7fde5fe00640 1 -- 172.21.15.79:0/2280799386 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7006c070 con 0x5567daa3c2f0 2024-09-21T02:49:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.339+0000 7fde5fe00640 1 -- 172.21.15.79:0/2280799386 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fde70004370 con 0x5567daa3c2f0 2024-09-21T02:49:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.339+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde78004030 con 0x5567daa3c2f0 2024-09-21T02:49:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.339+0000 7fde5fe00640 1 -- 172.21.15.79:0/2280799386 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fde70005610 con 0x5567daa3c2f0 2024-09-21T02:49:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.339+0000 7fde8c056740 10 client.26854 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.339+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5567dab49620 con 0x5567daa3c2f0 2024-09-21T02:49:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde5fe00640 1 -- 172.21.15.79:0/2280799386 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde78004030 con 0x5567daa3c2f0 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde5fe00640 1 -- 172.21.15.79:0/2280799386 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fde700f41c0 con 0x5567daa3c2f0 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde8c056740 10 client.26854 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde8c056740 10 client.26854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde8c056740 20 client.26854 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde8c056740 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567daa23d80 0x5567dae232f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde8c056740 4 client.26854 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567dad81600 con 0x5567daa23d80 2024-09-21T02:49:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.340+0000 7fde7d400640 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567daa23d80 0x5567dae232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.342+0000 7fde7d400640 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567daa23d80 0x5567dae232f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04c12738371c5a0 server_cookie=62febe33f8f944d2 in_seq=0 out_seq=0 2024-09-21T02:49:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.342+0000 7fde5fe00640 10 client.26854 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.343+0000 7fde5fe00640 1 -- 172.21.15.79:0/2280799386 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567dad81600 con 0x5567daa23d80 2024-09-21T02:49:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.343+0000 7fde5fe00640 10 client.26854 handle_command_reply: tid=0 2024-09-21T02:49:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.343+0000 7fde8c056740 1 client.26854 shutdown 2024-09-21T02:49:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa3c2f0 msgr2=0x5567dae15940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa3c2f0 0x5567dae15940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fde70127450 tx=0x7fde700ef970 comp rx=0 tx=0).stop 2024-09-21T02:49:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 shutdown_connections 2024-09-21T02:49:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567daa23d80 0x5567dae232f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa651b0 0x5567dae16b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae16000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 --2- 172.21.15.79:0/2280799386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa3c2f0 0x5567dae15940 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 >> 172.21.15.79:0/2280799386 conn(0x5567daa59300 msgr2=0x5567dae06360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.345+0000 7fde5fe00640 0 client.26854 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.346+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 shutdown_connections 2024-09-21T02:49:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.346+0000 7fde8c056740 1 -- 172.21.15.79:0/2280799386 wait complete. 2024-09-21T02:49:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.347+0000 7fde8c056740 20 client.26854 trim_cache size 0 max 16384 2024-09-21T02:49:09.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 Processor -- start 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 -- start start 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa3c2f0 0x5567dae10ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae08180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde801b0b20 con 0x5567daa3c2f0 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde801b33e0 con 0x5567daa444d0 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde8c056740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fde801b11d0 con 0x5567daa651b0 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.379+0000 7fde7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae08180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae08180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59452/0 (socket says 172.21.15.79:59452) 2024-09-21T02:49:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 -- 172.21.15.79:0/3407378212 learned_addr learned my addr 172.21.15.79:0/3407378212 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7e800640 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 -- 172.21.15.79:0/3407378212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 msgr2=0x5567dae086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 -- 172.21.15.79:0/3407378212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa3c2f0 msgr2=0x5567dae10ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa3c2f0 0x5567dae10ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 -- 172.21.15.79:0/3407378212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dae16ee0 con 0x5567daa444d0 2024-09-21T02:49:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7e800640 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:49:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.380+0000 7fde7d400640 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae08180 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00aa80 tx=0x7fde6c013830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb76438d34c4c37a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.381+0000 7fde6aa00640 1 -- 172.21.15.79:0/3407378212 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c0130d0 con 0x5567daa444d0 2024-09-21T02:49:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.381+0000 7fde6aa00640 1 -- 172.21.15.79:0/3407378212 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde6c013270 con 0x5567daa444d0 2024-09-21T02:49:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.381+0000 7fde6aa00640 1 -- 172.21.15.79:0/3407378212 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c011440 con 0x5567daa444d0 2024-09-21T02:49:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.382+0000 7fde8c056740 1 -- 172.21.15.79:0/3407378212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 msgr2=0x5567dae08180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.382+0000 7fde8c056740 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae08180 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00aa80 tx=0x7fde6c013830 comp rx=0 tx=0).stop 2024-09-21T02:49:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.382+0000 7fde8c056740 1 -- 172.21.15.79:0/3407378212 shutdown_connections 2024-09-21T02:49:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.382+0000 7fde8c056740 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.383+0000 7fde8c056740 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa444d0 0x5567dae08180 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.383+0000 7fde8c056740 1 --2- 172.21.15.79:0/3407378212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa3c2f0 0x5567dae10ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.383+0000 7fde8c056740 1 -- 172.21.15.79:0/3407378212 >> 172.21.15.79:0/3407378212 conn(0x5567daa59300 msgr2=0x5567dae103c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.384+0000 7fde8c056740 1 -- 172.21.15.79:0/3407378212 shutdown_connections 2024-09-21T02:49:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.384+0000 7fde8c056740 1 -- 172.21.15.79:0/3407378212 wait complete. 2024-09-21T02:49:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.385+0000 7fde8c056740 1 -- start start 2024-09-21T02:49:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.385+0000 7fde8c056740 1 Processor -- start 2024-09-21T02:49:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.386+0000 7fde8c056740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae1cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.386+0000 7fde8c056740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa444d0 0x5567dae1d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.386+0000 7fde8c056740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae85f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.386+0000 7fde8c056740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde801b18a0 con 0x5567daa444d0 2024-09-21T02:49:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.386+0000 7fde8c056740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde801b2d10 con 0x5567daa3c2f0 2024-09-21T02:49:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.386+0000 7fde8c056740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fde801b1f70 con 0x5567daa651b0 2024-09-21T02:49:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.386+0000 7fde8c056740 10 client.0 _ll_register_callbacks cb 0x7fde70005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.387+0000 7fde7de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae1cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.387+0000 7fde7e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae85f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.387+0000 7fde7de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae1cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59456/0 (socket says 172.21.15.79:59456) 2024-09-21T02:49:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.387+0000 7fde7de00640 1 -- 172.21.15.79:0/300665102 learned_addr learned my addr 172.21.15.79:0/300665102 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.387+0000 7fde7d400640 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa444d0 0x5567dae1d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.388+0000 7fde7de00640 1 -- 172.21.15.79:0/300665102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 msgr2=0x5567dae85f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.388+0000 7fde7de00640 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae85f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.388+0000 7fde7de00640 1 -- 172.21.15.79:0/300665102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa444d0 msgr2=0x5567dae1d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.388+0000 7fde7de00640 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa444d0 0x5567dae1d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.388+0000 7fde7de00640 1 -- 172.21.15.79:0/300665102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567dae866e0 con 0x5567daa3c2f0 2024-09-21T02:49:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.388+0000 7fde7de00640 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae1cd60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fde700ebaf0 tx=0x7fde700eb320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b258604446d1a56e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.388+0000 7fde5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:49:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.389+0000 7fde5fe00640 1 -- 172.21.15.79:0/300665102 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70005610 con 0x5567daa3c2f0 2024-09-21T02:49:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.389+0000 7fde5fe00640 1 -- 172.21.15.79:0/300665102 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fde70004370 con 0x5567daa3c2f0 2024-09-21T02:49:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.389+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde6c013270 con 0x5567daa3c2f0 2024-09-21T02:49:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.390+0000 7fde5fe00640 1 -- 172.21.15.79:0/300665102 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fde700ec130 con 0x5567daa3c2f0 2024-09-21T02:49:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.390+0000 7fde8c056740 10 client.26828 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.390+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5567dae8d980 con 0x5567daa3c2f0 2024-09-21T02:49:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.391+0000 7fde5fe00640 1 -- 172.21.15.79:0/300665102 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde6c013270 con 0x5567daa3c2f0 2024-09-21T02:49:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.391+0000 7fde5fe00640 1 -- 172.21.15.79:0/300665102 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fde700f41c0 con 0x5567daa3c2f0 2024-09-21T02:49:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.391+0000 7fde8c056740 10 client.26828 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.391+0000 7fde8c056740 10 client.26828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.392+0000 7fde8c056740 20 client.26828 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.392+0000 7fde8c056740 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567da9f91c0 0x5567dae90210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.392+0000 7fde8c056740 4 client.26828 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:49:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.392+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5567dad7d0b0 con 0x5567da9f91c0 2024-09-21T02:49:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.393+0000 7fde7d400640 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567da9f91c0 0x5567dae90210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.394+0000 7fde5fe00640 10 client.26828 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.394+0000 7fde7d400640 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567da9f91c0 0x5567dae90210 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48bc94ee06ba2801 server_cookie=857e76b9cd519298 in_seq=0 out_seq=0 2024-09-21T02:49:09.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:09 smithi098 ceph-mon[34832]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 4.6 MiB/s wr, 468 op/s 2024-09-21T02:49:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.420+0000 7fde5fe00640 1 -- 172.21.15.79:0/300665102 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5567dad7d0b0 con 0x5567da9f91c0 2024-09-21T02:49:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.420+0000 7fde5fe00640 10 client.26828 handle_command_reply: tid=0 2024-09-21T02:49:09.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.420+0000 7fde8c056740 1 client.26828 shutdown 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 msgr2=0x5567dae1cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae1cd60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fde700ebaf0 tx=0x7fde700eb320 comp rx=0 tx=0).stop 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 shutdown_connections 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5567da9f91c0 0x5567dae90210 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567daa651b0 0x5567dae85f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5567daa444d0 0x5567dae1d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde5fe00640 0 client.26828 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 --2- 172.21.15.79:0/300665102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567daa3c2f0 0x5567dae1cd60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 >> 172.21.15.79:0/300665102 conn(0x5567daa59300 msgr2=0x5567dae06360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 shutdown_connections 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 1 -- 172.21.15.79:0/300665102 wait complete. 2024-09-21T02:49:09.424 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.421+0000 7fde8c056740 20 client.26828 trim_cache size 0 max 16384 2024-09-21T02:49:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:49:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:49:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:49:09.425 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde640b64d0 msgr2=0x7fde640b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde640b64d0 0x7fde640b89e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fde78011d10 tx=0x7fde78005fd0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 msgr2=0x7fde801127d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde801127d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fde70000c00 tx=0x7fde70003e90 comp rx=0 tx=0).stop 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 shutdown_connections 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fde640b64d0 0x7fde640b89e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde8006ec40 0x7fde801022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8006e2a0 0x7fde80112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 --2- 172.21.15.79:0/1664371404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde8006d220 0x7fde801127d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 >> 172.21.15.79:0/1664371404 conn(0x7fde800fddd0 msgr2=0x7fde80071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 shutdown_connections 2024-09-21T02:49:09.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:09.422+0000 7fde85000640 1 -- 172.21.15.79:0/1664371404 wait complete. 2024-09-21T02:49:09.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:09 smithi079 ceph-mon[30788]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 4.6 MiB/s wr, 468 op/s 2024-09-21T02:49:09.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:09 smithi148 ceph-mon[34626]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 4.6 MiB/s wr, 468 op/s 2024-09-21T02:49:11.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:11 smithi098 ceph-mon[34832]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 4.9 MiB/s wr, 494 op/s 2024-09-21T02:49:11.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:11 smithi079 ceph-mon[30788]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 4.9 MiB/s wr, 494 op/s 2024-09-21T02:49:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 795.0 s, 476.2 tps, lat 205.404 ms stddev 256.530 2024-09-21T02:49:11.565 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:11 smithi148 ceph-mon[34626]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 4.9 MiB/s wr, 494 op/s 2024-09-21T02:49:13.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:13 smithi098 ceph-mon[34832]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 5.2 MiB/s wr, 511 op/s 2024-09-21T02:49:13.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:13 smithi079 ceph-mon[30788]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 5.2 MiB/s wr, 511 op/s 2024-09-21T02:49:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:13 smithi148 ceph-mon[34626]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 5.2 MiB/s wr, 511 op/s 2024-09-21T02:49:15.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:15 smithi098 ceph-mon[34832]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2024-09-21T02:49:15.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:15 smithi079 ceph-mon[30788]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2024-09-21T02:49:15.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:15 smithi148 ceph-mon[34626]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2024-09-21T02:49:16.496 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 800.0 s, 462.2 tps, lat 224.205 ms stddev 256.853 2024-09-21T02:49:17.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:17 smithi098 ceph-mon[34832]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.6 MiB/s wr, 453 op/s 2024-09-21T02:49:17.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:17 smithi079 ceph-mon[30788]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.6 MiB/s wr, 453 op/s 2024-09-21T02:49:17.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:17 smithi148 ceph-mon[34626]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.6 MiB/s wr, 453 op/s 2024-09-21T02:49:19.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:19 smithi098 ceph-mon[34832]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.6 MiB/s wr, 468 op/s 2024-09-21T02:49:19.481 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:19 smithi079 ceph-mon[30788]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.6 MiB/s wr, 468 op/s 2024-09-21T02:49:19.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:19 smithi148 ceph-mon[34626]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.6 MiB/s wr, 468 op/s 2024-09-21T02:49:20.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:20 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:49:20.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:20 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:49:20.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:20 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:49:21.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:21 smithi079 ceph-mon[30788]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 4.7 MiB/s wr, 479 op/s 2024-09-21T02:49:21.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 805.0 s, 488.2 tps, lat 205.754 ms stddev 237.462 2024-09-21T02:49:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:21 smithi148 ceph-mon[34626]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 4.7 MiB/s wr, 479 op/s 2024-09-21T02:49:21.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:21 smithi098 ceph-mon[34832]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 4.7 MiB/s wr, 479 op/s 2024-09-21T02:49:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.718+0000 7f6450a00640 1 -- 172.21.15.79:0/4226896111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c06b4e0 msgr2=0x7f644c108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.718+0000 7f6450a00640 1 --2- 172.21.15.79:0/4226896111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c06b4e0 0x7f644c108740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f643c009900 tx=0x7f643c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.719+0000 7f6450a00640 1 -- 172.21.15.79:0/4226896111 shutdown_connections 2024-09-21T02:49:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.719+0000 7f6450a00640 1 --2- 172.21.15.79:0/4226896111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c10b5e0 0x7f644c10daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.719+0000 7f6450a00640 1 --2- 172.21.15.79:0/4226896111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 0x7f644c10b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.719+0000 7f6450a00640 1 --2- 172.21.15.79:0/4226896111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c06b4e0 0x7f644c108740 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.719+0000 7f6450a00640 1 -- 172.21.15.79:0/4226896111 >> 172.21.15.79:0/4226896111 conn(0x7f644c0fdee0 msgr2=0x7f644c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.719+0000 7f6450a00640 1 -- 172.21.15.79:0/4226896111 shutdown_connections 2024-09-21T02:49:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.719+0000 7f6450a00640 1 -- 172.21.15.79:0/4226896111 wait complete. 2024-09-21T02:49:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.720+0000 7f6450a00640 1 Processor -- start 2024-09-21T02:49:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.721+0000 7f6450a00640 1 -- start start 2024-09-21T02:49:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.721+0000 7f6450a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c06b4e0 0x7f644c19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.721+0000 7f6450a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 0x7f644c19c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.721+0000 7f6450a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c10b5e0 0x7f644c19d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.721+0000 7f6450a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1114e0 con 0x7f644c06b4e0 2024-09-21T02:49:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.721+0000 7f6450a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f644c111360 con 0x7f644c108c80 2024-09-21T02:49:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.721+0000 7f6450a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f644c111660 con 0x7f644c10b5e0 2024-09-21T02:49:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f6449400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 0x7f644c19c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f644a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c10b5e0 0x7f644c19d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f6449400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 0x7f644c19c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47176/0 (socket says 172.21.15.79:47176) 2024-09-21T02:49:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f644a800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c10b5e0 0x7f644c19d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:42934/0 (socket says 172.21.15.79:42934) 2024-09-21T02:49:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f6449400640 1 -- 172.21.15.79:0/3372133373 learned_addr learned my addr 172.21.15.79:0/3372133373 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f6449e00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c06b4e0 0x7f644c19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f644a800640 1 -- 172.21.15.79:0/3372133373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 msgr2=0x7f644c19c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f644a800640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 0x7f644c19c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f644a800640 1 -- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c06b4e0 msgr2=0x7f644c19c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f644a800640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c06b4e0 0x7f644c19c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f644a800640 1 -- 172.21.15.79:0/3372133373 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c19db80 con 0x7f644c10b5e0 2024-09-21T02:49:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.722+0000 7f6449400640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 0x7f644c19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.723+0000 7f644a800640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c10b5e0 0x7f644c19d360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f644400eb20 tx=0x7f644400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.723+0000 7f6442a00640 1 -- 172.21.15.79:0/3372133373 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440039c0 con 0x7f644c10b5e0 2024-09-21T02:49:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.723+0000 7f6442a00640 1 -- 172.21.15.79:0/3372133373 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6444003b60 con 0x7f644c10b5e0 2024-09-21T02:49:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.723+0000 7f6442a00640 1 -- 172.21.15.79:0/3372133373 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444010670 con 0x7f644c10b5e0 2024-09-21T02:49:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.723+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c19de70 con 0x7f644c10b5e0 2024-09-21T02:49:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.723+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1a4560 con 0x7f644c10b5e0 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.727+0000 7f6457ad5740 1 Processor -- start 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.727+0000 7f6442a00640 1 -- 172.21.15.79:0/3372133373 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6444010810 con 0x7f644c10b5e0 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.727+0000 7f6457ad5740 1 -- start start 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x5618574b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570e62f0 0x5618574b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570ee4d0 0x5618574b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6457ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5618574296b0 con 0x5618570e62f0 2024-09-21T02:49:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6457ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561857418ae0 con 0x56185710f1b0 2024-09-21T02:49:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6457ad5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56185741c8f0 con 0x5618570ee4d0 2024-09-21T02:49:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6449400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x5618574b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6449400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x5618574b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47190/0 (socket says 172.21.15.79:47190) 2024-09-21T02:49:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6449400640 1 -- 172.21.15.79:0/1893733584 learned_addr learned my addr 172.21.15.79:0/1893733584 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6449e00640 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570e62f0 0x5618574b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.728+0000 7f6449400640 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570ee4d0 0x5618574b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6449400640 1 -- 172.21.15.79:0/1893733584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570ee4d0 msgr2=0x5618574b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6449400640 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570ee4d0 0x5618574b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6449400640 1 -- 172.21.15.79:0/1893733584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570e62f0 msgr2=0x5618574b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6449400640 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570e62f0 0x5618574b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6449400640 1 -- 172.21.15.79:0/1893733584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618573e5780 con 0x56185710f1b0 2024-09-21T02:49:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6449400640 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x5618574b17a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6438011d40 tx=0x7f6438009cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf3de12f122189a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6442a00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64300b6590 0x7f64300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6437000640 1 -- 172.21.15.79:0/1893733584 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643800fc50 con 0x56185710f1b0 2024-09-21T02:49:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6442a00640 1 -- 172.21.15.79:0/3372133373 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f64440e7e30 con 0x7f644c10b5e0 2024-09-21T02:49:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6437000640 1 -- 172.21.15.79:0/1893733584 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f643800fdf0 con 0x56185710f1b0 2024-09-21T02:49:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.729+0000 7f6437000640 1 -- 172.21.15.79:0/1893733584 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643800e6a0 con 0x56185710f1b0 2024-09-21T02:49:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.730+0000 7f6449e00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64300b6590 0x7f64300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.731+0000 7f6457ad5740 1 -- 172.21.15.79:0/1893733584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 msgr2=0x5618574b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.731+0000 7f6457ad5740 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x5618574b17a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6438011d40 tx=0x7f6438009cc0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.731+0000 7f6449e00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64300b6590 0x7f64300b8aa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f643c031440 tx=0x7f643c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.732+0000 7f6457ad5740 1 -- 172.21.15.79:0/1893733584 shutdown_connections 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.732+0000 7f6457ad5740 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570ee4d0 0x5618574b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.732+0000 7f6457ad5740 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570e62f0 0x5618574b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.732+0000 7f6457ad5740 1 --2- 172.21.15.79:0/1893733584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x5618574b17a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.732+0000 7f6457ad5740 1 -- 172.21.15.79:0/1893733584 >> 172.21.15.79:0/1893733584 conn(0x561857103300 msgr2=0x5618574ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.733+0000 7f6457ad5740 1 -- 172.21.15.79:0/1893733584 shutdown_connections 2024-09-21T02:49:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.734+0000 7f6457ad5740 1 -- 172.21.15.79:0/1893733584 wait complete. 2024-09-21T02:49:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.735+0000 7f6457ad5740 1 -- start start 2024-09-21T02:49:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.735+0000 7f6457ad5740 1 Processor -- start 2024-09-21T02:49:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.736+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.736+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.736+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.736+0000 7f6457ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561857350ab0 con 0x5618570ee4d0 2024-09-21T02:49:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.736+0000 7f6457ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5618573bf570 con 0x5618570e62f0 2024-09-21T02:49:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.736+0000 7f6457ad5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5618574b3240 con 0x56185710f1b0 2024-09-21T02:49:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.736+0000 7f6457ad5740 10 client.0 _ll_register_callbacks cb 0x5618573ce100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47198/0 (socket says 172.21.15.79:47198) 2024-09-21T02:49:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 -- 172.21.15.79:0/2816211156 learned_addr learned my addr 172.21.15.79:0/2816211156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f644a800640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449400640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 -- 172.21.15.79:0/2816211156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 msgr2=0x5618574d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 -- 172.21.15.79:0/2816211156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 msgr2=0x5618574d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 -- 172.21.15.79:0/2816211156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56185717a790 con 0x5618570e62f0 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f644a800640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f6449e00640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574d0840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f643c009900 tx=0x7f643c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fef7bafa786ee6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.737+0000 7f642b400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.738+0000 7f642b400640 1 -- 172.21.15.79:0/2816211156 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c04c070 con 0x5618570e62f0 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.738+0000 7f642b400640 1 -- 172.21.15.79:0/2816211156 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f643c004d90 con 0x5618570e62f0 2024-09-21T02:49:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.738+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f643800fdf0 con 0x5618570e62f0 2024-09-21T02:49:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.738+0000 7f642b400640 1 -- 172.21.15.79:0/2816211156 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f643c058050 con 0x5618570e62f0 2024-09-21T02:49:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.738+0000 7f6457ad5740 10 client.26840 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.738+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5618571f3620 con 0x5618570e62f0 2024-09-21T02:49:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.738+0000 7f642b400640 1 -- 172.21.15.79:0/2816211156 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f643800fdf0 con 0x5618570e62f0 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f642b400640 1 -- 172.21.15.79:0/2816211156 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f643c003ab0 con 0x5618570e62f0 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f6457ad5740 10 client.26840 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f6457ad5740 10 client.26840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f6457ad5740 20 client.26840 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f6457ad5740 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570cdd80 0x5618574de020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f6457ad5740 4 client.26840 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56185742b600 con 0x5618570cdd80 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.739+0000 7f6449400640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570cdd80 0x5618574de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.740+0000 7f6449400640 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570cdd80 0x5618574de020 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c5e6d932561aa2 server_cookie=66656fd7818f4c12 in_seq=0 out_seq=0 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.740+0000 7f642b400640 10 client.26840 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.740+0000 7f642b400640 1 -- 172.21.15.79:0/2816211156 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56185742b600 con 0x5618570cdd80 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.740+0000 7f642b400640 10 client.26840 handle_command_reply: tid=0 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.740+0000 7f6457ad5740 1 client.26840 shutdown 2024-09-21T02:49:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 msgr2=0x5618574d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574d0840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f643c009900 tx=0x7f643c009260 comp rx=0 tx=0).stop 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 shutdown_connections 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570cdd80 0x5618574de020 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f642b400640 0 client.26840 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 --2- 172.21.15.79:0/2816211156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574d0840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 >> 172.21.15.79:0/2816211156 conn(0x561857103300 msgr2=0x5618574b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 shutdown_connections 2024-09-21T02:49:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.741+0000 7f6457ad5740 1 -- 172.21.15.79:0/2816211156 wait complete. 2024-09-21T02:49:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.742+0000 7f6457ad5740 20 client.26840 trim_cache size 0 max 16384 2024-09-21T02:49:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.767+0000 7f6457ad5740 1 Processor -- start 2024-09-21T02:49:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.767+0000 7f6457ad5740 1 -- start start 2024-09-21T02:49:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6457ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1a8580 con 0x5618570ee4d0 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6457ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1aae00 con 0x5618570e62f0 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6457ad5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1a8bf0 con 0x56185710f1b0 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574e37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54264/0 (socket says 172.21.15.79:54264) 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:47212/0 (socket says 172.21.15.79:47212) 2024-09-21T02:49:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449400640 1 -- 172.21.15.79:0/3912888869 learned_addr learned my addr 172.21.15.79:0/3912888869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f644a800640 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449400640 1 -- 172.21.15.79:0/3912888869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 msgr2=0x5618574e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449400640 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449400640 1 -- 172.21.15.79:0/3912888869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 msgr2=0x5618574b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.768+0000 7f6449400640 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.769+0000 7f6449400640 1 -- 172.21.15.79:0/3912888869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618574d1da0 con 0x5618570ee4d0 2024-09-21T02:49:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.769+0000 7f644a800640 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:49:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.769+0000 7f6449e00640 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.769+0000 7f6449400640 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574e37e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6438010010 tx=0x7f643800ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2866dcc7d0b694e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.769+0000 7f6436600640 1 -- 172.21.15.79:0/3912888869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643802e040 con 0x5618570ee4d0 2024-09-21T02:49:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.769+0000 7f6436600640 1 -- 172.21.15.79:0/3912888869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f643800fc20 con 0x5618570ee4d0 2024-09-21T02:49:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.769+0000 7f6436600640 1 -- 172.21.15.79:0/3912888869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438004680 con 0x5618570ee4d0 2024-09-21T02:49:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 -- 172.21.15.79:0/3912888869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 msgr2=0x5618574e37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574e37e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6438010010 tx=0x7f643800ffa0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 -- 172.21.15.79:0/3912888869 shutdown_connections 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56185710f1b0 0x5618574e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x5618574e37e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 --2- 172.21.15.79:0/3912888869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5618570e62f0 0x5618574b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 -- 172.21.15.79:0/3912888869 >> 172.21.15.79:0/3912888869 conn(0x561857103300 msgr2=0x5618574b58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.770+0000 7f6457ad5740 1 -- 172.21.15.79:0/3912888869 shutdown_connections 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.771+0000 7f6457ad5740 1 -- 172.21.15.79:0/3912888869 wait complete. 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.771+0000 7f6457ad5740 1 -- start start 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.771+0000 7f6457ad5740 1 Processor -- start 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570e62f0 0x5618574d88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x561857544a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6457ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x561857547180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6457ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1a92c0 con 0x5618570ee4d0 2024-09-21T02:49:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6457ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1aa730 con 0x56185710f1b0 2024-09-21T02:49:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6457ad5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1a9990 con 0x5618570e62f0 2024-09-21T02:49:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6457ad5740 10 client.0 _ll_register_callbacks cb 0x7f6438005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6449400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x561857544a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6449400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x561857544a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54270/0 (socket says 172.21.15.79:54270) 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f6449400640 1 -- 172.21.15.79:0/659896376 learned_addr learned my addr 172.21.15.79:0/659896376 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.772+0000 7f644a800640 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x561857547180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f644a800640 1 -- 172.21.15.79:0/659896376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570e62f0 msgr2=0x5618574d88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f644a800640 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570e62f0 0x5618574d88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f644a800640 1 -- 172.21.15.79:0/659896376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 msgr2=0x561857544a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f644a800640 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x561857544a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f644a800640 1 -- 172.21.15.79:0/659896376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561857547910 con 0x56185710f1b0 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f644a800640 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x561857547180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f64440e5520 tx=0x7f64440ad630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11275574161962c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f642b400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f642b400640 1 -- 172.21.15.79:0/659896376 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440ad980 con 0x56185710f1b0 2024-09-21T02:49:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f642b400640 1 -- 172.21.15.79:0/659896376 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f64440cfdc0 con 0x56185710f1b0 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.773+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f643800fc20 con 0x56185710f1b0 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f642b400640 1 -- 172.21.15.79:0/659896376 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6444003dc0 con 0x56185710f1b0 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 10 client.26846 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561857548be0 con 0x56185710f1b0 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f642b400640 1 -- 172.21.15.79:0/659896376 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f643800fc20 con 0x56185710f1b0 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f642b400640 1 -- 172.21.15.79:0/659896376 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f64440a9500 con 0x56185710f1b0 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 10 client.26846 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 10 client.26846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 20 client.26846 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570a31c0 0x56185754b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 4 client.26846 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618574270b0 con 0x5618570a31c0 2024-09-21T02:49:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.774+0000 7f6449e00640 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570a31c0 0x56185754b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.775+0000 7f6449e00640 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570a31c0 0x56185754b5d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c252a22674f9d0f server_cookie=75574af696998f5c in_seq=0 out_seq=0 2024-09-21T02:49:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.775+0000 7f642b400640 10 client.26846 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f642b400640 1 -- 172.21.15.79:0/659896376 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618574270b0 con 0x5618570a31c0 2024-09-21T02:49:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f642b400640 10 client.26846 handle_command_reply: tid=0 2024-09-21T02:49:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 client.26846 shutdown 2024-09-21T02:49:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 msgr2=0x561857547180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x561857547180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f64440e5520 tx=0x7f64440ad630 comp rx=0 tx=0).stop 2024-09-21T02:49:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 shutdown_connections 2024-09-21T02:49:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5618570a31c0 0x56185754b5d0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56185710f1b0 0x561857547180 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618570ee4d0 0x561857544a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 --2- 172.21.15.79:0/659896376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618570e62f0 0x5618574d88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 >> 172.21.15.79:0/659896376 conn(0x561857103300 msgr2=0x5618574e27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f642b400640 0 client.26846 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.804+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 shutdown_connections 2024-09-21T02:49:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.806+0000 7f6457ad5740 1 -- 172.21.15.79:0/659896376 wait complete. 2024-09-21T02:49:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.807+0000 7f6457ad5740 20 client.26846 trim_cache size 0 max 16384 2024-09-21T02:49:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:49:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:49:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:49:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64300b6590 msgr2=0x7f64300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64300b6590 0x7f64300b8aa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f643c031440 tx=0x7f643c0314a0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c10b5e0 msgr2=0x7f644c19d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c10b5e0 0x7f644c19d360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f644400eb20 tx=0x7f644400c2d0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 shutdown_connections 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f64300b6590 0x7f64300b8aa0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f644c10b5e0 0x7f644c19d360 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f644c108c80 0x7f644c19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 --2- 172.21.15.79:0/3372133373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f644c06b4e0 0x7f644c19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 >> 172.21.15.79:0/3372133373 conn(0x7f644c0fdee0 msgr2=0x7f644c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 shutdown_connections 2024-09-21T02:49:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:22.809+0000 7f6450a00640 1 -- 172.21.15.79:0/3372133373 wait complete. 2024-09-21T02:49:23.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:23 smithi079 ceph-mon[30788]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 4.7 MiB/s wr, 489 op/s 2024-09-21T02:49:23.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:49:23.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:49:23.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:23 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:49:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:23 smithi148 ceph-mon[34626]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 4.7 MiB/s wr, 489 op/s 2024-09-21T02:49:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:49:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:49:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:23 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:49:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:23 smithi098 ceph-mon[34832]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 4.7 MiB/s wr, 489 op/s 2024-09-21T02:49:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:49:23.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:49:23.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:23 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:49:25.460 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T02:49:25.461 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-21T02:49:25.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:49:25.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:25 smithi079 ceph-mon[30788]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.7 MiB/s wr, 474 op/s 2024-09-21T02:49:25.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:25 smithi148 ceph-mon[34626]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.7 MiB/s wr, 474 op/s 2024-09-21T02:49:25.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:25 smithi098 ceph-mon[34832]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.7 MiB/s wr, 474 op/s 2024-09-21T02:49:26.186 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:49:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 810.0 s, 417.4 tps, lat 235.739 ms stddev 262.905 2024-09-21T02:49:27.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:27 smithi079 ceph-mon[30788]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 432 op/s 2024-09-21T02:49:27.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:27 smithi148 ceph-mon[34626]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 432 op/s 2024-09-21T02:49:27.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:27 smithi098 ceph-mon[34832]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 432 op/s 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.362+0000 7fee2be00640 1 -- 172.21.15.79:0/2000752123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 msgr2=0x7fee2c10aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.362+0000 7fee2be00640 1 --2- 172.21.15.79:0/2000752123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 0x7fee2c10aa50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee24009ca0 tx=0x7fee2402a8f0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.363+0000 7fee2be00640 1 -- 172.21.15.79:0/2000752123 shutdown_connections 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.363+0000 7fee2be00640 1 --2- 172.21.15.79:0/2000752123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c116510 0x7fee2c118990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.363+0000 7fee2be00640 1 --2- 172.21.15.79:0/2000752123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2c10af90 0x7fee2c115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.363+0000 7fee2be00640 1 --2- 172.21.15.79:0/2000752123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 0x7fee2c10aa50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.363+0000 7fee2be00640 1 -- 172.21.15.79:0/2000752123 >> 172.21.15.79:0/2000752123 conn(0x7fee2c06e9f0 msgr2=0x7fee2c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.363+0000 7fee2be00640 1 -- 172.21.15.79:0/2000752123 shutdown_connections 2024-09-21T02:49:29.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.363+0000 7fee2be00640 1 -- 172.21.15.79:0/2000752123 wait complete. 2024-09-21T02:49:29.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.365+0000 7fee2be00640 1 Processor -- start 2024-09-21T02:49:29.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.365+0000 7fee2be00640 1 -- start start 2024-09-21T02:49:29.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.366+0000 7fee2be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 0x7fee2c111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:29.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.366+0000 7fee2be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c10af90 0x7fee2c10e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:29.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.366+0000 7fee2be00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2c116510 0x7fee2c10e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:29.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 0x7fee2c111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:29.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 0x7fee2c111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:45670/0 (socket says 172.21.15.79:45670) 2024-09-21T02:49:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c10af90 0x7fee2c10e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c10af90 0x7fee2c10e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:34160/0 (socket says 172.21.15.79:34160) 2024-09-21T02:49:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2aa00640 1 -- 172.21.15.79:0/2191724186 learned_addr learned my addr 172.21.15.79:0/2191724186 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c11c1f0 con 0x7fee2c116510 2024-09-21T02:49:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c11c070 con 0x7fee2c10a640 2024-09-21T02:49:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2b400640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2c116510 0x7fee2c10e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.367+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c11c370 con 0x7fee2c10af90 2024-09-21T02:49:29.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.369+0000 7fee2a000640 1 -- 172.21.15.79:0/2191724186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 msgr2=0x7fee2c111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:29.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.369+0000 7fee2a000640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 0x7fee2c111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.369+0000 7fee2a000640 1 -- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2c116510 msgr2=0x7fee2c10e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:29.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.369+0000 7fee2a000640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2c116510 0x7fee2c10e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.369+0000 7fee2a000640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c1b5450 con 0x7fee2c10af90 2024-09-21T02:49:29.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.370+0000 7fee2a000640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c10af90 0x7fee2c10e090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee2c06c910 tx=0x7fee1c00b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:29.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.371+0000 7fee23400640 1 -- 172.21.15.79:0/2191724186 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c015020 con 0x7fee2c10af90 2024-09-21T02:49:29.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.371+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c1b5680 con 0x7fee2c10af90 2024-09-21T02:49:29.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.371+0000 7fee23400640 1 -- 172.21.15.79:0/2191724186 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee1c011ce0 con 0x7fee2c10af90 2024-09-21T02:49:29.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.371+0000 7fee23400640 1 -- 172.21.15.79:0/2191724186 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c015020 con 0x7fee2c10af90 2024-09-21T02:49:29.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.371+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c1b5c10 con 0x7fee2c10af90 2024-09-21T02:49:29.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.373+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2c10aad0 con 0x7fee2c10af90 2024-09-21T02:49:29.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.379+0000 7fee23400640 1 -- 172.21.15.79:0/2191724186 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fee1c018020 con 0x7fee2c10af90 2024-09-21T02:49:29.380 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:29 smithi079 ceph-mon[30788]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:49:29.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.384+0000 7fee23400640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fee100b6790 0x7fee100b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:29.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.386+0000 7fee2aa00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fee100b6790 0x7fee100b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:29.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.386+0000 7fee23400640 1 -- 172.21.15.79:0/2191724186 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fee1c0e6bd0 con 0x7fee2c10af90 2024-09-21T02:49:29.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.390+0000 7fee2aa00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fee100b6790 0x7fee100b8ca0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee240098d0 tx=0x7fee24009380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.418+0000 7fee23400640 1 -- 172.21.15.79:0/2191724186 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fee1c0e6e20 con 0x7fee2c10af90 2024-09-21T02:49:29.457 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:29 smithi098 ceph-mon[34832]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:49:29.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:29 smithi148 ceph-mon[34626]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:49:29.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.845+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee2c10f390 con 0x7fee2c10af90 2024-09-21T02:49:29.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.848+0000 7fee23400640 1 -- 172.21.15.79:0/2191724186 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fee1c0b1430 con 0x7fee2c10af90 2024-09-21T02:49:29.851 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:49:29.852 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:49:29.852 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fee100b6790 msgr2=0x7fee100b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fee100b6790 0x7fee100b8ca0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee240098d0 tx=0x7fee24009380 comp rx=0 tx=0).stop 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c10af90 msgr2=0x7fee2c10e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c10af90 0x7fee2c10e090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee2c06c910 tx=0x7fee1c00b850 comp rx=0 tx=0).stop 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 shutdown_connections 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fee100b6790 0x7fee100b8ca0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2c116510 0x7fee2c10e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee2c10af90 0x7fee2c10e090 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 --2- 172.21.15.79:0/2191724186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee2c10a640 0x7fee2c111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:29.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.856+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 >> 172.21.15.79:0/2191724186 conn(0x7fee2c06e9f0 msgr2=0x7fee2c071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:29.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.859+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 shutdown_connections 2024-09-21T02:49:29.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:29.859+0000 7fee2be00640 1 -- 172.21.15.79:0/2191724186 wait complete. 2024-09-21T02:49:30.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:30 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2191724186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:30 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2191724186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:30 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2191724186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:30.826 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-21T02:49:30.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-21T02:49:31.481 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:31 smithi079 ceph-mon[30788]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 4.5 MiB/s wr, 460 op/s 2024-09-21T02:49:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 815.0 s, 402.9 tps, lat 238.531 ms stddev 275.700 2024-09-21T02:49:31.545 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:49:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:31 smithi148 ceph-mon[34626]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 4.5 MiB/s wr, 460 op/s 2024-09-21T02:49:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:31 smithi098 ceph-mon[34832]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 4.5 MiB/s wr, 460 op/s 2024-09-21T02:49:33.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:33 smithi079 ceph-mon[30788]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.6 MiB/s wr, 465 op/s 2024-09-21T02:49:33.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:33 smithi148 ceph-mon[34626]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.6 MiB/s wr, 465 op/s 2024-09-21T02:49:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:33 smithi098 ceph-mon[34832]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.6 MiB/s wr, 465 op/s 2024-09-21T02:49:33.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 -- 172.21.15.79:0/2889064631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e80a5980 msgr2=0x7ff4e80aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:33.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2889064631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e80a5980 0x7ff4e80aaca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00d910 tx=0x7ff4dc02c370 comp rx=0 tx=0).stop 2024-09-21T02:49:33.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 -- 172.21.15.79:0/2889064631 shutdown_connections 2024-09-21T02:49:33.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2889064631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80ab1e0 0x7ff4e80ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2889064631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e80a5980 0x7ff4e80aaca0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2889064631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e8016c50 0x7ff4e80a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 -- 172.21.15.79:0/2889064631 >> 172.21.15.79:0/2889064631 conn(0x7ff4e801d090 msgr2=0x7ff4e80a39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 -- 172.21.15.79:0/2889064631 shutdown_connections 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.805+0000 7ff4f7600640 1 -- 172.21.15.79:0/2889064631 wait complete. 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.809+0000 7ff4f7600640 1 Processor -- start 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.810+0000 7ff4f7600640 1 -- start start 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.811+0000 7ff4f7600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8016c50 0x7ff4e80b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.811+0000 7ff4f7600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e80a5980 0x7ff4e80acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.811+0000 7ff4f7600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80ab1e0 0x7ff4e80ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.811+0000 7ff4f7600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e80b4e90 con 0x7ff4e80ab1e0 2024-09-21T02:49:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.811+0000 7ff4f7600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e80b4d10 con 0x7ff4e8016c50 2024-09-21T02:49:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.811+0000 7ff4f7600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e80b5010 con 0x7ff4e80a5980 2024-09-21T02:49:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f4c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8016c50 0x7ff4e80b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e80a5980 0x7ff4e80acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e80a5980 0x7ff4e80acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51516/0 (socket says 172.21.15.79:51516) 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4efe00640 1 -- 172.21.15.79:0/2515926352 learned_addr learned my addr 172.21.15.79:0/2515926352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f4c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8016c50 0x7ff4e80b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36190/0 (socket says 172.21.15.79:36190) 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f5600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80ab1e0 0x7ff4e80ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f4c00640 1 -- 172.21.15.79:0/2515926352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e80a5980 msgr2=0x7ff4e80acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e80a5980 0x7ff4e80acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f4c00640 1 -- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80ab1e0 msgr2=0x7ff4e80ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80ab1e0 0x7ff4e80ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.812+0000 7ff4f4c00640 1 -- 172.21.15.79:0/2515926352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e813f8c0 con 0x7ff4e8016c50 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.813+0000 7ff4efe00640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e80a5980 0x7ff4e80acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.813+0000 7ff4f5600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80ab1e0 0x7ff4e80ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:49:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.813+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8016c50 0x7ff4e80b0cc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400e9f0 tx=0x7ff4e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.813+0000 7ff4ed600640 1 -- 172.21.15.79:0/2515926352 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400ccc0 con 0x7ff4e8016c50 2024-09-21T02:49:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.813+0000 7ff4ed600640 1 -- 172.21.15.79:0/2515926352 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e40108e0 con 0x7ff4e8016c50 2024-09-21T02:49:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.813+0000 7ff4ed600640 1 -- 172.21.15.79:0/2515926352 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4018880 con 0x7ff4e8016c50 2024-09-21T02:49:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.814+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e813fbb0 con 0x7ff4e8016c50 2024-09-21T02:49:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.814+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e81400a0 con 0x7ff4e8016c50 2024-09-21T02:49:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.817+0000 7ff4fe286740 1 Processor -- start 2024-09-21T02:49:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.818+0000 7ff4fe286740 1 -- start start 2024-09-21T02:49:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.818+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e2480b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.818+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e24810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.818+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e2481610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.818+0000 7ff4fe286740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5602e23f6a90 con 0x5602e20d9850 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.818+0000 7ff4fe286740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602e23e5ec0 con 0x5602e20b0990 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.818+0000 7ff4fe286740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5602e23e9cd0 con 0x5602e20b8b70 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e2480b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e2480b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54136/0 (socket says 172.21.15.79:54136) 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 -- 172.21.15.79:0/4253312355 learned_addr learned my addr 172.21.15.79:0/4253312355 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4efe00640 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e2481610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 -- 172.21.15.79:0/4253312355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 msgr2=0x5602e2481610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e2481610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 -- 172.21.15.79:0/4253312355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 msgr2=0x5602e24810d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:49:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e24810d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.819+0000 7ff4f5600640 1 -- 172.21.15.79:0/4253312355 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e238b9d0 con 0x5602e20d9850 2024-09-21T02:49:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.820+0000 7ff4ed600640 1 -- 172.21.15.79:0/2515926352 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff4e4010430 con 0x7ff4e8016c50 2024-09-21T02:49:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.820+0000 7ff4f5600640 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e2480b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0066c70 tx=0x7ff4f0064940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a905ef66e55f06e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.820+0000 7ff4e1c00640 1 -- 172.21.15.79:0/4253312355 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0078640 con 0x5602e20d9850 2024-09-21T02:49:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.820+0000 7ff4e1c00640 1 -- 172.21.15.79:0/4253312355 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f0078c90 con 0x5602e20d9850 2024-09-21T02:49:33.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.820+0000 7ff4e1c00640 1 -- 172.21.15.79:0/4253312355 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0077d10 con 0x5602e20d9850 2024-09-21T02:49:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.822+0000 7ff4fe286740 1 -- 172.21.15.79:0/4253312355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 msgr2=0x5602e2480b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.822+0000 7ff4fe286740 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e2480b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0066c70 tx=0x7ff4f0064940 comp rx=0 tx=0).stop 2024-09-21T02:49:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.822+0000 7ff4ed600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff4d80b6610 0x7ff4d80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.822+0000 7ff4ed600640 1 -- 172.21.15.79:0/2515926352 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff4e40e7a30 con 0x7ff4e8016c50 2024-09-21T02:49:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.823+0000 7ff4fe286740 1 -- 172.21.15.79:0/4253312355 shutdown_connections 2024-09-21T02:49:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.823+0000 7ff4fe286740 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e2481610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.823+0000 7ff4fe286740 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e24810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.823+0000 7ff4fe286740 1 --2- 172.21.15.79:0/4253312355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e2480b90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.823+0000 7ff4fe286740 1 -- 172.21.15.79:0/4253312355 >> 172.21.15.79:0/4253312355 conn(0x5602e20cdc40 msgr2=0x5602e247ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.823+0000 7ff4f5600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff4d80b6610 0x7ff4d80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.823+0000 7ff4fe286740 1 -- 172.21.15.79:0/4253312355 shutdown_connections 2024-09-21T02:49:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.824+0000 7ff4fe286740 1 -- 172.21.15.79:0/4253312355 wait complete. 2024-09-21T02:49:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.824+0000 7ff4f5600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff4d80b6610 0x7ff4d80b8b20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00524b0 tx=0x7ff4f0051660 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.825+0000 7ff4fe286740 1 -- start start 2024-09-21T02:49:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.825+0000 7ff4fe286740 1 Processor -- start 2024-09-21T02:49:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e24986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4fe286740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5602e22477b0 con 0x5602e20d9850 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4fe286740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602e238a650 con 0x5602e20b0990 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4fe286740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5602e248f370 con 0x5602e20b8b70 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4fe286740 10 client.0 _ll_register_callbacks cb 0x5602e20f10a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51540/0 (socket says 172.21.15.79:51540) 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4efe00640 1 -- 172.21.15.79:0/2424669207 learned_addr learned my addr 172.21.15.79:0/2424669207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4f5600640 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e24986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.826+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4f4c00640 1 -- 172.21.15.79:0/2424669207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 msgr2=0x5602e248ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4f4c00640 1 -- 172.21.15.79:0/2424669207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 msgr2=0x5602e24986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e24986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4f4c00640 1 -- 172.21.15.79:0/2424669207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e2153ba0 con 0x5602e20b0990 2024-09-21T02:49:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248c790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5602e247f810 tx=0x7ff4e40acf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a166e3c24e64668 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4d6000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4d6000640 1 -- 172.21.15.79:0/2424669207 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40aece0 con 0x5602e20b0990 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.827+0000 7ff4d6000640 1 -- 172.21.15.79:0/2424669207 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff4e40a9100 con 0x5602e20b0990 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.828+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f0078c90 con 0x5602e20b0990 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.828+0000 7ff4d6000640 1 -- 172.21.15.79:0/2424669207 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff4e40adeb0 con 0x5602e20b0990 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.828+0000 7ff4fe286740 10 client.26861 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.828+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5602e249b3f0 con 0x5602e20b0990 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4d6000640 1 -- 172.21.15.79:0/2424669207 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f0078c90 con 0x5602e20b0990 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4d6000640 1 -- 172.21.15.79:0/2424669207 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff4e40b3420 con 0x5602e20b0990 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4fe286740 10 client.26861 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4fe286740 10 client.26861 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4fe286740 20 client.26861 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4fe286740 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e20981d0 0x5602e249e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4fe286740 4 client.26861 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:49:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602e23f89e0 con 0x5602e20981d0 2024-09-21T02:49:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.829+0000 7ff4efe00640 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e20981d0 0x5602e249e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.830+0000 7ff4efe00640 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e20981d0 0x5602e249e8d0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e362c1d144271b server_cookie=2e06b28cbb4e349f in_seq=0 out_seq=0 2024-09-21T02:49:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.830+0000 7ff4d6000640 10 client.26861 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4d6000640 1 -- 172.21.15.79:0/2424669207 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602e23f89e0 con 0x5602e20981d0 2024-09-21T02:49:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4d6000640 10 client.26861 handle_command_reply: tid=0 2024-09-21T02:49:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 client.26861 shutdown 2024-09-21T02:49:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 msgr2=0x5602e248c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248c790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5602e247f810 tx=0x7ff4e40acf20 comp rx=0 tx=0).stop 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 shutdown_connections 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e20981d0 0x5602e249e8d0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e24986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 --2- 172.21.15.79:0/2424669207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248c790 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4d6000640 0 client.26861 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.831+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 >> 172.21.15.79:0/2424669207 conn(0x5602e20cdc40 msgr2=0x5602e2483d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.832+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 shutdown_connections 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.832+0000 7ff4fe286740 1 -- 172.21.15.79:0/2424669207 wait complete. 2024-09-21T02:49:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.832+0000 7ff4fe286740 20 client.26861 trim_cache size 0 max 16384 2024-09-21T02:49:33.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.856+0000 7ff4fe286740 1 Processor -- start 2024-09-21T02:49:33.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.856+0000 7ff4fe286740 1 -- start start 2024-09-21T02:49:33.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.856+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.856+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e24985c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.856+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.856+0000 7ff4fe286740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e80ae2a0 con 0x5602e20d9850 2024-09-21T02:49:33.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.856+0000 7ff4fe286740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8163710 con 0x5602e20b0990 2024-09-21T02:49:33.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4fe286740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8147bc0 con 0x5602e20b8b70 2024-09-21T02:49:33.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e24985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36204/0 (socket says 172.21.15.79:36204) 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 -- 172.21.15.79:0/1273465868 learned_addr learned my addr 172.21.15.79:0/1273465868 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f5600640 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 -- 172.21.15.79:0/1273465868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 msgr2=0x5602e24985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e24985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 -- 172.21.15.79:0/1273465868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 msgr2=0x5602e248e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.857+0000 7ff4f4c00640 1 -- 172.21.15.79:0/1273465868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e24839f0 con 0x5602e20b0990 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.858+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248cde0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40057a0 tx=0x7ff4e40a9050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e18f04f362fef12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.858+0000 7ff4e1200640 1 -- 172.21.15.79:0/1273465868 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40a9e00 con 0x5602e20b0990 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.858+0000 7ff4e1200640 1 -- 172.21.15.79:0/1273465868 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e40d3050 con 0x5602e20b0990 2024-09-21T02:49:33.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.858+0000 7ff4e1200640 1 -- 172.21.15.79:0/1273465868 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40a9100 con 0x5602e20b0990 2024-09-21T02:49:33.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.860+0000 7ff4fe286740 1 -- 172.21.15.79:0/1273465868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 msgr2=0x5602e248cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:33.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.860+0000 7ff4fe286740 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248cde0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40057a0 tx=0x7ff4e40a9050 comp rx=0 tx=0).stop 2024-09-21T02:49:33.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.861+0000 7ff4fe286740 1 -- 172.21.15.79:0/1273465868 shutdown_connections 2024-09-21T02:49:33.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.861+0000 7ff4fe286740 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.861+0000 7ff4fe286740 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e24985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.861+0000 7ff4fe286740 1 --2- 172.21.15.79:0/1273465868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e248cde0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.861+0000 7ff4fe286740 1 -- 172.21.15.79:0/1273465868 >> 172.21.15.79:0/1273465868 conn(0x5602e20cdc40 msgr2=0x5602e2481ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:33.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.861+0000 7ff4fe286740 1 -- 172.21.15.79:0/1273465868 shutdown_connections 2024-09-21T02:49:33.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.861+0000 7ff4fe286740 1 -- 172.21.15.79:0/1273465868 wait complete. 2024-09-21T02:49:33.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.862+0000 7ff4fe286740 1 -- start start 2024-09-21T02:49:33.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.863+0000 7ff4fe286740 1 Processor -- start 2024-09-21T02:49:33.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.863+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e2494ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.863+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.863+0000 7ff4fe286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.864+0000 7ff4f4c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e2494ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.864+0000 7ff4f4c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e2494ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36214/0 (socket says 172.21.15.79:36214) 2024-09-21T02:49:33.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.864+0000 7ff4f5600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.864+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.864+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51552/0 (socket says 172.21.15.79:51552) 2024-09-21T02:49:33.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.864+0000 7ff4f5600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54156/0 (socket says 172.21.15.79:54156) 2024-09-21T02:49:33.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.865+0000 7ff4f4c00640 1 -- 172.21.15.79:0/440836312 learned_addr learned my addr 172.21.15.79:0/440836312 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:33.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.865+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8161bd0 con 0x5602e20d9850 2024-09-21T02:49:33.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.865+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8163040 con 0x5602e20b0990 2024-09-21T02:49:33.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.865+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81622a0 con 0x5602e20b8b70 2024-09-21T02:49:33.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.865+0000 7ff4fe286740 10 client.0 _ll_register_callbacks cb 0x7ff4e40056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:33.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.866+0000 7ff4f4c00640 1 -- 172.21.15.79:0/440836312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 msgr2=0x5602e248f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:33.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.866+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.866+0000 7ff4f4c00640 1 -- 172.21.15.79:0/440836312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 msgr2=0x5602e248fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:33.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.866+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:33.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.866+0000 7ff4f4c00640 1 -- 172.21.15.79:0/440836312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e2490340 con 0x5602e20b0990 2024-09-21T02:49:33.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.866+0000 7ff4f4c00640 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e2494ea0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ad4b0 tx=0x7ff4e40acf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a9c94d651aa707 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:33.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.866+0000 7ff4d6000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:49:33.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.867+0000 7ff4d6000640 1 -- 172.21.15.79:0/440836312 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40a9e00 con 0x5602e20b0990 2024-09-21T02:49:33.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.867+0000 7ff4d6000640 1 -- 172.21.15.79:0/440836312 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff4e40aecf0 con 0x5602e20b0990 2024-09-21T02:49:33.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.867+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e40d3050 con 0x5602e20b0990 2024-09-21T02:49:33.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.867+0000 7ff4d6000640 1 -- 172.21.15.79:0/440836312 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff4e40b6710 con 0x5602e20b0990 2024-09-21T02:49:33.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 10 client.26867 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:33.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5602e250a240 con 0x5602e20b0990 2024-09-21T02:49:33.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4d6000640 1 -- 172.21.15.79:0/440836312 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e40d3050 con 0x5602e20b0990 2024-09-21T02:49:33.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4d6000640 1 -- 172.21.15.79:0/440836312 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff4e4018a20 con 0x5602e20b0990 2024-09-21T02:49:33.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 10 client.26867 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:33.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 10 client.26867 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:49:33.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 20 client.26867 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:33.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e206d580 0x5602e250c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:33.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 4 client.26867 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-21T02:49:33.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.868+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x5602e23f4490 con 0x5602e206d580 2024-09-21T02:49:33.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.869+0000 7ff4efe00640 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e206d580 0x5602e250c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:33.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.869+0000 7ff4efe00640 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e206d580 0x5602e250c850 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77e3e61a46a1d662 server_cookie=9c9ef45d9d01295f in_seq=0 out_seq=0 2024-09-21T02:49:33.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:33.869+0000 7ff4d6000640 10 client.26867 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.202+0000 7ff4d6000640 1 -- 172.21.15.79:0/440836312 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5602e23f4490 con 0x5602e206d580 2024-09-21T02:49:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.202+0000 7ff4d6000640 10 client.26867 handle_command_reply: tid=0 2024-09-21T02:49:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.202+0000 7ff4fe286740 1 client.26867 shutdown 2024-09-21T02:49:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.202+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 msgr2=0x5602e2494ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.202+0000 7ff4fe286740 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e2494ea0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ad4b0 tx=0x7ff4e40acf20 comp rx=0 tx=0).stop 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 shutdown_connections 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5602e206d580 0x5602e250c850 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602e20d9850 0x5602e248fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602e20b8b70 0x5602e248f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 --2- 172.21.15.79:0/440836312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602e20b0990 0x5602e2494ea0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4d6000640 0 client.26867 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 >> 172.21.15.79:0/440836312 conn(0x5602e20cdc40 msgr2=0x5602e2484650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 shutdown_connections 2024-09-21T02:49:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 1 -- 172.21.15.79:0/440836312 wait complete. 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.203+0000 7ff4fe286740 20 client.26867 trim_cache size 0 max 16384 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 54, 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "6adeeac7": { 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 54, 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:49:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 138.8, 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:34.208 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:49:34.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff4d80b6610 msgr2=0x7ff4d80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff4d80b6610 0x7ff4d80b8b20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00524b0 tx=0x7ff4f0051660 comp rx=0 tx=0).stop 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8016c50 msgr2=0x7ff4e80b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8016c50 0x7ff4e80b0cc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400e9f0 tx=0x7ff4e400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 shutdown_connections 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff4d80b6610 0x7ff4d80b8b20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80ab1e0 0x7ff4e80ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e80a5980 0x7ff4e80acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 --2- 172.21.15.79:0/2515926352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4e8016c50 0x7ff4e80b0cc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 >> 172.21.15.79:0/2515926352 conn(0x7ff4e801d090 msgr2=0x7ff4e80b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 shutdown_connections 2024-09-21T02:49:34.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:34.204+0000 7ff4f7600640 1 -- 172.21.15.79:0/2515926352 wait complete. 2024-09-21T02:49:34.981 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6adeeac7', quiesce took 9.5 seconds. Will release after: 9.350000000000001 2024-09-21T02:49:35.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:35 smithi148 ceph-mon[34626]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 4.3 MiB/s wr, 439 op/s 2024-09-21T02:49:35.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:35 smithi098 ceph-mon[34832]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 4.3 MiB/s wr, 439 op/s 2024-09-21T02:49:35.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:35 smithi079 ceph-mon[30788]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 4.3 MiB/s wr, 439 op/s 2024-09-21T02:49:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.012+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3002667470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec104560 msgr2=0x7f1cec104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.012+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3002667470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec104560 0x7f1cec104970 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009900 tx=0x7f1cd802a410 comp rx=0 tx=0).stop 2024-09-21T02:49:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.012+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3002667470 shutdown_connections 2024-09-21T02:49:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.012+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3002667470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cec104f00 0x7f1cec10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.012+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3002667470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec104560 0x7f1cec104970 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.012+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3002667470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cec1034e0 0x7f1cec103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.012+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3002667470 >> 172.21.15.79:0/3002667470 conn(0x7f1cec0fee20 msgr2=0x7f1cec1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.013+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3002667470 shutdown_connections 2024-09-21T02:49:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.013+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3002667470 wait complete. 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 Processor -- start 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 -- start start 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec1034e0 0x7f1cec199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cec104560 0x7f1cec19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cec104f00 0x7f1cec19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec10f120 con 0x7f1cec1034e0 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec10efa0 con 0x7f1cec104560 2024-09-21T02:49:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf2a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec10f2a0 con 0x7f1cec104f00 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf1600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec1034e0 0x7f1cec199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf1600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec1034e0 0x7f1cec199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54178/0 (socket says 172.21.15.79:54178) 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf1600640 1 -- 172.21.15.79:0/3966572600 learned_addr learned my addr 172.21.15.79:0/3966572600 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.014+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cec104560 0x7f1cec19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cf2000640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cec104f00 0x7f1cec19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cf1600640 1 -- 172.21.15.79:0/3966572600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cec104f00 msgr2=0x7f1cec19afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cec104f00 0x7f1cec19afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cf1600640 1 -- 172.21.15.79:0/3966572600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cec104560 msgr2=0x7f1cec19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cec104560 0x7f1cec19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cf1600640 1 -- 172.21.15.79:0/3966572600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cec19b7e0 con 0x7f1cec1034e0 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec1034e0 0x7f1cec199da0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e9f0 tx=0x7f1ce000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.015+0000 7f1cea000640 1 -- 172.21.15.79:0/3966572600 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000cd80 con 0x7f1cec1034e0 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.016+0000 7f1cea000640 1 -- 172.21.15.79:0/3966572600 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce00054d0 con 0x7f1cec1034e0 2024-09-21T02:49:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.016+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cec19bad0 con 0x7f1cec1034e0 2024-09-21T02:49:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.016+0000 7f1cea000640 1 -- 172.21.15.79:0/3966572600 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0010690 con 0x7f1cec1034e0 2024-09-21T02:49:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.016+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cec1a21c0 con 0x7f1cec1034e0 2024-09-21T02:49:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 Processor -- start 2024-09-21T02:49:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 -- start start 2024-09-21T02:49:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8186c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b818d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b819880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55de3b7876b0 con 0x55de3b4442f0 2024-09-21T02:49:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55de3b776ae0 con 0x55de3b44c4d0 2024-09-21T02:49:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.019+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55de3b77a8f0 con 0x55de3b46d1b0 2024-09-21T02:49:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b819880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b819880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:36250/0 (socket says 172.21.15.79:36250) 2024-09-21T02:49:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 -- 172.21.15.79:0/1379221931 learned_addr learned my addr 172.21.15.79:0/1379221931 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cea000640 1 -- 172.21.15.79:0/3966572600 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1ce0004e90 con 0x7f1cec1034e0 2024-09-21T02:49:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 -- 172.21.15.79:0/1379221931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 msgr2=0x55de3b8186c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/1379221931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8186c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 -- 172.21.15.79:0/1379221931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 msgr2=0x55de3b818d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/1379221931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b818d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 -- 172.21.15.79:0/1379221931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de3b743780 con 0x55de3b44c4d0 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.020+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/1379221931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b819880 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cd802a930 tx=0x7f1cd8009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=945390aba331f7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.021+0000 7f1cde600640 1 -- 172.21.15.79:0/1379221931 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8035030 con 0x55de3b44c4d0 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.021+0000 7f1cde600640 1 -- 172.21.15.79:0/1379221931 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cd8040070 con 0x55de3b44c4d0 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.021+0000 7f1cde600640 1 -- 172.21.15.79:0/1379221931 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8003970 con 0x55de3b44c4d0 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.021+0000 7f1cea000640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd40b6590 0x7f1cd40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cea000640 1 -- 172.21.15.79:0/3966572600 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1ce00e7aa0 con 0x7f1cec1034e0 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/1379221931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 msgr2=0x55de3b819880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/1379221931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b819880 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cd802a930 tx=0x7f1cd8009620 comp rx=0 tx=0).stop 2024-09-21T02:49:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cf2000640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd40b6590 0x7f1cd40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/1379221931 shutdown_connections 2024-09-21T02:49:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/1379221931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b819880 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/1379221931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b818d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/1379221931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8186c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/1379221931 >> 172.21.15.79:0/1379221931 conn(0x55de3b461300 msgr2=0x55de3b814150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/1379221931 shutdown_connections 2024-09-21T02:49:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/1379221931 wait complete. 2024-09-21T02:49:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.022+0000 7f1cf2000640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd40b6590 0x7f1cd40b8aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4005fd0 tx=0x7f1ce4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 -- start start 2024-09-21T02:49:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 Processor -- start 2024-09-21T02:49:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b821dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b822490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b823000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55de3b6aeab0 con 0x55de3b4442f0 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55de3b71d570 con 0x55de3b44c4d0 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55de3b81a340 con 0x55de3b46d1b0 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.023+0000 7f1cfb1c3740 10 client.0 _ll_register_callbacks cb 0x55de3b72c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b821dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b821dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54198/0 (socket says 172.21.15.79:54198) 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 -- 172.21.15.79:0/2186307918 learned_addr learned my addr 172.21.15.79:0/2186307918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf2000640 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b823000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b822490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 -- 172.21.15.79:0/2186307918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 msgr2=0x55de3b823000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b823000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 -- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 msgr2=0x55de3b822490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b822490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 -- 172.21.15.79:0/2186307918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de3b4d8790 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cf1600640 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b821dd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00ad7b0 tx=0x7f1ce00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31158cf63794379 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.024+0000 7f1cd2a00640 1 -- 172.21.15.79:0/2186307918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0005180 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cd2a00640 1 -- 172.21.15.79:0/2186307918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1ce00a9170 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd8040070 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cd2a00640 1 -- 172.21.15.79:0/2186307918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1ce00ad330 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 10 client.16584 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55de3b551620 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cd2a00640 1 -- 172.21.15.79:0/2186307918 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cd8040070 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cd2a00640 1 -- 172.21.15.79:0/2186307918 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1ce00ac4f0 con 0x55de3b4442f0 2024-09-21T02:49:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 10 client.16584 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 10 client.16584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 20 client.16584 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b42bd80 0x55de3b82f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 4 client.16584 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:49:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.025+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de3b789600 con 0x55de3b42bd80 2024-09-21T02:49:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.026+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b42bd80 0x55de3b82f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.026+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b42bd80 0x55de3b82f590 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=331247ce1e07e33b server_cookie=c6f91ea97eb6f615 in_seq=0 out_seq=0 2024-09-21T02:49:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.026+0000 7f1cd2a00640 10 client.16584 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cd2a00640 1 -- 172.21.15.79:0/2186307918 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de3b789600 con 0x55de3b42bd80 2024-09-21T02:49:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cd2a00640 10 client.16584 handle_command_reply: tid=0 2024-09-21T02:49:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 client.16584 shutdown 2024-09-21T02:49:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 msgr2=0x55de3b821dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b821dd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00ad7b0 tx=0x7f1ce00048f0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 shutdown_connections 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b42bd80 0x55de3b82f590 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b823000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cd2a00640 0 client.16584 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b44c4d0 0x55de3b822490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/2186307918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b821dd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.027+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 >> 172.21.15.79:0/2186307918 conn(0x55de3b461300 msgr2=0x55de3b80e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.028+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 shutdown_connections 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.028+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/2186307918 wait complete. 2024-09-21T02:49:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.028+0000 7f1cfb1c3740 20 client.16584 trim_cache size 0 max 16384 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 Processor -- start 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 -- start start 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b4442f0 0x55de3b820830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b44c4d0 0x55de3b820d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1a8200 con 0x55de3b44c4d0 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1aaa80 con 0x55de3b4442f0 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1a8870 con 0x55de3b46d1b0 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cf0c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b44c4d0 0x55de3b820d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cf0c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b44c4d0 0x55de3b820d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54200/0 (socket says 172.21.15.79:54200) 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cf0c00640 1 -- 172.21.15.79:0/3143620688 learned_addr learned my addr 172.21.15.79:0/3143620688 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b4442f0 0x55de3b820830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.043+0000 7f1cf2000640 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cf1600640 1 -- 172.21.15.79:0/3143620688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 msgr2=0x55de3b8212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cf1600640 1 -- 172.21.15.79:0/3143620688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b44c4d0 msgr2=0x55de3b820d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b44c4d0 0x55de3b820d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cf1600640 1 -- 172.21.15.79:0/3143620688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de3b81ff90 con 0x55de3b4442f0 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b44c4d0 0x55de3b820d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b4442f0 0x55de3b820830 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00ac8c0 tx=0x7f1ce0004a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6859fcba3692254 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cddc00640 1 -- 172.21.15.79:0/3143620688 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0005180 con 0x55de3b4442f0 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cddc00640 1 -- 172.21.15.79:0/3143620688 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce00b7240 con 0x55de3b4442f0 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.044+0000 7f1cddc00640 1 -- 172.21.15.79:0/3143620688 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00ad170 con 0x55de3b4442f0 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3143620688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b4442f0 msgr2=0x55de3b820830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b4442f0 0x55de3b820830 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00ac8c0 tx=0x7f1ce0004a90 comp rx=0 tx=0).stop 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3143620688 shutdown_connections 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b46d1b0 0x55de3b8212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b44c4d0 0x55de3b820d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3143620688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b4442f0 0x55de3b820830 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3143620688 >> 172.21.15.79:0/3143620688 conn(0x55de3b461300 msgr2=0x55de3b81eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3143620688 shutdown_connections 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3143620688 wait complete. 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.045+0000 7f1cfb1c3740 1 -- start start 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 1 Processor -- start 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b8294b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b44c4d0 0x55de3b828170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b46d1b0 0x55de3b8286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1a8f40 con 0x55de3b4442f0 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1aa3b0 con 0x55de3b46d1b0 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1a9610 con 0x55de3b44c4d0 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cfb1c3740 10 client.0 _ll_register_callbacks cb 0x7f1ce000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cf1600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b8294b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cf0c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b44c4d0 0x55de3b828170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cf1600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b8294b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54214/0 (socket says 172.21.15.79:54214) 2024-09-21T02:49:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cf0c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b44c4d0 0x55de3b828170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:51622/0 (socket says 172.21.15.79:51622) 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cf1600640 1 -- 172.21.15.79:0/3343767624 learned_addr learned my addr 172.21.15.79:0/3343767624 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.046+0000 7f1cf2000640 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b46d1b0 0x55de3b8286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cf0c00640 1 -- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b46d1b0 msgr2=0x55de3b8286b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b46d1b0 0x55de3b8286b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cf0c00640 1 -- 172.21.15.79:0/3343767624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 msgr2=0x55de3b8294b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b8294b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cf0c00640 1 -- 172.21.15.79:0/3343767624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de3b828c70 con 0x55de3b44c4d0 2024-09-21T02:49:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b8294b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cf0c00640 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b44c4d0 0x55de3b828170 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009900 tx=0x7f1cd80314c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d39aacad5141f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:49:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.047+0000 7f1cd2a00640 1 -- 172.21.15.79:0/3343767624 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8035040 con 0x55de3b44c4d0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cd2a00640 1 -- 172.21.15.79:0/3343767624 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1cd8045470 con 0x55de3b44c4d0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ce00b7240 con 0x55de3b44c4d0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cd2a00640 1 -- 172.21.15.79:0/3343767624 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1cd8061050 con 0x55de3b44c4d0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 10 client.26908 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55de3b827bb0 con 0x55de3b44c4d0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cd2a00640 1 -- 172.21.15.79:0/3343767624 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce00b7240 con 0x55de3b44c4d0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cd2a00640 1 -- 172.21.15.79:0/3343767624 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1cd8056020 con 0x55de3b44c4d0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 10 client.26908 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 10 client.26908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 20 client.26908 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b4011c0 0x55de3b89c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 4 client.26908 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.048+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de3b7850b0 con 0x55de3b4011c0 2024-09-21T02:49:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.049+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b4011c0 0x55de3b89c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.049+0000 7f1cf1600640 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b4011c0 0x55de3b89c430 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735d43db12b06ce2 server_cookie=fede1bc0d46ba05b in_seq=0 out_seq=0 2024-09-21T02:49:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.049+0000 7f1cd2a00640 10 client.26908 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.069+0000 7f1cd2a00640 1 -- 172.21.15.79:0/3343767624 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de3b7850b0 con 0x55de3b4011c0 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cd2a00640 10 client.26908 handle_command_reply: tid=0 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 client.26908 shutdown 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b44c4d0 msgr2=0x55de3b828170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b44c4d0 0x55de3b828170 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009900 tx=0x7f1cd80314c0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 shutdown_connections 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55de3b4011c0 0x55de3b89c430 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55de3b46d1b0 0x55de3b8286b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55de3b44c4d0 0x55de3b828170 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 --2- 172.21.15.79:0/3343767624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de3b4442f0 0x55de3b8294b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cd2a00640 0 client.26908 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 >> 172.21.15.79:0/3343767624 conn(0x55de3b461300 msgr2=0x55de3b820830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 shutdown_connections 2024-09-21T02:49:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 1 -- 172.21.15.79:0/3343767624 wait complete. 2024-09-21T02:49:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.070+0000 7f1cfb1c3740 20 client.26908 trim_cache size 0 max 16384 2024-09-21T02:49:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:49:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:49:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:49:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd40b6590 msgr2=0x7f1cd40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd40b6590 0x7f1cd40b8aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4005fd0 tx=0x7f1ce4009500 comp rx=0 tx=0).stop 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec1034e0 msgr2=0x7f1cec199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec1034e0 0x7f1cec199da0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e9f0 tx=0x7f1ce000edf0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 shutdown_connections 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1cd40b6590 0x7f1cd40b8aa0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cec104f00 0x7f1cec19afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cec104560 0x7f1cec19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 --2- 172.21.15.79:0/3966572600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cec1034e0 0x7f1cec199da0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 >> 172.21.15.79:0/3966572600 conn(0x7f1cec0fee20 msgr2=0x7f1cec107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 shutdown_connections 2024-09-21T02:49:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:36.071+0000 7f1cf2a00640 1 -- 172.21.15.79:0/3966572600 wait complete. 2024-09-21T02:49:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 820.0 s, 215.8 tps, lat 244.251 ms stddev 315.020 2024-09-21T02:49:37.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:37 smithi148 ceph-mon[34626]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.7 MiB/s wr, 389 op/s 2024-09-21T02:49:37.631 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:37 smithi079 ceph-mon[30788]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.7 MiB/s wr, 389 op/s 2024-09-21T02:49:37.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:37 smithi098 ceph-mon[34832]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 3.7 MiB/s wr, 389 op/s 2024-09-21T02:49:39.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:39 smithi148 ceph-mon[34626]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 3.8 MiB/s wr, 397 op/s 2024-09-21T02:49:39.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:39 smithi098 ceph-mon[34832]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 3.8 MiB/s wr, 397 op/s 2024-09-21T02:49:39.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:39 smithi079 ceph-mon[30788]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 3.8 MiB/s wr, 397 op/s 2024-09-21T02:49:41.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:49:41.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:41 smithi148 ceph-mon[34626]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 3.3 MiB/s wr, 331 op/s 2024-09-21T02:49:41.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:41 smithi098 ceph-mon[34832]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 3.3 MiB/s wr, 331 op/s 2024-09-21T02:49:41.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:41 smithi079 ceph-mon[30788]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 3.3 MiB/s wr, 331 op/s 2024-09-21T02:49:43.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:43 smithi148 ceph-mon[34626]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.2 MiB/s wr, 250 op/s 2024-09-21T02:49:43.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:43 smithi098 ceph-mon[34832]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.2 MiB/s wr, 250 op/s 2024-09-21T02:49:43.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:43 smithi079 ceph-mon[30788]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.2 MiB/s wr, 250 op/s 2024-09-21T02:49:44.332 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:49:44.738 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:49:45.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:45 smithi079 ceph-mon[30788]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2024-09-21T02:49:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.483+0000 7f69d8e00640 1 -- 172.21.15.79:0/286291844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d410de40 msgr2=0x7f69d4110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.483+0000 7f69d8e00640 1 --2- 172.21.15.79:0/286291844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d410de40 0x7f69d4110310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009ca0 tx=0x7f69cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.484+0000 7f69d8e00640 1 -- 172.21.15.79:0/286291844 shutdown_connections 2024-09-21T02:49:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.484+0000 7f69d8e00640 1 --2- 172.21.15.79:0/286291844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d410de40 0x7f69d4110310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.484+0000 7f69d8e00640 1 --2- 172.21.15.79:0/286291844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69d4105360 0x7f69d410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.484+0000 7f69d8e00640 1 --2- 172.21.15.79:0/286291844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4104a10 0x7f69d4104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.484+0000 7f69d8e00640 1 -- 172.21.15.79:0/286291844 >> 172.21.15.79:0/286291844 conn(0x7f69d4079720 msgr2=0x7f69d4079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:45.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.486+0000 7f69d8e00640 1 -- 172.21.15.79:0/286291844 shutdown_connections 2024-09-21T02:49:45.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.486+0000 7f69d8e00640 1 -- 172.21.15.79:0/286291844 wait complete. 2024-09-21T02:49:45.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.488+0000 7f69d8e00640 1 Processor -- start 2024-09-21T02:49:45.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.488+0000 7f69d8e00640 1 -- start start 2024-09-21T02:49:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.489+0000 7f69d8e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4104a10 0x7f69d4074db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d4105360 0x7f69d406e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d8e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69d410de40 0x7f69d406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4104a10 0x7f69d4074db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d8e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4113ad0 con 0x7f69d4104a10 2024-09-21T02:49:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d1e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4104a10 0x7f69d4074db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45350/0 (socket says 172.21.15.79:45350) 2024-09-21T02:49:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d1e00640 1 -- 172.21.15.79:0/1623457363 learned_addr learned my addr 172.21.15.79:0/1623457363 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d8e00640 1 -- 172.21.15.79:0/1623457363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4113950 con 0x7f69d410de40 2024-09-21T02:49:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.491+0000 7f69d8e00640 1 -- 172.21.15.79:0/1623457363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4113c50 con 0x7f69d4105360 2024-09-21T02:49:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.490+0000 7f69d2800640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69d410de40 0x7f69d406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.491+0000 7f69d1400640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d4105360 0x7f69d406e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.492+0000 7f69d2800640 1 -- 172.21.15.79:0/1623457363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d4105360 msgr2=0x7f69d406e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.492+0000 7f69d2800640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d4105360 0x7f69d406e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.492+0000 7f69d2800640 1 -- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4104a10 msgr2=0x7f69d4074db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.492+0000 7f69d2800640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4104a10 0x7f69d4074db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.492+0000 7f69d2800640 1 -- 172.21.15.79:0/1623457363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d406ed90 con 0x7f69d410de40 2024-09-21T02:49:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.492+0000 7f69d2800640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69d410de40 0x7f69d406e5c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005e30 tx=0x7f69cc031680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.493+0000 7f69caa00640 1 -- 172.21.15.79:0/1623457363 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc051070 con 0x7f69d410de40 2024-09-21T02:49:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.493+0000 7f69caa00640 1 -- 172.21.15.79:0/1623457363 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69cc003e20 con 0x7f69d410de40 2024-09-21T02:49:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.493+0000 7f69caa00640 1 -- 172.21.15.79:0/1623457363 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc004510 con 0x7f69d410de40 2024-09-21T02:49:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.493+0000 7f69d8e00640 1 -- 172.21.15.79:0/1623457363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d4073a20 con 0x7f69d410de40 2024-09-21T02:49:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.493+0000 7f69d8e00640 1 -- 172.21.15.79:0/1623457363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d4073f10 con 0x7f69d410de40 2024-09-21T02:49:45.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.495+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d406bed0 con 0x7f69d410de40 2024-09-21T02:49:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.498+0000 7f69caa00640 1 -- 172.21.15.79:0/1623457363 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f69cc054070 con 0x7f69d410de40 2024-09-21T02:49:45.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.500+0000 7f69caa00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f69b80b6590 0x7f69b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.500+0000 7f69caa00640 1 -- 172.21.15.79:0/1623457363 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f69cc10ffc0 con 0x7f69d410de40 2024-09-21T02:49:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.500+0000 7f69d1e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f69b80b6590 0x7f69b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:45.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.501+0000 7f69d1e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f69b80b6590 0x7f69b80b8aa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009c30 tx=0x7f69bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:45.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.504+0000 7f69caa00640 1 -- 172.21.15.79:0/1623457363 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69cc08b710 con 0x7f69d410de40 2024-09-21T02:49:45.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:45 smithi148 ceph-mon[34626]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2024-09-21T02:49:45.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:45 smithi098 ceph-mon[34832]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2024-09-21T02:49:45.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.734+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69d4103d40 con 0x7f69d410de40 2024-09-21T02:49:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.735+0000 7f69caa00640 1 -- 172.21.15.79:0/1623457363 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f69cc0d6440 con 0x7f69d410de40 2024-09-21T02:49:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:49:45.737 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:49:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f69b80b6590 msgr2=0x7f69b80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f69b80b6590 0x7f69b80b8aa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009c30 tx=0x7f69bc005f90 comp rx=0 tx=0).stop 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69d410de40 msgr2=0x7f69d406e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69d410de40 0x7f69d406e5c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005e30 tx=0x7f69cc031680 comp rx=0 tx=0).stop 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 shutdown_connections 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f69b80b6590 0x7f69b80b8aa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69d410de40 0x7f69d406e5c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69d4105360 0x7f69d406e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 --2- 172.21.15.79:0/1623457363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4104a10 0x7f69d4074db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 >> 172.21.15.79:0/1623457363 conn(0x7f69d4079720 msgr2=0x7f69d41068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 shutdown_connections 2024-09-21T02:49:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:45.738+0000 7f69c3e00640 1 -- 172.21.15.79:0/1623457363 wait complete. 2024-09-21T02:49:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:49:46.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:46 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1623457363' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:46.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:46 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1623457363' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:46.693 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:46 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1623457363' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:46.731 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 6adeeac7 --release --await' 2024-09-21T02:49:46.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 6adeeac7 --release --await 2024-09-21T02:49:47.114 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:49:47.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:47 smithi148 ceph-mon[34626]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 637 KiB/s wr, 88 op/s 2024-09-21T02:49:47.589 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:47 smithi079 ceph-mon[30788]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 637 KiB/s wr, 88 op/s 2024-09-21T02:49:47.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:47 smithi098 ceph-mon[34832]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 637 KiB/s wr, 88 op/s 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 -- 172.21.15.79:0/825668953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80105d80 msgr2=0x7f4d80106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 --2- 172.21.15.79:0/825668953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80105d80 0x7f4d80106190 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009900 tx=0x7f4d7402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 -- 172.21.15.79:0/825668953 shutdown_connections 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 --2- 172.21.15.79:0/825668953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010c010 0x7f4d80112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 --2- 172.21.15.79:0/825668953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d8010b6c0 0x7f4d8010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 --2- 172.21.15.79:0/825668953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80105d80 0x7f4d80106190 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 -- 172.21.15.79:0/825668953 >> 172.21.15.79:0/825668953 conn(0x7f4d80101810 msgr2=0x7f4d80103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 -- 172.21.15.79:0/825668953 shutdown_connections 2024-09-21T02:49:47.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.844+0000 7f4d88200640 1 -- 172.21.15.79:0/825668953 wait complete. 2024-09-21T02:49:47.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.845+0000 7f4d88200640 1 Processor -- start 2024-09-21T02:49:47.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d88200640 1 -- start start 2024-09-21T02:49:47.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d88200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d80105d80 0x7f4d8019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d88200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010b6c0 0x7f4d8019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d88200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8010c010 0x7f4d801a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d88200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80115cd0 con 0x7f4d8010c010 2024-09-21T02:49:47.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d88200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80115b50 con 0x7f4d80105d80 2024-09-21T02:49:47.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d88200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80115e50 con 0x7f4d8010b6c0 2024-09-21T02:49:47.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.846+0000 7f4d86200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8010c010 0x7f4d801a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010b6c0 0x7f4d8019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010b6c0 0x7f4d8019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47852/0 (socket says 172.21.15.79:47852) 2024-09-21T02:49:47.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d86200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8010c010 0x7f4d801a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45364/0 (socket says 172.21.15.79:45364) 2024-09-21T02:49:47.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 -- 172.21.15.79:0/1603719543 learned_addr learned my addr 172.21.15.79:0/1603719543 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:47.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d85800640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d80105d80 0x7f4d8019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 -- 172.21.15.79:0/1603719543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d80105d80 msgr2=0x7f4d8019c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d80105d80 0x7f4d8019c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 -- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8010c010 msgr2=0x7f4d801a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8010c010 0x7f4d801a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 -- 172.21.15.79:0/1603719543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d801a2650 con 0x7f4d8010b6c0 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d86200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8010c010 0x7f4d801a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.847+0000 7f4d84e00640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010b6c0 0x7f4d8019cc80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e970 tx=0x7f4d6c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.848+0000 7f4d7e000640 1 -- 172.21.15.79:0/1603719543 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00cd80 con 0x7f4d8010b6c0 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.848+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d801a2940 con 0x7f4d8010b6c0 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.848+0000 7f4d7e000640 1 -- 172.21.15.79:0/1603719543 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d6c0035f0 con 0x7f4d8010b6c0 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.848+0000 7f4d7e000640 1 -- 172.21.15.79:0/1603719543 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c010690 con 0x7f4d8010b6c0 2024-09-21T02:49:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.848+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d801a90a0 con 0x7f4d8010b6c0 2024-09-21T02:49:47.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.851+0000 7f4d8ee62740 1 Processor -- start 2024-09-21T02:49:47.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.852+0000 7f4d8ee62740 1 -- start start 2024-09-21T02:49:47.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.852+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14c9520 0x557cc18701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.852+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc1870700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.852+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a8840 0x557cc1870c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.852+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557cc17e7290 con 0x557cc14a0660 2024-09-21T02:49:47.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.852+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cc17d66c0 con 0x557cc14a8840 2024-09-21T02:49:47.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.852+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557cc17da4d0 con 0x557cc14c9520 2024-09-21T02:49:47.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc1870700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d86200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14c9520 0x557cc18701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc1870700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45370/0 (socket says 172.21.15.79:45370) 2024-09-21T02:49:47.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 -- 172.21.15.79:0/1049182816 learned_addr learned my addr 172.21.15.79:0/1049182816 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:47.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 -- 172.21.15.79:0/1049182816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14c9520 msgr2=0x557cc18701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14c9520 0x557cc18701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 -- 172.21.15.79:0/1049182816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a8840 msgr2=0x557cc1870c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a8840 0x557cc1870c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 -- 172.21.15.79:0/1049182816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc1763460 con 0x557cc14a0660 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d86200640 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14c9520 0x557cc18701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.853+0000 7f4d85800640 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc1870700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009900 tx=0x7f4d74032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac8e560ab76725c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.854+0000 7f4d7e000640 1 -- 172.21.15.79:0/1603719543 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4d6c003aa0 con 0x7f4d8010b6c0 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.854+0000 7f4d72a00640 1 -- 172.21.15.79:0/1049182816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74040070 con 0x557cc14a0660 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.854+0000 7f4d72a00640 1 -- 172.21.15.79:0/1049182816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d74004030 con 0x557cc14a0660 2024-09-21T02:49:47.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.854+0000 7f4d72a00640 1 -- 172.21.15.79:0/1049182816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74035040 con 0x557cc14a0660 2024-09-21T02:49:47.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 -- 172.21.15.79:0/1049182816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 msgr2=0x557cc1870700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc1870700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009900 tx=0x7f4d74032b90 comp rx=0 tx=0).stop 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 -- 172.21.15.79:0/1049182816 shutdown_connections 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a8840 0x557cc1870c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc1870700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/1049182816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14c9520 0x557cc18701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 -- 172.21.15.79:0/1049182816 >> 172.21.15.79:0/1049182816 conn(0x557cc14bd910 msgr2=0x557cc186e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 -- 172.21.15.79:0/1049182816 shutdown_connections 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.855+0000 7f4d8ee62740 1 -- 172.21.15.79:0/1049182816 wait complete. 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.856+0000 7f4d7e000640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4d680b6430 0x7f4d680b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.856+0000 7f4d8ee62740 1 -- start start 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.856+0000 7f4d7e000640 1 -- 172.21.15.79:0/1603719543 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4d6c0e7980 con 0x7f4d8010b6c0 2024-09-21T02:49:47.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.856+0000 7f4d86200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4d680b6430 0x7f4d680b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.856+0000 7f4d8ee62740 1 Processor -- start 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d86200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4d680b6430 0x7f4d680b8940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009fd0 tx=0x7f4d78009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc187bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc187c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc1887c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557cc1637bb0 con 0x557cc14a0660 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cc17716c0 con 0x557cc14c9520 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557cc187e940 con 0x557cc14a8840 2024-09-21T02:49:47.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d8ee62740 10 client.0 _ll_register_callbacks cb 0x557cc178c490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d85800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc187bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d85800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc187bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45384/0 (socket says 172.21.15.79:45384) 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d85800640 1 -- 172.21.15.79:0/411329734 learned_addr learned my addr 172.21.15.79:0/411329734 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d84e00640 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc187c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.857+0000 7f4d86200640 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc1887c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d85800640 1 -- 172.21.15.79:0/411329734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 msgr2=0x557cc187c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d85800640 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc187c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d85800640 1 -- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 msgr2=0x557cc1887c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d85800640 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc1887c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d85800640 1 -- 172.21.15.79:0/411329734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc1534b00 con 0x557cc14a0660 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d85800640 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc187bdc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d74032f60 tx=0x7f4d7402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c189892f5311b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d67400640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d67400640 1 -- 172.21.15.79:0/411329734 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74035070 con 0x557cc14a0660 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d67400640 1 -- 172.21.15.79:0/411329734 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4d74005460 con 0x557cc14a0660 2024-09-21T02:49:47.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.858+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d74004030 con 0x557cc14a0660 2024-09-21T02:49:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d67400640 1 -- 172.21.15.79:0/411329734 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4d74058050 con 0x557cc14a0660 2024-09-21T02:49:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 10 client.16608 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:47.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557cc15ab960 con 0x557cc14a0660 2024-09-21T02:49:47.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d67400640 1 -- 172.21.15.79:0/411329734 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d74004030 con 0x557cc14a0660 2024-09-21T02:49:47.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d67400640 1 -- 172.21.15.79:0/411329734 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4d74004c90 con 0x557cc14a0660 2024-09-21T02:49:47.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 10 client.16608 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 10 client.16608 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 20 client.16608 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc1487ea0 0x557cc188db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 4 client.16608 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.859+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cc17e91e0 con 0x557cc1487ea0 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.860+0000 7f4d84e00640 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc1487ea0 0x557cc188db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.860+0000 7f4d84e00640 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc1487ea0 0x557cc188db10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b260417a51576112 server_cookie=1068b7ce54541fad in_seq=0 out_seq=0 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.860+0000 7f4d67400640 10 client.16608 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d67400640 1 -- 172.21.15.79:0/411329734 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557cc17e91e0 con 0x557cc1487ea0 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d67400640 10 client.16608 handle_command_reply: tid=0 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 client.16608 shutdown 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 msgr2=0x557cc187bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc187bdc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d74032f60 tx=0x7f4d7402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 shutdown_connections 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc1487ea0 0x557cc188db10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc1887c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc187c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/411329734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a0660 0x557cc187bdc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d67400640 0 client.16608 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 >> 172.21.15.79:0/411329734 conn(0x557cc14bd910 msgr2=0x557cc1873350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.861+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 shutdown_connections 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.862+0000 7f4d8ee62740 1 -- 172.21.15.79:0/411329734 wait complete. 2024-09-21T02:49:47.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.862+0000 7f4d8ee62740 20 client.16608 trim_cache size 0 max 16384 2024-09-21T02:49:47.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 Processor -- start 2024-09-21T02:49:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 -- start start 2024-09-21T02:49:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a0660 0x557cc186dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc1887bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14c9520 0x557cc1888110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801b0db0 con 0x557cc14c9520 2024-09-21T02:49:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801b3630 con 0x557cc14a0660 2024-09-21T02:49:47.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801b1420 con 0x557cc14a8840 2024-09-21T02:49:47.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d84e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc1887bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d84e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc1887bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47880/0 (socket says 172.21.15.79:47880) 2024-09-21T02:49:47.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d86200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14c9520 0x557cc1888110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.880+0000 7f4d84e00640 1 -- 172.21.15.79:0/2978601512 learned_addr learned my addr 172.21.15.79:0/2978601512 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d85800640 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a0660 0x557cc186dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d84e00640 1 -- 172.21.15.79:0/2978601512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a0660 msgr2=0x557cc186dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d84e00640 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a0660 0x557cc186dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d84e00640 1 -- 172.21.15.79:0/2978601512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14c9520 msgr2=0x557cc1888110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d84e00640 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14c9520 0x557cc1888110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d84e00640 1 -- 172.21.15.79:0/2978601512 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc187cb10 con 0x557cc14a8840 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d85800640 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a0660 0x557cc186dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d84e00640 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc1887bd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0ad690 tx=0x7f4d6c009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec0ec81fccb1bbe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d72000640 1 -- 172.21.15.79:0/2978601512 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0b21e0 con 0x557cc14a8840 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d72000640 1 -- 172.21.15.79:0/2978601512 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d6c0d4070 con 0x557cc14a8840 2024-09-21T02:49:47.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.881+0000 7f4d72000640 1 -- 172.21.15.79:0/2978601512 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0a92b0 con 0x557cc14a8840 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2978601512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 msgr2=0x557cc1887bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc1887bd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0ad690 tx=0x7f4d6c009490 comp rx=0 tx=0).stop 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2978601512 shutdown_connections 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14c9520 0x557cc1888110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a8840 0x557cc1887bd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2978601512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14a0660 0x557cc186dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2978601512 >> 172.21.15.79:0/2978601512 conn(0x557cc14bd910 msgr2=0x557cc186d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2978601512 shutdown_connections 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.882+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2978601512 wait complete. 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.883+0000 7f4d8ee62740 1 -- start start 2024-09-21T02:49:47.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.883+0000 7f4d8ee62740 1 Processor -- start 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.883+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a0660 0x557cc188f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.883+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a8840 0x557cc188fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.883+0000 7f4d8ee62740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc18f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.883+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801b1af0 con 0x557cc14a8840 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801b2f60 con 0x557cc14c9520 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d8ee62740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801b21c0 con 0x557cc14a0660 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d8ee62740 10 client.0 _ll_register_callbacks cb 0x7f4d78009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a0660 0x557cc188f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a0660 0x557cc188f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47888/0 (socket says 172.21.15.79:47888) 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 -- 172.21.15.79:0/2795268872 learned_addr learned my addr 172.21.15.79:0/2795268872 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d84e00640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a8840 0x557cc188fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d86200640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc18f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 -- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 msgr2=0x557cc18f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc18f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 -- 172.21.15.79:0/2795268872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a8840 msgr2=0x557cc188fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a8840 0x557cc188fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d85800640 1 -- 172.21.15.79:0/2795268872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc18f1940 con 0x557cc14a0660 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.884+0000 7f4d84e00640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a8840 0x557cc188fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d85800640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a0660 0x557cc188f490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4d74006010 tx=0x7f4d740044f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dd38a6e7efd41bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d67400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d67400640 1 -- 172.21.15.79:0/2795268872 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74035040 con 0x557cc14a0660 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d67400640 1 -- 172.21.15.79:0/2795268872 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4d740318b0 con 0x557cc14a0660 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d6c0d4070 con 0x557cc14a0660 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d67400640 1 -- 172.21.15.79:0/2795268872 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4d7406c050 con 0x557cc14a0660 2024-09-21T02:49:47.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d8ee62740 10 client.26932 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:47.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.885+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557cc18f8ca0 con 0x557cc14a0660 2024-09-21T02:49:47.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d67400640 1 -- 172.21.15.79:0/2795268872 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d6c0d4070 con 0x557cc14a0660 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d67400640 1 -- 172.21.15.79:0/2795268872 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4d74003dd0 con 0x557cc14a0660 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d8ee62740 10 client.26932 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d8ee62740 10 client.26932 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d8ee62740 20 client.26932 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc145d250 0x557cc18fb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d8ee62740 4 client.26932 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6adeeac7", "release": true, "await": true}] 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6adeeac7", "release": true, "await": true}) -- 0x557cc17e4c90 con 0x557cc145d250 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.886+0000 7f4d84e00640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc145d250 0x557cc18fb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.887+0000 7f4d84e00640 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc145d250 0x557cc18fb460 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7289bed8987bb1d0 server_cookie=15a1f83122d32901 in_seq=0 out_seq=0 2024-09-21T02:49:47.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.887+0000 7f4d67400640 10 client.26932 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:47.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.936+0000 7f4d67400640 1 -- 172.21.15.79:0/2795268872 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557cc17e4c90 con 0x557cc145d250 2024-09-21T02:49:47.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.936+0000 7f4d67400640 10 client.26932 handle_command_reply: tid=0 2024-09-21T02:49:47.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.936+0000 7f4d8ee62740 1 client.26932 shutdown 2024-09-21T02:49:47.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.936+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a0660 msgr2=0x557cc188f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.936+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a0660 0x557cc188f490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4d74006010 tx=0x7f4d740044f0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 shutdown_connections 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x557cc145d250 0x557cc18fb460 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cc14c9520 0x557cc18f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d67400640 0 client.26932 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557cc14a8840 0x557cc188fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 --2- 172.21.15.79:0/2795268872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557cc14a0660 0x557cc188f490 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 >> 172.21.15.79:0/2795268872 conn(0x557cc14bd910 msgr2=0x557cc18711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 shutdown_connections 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 1 -- 172.21.15.79:0/2795268872 wait complete. 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.937+0000 7f4d8ee62740 20 client.26932 trim_cache size 0 max 16384 2024-09-21T02:49:47.940 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 56, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "6adeeac7": { 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 56, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 138.8, 2024-09-21T02:49:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:47.942 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:49:47.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.941+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4d680b6430 msgr2=0x7f4d680b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.941+0000 7f4d88200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4d680b6430 0x7f4d680b8940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009fd0 tx=0x7f4d78009500 comp rx=0 tx=0).stop 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.941+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010b6c0 msgr2=0x7f4d8019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.941+0000 7f4d88200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010b6c0 0x7f4d8019cc80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e970 tx=0x7f4d6c00ee30 comp rx=0 tx=0).stop 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 shutdown_connections 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4d680b6430 0x7f4d680b8940 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d8010c010 0x7f4d801a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8010b6c0 0x7f4d8019cc80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 --2- 172.21.15.79:0/1603719543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d80105d80 0x7f4d8019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 >> 172.21.15.79:0/1603719543 conn(0x7f4d80101810 msgr2=0x7f4d80103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 shutdown_connections 2024-09-21T02:49:47.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:47.942+0000 7f4d88200640 1 -- 172.21.15.79:0/1603719543 wait complete. 2024-09-21T02:49:48.887 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6adeeac7', total seconds elapsed: 23.4 2024-09-21T02:49:48.887 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-21T02:49:48.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:49:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.373+0000 7effcf000640 1 -- 172.21.15.79:0/519681386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104560 msgr2=0x7effc8104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.373+0000 7effcf000640 1 --2- 172.21.15.79:0/519681386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104560 0x7effc8104970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7effc0009ca0 tx=0x7effc002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.373+0000 7effcf000640 1 -- 172.21.15.79:0/519681386 shutdown_connections 2024-09-21T02:49:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.373+0000 7effcf000640 1 --2- 172.21.15.79:0/519681386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8104f00 0x7effc810b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.373+0000 7effcf000640 1 --2- 172.21.15.79:0/519681386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104560 0x7effc8104970 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.373+0000 7effcf000640 1 --2- 172.21.15.79:0/519681386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 0x7effc8103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.373+0000 7effcf000640 1 -- 172.21.15.79:0/519681386 >> 172.21.15.79:0/519681386 conn(0x7effc80fee20 msgr2=0x7effc81012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.374+0000 7effcf000640 1 -- 172.21.15.79:0/519681386 shutdown_connections 2024-09-21T02:49:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.374+0000 7effcf000640 1 -- 172.21.15.79:0/519681386 wait complete. 2024-09-21T02:49:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.375+0000 7effcf000640 1 Processor -- start 2024-09-21T02:49:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.375+0000 7effcf000640 1 -- start start 2024-09-21T02:49:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.375+0000 7effcf000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 0x7effc819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcf000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8104560 0x7effc819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcf000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104f00 0x7effc819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcf000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effc810f160 con 0x7effc8104560 2024-09-21T02:49:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcf000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7effc810efe0 con 0x7effc81034e0 2024-09-21T02:49:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcf000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7effc810f2e0 con 0x7effc8104f00 2024-09-21T02:49:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcdc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 0x7effc819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcdc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 0x7effc819bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51908/0 (socket says 172.21.15.79:51908) 2024-09-21T02:49:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effcdc00640 1 -- 172.21.15.79:0/2758275762 learned_addr learned my addr 172.21.15.79:0/2758275762 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.376+0000 7effce600640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104f00 0x7effc819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.377+0000 7effcdc00640 1 -- 172.21.15.79:0/2758275762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104f00 msgr2=0x7effc819d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.377+0000 7effcdc00640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104f00 0x7effc819d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.377+0000 7effcdc00640 1 -- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8104560 msgr2=0x7effc819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.377+0000 7effcd200640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8104560 0x7effc819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.377+0000 7effcdc00640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8104560 0x7effc819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.377+0000 7effcdc00640 1 -- 172.21.15.79:0/2758275762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc819d9a0 con 0x7effc81034e0 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.377+0000 7effcd200640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8104560 0x7effc819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:49:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.378+0000 7effcdc00640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 0x7effc819bf60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7effbc00d950 tx=0x7effbc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.382+0000 7effc6000640 1 -- 172.21.15.79:0/2758275762 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc017030 con 0x7effc81034e0 2024-09-21T02:49:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.382+0000 7effc6000640 1 -- 172.21.15.79:0/2758275762 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effbc004020 con 0x7effc81034e0 2024-09-21T02:49:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.382+0000 7effc6000640 1 -- 172.21.15.79:0/2758275762 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0047a0 con 0x7effc81034e0 2024-09-21T02:49:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.382+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc819dc90 con 0x7effc81034e0 2024-09-21T02:49:49.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.382+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81a4380 con 0x7effc81034e0 2024-09-21T02:49:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.388+0000 7effc6000640 1 -- 172.21.15.79:0/2758275762 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7effbc009a30 con 0x7effc81034e0 2024-09-21T02:49:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.389+0000 7effd780e740 1 Processor -- start 2024-09-21T02:49:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.389+0000 7effd780e740 1 -- start start 2024-09-21T02:49:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effd780e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6010c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effd780e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f6010c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effd780e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6010d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effd780e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560f6007f6b0 con 0x560f5fd3c2f0 2024-09-21T02:49:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effd780e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560f6006eae0 con 0x560f5fd651b0 2024-09-21T02:49:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effd780e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560f600728f0 con 0x560f5fd444d0 2024-09-21T02:49:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effce600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6010c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effce600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6010c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51916/0 (socket says 172.21.15.79:51916) 2024-09-21T02:49:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effce600640 1 -- 172.21.15.79:0/1079464439 learned_addr learned my addr 172.21.15.79:0/1079464439 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.390+0000 7effcd200640 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6010d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effcdc00640 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f6010c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effcd200640 1 -- 172.21.15.79:0/1079464439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 msgr2=0x560f6010c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effcd200640 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6010c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effcd200640 1 -- 172.21.15.79:0/1079464439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 msgr2=0x560f6010c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effcd200640 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f6010c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effcd200640 1 -- 172.21.15.79:0/1079464439 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f6003b780 con 0x560f5fd444d0 2024-09-21T02:49:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effc6000640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7effb00b6660 0x7effb00b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effce600640 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6010c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effc6000640 1 -- 172.21.15.79:0/2758275762 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7effbc0e70a0 con 0x7effc81034e0 2024-09-21T02:49:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.391+0000 7effcd200640 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6010d470 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7effc0031a90 tx=0x7effc002f420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5841d89bb4e1d239 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.392+0000 7effce600640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7effb00b6660 0x7effb00b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.392+0000 7effbaa00640 1 -- 172.21.15.79:0/1079464439 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0031650 con 0x560f5fd444d0 2024-09-21T02:49:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.392+0000 7effbaa00640 1 -- 172.21.15.79:0/1079464439 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc0036070 con 0x560f5fd444d0 2024-09-21T02:49:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.392+0000 7effbaa00640 1 -- 172.21.15.79:0/1079464439 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0004690 con 0x560f5fd444d0 2024-09-21T02:49:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 -- 172.21.15.79:0/1079464439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 msgr2=0x560f6010d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6010d470 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7effc0031a90 tx=0x7effc002f420 comp rx=0 tx=0).stop 2024-09-21T02:49:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effce600640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7effb00b6660 0x7effb00b8b70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7effb4009bd0 tx=0x7effb4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 -- 172.21.15.79:0/1079464439 shutdown_connections 2024-09-21T02:49:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6010d470 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f6010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 --2- 172.21.15.79:0/1079464439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6010c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 -- 172.21.15.79:0/1079464439 >> 172.21.15.79:0/1079464439 conn(0x560f5fd59300 msgr2=0x560f60107d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 -- 172.21.15.79:0/1079464439 shutdown_connections 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.393+0000 7effd780e740 1 -- 172.21.15.79:0/1079464439 wait complete. 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.394+0000 7effd780e740 1 -- start start 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.394+0000 7effd780e740 1 Processor -- start 2024-09-21T02:49:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.395+0000 7effd780e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f601158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.395+0000 7effd780e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f60115f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.395+0000 7effd780e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd651b0 0x560f60116ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.395+0000 7effd780e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560f5ffa6ab0 con 0x560f5fd3c2f0 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.395+0000 7effd780e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560f60015570 con 0x560f5fd444d0 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.395+0000 7effd780e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560f6010df30 con 0x560f5fd651b0 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.395+0000 7effd780e740 10 client.0 _ll_register_callbacks cb 0x560f60024100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f601158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f601158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45432/0 (socket says 172.21.15.79:45432) 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 -- 172.21.15.79:0/3700188817 learned_addr learned my addr 172.21.15.79:0/3700188817 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effce600640 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd651b0 0x560f60116ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcd200640 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f60115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 -- 172.21.15.79:0/3700188817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd651b0 msgr2=0x560f60116ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd651b0 0x560f60116ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 -- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 msgr2=0x560f60115f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f60115f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.396+0000 7effcdc00640 1 -- 172.21.15.79:0/3700188817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5fdd0790 con 0x560f5fd3c2f0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.397+0000 7effcdc00640 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f601158a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7effbc0acb80 tx=0x7effbc009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a613d404273c0cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.397+0000 7effaf400640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.398+0000 7effaf400640 1 -- 172.21.15.79:0/3700188817 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0ac5f0 con 0x560f5fd3c2f0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.398+0000 7effaf400640 1 -- 172.21.15.79:0/3700188817 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7effbc0b1630 con 0x560f5fd3c2f0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.398+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc0036070 con 0x560f5fd3c2f0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.398+0000 7effaf400640 1 -- 172.21.15.79:0/3700188817 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effbc0ac990 con 0x560f5fd3c2f0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.398+0000 7effd780e740 10 client.16623 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.398+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560f5fe49620 con 0x560f5fd3c2f0 2024-09-21T02:49:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.398+0000 7effaf400640 1 -- 172.21.15.79:0/3700188817 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc0036070 con 0x560f5fd3c2f0 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.399+0000 7effaf400640 1 -- 172.21.15.79:0/3700188817 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effbc0b4ce0 con 0x560f5fd3c2f0 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.399+0000 7effd780e740 10 client.16623 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.399+0000 7effd780e740 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.399+0000 7effd780e740 20 client.16623 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.399+0000 7effd780e740 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f5fd23d80 0x560f60122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.399+0000 7effd780e740 4 client.16623 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.399+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f60081600 con 0x560f5fd23d80 2024-09-21T02:49:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.400+0000 7effcd200640 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f5fd23d80 0x560f60122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.401+0000 7effcd200640 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f5fd23d80 0x560f60122fc0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28fccdb5b658044e server_cookie=b4c7a8dc6d226bdd in_seq=0 out_seq=0 2024-09-21T02:49:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.401+0000 7effaf400640 10 client.16623 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.401+0000 7effaf400640 1 -- 172.21.15.79:0/3700188817 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560f60081600 con 0x560f5fd23d80 2024-09-21T02:49:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.401+0000 7effaf400640 10 client.16623 handle_command_reply: tid=0 2024-09-21T02:49:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 client.16623 shutdown 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 msgr2=0x560f601158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f601158a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7effbc0acb80 tx=0x7effbc009f50 comp rx=0 tx=0).stop 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 shutdown_connections 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f5fd23d80 0x560f60122fc0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd651b0 0x560f60116ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f60115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 --2- 172.21.15.79:0/3700188817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd3c2f0 0x560f601158a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 >> 172.21.15.79:0/3700188817 conn(0x560f5fd59300 msgr2=0x560f60106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effaf400640 0 client.16623 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 shutdown_connections 2024-09-21T02:49:49.405 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.402+0000 7effd780e740 1 -- 172.21.15.79:0/3700188817 wait complete. 2024-09-21T02:49:49.405 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.403+0000 7effd780e740 20 client.16623 trim_cache size 0 max 16384 2024-09-21T02:49:49.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.430+0000 7effd780e740 1 Processor -- start 2024-09-21T02:49:49.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.430+0000 7effd780e740 1 -- start start 2024-09-21T02:49:49.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effd780e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f6010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effd780e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd651b0 0x560f6010c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effd780e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fcf91c0 0x560f601102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effd780e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effc81a8380 con 0x560f5fd651b0 2024-09-21T02:49:49.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effd780e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7effc81aabe0 con 0x560f5fd444d0 2024-09-21T02:49:49.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effd780e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7effc81a89d0 con 0x560f5fcf91c0 2024-09-21T02:49:49.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effcd200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd651b0 0x560f6010c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effcdc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f6010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effcd200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd651b0 0x560f6010c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45442/0 (socket says 172.21.15.79:45442) 2024-09-21T02:49:49.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effcd200640 1 -- 172.21.15.79:0/2066967157 learned_addr learned my addr 172.21.15.79:0/2066967157 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:49.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.431+0000 7effce600640 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fcf91c0 0x560f601102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.432+0000 7effcd200640 1 -- 172.21.15.79:0/2066967157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fcf91c0 msgr2=0x560f601102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.432+0000 7effcd200640 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fcf91c0 0x560f601102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.432+0000 7effcd200640 1 -- 172.21.15.79:0/2066967157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 msgr2=0x560f6010bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.432+0000 7effcd200640 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f6010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.432+0000 7effcd200640 1 -- 172.21.15.79:0/2066967157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f60116e40 con 0x560f5fd651b0 2024-09-21T02:49:49.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.432+0000 7effcd200640 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd651b0 0x560f6010c4d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7effc0009ca0 tx=0x7effc0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd23373f3176460e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.433+0000 7effba000640 1 -- 172.21.15.79:0/2066967157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0049040 con 0x560f5fd651b0 2024-09-21T02:49:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.433+0000 7effba000640 1 -- 172.21.15.79:0/2066967157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc0036050 con 0x560f5fd651b0 2024-09-21T02:49:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.434+0000 7effba000640 1 -- 172.21.15.79:0/2066967157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0003fe0 con 0x560f5fd651b0 2024-09-21T02:49:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.435+0000 7effd780e740 1 -- 172.21.15.79:0/2066967157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd651b0 msgr2=0x560f6010c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.435+0000 7effd780e740 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd651b0 0x560f6010c4d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7effc0009ca0 tx=0x7effc0031a20 comp rx=0 tx=0).stop 2024-09-21T02:49:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.435+0000 7effd780e740 1 -- 172.21.15.79:0/2066967157 shutdown_connections 2024-09-21T02:49:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.435+0000 7effd780e740 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fcf91c0 0x560f601102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.435+0000 7effd780e740 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fd651b0 0x560f6010c4d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.435+0000 7effd780e740 1 --2- 172.21.15.79:0/2066967157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd444d0 0x560f6010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.435+0000 7effd780e740 1 -- 172.21.15.79:0/2066967157 >> 172.21.15.79:0/2066967157 conn(0x560f5fd59300 msgr2=0x560f6010d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.436+0000 7effd780e740 1 -- 172.21.15.79:0/2066967157 shutdown_connections 2024-09-21T02:49:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.436+0000 7effd780e740 1 -- 172.21.15.79:0/2066967157 wait complete. 2024-09-21T02:49:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.436+0000 7effd780e740 1 -- start start 2024-09-21T02:49:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.437+0000 7effd780e740 1 Processor -- start 2024-09-21T02:49:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.437+0000 7effd780e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fcf91c0 0x560f6011d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.437+0000 7effd780e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6011c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effd780e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6011c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effd780e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effc81a90a0 con 0x560f5fcf91c0 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effcdc00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fcf91c0 0x560f6011d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effce600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6011c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effcd200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6011c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effce600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6011c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51948/0 (socket says 172.21.15.79:51948) 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effce600640 1 -- 172.21.15.79:0/210249172 learned_addr learned my addr 172.21.15.79:0/210249172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.438+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7effc81aa510 con 0x560f5fd651b0 2024-09-21T02:49:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.439+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7effc81a9770 con 0x560f5fd444d0 2024-09-21T02:49:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.439+0000 7effd780e740 10 client.0 _ll_register_callbacks cb 0x7effbc0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.439+0000 7effce600640 1 -- 172.21.15.79:0/210249172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 msgr2=0x560f6011c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.439+0000 7effce600640 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6011c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.439+0000 7effce600640 1 -- 172.21.15.79:0/210249172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fcf91c0 msgr2=0x560f6011d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.440+0000 7effce600640 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fcf91c0 0x560f6011d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.440+0000 7effce600640 1 -- 172.21.15.79:0/210249172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f6011cca0 con 0x560f5fd651b0 2024-09-21T02:49:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.440+0000 7effcdc00640 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fcf91c0 0x560f6011d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.440+0000 7effce600640 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6011c6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7effb4023760 tx=0x7effb40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb6f3b28b977a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.440+0000 7effaf400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:49:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.440+0000 7effaf400640 1 -- 172.21.15.79:0/210249172 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4004320 con 0x560f5fd651b0 2024-09-21T02:49:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc0036050 con 0x560f5fd651b0 2024-09-21T02:49:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effaf400640 1 -- 172.21.15.79:0/210249172 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7effb40035f0 con 0x560f5fd651b0 2024-09-21T02:49:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effaf400640 1 -- 172.21.15.79:0/210249172 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effb403f050 con 0x560f5fd651b0 2024-09-21T02:49:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effd780e740 10 client.26915 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560f6018d9c0 con 0x560f5fd651b0 2024-09-21T02:49:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effaf400640 1 -- 172.21.15.79:0/210249172 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc0036050 con 0x560f5fd651b0 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effaf400640 1 -- 172.21.15.79:0/210249172 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effb40218b0 con 0x560f5fd651b0 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effd780e740 10 client.26915 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.441+0000 7effd780e740 10 client.26915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.442+0000 7effd780e740 20 client.26915 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.442+0000 7effd780e740 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f6018e2b0 0x560f601906d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.442+0000 7effd780e740 4 client.26915 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.442+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560f6007d0b0 con 0x560f6018e2b0 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.442+0000 7effcdc00640 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f6018e2b0 0x560f601906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.442+0000 7effcdc00640 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f6018e2b0 0x560f601906d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e99b16a7e382feb server_cookie=9c6506cfe7b2d417 in_seq=0 out_seq=0 2024-09-21T02:49:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.442+0000 7effaf400640 10 client.26915 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effaf400640 1 -- 172.21.15.79:0/210249172 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560f6007d0b0 con 0x560f6018e2b0 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effaf400640 10 client.26915 handle_command_reply: tid=0 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 client.26915 shutdown 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 msgr2=0x560f6011c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6011c6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7effb4023760 tx=0x7effb40046c0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 shutdown_connections 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x560f6018e2b0 0x560f601906d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f5fd651b0 0x560f6011c6e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560f5fd444d0 0x560f6011c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 --2- 172.21.15.79:0/210249172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f5fcf91c0 0x560f6011d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effaf400640 0 client.26915 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.496+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 >> 172.21.15.79:0/210249172 conn(0x560f5fd59300 msgr2=0x560f6010bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.497+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 shutdown_connections 2024-09-21T02:49:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.497+0000 7effd780e740 1 -- 172.21.15.79:0/210249172 wait complete. 2024-09-21T02:49:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.497+0000 7effd780e740 20 client.26915 trim_cache size 0 max 16384 2024-09-21T02:49:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:49:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:49:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:49:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7effb00b6660 msgr2=0x7effb00b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7effb00b6660 0x7effb00b8b70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7effb4009bd0 tx=0x7effb4005f90 comp rx=0 tx=0).stop 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 msgr2=0x7effc819bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 0x7effc819bf60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7effbc00d950 tx=0x7effbc00de10 comp rx=0 tx=0).stop 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 shutdown_connections 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7effb00b6660 0x7effb00b8b70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effc8104f00 0x7effc819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effc8104560 0x7effc819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 --2- 172.21.15.79:0/2758275762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effc81034e0 0x7effc819bf60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 >> 172.21.15.79:0/2758275762 conn(0x7effc80fee20 msgr2=0x7effc80755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.498+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 shutdown_connections 2024-09-21T02:49:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:49:49.499+0000 7effcf000640 1 -- 172.21.15.79:0/2758275762 wait complete. 2024-09-21T02:49:49.542 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:49:49.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:49 smithi148 ceph-mon[34626]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 434 KiB/s wr, 63 op/s 2024-09-21T02:49:49.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:49 smithi098 ceph-mon[34832]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 434 KiB/s wr, 63 op/s 2024-09-21T02:49:49.695 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:49 smithi079 ceph-mon[30788]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 434 KiB/s wr, 63 op/s 2024-09-21T02:49:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.375+0000 7f5615400640 1 -- 172.21.15.79:0/2922779521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610077380 msgr2=0x7f56100757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.375+0000 7f5615400640 1 --2- 172.21.15.79:0/2922779521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610077380 0x7f56100757b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009900 tx=0x7f55fc02a440 comp rx=0 tx=0).stop 2024-09-21T02:49:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.376+0000 7f5615400640 1 -- 172.21.15.79:0/2922779521 shutdown_connections 2024-09-21T02:49:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.376+0000 7f5615400640 1 --2- 172.21.15.79:0/2922779521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5610114440 0x7f5610116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.376+0000 7f5615400640 1 --2- 172.21.15.79:0/2922779521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5610075dd0 0x7f56100761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.376+0000 7f5615400640 1 --2- 172.21.15.79:0/2922779521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610077380 0x7f56100757b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.376+0000 7f5615400640 1 -- 172.21.15.79:0/2922779521 >> 172.21.15.79:0/2922779521 conn(0x7f56100ff5e0 msgr2=0x7f5610101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:50.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.377+0000 7f5615400640 1 -- 172.21.15.79:0/2922779521 shutdown_connections 2024-09-21T02:49:50.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.378+0000 7f5615400640 1 -- 172.21.15.79:0/2922779521 wait complete. 2024-09-21T02:49:50.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.381+0000 7f5615400640 1 Processor -- start 2024-09-21T02:49:50.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.381+0000 7f5615400640 1 -- start start 2024-09-21T02:49:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f5615400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5610075dd0 0x7f56101a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f5615400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5610077380 0x7f56101a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f5615400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610114440 0x7f56101a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f5615400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f561011a0e0 con 0x7f5610077380 2024-09-21T02:49:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f5615400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5610119f60 con 0x7f5610114440 2024-09-21T02:49:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f5615400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f561011a260 con 0x7f5610075dd0 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f560e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5610075dd0 0x7f56101a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f560f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610114440 0x7f56101a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f560f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610114440 0x7f56101a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:51966/0 (socket says 172.21.15.79:51966) 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f560e800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5610075dd0 0x7f56101a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:47950/0 (socket says 172.21.15.79:47950) 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.382+0000 7f560f200640 1 -- 172.21.15.79:0/818218405 learned_addr learned my addr 172.21.15.79:0/818218405 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.383+0000 7f560f200640 1 -- 172.21.15.79:0/818218405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5610075dd0 msgr2=0x7f56101a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.383+0000 7f560f200640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5610075dd0 0x7f56101a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.383+0000 7f560f200640 1 -- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5610077380 msgr2=0x7f56101a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.383+0000 7f560f200640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5610077380 0x7f56101a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.383+0000 7f560f200640 1 -- 172.21.15.79:0/818218405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56101a6aa0 con 0x7f5610114440 2024-09-21T02:49:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.384+0000 7f560f200640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610114440 0x7f56101a6370 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5608009fd0 tx=0x7f560800b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.384+0000 7f5607400640 1 -- 172.21.15.79:0/818218405 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608017070 con 0x7f5610114440 2024-09-21T02:49:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.385+0000 7f5607400640 1 -- 172.21.15.79:0/818218405 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5608003e20 con 0x7f5610114440 2024-09-21T02:49:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.385+0000 7f5607400640 1 -- 172.21.15.79:0/818218405 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608010460 con 0x7f5610114440 2024-09-21T02:49:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.385+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56101a6d90 con 0x7f5610114440 2024-09-21T02:49:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.385+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56101ad4f0 con 0x7f5610114440 2024-09-21T02:49:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.389+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56100761e0 con 0x7f5610114440 2024-09-21T02:49:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.392+0000 7f5607400640 1 -- 172.21.15.79:0/818218405 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5608003970 con 0x7f5610114440 2024-09-21T02:49:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.394+0000 7f5607400640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55f40b6590 0x7f55f40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.395+0000 7f5607400640 1 -- 172.21.15.79:0/818218405 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f56080e7390 con 0x7f5610114440 2024-09-21T02:49:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.396+0000 7f560e800640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55f40b6590 0x7f55f40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.397+0000 7f560e800640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55f40b6590 0x7f55f40b8aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009230 tx=0x7f55fc005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.398+0000 7f5607400640 1 -- 172.21.15.79:0/818218405 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56080ad910 con 0x7f5610114440 2024-09-21T02:49:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.782+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5610113170 con 0x7f5610114440 2024-09-21T02:49:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.783+0000 7f5607400640 1 -- 172.21.15.79:0/818218405 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f56080b1cf0 con 0x7f5610114440 2024-09-21T02:49:50.785 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:49:50.785 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:49:50.785 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:49:50.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55f40b6590 msgr2=0x7f55f40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:50.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55f40b6590 0x7f55f40b8aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009230 tx=0x7f55fc005a20 comp rx=0 tx=0).stop 2024-09-21T02:49:50.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610114440 msgr2=0x7f56101a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:50.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610114440 0x7f56101a6370 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5608009fd0 tx=0x7f560800b260 comp rx=0 tx=0).stop 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 shutdown_connections 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f55f40b6590 0x7f55f40b8aa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5610114440 0x7f56101a6370 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5610077380 0x7f56101a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 --2- 172.21.15.79:0/818218405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5610075dd0 0x7f56101a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.786+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 >> 172.21.15.79:0/818218405 conn(0x7f56100ff5e0 msgr2=0x7f5610110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.787+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 shutdown_connections 2024-09-21T02:49:50.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:50.787+0000 7f5615400640 1 -- 172.21.15.79:0/818218405 wait complete. 2024-09-21T02:49:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 835.0 s, 309.9 tps, lat 1137.771 ms stddev 3502.934 2024-09-21T02:49:51.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:51 smithi148 ceph-mon[34626]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 258 KiB/s wr, 31 op/s 2024-09-21T02:49:51.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:51 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/818218405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:51 smithi098 ceph-mon[34832]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 258 KiB/s wr, 31 op/s 2024-09-21T02:49:51.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:51 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/818218405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:51.664 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:51 smithi079 ceph-mon[30788]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 258 KiB/s wr, 31 op/s 2024-09-21T02:49:51.664 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:51 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/818218405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:49:51.729 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-21T02:49:51.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-21T02:49:52.290 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:49:53.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:53 smithi148 ceph-mon[34626]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 550 KiB/s wr, 76 op/s 2024-09-21T02:49:53.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:53 smithi098 ceph-mon[34832]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 550 KiB/s wr, 76 op/s 2024-09-21T02:49:53.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:53 smithi079 ceph-mon[30788]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 550 KiB/s wr, 76 op/s 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 -- 172.21.15.79:0/2879959974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 msgr2=0x7f4420109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 --2- 172.21.15.79:0/2879959974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420109710 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4414009900 tx=0x7f441402a440 comp rx=0 tx=0).stop 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 -- 172.21.15.79:0/2879959974 shutdown_connections 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 --2- 172.21.15.79:0/2879959974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4420109c50 0x7f4420110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 --2- 172.21.15.79:0/2879959974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420109710 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 --2- 172.21.15.79:0/2879959974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44201039c0 0x7f4420103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 -- 172.21.15.79:0/2879959974 >> 172.21.15.79:0/2879959974 conn(0x7f44200ff430 msgr2=0x7f4420101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 -- 172.21.15.79:0/2879959974 shutdown_connections 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.227+0000 7f4427200640 1 -- 172.21.15.79:0/2879959974 wait complete. 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.229+0000 7f4427200640 1 Processor -- start 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.229+0000 7f4427200640 1 -- start start 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.230+0000 7f4427200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44201039c0 0x7f4420075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.230+0000 7f4427200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.230+0000 7f4425e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44201039c0 0x7f4420075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.230+0000 7f4425e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44201039c0 0x7f4420075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:48126/0 (socket says 172.21.15.79:48126) 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.230+0000 7f4427200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420109c50 0x7f4420076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.230+0000 7f4425400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.230+0000 7f4425400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58370/0 (socket says 172.21.15.79:58370) 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.231+0000 7f4425e00640 1 -- 172.21.15.79:0/1709941482 learned_addr learned my addr 172.21.15.79:0/1709941482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.231+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44201139a0 con 0x7f4420109c50 2024-09-21T02:49:54.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.231+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4420113820 con 0x7f44201039c0 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.231+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4420113b20 con 0x7f4420109300 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.231+0000 7f4426800640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420109c50 0x7f4420076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.232+0000 7f4425400640 1 -- 172.21.15.79:0/1709941482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44201039c0 msgr2=0x7f4420075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.232+0000 7f4425400640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44201039c0 0x7f4420075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.232+0000 7f4425400640 1 -- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420109c50 msgr2=0x7f4420076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.232+0000 7f4425400640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420109c50 0x7f4420076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.232+0000 7f4425400640 1 -- 172.21.15.79:0/1709941482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44201a8670 con 0x7f4420109300 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.232+0000 7f4425400640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420075c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4414009230 tx=0x7f4414003de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.232+0000 7f441aa00640 1 -- 172.21.15.79:0/1709941482 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441403f070 con 0x7f4420109300 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.233+0000 7f441aa00640 1 -- 172.21.15.79:0/1709941482 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f441403bd20 con 0x7f4420109300 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.235+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44201a8900 con 0x7f4420109300 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.235+0000 7f441aa00640 1 -- 172.21.15.79:0/1709941482 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414035030 con 0x7f4420109300 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.236+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44201a8cf0 con 0x7f4420109300 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.241+0000 7f442f3f5740 1 Processor -- start 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.241+0000 7f442f3f5740 1 -- start start 2024-09-21T02:49:54.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.242+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.242+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.242+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2d5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.242+0000 7f442f3f5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b5fc24aa90 con 0x55b5fbf0cb70 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.242+0000 7f442f3f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b5fc239ec0 con 0x55b5fbf2d850 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.242+0000 7f442f3f5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b5fc23dcd0 con 0x55b5fbf04990 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.243+0000 7f441aa00640 1 -- 172.21.15.79:0/1709941482 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4414042070 con 0x7f4420109300 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.243+0000 7f4425400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.243+0000 7f4425e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4425e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2d50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58380/0 (socket says 172.21.15.79:58380) 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4425e00640 1 -- 172.21.15.79:0/2135460758 learned_addr learned my addr 172.21.15.79:0/2135460758 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4426800640 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4426800640 1 -- 172.21.15.79:0/2135460758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 msgr2=0x55b5fc2d50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:54.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4426800640 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2d50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4426800640 1 -- 172.21.15.79:0/2135460758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 msgr2=0x55b5fc2d5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4426800640 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2d5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.244+0000 7f4426800640 1 -- 172.21.15.79:0/2135460758 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5fc1df9d0 con 0x55b5fbf2d850 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.245+0000 7f441aa00640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f44080b6600 0x7f44080b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.245+0000 7f441aa00640 1 -- 172.21.15.79:0/1709941482 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4414107d60 con 0x7f4420109300 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.246+0000 7f4425e00640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f44080b6600 0x7f44080b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.247+0000 7f4425e00640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f44080b6600 0x7f44080b8b10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55b5fc2d3810 tx=0x7f441c007620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.248+0000 7f4426800640 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d4b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f441000a790 tx=0x7f441000ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8bf095dc906ebee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.248+0000 7f440f000640 1 -- 172.21.15.79:0/2135460758 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410015070 con 0x55b5fbf2d850 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.249+0000 7f440f000640 1 -- 172.21.15.79:0/2135460758 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44100113f0 con 0x55b5fbf2d850 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.249+0000 7f440f000640 1 -- 172.21.15.79:0/2135460758 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44100185c0 con 0x55b5fbf2d850 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.253+0000 7f442f3f5740 1 -- 172.21.15.79:0/2135460758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 msgr2=0x55b5fc2d4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.253+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d4b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f441000a790 tx=0x7f441000ac50 comp rx=0 tx=0).stop 2024-09-21T02:49:54.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.253+0000 7f442f3f5740 1 -- 172.21.15.79:0/2135460758 shutdown_connections 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.253+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2d5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.253+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2d50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.253+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2135460758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d4b90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.254+0000 7f442f3f5740 1 -- 172.21.15.79:0/2135460758 >> 172.21.15.79:0/2135460758 conn(0x55b5fbf21c40 msgr2=0x55b5fc2d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.255+0000 7f442f3f5740 1 -- 172.21.15.79:0/2135460758 shutdown_connections 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.255+0000 7f442f3f5740 1 -- 172.21.15.79:0/2135460758 wait complete. 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.256+0000 7f442f3f5740 1 -- start start 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.257+0000 7f442f3f5740 1 Processor -- start 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.258+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2e0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.258+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2e1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.258+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2e6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.258+0000 7f442f3f5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b5fc09b7b0 con 0x55b5fbf0cb70 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.258+0000 7f442f3f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b5fc1de650 con 0x55b5fbf2d850 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.258+0000 7f442f3f5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b5fc2db240 con 0x55b5fbf04990 2024-09-21T02:49:54.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.258+0000 7f442f3f5740 10 client.0 _ll_register_callbacks cb 0x55b5fbf450a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.259+0000 7f4425e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2e0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.262+0000 7f4426800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.262+0000 7f4425e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2e0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58390/0 (socket says 172.21.15.79:58390) 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.262+0000 7f4425e00640 1 -- 172.21.15.79:0/2540506482 learned_addr learned my addr 172.21.15.79:0/2540506482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.262+0000 7f4426800640 1 -- 172.21.15.79:0/2540506482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 msgr2=0x55b5fc2e0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.262+0000 7f4426800640 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2e0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.263+0000 7f4426800640 1 -- 172.21.15.79:0/2540506482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 msgr2=0x55b5fc2e1310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.263+0000 7f4426800640 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.263+0000 7f4426800640 1 -- 172.21.15.79:0/2540506482 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5fbfa7ba0 con 0x55b5fbf2d850 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.263+0000 7f4425e00640 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.264+0000 7f4426800640 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2e6350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4410011dc0 tx=0x7f44100117d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad80c010098273c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.264+0000 7f4403400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:49:54.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.265+0000 7f4403400640 1 -- 172.21.15.79:0/2540506482 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410029060 con 0x55b5fbf2d850 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.266+0000 7f4403400640 1 -- 172.21.15.79:0/2540506482 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f441001a450 con 0x55b5fbf2d850 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.266+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44100113f0 con 0x55b5fbf2d850 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.266+0000 7f4403400640 1 -- 172.21.15.79:0/2540506482 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4410015040 con 0x55b5fbf2d850 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.266+0000 7f442f3f5740 10 client.26930 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.266+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b5fc3112b0 con 0x55b5fbf2d850 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.267+0000 7f4403400640 1 -- 172.21.15.79:0/2540506482 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44100113f0 con 0x55b5fbf2d850 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.270+0000 7f4403400640 1 -- 172.21.15.79:0/2540506482 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f441002d3a0 con 0x55b5fbf2d850 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.270+0000 7f442f3f5740 10 client.26930 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.270+0000 7f442f3f5740 10 client.26930 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.270+0000 7f442f3f5740 20 client.26930 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.270+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbeec1d0 0x55b5fc314610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.270+0000 7f442f3f5740 4 client.26930 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.270+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5fc24c9e0 con 0x55b5fbeec1d0 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.272+0000 7f4425e00640 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbeec1d0 0x55b5fc314610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.272+0000 7f4425e00640 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbeec1d0 0x55b5fc314610 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec22c0500ab1fe6 server_cookie=99959402effcbaf3 in_seq=0 out_seq=0 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.272+0000 7f4403400640 10 client.26930 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.274+0000 7f4403400640 1 -- 172.21.15.79:0/2540506482 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5fc24c9e0 con 0x55b5fbeec1d0 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.274+0000 7f4403400640 10 client.26930 handle_command_reply: tid=0 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.274+0000 7f442f3f5740 1 client.26930 shutdown 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.274+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 msgr2=0x55b5fc2e6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.274+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2e6350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4410011dc0 tx=0x7f44100117d0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 shutdown_connections 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbeec1d0 0x55b5fc314610 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf2d850 0x55b5fc2e6350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2e1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f442f3f5740 1 --2- 172.21.15.79:0/2540506482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf04990 0x55b5fc2e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 >> 172.21.15.79:0/2540506482 conn(0x55b5fbf21c40 msgr2=0x55b5fc2d7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f4403400640 0 client.26930 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:54.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.275+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 shutdown_connections 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.277+0000 7f442f3f5740 1 -- 172.21.15.79:0/2540506482 wait complete. 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.278+0000 7f442f3f5740 20 client.26930 trim_cache size 0 max 16384 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.311+0000 7f442f3f5740 1 Processor -- start 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.311+0000 7f442f3f5740 1 -- start start 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.312+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf04990 0x55b5fc2ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.312+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2de280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.312+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f4425e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf04990 0x55b5fc2ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f4425400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2de280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f442f3f5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4420070500 con 0x55b5fbf2d850 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f442f3f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4420072d80 con 0x55b5fbf04990 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f442f3f5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4420070b70 con 0x55b5fbf0cb70 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f4426800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f4426800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44464/0 (socket says 172.21.15.79:44464) 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.313+0000 7f4426800640 1 -- 172.21.15.79:0/770881652 learned_addr learned my addr 172.21.15.79:0/770881652 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.314+0000 7f4426800640 1 -- 172.21.15.79:0/770881652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf0cb70 msgr2=0x55b5fc2de280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.314+0000 7f4426800640 1 --2- 172.21.15.79:0/770881652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2de280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.314+0000 7f4426800640 1 -- 172.21.15.79:0/770881652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf04990 msgr2=0x55b5fc2ddd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.314+0000 7f4426800640 1 --2- 172.21.15.79:0/770881652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf04990 0x55b5fc2ddd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.314+0000 7f4426800640 1 -- 172.21.15.79:0/770881652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5fc2d3400 con 0x55b5fbf2d850 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.316+0000 7f4426800640 1 --2- 172.21.15.79:0/770881652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d7cf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f441002d7a0 tx=0x7f4410006b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469c8c3985034426 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.324+0000 7f440e600640 1 -- 172.21.15.79:0/770881652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410029070 con 0x55b5fbf2d850 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.324+0000 7f440e600640 1 -- 172.21.15.79:0/770881652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44100113f0 con 0x55b5fbf2d850 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.324+0000 7f440e600640 1 -- 172.21.15.79:0/770881652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410033080 con 0x55b5fbf2d850 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.325+0000 7f442f3f5740 1 -- 172.21.15.79:0/770881652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf2d850 msgr2=0x55b5fc2d7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.325+0000 7f442f3f5740 1 --2- 172.21.15.79:0/770881652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d7cf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f441002d7a0 tx=0x7f4410006b00 comp rx=0 tx=0).stop 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.326+0000 7f442f3f5740 1 -- 172.21.15.79:0/770881652 shutdown_connections 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.326+0000 7f442f3f5740 1 --2- 172.21.15.79:0/770881652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf2d850 0x55b5fc2d7cf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.326+0000 7f442f3f5740 1 --2- 172.21.15.79:0/770881652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf0cb70 0x55b5fc2de280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.326+0000 7f442f3f5740 1 --2- 172.21.15.79:0/770881652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf04990 0x55b5fc2ddd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.326+0000 7f442f3f5740 1 -- 172.21.15.79:0/770881652 >> 172.21.15.79:0/770881652 conn(0x55b5fbf21c40 msgr2=0x55b5fc2dbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.326+0000 7f442f3f5740 1 -- 172.21.15.79:0/770881652 shutdown_connections 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.326+0000 7f442f3f5740 1 -- 172.21.15.79:0/770881652 wait complete. 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.327+0000 7f442f3f5740 1 -- start start 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.327+0000 7f442f3f5740 1 Processor -- start 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.328+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf04990 0x55b5fc313de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf0cb70 0x55b5fc314320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f4425e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf04990 0x55b5fc313de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f442f3f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf2d850 0x55b5fc37dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f442f3f5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4420071240 con 0x55b5fbf04990 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f442f3f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f44200726b0 con 0x55b5fbf0cb70 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f442f3f5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4420071910 con 0x55b5fbf2d850 2024-09-21T02:49:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f4426800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf2d850 0x55b5fc37dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f4426800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf2d850 0x55b5fc37dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:58418/0 (socket says 172.21.15.79:58418) 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.329+0000 7f4426800640 1 -- 172.21.15.79:0/1550571117 learned_addr learned my addr 172.21.15.79:0/1550571117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.330+0000 7f4426800640 1 -- 172.21.15.79:0/1550571117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf0cb70 msgr2=0x55b5fc314320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.330+0000 7f4426800640 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf0cb70 0x55b5fc314320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.330+0000 7f4426800640 1 -- 172.21.15.79:0/1550571117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf04990 msgr2=0x55b5fc313de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.330+0000 7f4426800640 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf04990 0x55b5fc313de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.330+0000 7f4426800640 1 -- 172.21.15.79:0/1550571117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5fc37e2c0 con 0x55b5fbf2d850 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.332+0000 7f4426800640 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf2d850 0x55b5fc37dd80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f441002d910 tx=0x7f441002de50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5493402dcc6974a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.332+0000 7f4403400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.332+0000 7f442f3f5740 10 client.0 _ll_register_callbacks cb 0x7f441000a5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.332+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44100113f0 con 0x55b5fbf2d850 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.335+0000 7f4403400640 1 -- 172.21.15.79:0/1550571117 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441003b060 con 0x55b5fbf2d850 2024-09-21T02:49:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.335+0000 7f4403400640 1 -- 172.21.15.79:0/1550571117 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f4410011bc0 con 0x55b5fbf2d850 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.335+0000 7f4403400640 1 -- 172.21.15.79:0/1550571117 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4410042050 con 0x55b5fbf2d850 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.335+0000 7f442f3f5740 10 client.26971 fetch_fsmap learned FSMap version 21 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.337+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55b5fc37f2c0 con 0x55b5fbf2d850 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.337+0000 7f4403400640 1 -- 172.21.15.79:0/1550571117 <== mon.1 v2:172.21.15.148:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4410004040 con 0x55b5fbf2d850 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.338+0000 7f442f3f5740 10 client.26971 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.338+0000 7f442f3f5740 10 client.26971 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.338+0000 7f442f3f5740 20 client.26971 populate_metadata read hostname 'smithi079' 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.338+0000 7f442f3f5740 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbec1580 0x55b5fc3818a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.338+0000 7f442f3f5740 4 client.26971 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.338+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x55b5fc2e6ba0 con 0x55b5fbec1580 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.340+0000 7f4425e00640 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbec1580 0x55b5fc3818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.341+0000 7f4403400640 10 client.26971 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.341+0000 7f4425e00640 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbec1580 0x55b5fc3818a0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c73a775b01fd6e27 server_cookie=e3f0e9c02b448d72 in_seq=0 out_seq=0 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f4403400640 1 -- 172.21.15.79:0/1550571117 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b5fc2e6ba0 con 0x55b5fbec1580 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f4403400640 10 client.26971 handle_command_reply: tid=0 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 client.26971 shutdown 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf2d850 msgr2=0x55b5fc37dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf2d850 0x55b5fc37dd80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f441002d910 tx=0x7f441002de50 comp rx=0 tx=0).stop 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 shutdown_connections 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55b5fbec1580 0x55b5fc3818a0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5fbf2d850 0x55b5fc37dd80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5fbf0cb70 0x55b5fc314320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 --2- 172.21.15.79:0/1550571117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5fbf04990 0x55b5fc313de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f4403400640 0 client.26971 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 >> 172.21.15.79:0/1550571117 conn(0x55b5fbf21c40 msgr2=0x55b5fc2e3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 shutdown_connections 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 1 -- 172.21.15.79:0/1550571117 wait complete. 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.686+0000 7f442f3f5740 20 client.26971 trim_cache size 0 max 16384 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:49:54.690 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 58, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "21fa08aa": { 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 58, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 138.8, 2024-09-21T02:49:54.691 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "QUIESCED", 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:49:54.692 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f44080b6600 msgr2=0x7f44080b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f44080b6600 0x7f44080b8b10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55b5fc2d3810 tx=0x7f441c007620 comp rx=0 tx=0).stop 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 msgr2=0x7f4420075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420075c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4414009230 tx=0x7f4414003de0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 shutdown_connections 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f44080b6600 0x7f44080b8b10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4420109c50 0x7f4420076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4420109300 0x7f4420075c50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 --2- 172.21.15.79:0/1709941482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44201039c0 0x7f4420075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:49:54.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.687+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 >> 172.21.15.79:0/1709941482 conn(0x7f44200ff430 msgr2=0x7f4420101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:49:54.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.688+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 shutdown_connections 2024-09-21T02:49:54.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:49:54.688+0000 7f4427200640 1 -- 172.21.15.79:0/1709941482 wait complete. 2024-09-21T02:49:55.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:55 smithi079 ceph-mon[30788]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-21T02:49:55.564 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '21fa08aa', quiesce took 6.7 seconds. Will release after: 12.150000000000002 2024-09-21T02:49:55.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:55 smithi098 ceph-mon[34832]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-21T02:49:55.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:55 smithi148 ceph-mon[34626]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-21T02:49:56.495 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 840.0 s, 284.5 tps, lat 200.268 ms stddev 268.416 2024-09-21T02:49:57.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:57 smithi098 ceph-mon[34832]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-09-21T02:49:57.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:57 smithi079 ceph-mon[30788]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-09-21T02:49:57.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:57 smithi148 ceph-mon[34626]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-09-21T02:49:59.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:49:59 smithi098 ceph-mon[34832]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 2.2 MiB/s wr, 246 op/s 2024-09-21T02:49:59.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:49:59 smithi079 ceph-mon[30788]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 2.2 MiB/s wr, 246 op/s 2024-09-21T02:49:59.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:49:59 smithi148 ceph-mon[34626]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 2.2 MiB/s wr, 246 op/s 2024-09-21T02:50:00.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:00 smithi098 ceph-mon[34832]: overall HEALTH_OK 2024-09-21T02:50:00.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:00 smithi079 ceph-mon[30788]: overall HEALTH_OK 2024-09-21T02:50:00.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:00 smithi148 ceph-mon[34626]: overall HEALTH_OK 2024-09-21T02:50:01.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:50:01.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:01 smithi098 ceph-mon[34832]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2024-09-21T02:50:01.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:01 smithi079 ceph-mon[30788]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2024-09-21T02:50:01.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:01 smithi148 ceph-mon[34626]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2024-09-21T02:50:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.723+0000 7fa8d9600640 1 -- 172.21.15.79:0/3380803238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41058d0 msgr2=0x7fa8d4105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.723+0000 7fa8d9600640 1 --2- 172.21.15.79:0/3380803238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41058d0 0x7fa8d4105d40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009860 tx=0x7fa8c402a340 comp rx=0 tx=0).stop 2024-09-21T02:50:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.723+0000 7fa8d9600640 1 -- 172.21.15.79:0/3380803238 shutdown_connections 2024-09-21T02:50:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.723+0000 7fa8d9600640 1 --2- 172.21.15.79:0/3380803238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d41072f0 0x7fa8d410dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.723+0000 7fa8d9600640 1 --2- 172.21.15.79:0/3380803238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d4106950 0x7fa8d4106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.723+0000 7fa8d9600640 1 --2- 172.21.15.79:0/3380803238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41058d0 0x7fa8d4105d40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.723+0000 7fa8d9600640 1 -- 172.21.15.79:0/3380803238 >> 172.21.15.79:0/3380803238 conn(0x7fa8d4101230 msgr2=0x7fa8d41036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.724+0000 7fa8d9600640 1 -- 172.21.15.79:0/3380803238 shutdown_connections 2024-09-21T02:50:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.724+0000 7fa8d9600640 1 -- 172.21.15.79:0/3380803238 wait complete. 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.724+0000 7fa8d9600640 1 Processor -- start 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d9600640 1 -- start start 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d9600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d41058d0 0x7fa8d419c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d9600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d4106950 0x7fa8d419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d9600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41072f0 0x7fa8d419d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d9600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4111510 con 0x7fa8d41072f0 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d9600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4111390 con 0x7fa8d41058d0 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d9600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4111690 con 0x7fa8d4106950 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41072f0 0x7fa8d419d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41072f0 0x7fa8d419d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44498/0 (socket says 172.21.15.79:44498) 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d3400640 1 -- 172.21.15.79:0/4187957325 learned_addr learned my addr 172.21.15.79:0/4187957325 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d41058d0 0x7fa8d419c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.725+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d4106950 0x7fa8d419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d3400640 1 -- 172.21.15.79:0/4187957325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d4106950 msgr2=0x7fa8d419c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d3400640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d4106950 0x7fa8d419c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d3400640 1 -- 172.21.15.79:0/4187957325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d41058d0 msgr2=0x7fa8d419c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d3400640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d41058d0 0x7fa8d419c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d3400640 1 -- 172.21.15.79:0/4187957325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d419db80 con 0x7fa8d41072f0 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d3400640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41072f0 0x7fa8d419d360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009fd0 tx=0x7fa8cc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8cb400640 1 -- 172.21.15.79:0/4187957325 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc004b20 con 0x7fa8d41072f0 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8cb400640 1 -- 172.21.15.79:0/4187957325 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8cc003e20 con 0x7fa8d41072f0 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8cb400640 1 -- 172.21.15.79:0/4187957325 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc004820 con 0x7fa8d41072f0 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d419de70 con 0x7fa8d41072f0 2024-09-21T02:50:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.726+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d41a4560 con 0x7fa8d41072f0 2024-09-21T02:50:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.729+0000 7fa8e0832740 1 Processor -- start 2024-09-21T02:50:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8cb400640 1 -- 172.21.15.79:0/4187957325 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa8cc01d020 con 0x7fa8d41072f0 2024-09-21T02:50:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8e0832740 1 -- start start 2024-09-21T02:50:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8e0832740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c4669216b0 con 0x55c4666071b0 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8e0832740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c466910ae0 con 0x55c4665e64d0 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.730+0000 7fa8e0832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c4669148f0 con 0x55c4665de2f0 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44514/0 (socket says 172.21.15.79:44514) 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 -- 172.21.15.79:0/1504645495 learned_addr learned my addr 172.21.15.79:0/1504645495 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 -- 172.21.15.79:0/1504645495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 msgr2=0x55c4669ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 -- 172.21.15.79:0/1504645495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 msgr2=0x55c4669af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 -- 172.21.15.79:0/1504645495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4668dd780 con 0x55c4666071b0 2024-09-21T02:50:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669ae0d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc013860 tx=0x7fa8bc0097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2a3262c5fe08d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.731+0000 7fa8cb400640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa8b80b6510 0x7fa8b80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.732+0000 7fa8c3400640 1 -- 172.21.15.79:0/1504645495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc013de0 con 0x55c4666071b0 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.732+0000 7fa8c3400640 1 -- 172.21.15.79:0/1504645495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8bc011c90 con 0x55c4666071b0 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.732+0000 7fa8c3400640 1 -- 172.21.15.79:0/1504645495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc01fc30 con 0x55c4666071b0 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.732+0000 7fa8cb400640 1 -- 172.21.15.79:0/4187957325 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa8cc0e76b0 con 0x7fa8d41072f0 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.732+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa8b80b6510 0x7fa8b80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 -- 172.21.15.79:0/1504645495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 msgr2=0x55c4669ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa8b80b6510 0x7fa8b80b8a20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4000c00 tx=0x7fa8c402c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669ae0d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc013860 tx=0x7fa8bc0097e0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 -- 172.21.15.79:0/1504645495 shutdown_connections 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 --2- 172.21.15.79:0/1504645495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669ae0d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 -- 172.21.15.79:0/1504645495 >> 172.21.15.79:0/1504645495 conn(0x55c4665fb300 msgr2=0x55c4669a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 -- 172.21.15.79:0/1504645495 shutdown_connections 2024-09-21T02:50:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 -- 172.21.15.79:0/1504645495 wait complete. 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.733+0000 7fa8e0832740 1 -- start start 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 1 Processor -- start 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665de2f0 0x55c4669b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c466848ab0 con 0x55c4666071b0 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c4668b7570 con 0x55c4665de2f0 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c4669afdb0 con 0x55c4665e64d0 2024-09-21T02:50:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8e0832740 10 client.0 _ll_register_callbacks cb 0x55c4668c6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8d2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665de2f0 0x55c4669b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8d2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665de2f0 0x55c4669b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:48196/0 (socket says 172.21.15.79:48196) 2024-09-21T02:50:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8d2a00640 1 -- 172.21.15.79:0/3280430772 learned_addr learned my addr 172.21.15.79:0/3280430772 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.734+0000 7fa8d3400640 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8cbe00640 1 -- 172.21.15.79:0/3280430772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665de2f0 msgr2=0x55c4669b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665de2f0 0x55c4669b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8cbe00640 1 -- 172.21.15.79:0/3280430772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 msgr2=0x55c4669b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8cbe00640 1 -- 172.21.15.79:0/3280430772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c466672790 con 0x55c4665e64d0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669b7e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc013860 tx=0x7fa8bc011a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b872c8160fe8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3280430772 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc013240 con 0x55c4665e64d0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8bc011c90 con 0x55c4665e64d0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.735+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3280430772 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa8bc01f9b0 con 0x55c4665e64d0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3280430772 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa8bc031050 con 0x55c4665e64d0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 10 client.26983 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c4666eb620 con 0x55c4665e64d0 2024-09-21T02:50:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3280430772 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8bc011c90 con 0x55c4665e64d0 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3280430772 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa8bc027030 con 0x55c4665e64d0 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 10 client.26983 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 10 client.26983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 20 client.26983 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c4665c5d80 0x55c4669c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 4 client.26983 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.736+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c466923600 con 0x55c4665c5d80 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.737+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c4665c5d80 0x55c4669c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.737+0000 7fa8b7e00640 10 client.26983 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.737+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c4665c5d80 0x55c4669c4c70 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fd923ce1218d094 server_cookie=2cb11ffa0e90dd68 in_seq=0 out_seq=0 2024-09-21T02:50:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.738+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3280430772 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c466923600 con 0x55c4665c5d80 2024-09-21T02:50:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.738+0000 7fa8b7e00640 10 client.26983 handle_command_reply: tid=0 2024-09-21T02:50:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.738+0000 7fa8e0832740 1 client.26983 shutdown 2024-09-21T02:50:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.738+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 msgr2=0x55c4669b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.738+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669b7e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc013860 tx=0x7fa8bc011a90 comp rx=0 tx=0).stop 2024-09-21T02:50:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.738+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 shutdown_connections 2024-09-21T02:50:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c4665c5d80 0x55c4669c4c70 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8b7e00640 0 client.26983 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669b7e90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3280430772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665de2f0 0x55c4669b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 >> 172.21.15.79:0/3280430772 conn(0x55c4665fb300 msgr2=0x55c4669a80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 shutdown_connections 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 1 -- 172.21.15.79:0/3280430772 wait complete. 2024-09-21T02:50:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.739+0000 7fa8e0832740 20 client.26983 trim_cache size 0 max 16384 2024-09-21T02:50:02.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 Processor -- start 2024-09-21T02:50:02.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 -- start start 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4665de2f0 0x55c4669b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4666071b0 0x55c4669ae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41ac8a0 con 0x55c4665de2f0 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41af120 con 0x55c4666071b0 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8e0832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41acf10 con 0x55c4665e64d0 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8d2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4665de2f0 0x55c4669b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8d2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4665de2f0 0x55c4669b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44524/0 (socket says 172.21.15.79:44524) 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.754+0000 7fa8d2a00640 1 -- 172.21.15.79:0/3993263803 learned_addr learned my addr 172.21.15.79:0/3993263803 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8d3400640 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4666071b0 0x55c4669ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8d2a00640 1 -- 172.21.15.79:0/3993263803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 msgr2=0x55c4669adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8d2a00640 1 -- 172.21.15.79:0/3993263803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4666071b0 msgr2=0x55c4669ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4666071b0 0x55c4669ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8d2a00640 1 -- 172.21.15.79:0/3993263803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4669b5960 con 0x55c4665de2f0 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4665de2f0 0x55c4669b63f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009830 tx=0x7fa8c403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19084dd07c388b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8c2a00640 1 -- 172.21.15.79:0/3993263803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4037040 con 0x55c4665de2f0 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8c2a00640 1 -- 172.21.15.79:0/3993263803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4003aa0 con 0x55c4665de2f0 2024-09-21T02:50:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.755+0000 7fa8c2a00640 1 -- 172.21.15.79:0/3993263803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c404b970 con 0x55c4665de2f0 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 -- 172.21.15.79:0/3993263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4665de2f0 msgr2=0x55c4669b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4665de2f0 0x55c4669b63f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009830 tx=0x7fa8c403e000 comp rx=0 tx=0).stop 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 -- 172.21.15.79:0/3993263803 shutdown_connections 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4666071b0 0x55c4669ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665e64d0 0x55c4669adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3993263803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4665de2f0 0x55c4669b63f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 -- 172.21.15.79:0/3993263803 >> 172.21.15.79:0/3993263803 conn(0x55c4665fb300 msgr2=0x55c4669b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 -- 172.21.15.79:0/3993263803 shutdown_connections 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.756+0000 7fa8e0832740 1 -- 172.21.15.79:0/3993263803 wait complete. 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 -- start start 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 Processor -- start 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669bf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41ad5e0 con 0x55c4666071b0 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41aea50 con 0x55c4665e64d0 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41adcb0 con 0x55c4665de2f0 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.757+0000 7fa8e0832740 10 client.0 _ll_register_callbacks cb 0x7fa8bc009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669bd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44532/0 (socket says 172.21.15.79:44532) 2024-09-21T02:50:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 -- 172.21.15.79:0/3120631772 learned_addr learned my addr 172.21.15.79:0/3120631772 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8cbe00640 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 -- 172.21.15.79:0/3120631772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 msgr2=0x55c4669bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669bebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 -- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 msgr2=0x55c4669bf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669bf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 -- 172.21.15.79:0/3120631772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4669be160 con 0x55c4666071b0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8d3400640 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669bd9f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00cd00 tx=0x7fa8cc0ad320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b0922801d882a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.758+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3120631772 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc01a040 con 0x55c4666071b0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3120631772 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa8cc003b80 con 0x55c4666071b0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c4003aa0 con 0x55c4666071b0 2024-09-21T02:50:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3120631772 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa8cc0acf40 con 0x55c4666071b0 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 10 client.16656 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c4669bd070 con 0x55c4666071b0 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3120631772 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4003aa0 con 0x55c4666071b0 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3120631772 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa8cc00b040 con 0x55c4666071b0 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 10 client.16656 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 20 client.16656 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c46659b1c0 0x55c466a31c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 4 client.16656 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.759+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c46691f0b0 con 0x55c46659b1c0 2024-09-21T02:50:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.760+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c46659b1c0 0x55c466a31c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.760+0000 7fa8d2a00640 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c46659b1c0 0x55c466a31c70 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9521ed75f8546aa0 server_cookie=81d2b950dbc0137a in_seq=0 out_seq=0 2024-09-21T02:50:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.760+0000 7fa8b7e00640 10 client.16656 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8b7e00640 1 -- 172.21.15.79:0/3120631772 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c46691f0b0 con 0x55c46659b1c0 2024-09-21T02:50:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8b7e00640 10 client.16656 handle_command_reply: tid=0 2024-09-21T02:50:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 client.16656 shutdown 2024-09-21T02:50:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 msgr2=0x55c4669bd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669bd9f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00cd00 tx=0x7fa8cc0ad320 comp rx=0 tx=0).stop 2024-09-21T02:50:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 shutdown_connections 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55c46659b1c0 0x55c466a31c70 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4666071b0 0x55c4669bd9f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c4665e64d0 0x55c4669bf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8e0832740 1 --2- 172.21.15.79:0/3120631772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4665de2f0 0x55c4669bebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.778+0000 7fa8b7e00640 0 client.16656 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 >> 172.21.15.79:0/3120631772 conn(0x55c4665fb300 msgr2=0x55c4669b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 shutdown_connections 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8e0832740 1 -- 172.21.15.79:0/3120631772 wait complete. 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8e0832740 20 client.16656 trim_cache size 0 max 16384 2024-09-21T02:50:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:50:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:50:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:50:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:50:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa8b80b6510 msgr2=0x7fa8b80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8d9600640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa8b80b6510 0x7fa8b80b8a20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4000c00 tx=0x7fa8c402c040 comp rx=0 tx=0).stop 2024-09-21T02:50:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41072f0 msgr2=0x7fa8d419d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.779+0000 7fa8d9600640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41072f0 0x7fa8d419d360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009fd0 tx=0x7fa8cc00c800 comp rx=0 tx=0).stop 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 shutdown_connections 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa8b80b6510 0x7fa8b80b8a20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d41072f0 0x7fa8d419d360 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d4106950 0x7fa8d419c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 --2- 172.21.15.79:0/4187957325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d41058d0 0x7fa8d419c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 >> 172.21.15.79:0/4187957325 conn(0x7fa8d4101230 msgr2=0x7fa8d4109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 shutdown_connections 2024-09-21T02:50:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:02.780+0000 7fa8d9600640 1 -- 172.21.15.79:0/4187957325 wait complete. 2024-09-21T02:50:03.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:03 smithi098 ceph-mon[34832]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 2.1 MiB/s wr, 244 op/s 2024-09-21T02:50:03.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:03 smithi079 ceph-mon[30788]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 2.1 MiB/s wr, 244 op/s 2024-09-21T02:50:03.813 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:03 smithi148 ceph-mon[34626]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 2.1 MiB/s wr, 244 op/s 2024-09-21T02:50:05.971 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:05 smithi098 ceph-mon[34832]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 1.8 MiB/s wr, 192 op/s 2024-09-21T02:50:05.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:05 smithi079 ceph-mon[30788]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 1.8 MiB/s wr, 192 op/s 2024-09-21T02:50:06.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:05 smithi148 ceph-mon[34626]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 1.8 MiB/s wr, 192 op/s 2024-09-21T02:50:06.498 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T02:50:07.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:50:07.728 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:07 smithi079 ceph-mon[30788]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1008 KiB/s wr, 121 op/s 2024-09-21T02:50:08.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:07 smithi148 ceph-mon[34626]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1008 KiB/s wr, 121 op/s 2024-09-21T02:50:08.137 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:50:08.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:07 smithi098 ceph-mon[34832]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1008 KiB/s wr, 121 op/s 2024-09-21T02:50:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 -- 172.21.15.79:0/2035956804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01092f0 msgr2=0x7ffbc0109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 --2- 172.21.15.79:0/2035956804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01092f0 0x7ffbc0109700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009900 tx=0x7ffbac02a410 comp rx=0 tx=0).stop 2024-09-21T02:50:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 -- 172.21.15.79:0/2035956804 shutdown_connections 2024-09-21T02:50:09.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 --2- 172.21.15.79:0/2035956804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbc0109c40 0x7ffbc0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 --2- 172.21.15.79:0/2035956804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01092f0 0x7ffbc0109700 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 --2- 172.21.15.79:0/2035956804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc01039b0 0x7ffbc0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 -- 172.21.15.79:0/2035956804 >> 172.21.15.79:0/2035956804 conn(0x7ffbc00ff440 msgr2=0x7ffbc0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 -- 172.21.15.79:0/2035956804 shutdown_connections 2024-09-21T02:50:09.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.342+0000 7ffbbf200640 1 -- 172.21.15.79:0/2035956804 wait complete. 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.343+0000 7ffbbf200640 1 Processor -- start 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.343+0000 7ffbbf200640 1 -- start start 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbf200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01039b0 0x7ffbc0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbf200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbc01092f0 0x7ffbc0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbf200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc0109c40 0x7ffbc0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbf200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0113900 con 0x7ffbc01039b0 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbf200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0113780 con 0x7ffbc01092f0 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbf200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0113a80 con 0x7ffbc0109c40 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbde00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01039b0 0x7ffbc0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbde00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01039b0 0x7ffbc0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60126/0 (socket says 172.21.15.79:60126) 2024-09-21T02:50:09.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbde00640 1 -- 172.21.15.79:0/1132819705 learned_addr learned my addr 172.21.15.79:0/1132819705 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbd400640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbc01092f0 0x7ffbc0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.344+0000 7ffbbe800640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc0109c40 0x7ffbc0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbde00640 1 -- 172.21.15.79:0/1132819705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc0109c40 msgr2=0x7ffbc0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:09.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbde00640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc0109c40 0x7ffbc0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbde00640 1 -- 172.21.15.79:0/1132819705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbc01092f0 msgr2=0x7ffbc0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbde00640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbc01092f0 0x7ffbc0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbde00640 1 -- 172.21.15.79:0/1132819705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc01a8590 con 0x7ffbc01039b0 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbd400640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbc01092f0 0x7ffbc0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbde00640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01039b0 0x7ffbc0075710 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000d950 tx=0x7ffbb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbb6a00640 1 -- 172.21.15.79:0/1132819705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0017030 con 0x7ffbc01039b0 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc01a8880 con 0x7ffbc01039b0 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbb6a00640 1 -- 172.21.15.79:0/1132819705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb0004020 con 0x7ffbc01039b0 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.345+0000 7ffbb6a00640 1 -- 172.21.15.79:0/1132819705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00047a0 con 0x7ffbc01039b0 2024-09-21T02:50:09.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.346+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01a8de0 con 0x7ffbc01039b0 2024-09-21T02:50:09.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.347+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0103dc0 con 0x7ffbc01039b0 2024-09-21T02:50:09.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.349+0000 7ffbb6a00640 1 -- 172.21.15.79:0/1132819705 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ffbb0009a30 con 0x7ffbc01039b0 2024-09-21T02:50:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.350+0000 7ffbb6a00640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffba40b6510 0x7ffba40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.351+0000 7ffbb6a00640 1 -- 172.21.15.79:0/1132819705 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ffbb00e70f0 con 0x7ffbc01039b0 2024-09-21T02:50:09.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.351+0000 7ffbbd400640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffba40b6510 0x7ffba40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:09.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.352+0000 7ffbbd400640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffba40b6510 0x7ffba40b8a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009230 tx=0x7ffbac031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:09.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.355+0000 7ffbb6a00640 1 -- 172.21.15.79:0/1132819705 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffbb00ad5d0 con 0x7ffbc01039b0 2024-09-21T02:50:09.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.586+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbc0076a10 con 0x7ffbc01039b0 2024-09-21T02:50:09.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.587+0000 7ffbb6a00640 1 -- 172.21.15.79:0/1132819705 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7ffbb00b19b0 con 0x7ffbc01039b0 2024-09-21T02:50:09.588 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:50:09.589 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:50:09.589 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffba40b6510 msgr2=0x7ffba40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffba40b6510 0x7ffba40b8a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009230 tx=0x7ffbac031400 comp rx=0 tx=0).stop 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01039b0 msgr2=0x7ffbc0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01039b0 0x7ffbc0075710 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000d950 tx=0x7ffbb000de10 comp rx=0 tx=0).stop 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 shutdown_connections 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ffba40b6510 0x7ffba40b8a20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc0109c40 0x7ffbc0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbc01092f0 0x7ffbc0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 --2- 172.21.15.79:0/1132819705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc01039b0 0x7ffbc0075710 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 >> 172.21.15.79:0/1132819705 conn(0x7ffbc00ff440 msgr2=0x7ffbc0101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 shutdown_connections 2024-09-21T02:50:09.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:09.589+0000 7ffbbf200640 1 -- 172.21.15.79:0/1132819705 wait complete. 2024-09-21T02:50:09.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:09 smithi079 ceph-mon[30788]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 559 KiB/s wr, 83 op/s 2024-09-21T02:50:09.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:09 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1132819705' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:50:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:09 smithi148 ceph-mon[34626]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 559 KiB/s wr, 83 op/s 2024-09-21T02:50:10.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:09 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1132819705' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:50:10.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:09 smithi098 ceph-mon[34832]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 559 KiB/s wr, 83 op/s 2024-09-21T02:50:10.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:09 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1132819705' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:50:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 21fa08aa --release --await' 2024-09-21T02:50:10.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 21fa08aa --release --await 2024-09-21T02:50:10.803 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:50:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 -- 172.21.15.79:0/702124445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 msgr2=0x7fa9d0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/702124445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d0110640 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009ca0 tx=0x7fa9c802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 -- 172.21.15.79:0/702124445 shutdown_connections 2024-09-21T02:50:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/702124445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d0110640 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/702124445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9d01094c0 0x7fa9d01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/702124445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d0103b80 0x7fa9d0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 -- 172.21.15.79:0/702124445 >> 172.21.15.79:0/702124445 conn(0x7fa9d00ff590 msgr2=0x7fa9d01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 -- 172.21.15.79:0/702124445 shutdown_connections 2024-09-21T02:50:11.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.406+0000 7fa9d5a00640 1 -- 172.21.15.79:0/702124445 wait complete. 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.407+0000 7fa9d5a00640 1 Processor -- start 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9d5a00640 1 -- start start 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9d5a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9d0103b80 0x7fa9d019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9d5a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d01094c0 0x7fa9d019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9d5a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9d5a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d0113ad0 con 0x7fa9d0109e10 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9d5a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d0113950 con 0x7fa9d0103b80 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9d5a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d0113c50 con 0x7fa9d01094c0 2024-09-21T02:50:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9cf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d01094c0 0x7fa9d019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9cf400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60140/0 (socket says 172.21.15.79:60140) 2024-09-21T02:50:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9cf400640 1 -- 172.21.15.79:0/187469782 learned_addr learned my addr 172.21.15.79:0/187469782 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d01094c0 0x7fa9d019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:33336/0 (socket says 172.21.15.79:33336) 2024-09-21T02:50:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.408+0000 7fa9cea00640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9d0103b80 0x7fa9d019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9ce000640 1 -- 172.21.15.79:0/187469782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9d0103b80 msgr2=0x7fa9d019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9ce000640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9d0103b80 0x7fa9d019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9ce000640 1 -- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 msgr2=0x7fa9d019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9ce000640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9ce000640 1 -- 172.21.15.79:0/187469782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d01a03d0 con 0x7fa9d01094c0 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9cf400640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9ce000640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d01094c0 0x7fa9d019aa00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa9d006aa90 tx=0x7fa9bc00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.409+0000 7fa9c7400640 1 -- 172.21.15.79:0/187469782 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00cd00 con 0x7fa9d01094c0 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.410+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d01a06c0 con 0x7fa9d01094c0 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.410+0000 7fa9c7400640 1 -- 172.21.15.79:0/187469782 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9bc0035f0 con 0x7fa9d01094c0 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.410+0000 7fa9c7400640 1 -- 172.21.15.79:0/187469782 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc010690 con 0x7fa9d01094c0 2024-09-21T02:50:11.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.410+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d01a6e20 con 0x7fa9d01094c0 2024-09-21T02:50:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.413+0000 7fa9dc64e740 1 Processor -- start 2024-09-21T02:50:11.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.414+0000 7fa9dc64e740 1 -- start start 2024-09-21T02:50:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.414+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25fa2520 0x562f263491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.414+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25f79660 0x562f26349700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.414+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26349c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.414+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562f262c0290 con 0x562f25f81840 2024-09-21T02:50:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.414+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562f262af6c0 con 0x562f25f79660 2024-09-21T02:50:11.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.414+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562f262b34d0 con 0x562f25fa2520 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25f79660 0x562f26349700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25fa2520 0x562f263491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25f79660 0x562f26349700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:50618/0 (socket says 172.21.15.79:50618) 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 -- 172.21.15.79:0/3888557448 learned_addr learned my addr 172.21.15.79:0/3888557448 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 -- 172.21.15.79:0/3888557448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25fa2520 msgr2=0x562f263491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 --2- 172.21.15.79:0/3888557448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25fa2520 0x562f263491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 -- 172.21.15.79:0/3888557448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 msgr2=0x562f26349c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 --2- 172.21.15.79:0/3888557448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26349c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 -- 172.21.15.79:0/3888557448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f2623c460 con 0x562f25f79660 2024-09-21T02:50:11.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9c7400640 1 -- 172.21.15.79:0/187469782 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa9bc0037a0 con 0x7fa9d01094c0 2024-09-21T02:50:11.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.415+0000 7fa9cea00640 1 --2- 172.21.15.79:0/3888557448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25f79660 0x562f26349700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009d20 tx=0x7fa9c0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dcc9c8bb141f939 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:11.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.416+0000 7fa9bbe00640 1 -- 172.21.15.79:0/3888557448 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c001e070 con 0x562f25f79660 2024-09-21T02:50:11.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.416+0000 7fa9bbe00640 1 -- 172.21.15.79:0/3888557448 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9c0019ae0 con 0x562f25f79660 2024-09-21T02:50:11.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.416+0000 7fa9bbe00640 1 -- 172.21.15.79:0/3888557448 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c000eab0 con 0x562f25f79660 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.416+0000 7fa9dc64e740 1 -- 172.21.15.79:0/3888557448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25f79660 msgr2=0x562f26349700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.416+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/3888557448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25f79660 0x562f26349700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009d20 tx=0x7fa9c0011810 comp rx=0 tx=0).stop 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 -- 172.21.15.79:0/3888557448 shutdown_connections 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/3888557448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26349c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/3888557448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25f79660 0x562f26349700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/3888557448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25fa2520 0x562f263491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 -- 172.21.15.79:0/3888557448 >> 172.21.15.79:0/3888557448 conn(0x562f25f96910 msgr2=0x562f263470b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 -- 172.21.15.79:0/3888557448 shutdown_connections 2024-09-21T02:50:11.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 -- 172.21.15.79:0/3888557448 wait complete. 2024-09-21T02:50:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9c7400640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa9b40b6420 0x7fa9b40b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9c7400640 1 -- 172.21.15.79:0/187469782 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa9bc0e7960 con 0x7fa9d01094c0 2024-09-21T02:50:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 -- start start 2024-09-21T02:50:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9cf400640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa9b40b6420 0x7fa9b40b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.417+0000 7fa9dc64e740 1 Processor -- start 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9cf400640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa9b40b6420 0x7fa9b40b8930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80094e0 tx=0x7fa9c8005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26359190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f263596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f26365000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562f26110bb0 con 0x562f25f81840 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562f2624a6c0 con 0x562f25fa2520 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562f2635bcd0 con 0x562f25f79660 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.418+0000 7fa9dc64e740 10 client.0 _ll_register_callbacks cb 0x562f26265490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f263596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26359190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f263596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60152/0 (socket says 172.21.15.79:60152) 2024-09-21T02:50:11.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9ce000640 1 -- 172.21.15.79:0/601834469 learned_addr learned my addr 172.21.15.79:0/601834469 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cf400640 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f26365000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cea00640 1 -- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 msgr2=0x562f26365000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cea00640 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f26365000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cea00640 1 -- 172.21.15.79:0/601834469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 msgr2=0x562f263596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cea00640 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f263596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cea00640 1 -- 172.21.15.79:0/601834469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f2600db00 con 0x562f25f79660 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.419+0000 7fa9cea00640 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26359190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0011d10 tx=0x7fa9c0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae87d35df4782ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:50:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9b8c00640 1 -- 172.21.15.79:0/601834469 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c001e050 con 0x562f25f79660 2024-09-21T02:50:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9b8c00640 1 -- 172.21.15.79:0/601834469 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa9c0019430 con 0x562f25f79660 2024-09-21T02:50:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c0019ae0 con 0x562f25f79660 2024-09-21T02:50:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9b8c00640 1 -- 172.21.15.79:0/601834469 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa9c0032050 con 0x562f25f79660 2024-09-21T02:50:11.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9dc64e740 10 client.27007 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562f26084960 con 0x562f25f79660 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.420+0000 7fa9b8c00640 1 -- 172.21.15.79:0/601834469 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9c0019ae0 con 0x562f25f79660 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9b8c00640 1 -- 172.21.15.79:0/601834469 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa9c00035f0 con 0x562f25f79660 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9dc64e740 10 client.27007 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9dc64e740 10 client.27007 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9dc64e740 20 client.27007 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f60ea0 0x562f2636aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9dc64e740 4 client.27007 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f262c21e0 con 0x562f25f60ea0 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.421+0000 7fa9ce000640 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f60ea0 0x562f2636aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.422+0000 7fa9ce000640 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f60ea0 0x562f2636aec0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf6fec771c5e529a server_cookie=fd47ddc07d437115 in_seq=0 out_seq=0 2024-09-21T02:50:11.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.422+0000 7fa9b8c00640 10 client.27007 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9b8c00640 1 -- 172.21.15.79:0/601834469 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f262c21e0 con 0x562f25f60ea0 2024-09-21T02:50:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9b8c00640 10 client.27007 handle_command_reply: tid=0 2024-09-21T02:50:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 client.27007 shutdown 2024-09-21T02:50:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 msgr2=0x562f26359190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26359190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0011d10 tx=0x7fa9c0004270 comp rx=0 tx=0).stop 2024-09-21T02:50:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 shutdown_connections 2024-09-21T02:50:11.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f60ea0 0x562f2636aec0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f26365000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f263596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/601834469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26359190 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9b8c00640 0 client.27007 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 >> 172.21.15.79:0/601834469 conn(0x562f25f96910 msgr2=0x562f2634c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 shutdown_connections 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 1 -- 172.21.15.79:0/601834469 wait complete. 2024-09-21T02:50:11.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.423+0000 7fa9dc64e740 20 client.27007 trim_cache size 0 max 16384 2024-09-21T02:50:11.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 Processor -- start 2024-09-21T02:50:11.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 -- start start 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26346f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26346010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2634a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01ac9c0 con 0x562f25f81840 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01af240 con 0x562f25fa2520 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.441+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01ad030 con 0x562f25f79660 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26346f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26346010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26346f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:33366/0 (socket says 172.21.15.79:33366) 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 -- 172.21.15.79:0/645895482 learned_addr learned my addr 172.21.15.79:0/645895482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cf400640 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2634a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 -- 172.21.15.79:0/645895482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 msgr2=0x562f2634a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:11.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2634a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 -- 172.21.15.79:0/645895482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 msgr2=0x562f26346010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:11.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26346010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 -- 172.21.15.79:0/645895482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f263574b0 con 0x562f25f79660 2024-09-21T02:50:11.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9ce000640 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26346010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:11.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.442+0000 7fa9cea00640 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26346f10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0003a40 tx=0x7fa9c001bfc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcf1d0935ba49423 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.443+0000 7fa9bb400640 1 -- 172.21.15.79:0/645895482 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c003b070 con 0x562f25f79660 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.443+0000 7fa9bb400640 1 -- 172.21.15.79:0/645895482 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9c001f040 con 0x562f25f79660 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.443+0000 7fa9bb400640 1 -- 172.21.15.79:0/645895482 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c001e070 con 0x562f25f79660 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.443+0000 7fa9dc64e740 1 -- 172.21.15.79:0/645895482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 msgr2=0x562f26346f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.443+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26346f10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0003a40 tx=0x7fa9c001bfc0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 -- 172.21.15.79:0/645895482 shutdown_connections 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2634a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f26346010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/645895482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26346f10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 -- 172.21.15.79:0/645895482 >> 172.21.15.79:0/645895482 conn(0x562f25f96910 msgr2=0x562f2634a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:11.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 -- 172.21.15.79:0/645895482 shutdown_connections 2024-09-21T02:50:11.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 -- 172.21.15.79:0/645895482 wait complete. 2024-09-21T02:50:11.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 -- start start 2024-09-21T02:50:11.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.444+0000 7fa9dc64e740 1 Processor -- start 2024-09-21T02:50:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26361500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f2635ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9dc64e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2635f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01ad700 con 0x562f25f81840 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01aeb70 con 0x562f25fa2520 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9dc64e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01addd0 con 0x562f25f79660 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9dc64e740 10 client.0 _ll_register_callbacks cb 0x7fa9c001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f2635ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9cea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26361500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f2635ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60166/0 (socket says 172.21.15.79:60166) 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9ce000640 1 -- 172.21.15.79:0/959595456 learned_addr learned my addr 172.21.15.79:0/959595456 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.445+0000 7fa9cf400640 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2635f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9cea00640 1 -- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 msgr2=0x562f2635f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9cea00640 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2635f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9cea00640 1 -- 172.21.15.79:0/959595456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 msgr2=0x562f2635ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9cea00640 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f2635ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9cea00640 1 -- 172.21.15.79:0/959595456 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f2635fa10 con 0x562f25f79660 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9ce000640 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f2635ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9cea00640 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26361500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009660 tx=0x7fa9c0009fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a777fd414f4a30c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9b8c00640 1 -- 172.21.15.79:0/959595456 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c003b070 con 0x562f25f79660 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9b8c00640 1 -- 172.21.15.79:0/959595456 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fa9c0003bb0 con 0x562f25f79660 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.446+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c001f040 con 0x562f25f79660 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9b8c00640 1 -- 172.21.15.79:0/959595456 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa9c001e040 con 0x562f25f79660 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 10 client.27013 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562f263d63d0 con 0x562f25f79660 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9b8c00640 1 -- 172.21.15.79:0/959595456 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9c001f040 con 0x562f25f79660 2024-09-21T02:50:11.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9b8c00640 1 -- 172.21.15.79:0/959595456 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa9c0019840 con 0x562f25f79660 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 10 client.27013 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 10 client.27013 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 20 client.27013 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f36250 0x562f263d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 4 client.27013 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "21fa08aa", "release": true, "await": true}] 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.447+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "set_id": "21fa08aa", "release": true, "await": true}) -- 0x562f26353c70 con 0x562f25f36250 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.448+0000 7fa9ce000640 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f36250 0x562f263d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.448+0000 7fa9b8c00640 10 client.27013 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:11.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.448+0000 7fa9ce000640 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f36250 0x562f263d89c0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=defaf8d9e1e6f23a server_cookie=82d75dec87537d9e in_seq=0 out_seq=0 2024-09-21T02:50:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 855.0 s, 9.0 tps, lat 17244.374 ms stddev 373.178 2024-09-21T02:50:11.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.511+0000 7fa9b8c00640 1 -- 172.21.15.79:0/959595456 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562f26353c70 con 0x562f25f36250 2024-09-21T02:50:11.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.511+0000 7fa9b8c00640 10 client.27013 handle_command_reply: tid=0 2024-09-21T02:50:11.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.512+0000 7fa9dc64e740 1 client.27013 shutdown 2024-09-21T02:50:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.512+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 msgr2=0x562f26361500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.512+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26361500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009660 tx=0x7fa9c0009fc0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 shutdown_connections 2024-09-21T02:50:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562f25f36250 0x562f263d89c0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562f25fa2520 0x562f2635f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562f25f81840 0x562f2635ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 --2- 172.21.15.79:0/959595456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562f25f79660 0x562f26361500 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 >> 172.21.15.79:0/959595456 conn(0x562f25f96910 msgr2=0x562f2634abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9b8c00640 0 client.27013 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 shutdown_connections 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 1 -- 172.21.15.79:0/959595456 wait complete. 2024-09-21T02:50:11.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.513+0000 7fa9dc64e740 20 client.27013 trim_cache size 0 max 16384 2024-09-21T02:50:11.517 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:50:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:50:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:50:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 60, 2024-09-21T02:50:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": { 2024-09-21T02:50:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "21fa08aa": { 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "version": 60, 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age_ref": 0.0, 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "timeout": 90.0, 2024-09-21T02:50:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "expiration": 138.8, 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "members": { 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "file:/": { 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "excluded": false, 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "state": { 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RELEASED", 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:50:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:50:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:50:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:50:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:50:11.520 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:50:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa9b40b6420 msgr2=0x7fa9b40b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa9b40b6420 0x7fa9b40b8930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80094e0 tx=0x7fa9c8005c50 comp rx=0 tx=0).stop 2024-09-21T02:50:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d01094c0 msgr2=0x7fa9d019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d01094c0 0x7fa9d019aa00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa9d006aa90 tx=0x7fa9bc00ee50 comp rx=0 tx=0).stop 2024-09-21T02:50:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 shutdown_connections 2024-09-21T02:50:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fa9b40b6420 0x7fa9b40b8930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d0109e10 0x7fa9d019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d01094c0 0x7fa9d019aa00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 --2- 172.21.15.79:0/187469782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9d0103b80 0x7fa9d019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:11.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.514+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 >> 172.21.15.79:0/187469782 conn(0x7fa9d00ff590 msgr2=0x7fa9d01028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:11.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.515+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 shutdown_connections 2024-09-21T02:50:11.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:50:11.515+0000 7fa9d5a00640 1 -- 172.21.15.79:0/187469782 wait complete. 2024-09-21T02:50:11.909 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:11 smithi079 ceph-mon[30788]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 125 KiB/s wr, 27 op/s 2024-09-21T02:50:12.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:11 smithi148 ceph-mon[34626]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 125 KiB/s wr, 27 op/s 2024-09-21T02:50:12.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:11 smithi098 ceph-mon[34832]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 125 KiB/s wr, 27 op/s 2024-09-21T02:50:12.503 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '21fa08aa', total seconds elapsed: 23.6 2024-09-21T02:50:13.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:13 smithi079 ceph-mon[30788]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-21T02:50:14.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:13 smithi148 ceph-mon[34626]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-21T02:50:14.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:13 smithi098 ceph-mon[34832]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-21T02:50:15.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:15 smithi079 ceph-mon[30788]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 211 KiB/s wr, 35 op/s 2024-09-21T02:50:16.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:15 smithi148 ceph-mon[34626]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 211 KiB/s wr, 35 op/s 2024-09-21T02:50:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.071+0000 7f8bc1600640 1 -- 172.21.15.79:0/2982585975 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00308f0 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2982585975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0a24e0 msgr2=0x7f8bbc0a4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2982585975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0a24e0 0x7f8bbc0a4900 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009850 tx=0x7f8bb002a360 comp rx=0 tx=0).stop 2024-09-21T02:50:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2982585975 shutdown_connections 2024-09-21T02:50:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2982585975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0a24e0 0x7f8bbc0a4900 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2982585975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bbc0072a0 0x7f8bbc0076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2982585975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bbc0086a0 0x7f8bbc006d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2982585975 >> 172.21.15.79:0/2982585975 conn(0x7f8bbc0916a0 msgr2=0x7f8bbc093b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2982585975 shutdown_connections 2024-09-21T02:50:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.073+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2982585975 wait complete. 2024-09-21T02:50:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.075+0000 7f8bc9a00640 1 Processor -- start 2024-09-21T02:50:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.077+0000 7f8bc9a00640 1 -- start start 2024-09-21T02:50:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.079+0000 7f8bc9a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0072a0 0x7f8bbc132c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.079+0000 7f8bc9a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bbc0086a0 0x7f8bbc1332a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.080+0000 7f8bc9a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bbc0a24e0 0x7f8bbc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.080+0000 7f8bc9a00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc0a8010 con 0x7f8bbc0072a0 2024-09-21T02:50:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.081+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0072a0 0x7f8bbc132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.081+0000 7f8bc9a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc0a7e90 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.081+0000 7f8bc9a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc0a8190 con 0x7f8bbc0086a0 2024-09-21T02:50:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.081+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0072a0 0x7f8bbc132c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37092/0 (socket says 172.21.15.79:37092) 2024-09-21T02:50:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.081+0000 7f8bc2a00640 1 -- 172.21.15.79:0/2368785442 learned_addr learned my addr 172.21.15.79:0/2368785442 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.081+0000 7f8bc3400640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bbc0a24e0 0x7f8bbc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc3400640 1 -- 172.21.15.79:0/2368785442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bbc0086a0 msgr2=0x7f8bbc1332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc2000640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bbc0086a0 0x7f8bbc1332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc3400640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bbc0086a0 0x7f8bbc1332a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc3400640 1 -- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0072a0 msgr2=0x7f8bbc132c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc3400640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0072a0 0x7f8bbc132c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc3400640 1 -- 172.21.15.79:0/2368785442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bbc134670 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0072a0 0x7f8bbc132c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc2000640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bbc0086a0 0x7f8bbc1332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:50:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.082+0000 7f8bc3400640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bbc0a24e0 0x7f8bbc133e50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0000e60 tx=0x7f8bb0032760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.083+0000 7f8bbb400640 1 -- 172.21.15.79:0/2368785442 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb003f020 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.084+0000 7f8bbb400640 1 -- 172.21.15.79:0/2368785442 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bb0033df0 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.084+0000 7f8bbb400640 1 -- 172.21.15.79:0/2368785442 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0037040 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.085+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bbc134900 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.085+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bbc13ae70 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.092+0000 7f8bbb400640 1 -- 172.21.15.79:0/2368785442 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8bb0042020 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.094+0000 7f8bd0bf0740 1 Processor -- start 2024-09-21T02:50:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.094+0000 7f8bd0bf0740 1 -- start start 2024-09-21T02:50:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bbb400640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ba80b6590 0x7f8ba80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8301b0 0x55ea7abd72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abd7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abd8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea7ab4a6b0 con 0x55ea7a80f4d0 2024-09-21T02:50:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ea7ab39ae0 con 0x55ea7a8301b0 2024-09-21T02:50:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ea7ab3d8f0 con 0x55ea7a8072f0 2024-09-21T02:50:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.095+0000 7f8bbb400640 1 -- 172.21.15.79:0/2368785442 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8bb0106cc0 con 0x7f8bbc0a24e0 2024-09-21T02:50:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.096+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8301b0 0x55ea7abd72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.097+0000 7f8bc2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abd7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.097+0000 7f8bc2000640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ba80b6590 0x7f8ba80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.097+0000 7f8bc2000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abd7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:56878/0 (socket says 172.21.15.79:56878) 2024-09-21T02:50:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.097+0000 7f8bc2000640 1 -- 172.21.15.79:0/4091200706 learned_addr learned my addr 172.21.15.79:0/4091200706 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.098+0000 7f8bc3400640 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abd8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.098+0000 7f8bc2a00640 1 -- 172.21.15.79:0/4091200706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 msgr2=0x55ea7abd7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.098+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abd7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.098+0000 7f8bc2a00640 1 -- 172.21.15.79:0/4091200706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 msgr2=0x55ea7abd8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.098+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abd8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.098+0000 7f8bc2a00640 1 -- 172.21.15.79:0/4091200706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea7ab06780 con 0x55ea7a8301b0 2024-09-21T02:50:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.099+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8301b0 0x55ea7abd72b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4068f20 tx=0x7f8bc4075e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e429797f2dd4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.099+0000 7f8bafe00640 1 -- 172.21.15.79:0/4091200706 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc407fd50 con 0x55ea7a8301b0 2024-09-21T02:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.099+0000 7f8bafe00640 1 -- 172.21.15.79:0/4091200706 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc4084030 con 0x55ea7a8301b0 2024-09-21T02:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.099+0000 7f8bafe00640 1 -- 172.21.15.79:0/4091200706 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4088630 con 0x55ea7a8301b0 2024-09-21T02:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.100+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/4091200706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8301b0 msgr2=0x55ea7abd72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.100+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8301b0 0x55ea7abd72b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4068f20 tx=0x7f8bc4075e90 comp rx=0 tx=0).stop 2024-09-21T02:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.100+0000 7f8bc2000640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ba80b6590 0x7f8ba80b8aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400bfd0 tx=0x7f8bb400b160 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.101+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/4091200706 shutdown_connections 2024-09-21T02:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.101+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abd8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.101+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abd7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.101+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/4091200706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8301b0 0x55ea7abd72b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.101+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/4091200706 >> 172.21.15.79:0/4091200706 conn(0x55ea7a824300 msgr2=0x55ea7abd2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.103+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/4091200706 shutdown_connections 2024-09-21T02:50:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.103+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/4091200706 wait complete. 2024-09-21T02:50:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.104+0000 7f8bd0bf0740 1 -- start start 2024-09-21T02:50:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.104+0000 7f8bd0bf0740 1 Processor -- start 2024-09-21T02:50:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.105+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abe08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.105+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.105+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 0x55ea7abe1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.105+0000 7f8bc2000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bc2000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46906/0 (socket says 172.21.15.79:46906) 2024-09-21T02:50:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abe08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abe08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:56888/0 (socket says 172.21.15.79:56888) 2024-09-21T02:50:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea7aa71ab0 con 0x55ea7a8301b0 2024-09-21T02:50:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ea7aae0570 con 0x55ea7a80f4d0 2024-09-21T02:50:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bc2000640 1 -- 172.21.15.79:0/3289928315 learned_addr learned my addr 172.21.15.79:0/3289928315 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ea7abd8f90 con 0x55ea7a8072f0 2024-09-21T02:50:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.106+0000 7f8bd0bf0740 10 client.0 _ll_register_callbacks cb 0x55ea7aaef100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.107+0000 7f8bc2a00640 1 -- 172.21.15.79:0/3289928315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a80f4d0 msgr2=0x55ea7abe0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.107+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.107+0000 7f8bc2a00640 1 -- 172.21.15.79:0/3289928315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 msgr2=0x55ea7abe1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.107+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 0x55ea7abe1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.107+0000 7f8bc2a00640 1 -- 172.21.15.79:0/3289928315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea7a89b790 con 0x55ea7a8072f0 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.107+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bc4084030 con 0x55ea7a8072f0 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.108+0000 7f8bacc00640 10 client.27019 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:50:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.108+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abe08e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402ebd0 tx=0x7f8bc407ff70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f5b6eb4ba4cd82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.108+0000 7f8bacc00640 1 -- 172.21.15.79:0/3289928315 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4097060 con 0x55ea7a8072f0 2024-09-21T02:50:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.110+0000 7f8bacc00640 1 -- 172.21.15.79:0/3289928315 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8bc408f070 con 0x55ea7a8072f0 2024-09-21T02:50:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.110+0000 7f8bacc00640 1 -- 172.21.15.79:0/3289928315 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8bc4097060 con 0x55ea7a8072f0 2024-09-21T02:50:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.110+0000 7f8bd0bf0740 10 client.27019 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.110+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55ea7a914620 con 0x55ea7a8072f0 2024-09-21T02:50:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.111+0000 7f8bacc00640 1 -- 172.21.15.79:0/3289928315 <== mon.1 v2:172.21.15.148:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8bc4080640 con 0x55ea7a8072f0 2024-09-21T02:50:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.111+0000 7f8bd0bf0740 10 client.27019 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.111+0000 7f8bd0bf0740 10 client.27019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.111+0000 7f8bd0bf0740 20 client.27019 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.111+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7eed80 0x55ea7abedb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.111+0000 7f8bd0bf0740 4 client.27019 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:50:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.111+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea7ab4c600 con 0x55ea7a7eed80 2024-09-21T02:50:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.112+0000 7f8bc2000640 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7eed80 0x55ea7abedb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.112+0000 7f8bc2000640 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7eed80 0x55ea7abedb80 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b2b1b4a4990b3b server_cookie=65192779187a03ec in_seq=0 out_seq=0 2024-09-21T02:50:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.113+0000 7f8bacc00640 10 client.27019 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.113+0000 7f8bacc00640 1 -- 172.21.15.79:0/3289928315 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea7ab4c600 con 0x55ea7a7eed80 2024-09-21T02:50:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.113+0000 7f8bacc00640 10 client.27019 handle_command_reply: tid=0 2024-09-21T02:50:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.114+0000 7f8bd0bf0740 1 client.27019 shutdown 2024-09-21T02:50:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.115+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 msgr2=0x55ea7abe08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.115+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abe08e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402ebd0 tx=0x7f8bc407ff70 comp rx=0 tx=0).stop 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 shutdown_connections 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7eed80 0x55ea7abedb80 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 0x55ea7abe1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/3289928315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8072f0 0x55ea7abe08e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bacc00640 0 client.27019 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 >> 172.21.15.79:0/3289928315 conn(0x55ea7a824300 msgr2=0x55ea7abd7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 shutdown_connections 2024-09-21T02:50:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.117+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/3289928315 wait complete. 2024-09-21T02:50:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.118+0000 7f8bd0bf0740 20 client.27019 trim_cache size 0 max 16384 2024-09-21T02:50:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.149+0000 7f8bd0bf0740 1 Processor -- start 2024-09-21T02:50:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.149+0000 7f8bd0bf0740 1 -- start start 2024-09-21T02:50:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.150+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abdf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.150+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.150+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 0x55ea7abd9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.150+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc143470 con 0x55ea7a8301b0 2024-09-21T02:50:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.150+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc145d50 con 0x55ea7a8072f0 2024-09-21T02:50:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.150+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc143b40 con 0x55ea7a80f4d0 2024-09-21T02:50:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.151+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abdf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.151+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abdf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46908/0 (socket says 172.21.15.79:46908) 2024-09-21T02:50:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.151+0000 7f8bc2a00640 1 -- 172.21.15.79:0/402270503 learned_addr learned my addr 172.21.15.79:0/402270503 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.151+0000 7f8bc2000640 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.151+0000 7f8bc3400640 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 0x55ea7abd9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.152+0000 7f8bc2a00640 1 -- 172.21.15.79:0/402270503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a80f4d0 msgr2=0x55ea7abe89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.152+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.152+0000 7f8bc2a00640 1 -- 172.21.15.79:0/402270503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 msgr2=0x55ea7abd9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.152+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 0x55ea7abd9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.152+0000 7f8bc2a00640 1 -- 172.21.15.79:0/402270503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea7abdc0a0 con 0x55ea7a8072f0 2024-09-21T02:50:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.152+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abdf500 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4000b60 tx=0x7f8bc406b070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9631a60ad27bc55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:16.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:15 smithi098 ceph-mon[34832]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 211 KiB/s wr, 35 op/s 2024-09-21T02:50:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.154+0000 7f8baf400640 1 -- 172.21.15.79:0/402270503 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4097060 con 0x55ea7a8072f0 2024-09-21T02:50:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.154+0000 7f8baf400640 1 -- 172.21.15.79:0/402270503 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc4084030 con 0x55ea7a8072f0 2024-09-21T02:50:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.154+0000 7f8baf400640 1 -- 172.21.15.79:0/402270503 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc409a350 con 0x55ea7a8072f0 2024-09-21T02:50:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.156+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/402270503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 msgr2=0x55ea7abdf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.156+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abdf500 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4000b60 tx=0x7f8bc406b070 comp rx=0 tx=0).stop 2024-09-21T02:50:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/402270503 shutdown_connections 2024-09-21T02:50:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a8301b0 0x55ea7abd9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/402270503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abdf500 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/402270503 >> 172.21.15.79:0/402270503 conn(0x55ea7a824300 msgr2=0x55ea7abdedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/402270503 shutdown_connections 2024-09-21T02:50:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/402270503 wait complete. 2024-09-21T02:50:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.159+0000 7f8bd0bf0740 1 -- start start 2024-09-21T02:50:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 1 Processor -- start 2024-09-21T02:50:16.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abe8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8301b0 0x55ea7abe7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc144210 con 0x55ea7a80f4d0 2024-09-21T02:50:16.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc145680 con 0x55ea7a8072f0 2024-09-21T02:50:16.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc1448e0 con 0x55ea7a8301b0 2024-09-21T02:50:16.162 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.160+0000 7f8bd0bf0740 10 client.0 _ll_register_callbacks cb 0x7f8bb400be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.161+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abe8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.161+0000 7f8bc2a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abe8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:46920/0 (socket says 172.21.15.79:46920) 2024-09-21T02:50:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.161+0000 7f8bc2a00640 1 -- 172.21.15.79:0/586838048 learned_addr learned my addr 172.21.15.79:0/586838048 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.161+0000 7f8bc2000640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.161+0000 7f8bc3400640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8301b0 0x55ea7abe7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.162+0000 7f8bc2000640 1 -- 172.21.15.79:0/586838048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8301b0 msgr2=0x55ea7abe7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.162+0000 7f8bc2000640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8301b0 0x55ea7abe7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.162+0000 7f8bc2000640 1 -- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 msgr2=0x55ea7abe8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.162+0000 7f8bc2000640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abe8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.162+0000 7f8bc2000640 1 -- 172.21.15.79:0/586838048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea7abe80b0 con 0x55ea7a80f4d0 2024-09-21T02:50:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.162+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abe8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.164+0000 7f8bacc00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:50:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.164+0000 7f8bc2000640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe73c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55ea7abd90a0 tx=0x7f8bb4006d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9679dd4ddb7b4871 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.164+0000 7f8bacc00640 1 -- 172.21.15.79:0/586838048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4031060 con 0x55ea7a80f4d0 2024-09-21T02:50:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.164+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bc4084030 con 0x55ea7a80f4d0 2024-09-21T02:50:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.165+0000 7f8bacc00640 1 -- 172.21.15.79:0/586838048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8bb4021040 con 0x55ea7a80f4d0 2024-09-21T02:50:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.165+0000 7f8bacc00640 1 -- 172.21.15.79:0/586838048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8bb4031060 con 0x55ea7a80f4d0 2024-09-21T02:50:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.165+0000 7f8bd0bf0740 10 client.16692 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.165+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ea7ac58590 con 0x55ea7a80f4d0 2024-09-21T02:50:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.168+0000 7f8bacc00640 1 -- 172.21.15.79:0/586838048 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bb4003e10 con 0x55ea7a80f4d0 2024-09-21T02:50:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.170+0000 7f8bacc00640 1 -- 172.21.15.79:0/586838048 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8bb4017680 con 0x55ea7a80f4d0 2024-09-21T02:50:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.170+0000 7f8bd0bf0740 10 client.16692 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.170+0000 7f8bd0bf0740 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.170+0000 7f8bd0bf0740 20 client.16692 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.170+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7c41c0 0x55ea7ac5ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.170+0000 7f8bd0bf0740 4 client.16692 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:50:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.170+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8bc4084030 con 0x55ea7a7c41c0 2024-09-21T02:50:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.171+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7c41c0 0x55ea7ac5ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.172+0000 7f8bacc00640 10 client.16692 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.172+0000 7f8bc2a00640 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7c41c0 0x55ea7ac5ae00 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e25e6789be4ea8e server_cookie=ae85e1c2f53ccb93 in_seq=0 out_seq=0 2024-09-21T02:50:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.259+0000 7f8bacc00640 1 -- 172.21.15.79:0/586838048 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8bc4084030 con 0x55ea7a7c41c0 2024-09-21T02:50:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.259+0000 7f8bacc00640 10 client.16692 handle_command_reply: tid=0 2024-09-21T02:50:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.259+0000 7f8bd0bf0740 1 client.16692 shutdown 2024-09-21T02:50:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 msgr2=0x55ea7abe73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe73c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55ea7abd90a0 tx=0x7f8bb4006d00 comp rx=0 tx=0).stop 2024-09-21T02:50:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 shutdown_connections 2024-09-21T02:50:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55ea7a7c41c0 0x55ea7ac5ae00 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ea7a8301b0 0x55ea7abe7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea7a80f4d0 0x55ea7abe73c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 --2- 172.21.15.79:0/586838048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea7a8072f0 0x55ea7abe8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 >> 172.21.15.79:0/586838048 conn(0x55ea7a824300 msgr2=0x55ea7abd1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bacc00640 0 client.16692 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.260+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 shutdown_connections 2024-09-21T02:50:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.262+0000 7f8bd0bf0740 1 -- 172.21.15.79:0/586838048 wait complete. 2024-09-21T02:50:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.262+0000 7f8bd0bf0740 20 client.16692 trim_cache size 0 max 16384 2024-09-21T02:50:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:50:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:50:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:50:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:50:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.263+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ba80b6590 msgr2=0x7f8ba80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.263+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ba80b6590 0x7f8ba80b8aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400bfd0 tx=0x7f8bb400b160 comp rx=0 tx=0).stop 2024-09-21T02:50:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.263+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bbc0a24e0 msgr2=0x7f8bbc133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.263+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bbc0a24e0 0x7f8bbc133e50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0000e60 tx=0x7f8bb0032760 comp rx=0 tx=0).stop 2024-09-21T02:50:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.263+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 shutdown_connections 2024-09-21T02:50:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.263+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8ba80b6590 0x7f8ba80b8aa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.264+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bbc0a24e0 0x7f8bbc133e50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.264+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bbc0086a0 0x7f8bbc1332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.264+0000 7f8bc9a00640 1 --2- 172.21.15.79:0/2368785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8bbc0072a0 0x7f8bbc132c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.264+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 >> 172.21.15.79:0/2368785442 conn(0x7f8bbc0916a0 msgr2=0x7f8bbc091d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.264+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 shutdown_connections 2024-09-21T02:50:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:16.264+0000 7f8bc9a00640 1 -- 172.21.15.79:0/2368785442 wait complete. 2024-09-21T02:50:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 860.0 s, 487.8 tps, lat 592.060 ms stddev 2615.208 2024-09-21T02:50:17.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:17 smithi079 ceph-mon[30788]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 795 KiB/s wr, 82 op/s 2024-09-21T02:50:18.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:17 smithi148 ceph-mon[34626]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 795 KiB/s wr, 82 op/s 2024-09-21T02:50:18.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:17 smithi098 ceph-mon[34832]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 795 KiB/s wr, 82 op/s 2024-09-21T02:50:20.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:19 smithi148 ceph-mon[34626]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-09-21T02:50:20.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:19 smithi098 ceph-mon[34832]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-09-21T02:50:20.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:19 smithi079 ceph-mon[30788]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-09-21T02:50:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 865.0 s, 492.0 tps, lat 197.932 ms stddev 260.459 2024-09-21T02:50:22.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:21 smithi148 ceph-mon[34626]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2024-09-21T02:50:22.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:21 smithi098 ceph-mon[34832]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2024-09-21T02:50:22.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:21 smithi079 ceph-mon[30788]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2024-09-21T02:50:23.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:22 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:23.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:22 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:23.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:22 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:24.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:23 smithi148 ceph-mon[34626]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.3 MiB/s wr, 342 op/s 2024-09-21T02:50:24.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:23 smithi098 ceph-mon[34832]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.3 MiB/s wr, 342 op/s 2024-09-21T02:50:24.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:23 smithi079 ceph-mon[30788]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.3 MiB/s wr, 342 op/s 2024-09-21T02:50:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:50:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:50:25.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:24 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:50:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:50:25.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:50:25.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:24 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:50:25.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:50:25.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:50:25.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:24 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:50:26.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:25 smithi148 ceph-mon[34626]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 3.8 MiB/s wr, 402 op/s 2024-09-21T02:50:26.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:25 smithi098 ceph-mon[34832]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 3.8 MiB/s wr, 402 op/s 2024-09-21T02:50:26.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:25 smithi079 ceph-mon[30788]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 3.8 MiB/s wr, 402 op/s 2024-09-21T02:50:26.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 870.0 s, 454.4 tps, lat 223.609 ms stddev 288.996 2024-09-21T02:50:28.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:27 smithi148 ceph-mon[34626]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.1 MiB/s wr, 433 op/s 2024-09-21T02:50:28.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:27 smithi098 ceph-mon[34832]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.1 MiB/s wr, 433 op/s 2024-09-21T02:50:28.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:27 smithi079 ceph-mon[30788]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.1 MiB/s wr, 433 op/s 2024-09-21T02:50:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.719+0000 7fccf6e00640 1 -- 172.21.15.79:0/3863539329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf0077090 msgr2=0x7fccf0075750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.719+0000 7fccf6e00640 1 --2- 172.21.15.79:0/3863539329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf0077090 0x7fccf0075750 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009900 tx=0x7fcce402a410 comp rx=0 tx=0).stop 2024-09-21T02:50:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.719+0000 7fccf6e00640 1 -- 172.21.15.79:0/3863539329 shutdown_connections 2024-09-21T02:50:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.719+0000 7fccf6e00640 1 --2- 172.21.15.79:0/3863539329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf010b4d0 0x7fccf010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.719+0000 7fccf6e00640 1 --2- 172.21.15.79:0/3863539329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 0x7fccf00760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.719+0000 7fccf6e00640 1 --2- 172.21.15.79:0/3863539329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf0077090 0x7fccf0075750 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009900 tx=0x7fcce402a410 comp rx=0 tx=0).stop 2024-09-21T02:50:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.719+0000 7fccf6e00640 1 -- 172.21.15.79:0/3863539329 >> 172.21.15.79:0/3863539329 conn(0x7fccf00fee20 msgr2=0x7fccf01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.721+0000 7fccf6e00640 1 -- 172.21.15.79:0/3863539329 shutdown_connections 2024-09-21T02:50:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.721+0000 7fccf6e00640 1 -- 172.21.15.79:0/3863539329 wait complete. 2024-09-21T02:50:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.723+0000 7fccf6e00640 1 Processor -- start 2024-09-21T02:50:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.723+0000 7fccf6e00640 1 -- start start 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf6e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 0x7fccf019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf6e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf010b4d0 0x7fccf019c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf6e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf019d2b0 0x7fccf019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf6e00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0111410 con 0x7fccf019d2b0 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf6e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0111290 con 0x7fccf010b4d0 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf6e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0111590 con 0x7fccf0075c90 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 0x7fccf019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 0x7fccf019c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52802/0 (socket says 172.21.15.79:52802) 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf5a00640 1 -- 172.21.15.79:0/934077258 learned_addr learned my addr 172.21.15.79:0/934077258 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf5000640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf010b4d0 0x7fccf019c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf5a00640 1 -- 172.21.15.79:0/934077258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf010b4d0 msgr2=0x7fccf019c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.724+0000 7fccf5a00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf010b4d0 0x7fccf019c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.725+0000 7fccf5a00640 1 -- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf019d2b0 msgr2=0x7fccf019d7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T02:50:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.725+0000 7fccf6400640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf019d2b0 0x7fccf019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.725+0000 7fccf5a00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf019d2b0 0x7fccf019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.725+0000 7fccf5a00640 1 -- 172.21.15.79:0/934077258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf019dfd0 con 0x7fccf0075c90 2024-09-21T02:50:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.726+0000 7fccf5a00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 0x7fccf019c180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcce402aa00 tx=0x7fcce4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.726+0000 7fccee000640 1 -- 172.21.15.79:0/934077258 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce403f020 con 0x7fccf0075c90 2024-09-21T02:50:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.727+0000 7fccee000640 1 -- 172.21.15.79:0/934077258 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce4031c50 con 0x7fccf0075c90 2024-09-21T02:50:29.729 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.727+0000 7fccee000640 1 -- 172.21.15.79:0/934077258 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4035070 con 0x7fccf0075c90 2024-09-21T02:50:29.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.728+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf006cde0 con 0x7fccf0075c90 2024-09-21T02:50:29.730 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.728+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf006d330 con 0x7fccf0075c90 2024-09-21T02:50:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.738+0000 7fccee000640 1 -- 172.21.15.79:0/934077258 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fcce4042020 con 0x7fccf0075c90 2024-09-21T02:50:29.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.740+0000 7fccff47f740 1 Processor -- start 2024-09-21T02:50:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.743+0000 7fccee000640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fccd80b6540 0x7fccd80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.743+0000 7fccee000640 1 -- 172.21.15.79:0/934077258 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcce4107d80 con 0x7fccf0075c90 2024-09-21T02:50:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.743+0000 7fccff47f740 1 -- start start 2024-09-21T02:50:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf6400640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fccd80b6540 0x7fccd80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccff47f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eef11b0 0x562e3f2982b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccff47f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f298920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccff47f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f299470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccff47f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e3f20b6b0 con 0x562e3eed04d0 2024-09-21T02:50:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccff47f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562e3f1faae0 con 0x562e3eef11b0 2024-09-21T02:50:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccff47f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562e3f1fe8f0 con 0x562e3eec82f0 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eef11b0 0x562e3f2982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eef11b0 0x562e3f2982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37448/0 (socket says 172.21.15.79:37448) 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf5a00640 1 -- 172.21.15.79:0/1409303505 learned_addr learned my addr 172.21.15.79:0/1409303505 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf6400640 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f299470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf5a00640 1 -- 172.21.15.79:0/1409303505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 msgr2=0x562e3f298920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf5a00640 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f298920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.744+0000 7fccf5a00640 1 -- 172.21.15.79:0/1409303505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 msgr2=0x562e3f299470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.745+0000 7fccf5a00640 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f299470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.745+0000 7fccf5a00640 1 -- 172.21.15.79:0/1409303505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e3f1c7780 con 0x562e3eef11b0 2024-09-21T02:50:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.745+0000 7fccf5a00640 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eef11b0 0x562e3f2982b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcce40cd860 tx=0x7fcce4005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df080f479829b814 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.745+0000 7fcce2a00640 1 -- 172.21.15.79:0/1409303505 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40cd670 con 0x562e3eef11b0 2024-09-21T02:50:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.745+0000 7fcce2a00640 1 -- 172.21.15.79:0/1409303505 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce40ce260 con 0x562e3eef11b0 2024-09-21T02:50:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.745+0000 7fcce2a00640 1 -- 172.21.15.79:0/1409303505 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40c9dd0 con 0x562e3eef11b0 2024-09-21T02:50:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.745+0000 7fccf6400640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fccd80b6540 0x7fccd80b8a50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcce8007fd0 tx=0x7fcce8007d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.747+0000 7fccff47f740 1 -- 172.21.15.79:0/1409303505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eef11b0 msgr2=0x562e3f2982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.747+0000 7fccff47f740 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eef11b0 0x562e3f2982b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcce40cd860 tx=0x7fcce4005d50 comp rx=0 tx=0).stop 2024-09-21T02:50:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.748+0000 7fccff47f740 1 -- 172.21.15.79:0/1409303505 shutdown_connections 2024-09-21T02:50:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.748+0000 7fccff47f740 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f299470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.748+0000 7fccff47f740 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f298920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.748+0000 7fccff47f740 1 --2- 172.21.15.79:0/1409303505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eef11b0 0x562e3f2982b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.748+0000 7fccff47f740 1 -- 172.21.15.79:0/1409303505 >> 172.21.15.79:0/1409303505 conn(0x562e3eee5300 msgr2=0x562e3f293d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.752+0000 7fccff47f740 1 -- 172.21.15.79:0/1409303505 shutdown_connections 2024-09-21T02:50:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.752+0000 7fccff47f740 1 -- 172.21.15.79:0/1409303505 wait complete. 2024-09-21T02:50:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.753+0000 7fccff47f740 1 -- start start 2024-09-21T02:50:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.753+0000 7fccff47f740 1 Processor -- start 2024-09-21T02:50:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.754+0000 7fccff47f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eec82f0 0x562e3f2a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.754+0000 7fccff47f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.754+0000 7fccff47f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f2a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.755+0000 7fccf5000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.755+0000 7fccf5000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37452/0 (socket says 172.21.15.79:37452) 2024-09-21T02:50:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.755+0000 7fccf6400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f2a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.755+0000 7fccf6400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f2a2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52806/0 (socket says 172.21.15.79:52806) 2024-09-21T02:50:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.755+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eec82f0 0x562e3f2a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eec82f0 0x562e3f2a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49440/0 (socket says 172.21.15.79:49440) 2024-09-21T02:50:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccff47f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e3f132ab0 con 0x562e3eec82f0 2024-09-21T02:50:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562e3f1a1570 con 0x562e3eed04d0 2024-09-21T02:50:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccf5000640 1 -- 172.21.15.79:0/3601066723 learned_addr learned my addr 172.21.15.79:0/3601066723 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562e3f299d50 con 0x562e3eef11b0 2024-09-21T02:50:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccff47f740 10 client.0 _ll_register_callbacks cb 0x562e3f1b0100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccf6400640 1 -- 172.21.15.79:0/3601066723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 msgr2=0x562e3f2a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccf6400640 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccf6400640 1 -- 172.21.15.79:0/3601066723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eec82f0 msgr2=0x562e3f2a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccf6400640 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eec82f0 0x562e3f2a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.756+0000 7fccf6400640 1 -- 172.21.15.79:0/3601066723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e3ef5c790 con 0x562e3eef11b0 2024-09-21T02:50:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.757+0000 7fccf6400640 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f2a2880 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcce8022e20 tx=0x7fcce8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f6035726d42e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.757+0000 7fccd7400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:50:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.757+0000 7fccd7400640 1 -- 172.21.15.79:0/3601066723 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8037060 con 0x562e3eef11b0 2024-09-21T02:50:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.758+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce40ce260 con 0x562e3eef11b0 2024-09-21T02:50:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.758+0000 7fccd7400640 1 -- 172.21.15.79:0/3601066723 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcce80265c0 con 0x562e3eef11b0 2024-09-21T02:50:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.758+0000 7fccd7400640 1 -- 172.21.15.79:0/3601066723 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcce803e050 con 0x562e3eef11b0 2024-09-21T02:50:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.759+0000 7fccff47f740 10 client.27034 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.759+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562e3efd5620 con 0x562e3eef11b0 2024-09-21T02:50:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.760+0000 7fccd7400640 1 -- 172.21.15.79:0/3601066723 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce40ce260 con 0x562e3eef11b0 2024-09-21T02:50:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.760+0000 7fccd7400640 1 -- 172.21.15.79:0/3601066723 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcce80324e0 con 0x562e3eef11b0 2024-09-21T02:50:29.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.760+0000 7fccff47f740 10 client.27034 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:29.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.760+0000 7fccff47f740 10 client.27034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:29.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.760+0000 7fccff47f740 20 client.27034 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:29.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.760+0000 7fccff47f740 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3eeafd80 0x562e3f2aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.761+0000 7fccff47f740 4 client.27034 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:50:29.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.761+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e3f20d600 con 0x562e3eeafd80 2024-09-21T02:50:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.761+0000 7fccf5a00640 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3eeafd80 0x562e3f2aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.762+0000 7fccd7400640 10 client.27034 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.762+0000 7fccf5a00640 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3eeafd80 0x562e3f2aee90 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f73b1348b47175 server_cookie=ac4dee14af5e0d5b in_seq=0 out_seq=0 2024-09-21T02:50:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccd7400640 1 -- 172.21.15.79:0/3601066723 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e3f20d600 con 0x562e3eeafd80 2024-09-21T02:50:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccd7400640 10 client.27034 handle_command_reply: tid=0 2024-09-21T02:50:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 client.27034 shutdown 2024-09-21T02:50:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 msgr2=0x562e3f2a2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f2a2880 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcce8022e20 tx=0x7fcce8004a40 comp rx=0 tx=0).stop 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 shutdown_connections 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3eeafd80 0x562e3f2aee90 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f2a2880 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 --2- 172.21.15.79:0/3601066723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eec82f0 0x562e3f2a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.763+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 >> 172.21.15.79:0/3601066723 conn(0x562e3eee5300 msgr2=0x562e3f292360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.764+0000 7fccd7400640 0 client.27034 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.764+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 shutdown_connections 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.764+0000 7fccff47f740 1 -- 172.21.15.79:0/3601066723 wait complete. 2024-09-21T02:50:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.764+0000 7fccff47f740 20 client.27034 trim_cache size 0 max 16384 2024-09-21T02:50:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 Processor -- start 2024-09-21T02:50:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 -- start start 2024-09-21T02:50:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eec82f0 0x562e3f2a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f293680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f293bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00714c0 con 0x562e3eed04d0 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0073d40 con 0x562e3eec82f0 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.793+0000 7fccff47f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0071b30 con 0x562e3eef11b0 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eec82f0 0x562e3f2a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f293680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf6400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f293bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eec82f0 0x562e3f2a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:37466/0 (socket says 172.21.15.79:37466) 2024-09-21T02:50:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 -- 172.21.15.79:0/454002757 learned_addr learned my addr 172.21.15.79:0/454002757 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 -- 172.21.15.79:0/454002757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 msgr2=0x562e3f293bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f293bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 -- 172.21.15.79:0/454002757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 msgr2=0x562e3f293680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f293680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5a00640 1 -- 172.21.15.79:0/454002757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e3f2a9b20 con 0x562e3eec82f0 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.794+0000 7fccf5000640 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f293680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.795+0000 7fccf5a00640 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eec82f0 0x562e3f2a0fd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcce4031440 tx=0x7fcce4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7452949461e8affd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.795+0000 7fcce2000640 1 -- 172.21.15.79:0/454002757 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40cd670 con 0x562e3eec82f0 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.795+0000 7fcce2000640 1 -- 172.21.15.79:0/454002757 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce40ce260 con 0x562e3eec82f0 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.795+0000 7fcce2000640 1 -- 172.21.15.79:0/454002757 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40f11e0 con 0x562e3eec82f0 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 -- 172.21.15.79:0/454002757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eec82f0 msgr2=0x562e3f2a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eec82f0 0x562e3f2a0fd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcce4031440 tx=0x7fcce4009260 comp rx=0 tx=0).stop 2024-09-21T02:50:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 -- 172.21.15.79:0/454002757 shutdown_connections 2024-09-21T02:50:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eef11b0 0x562e3f293bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eed04d0 0x562e3f293680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 --2- 172.21.15.79:0/454002757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eec82f0 0x562e3f2a0fd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 -- 172.21.15.79:0/454002757 >> 172.21.15.79:0/454002757 conn(0x562e3eee5300 msgr2=0x562e3f2a08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.796+0000 7fccff47f740 1 -- 172.21.15.79:0/454002757 shutdown_connections 2024-09-21T02:50:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.797+0000 7fccff47f740 1 -- 172.21.15.79:0/454002757 wait complete. 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.797+0000 7fccff47f740 1 -- start start 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.797+0000 7fccff47f740 1 Processor -- start 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccff47f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f2a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccff47f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccff47f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eef11b0 0x562e3f2a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccff47f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0072200 con 0x562e3eef11b0 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccff47f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0073670 con 0x562e3eed04d0 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccff47f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00728d0 con 0x562e3eec82f0 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccf5000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f2a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccff47f740 10 client.0 _ll_register_callbacks cb 0x7fcce8008040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f2a7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:52830/0 (socket says 172.21.15.79:52830) 2024-09-21T02:50:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccf5a00640 1 -- 172.21.15.79:0/4132542709 learned_addr learned my addr 172.21.15.79:0/4132542709 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.798+0000 7fccf6400640 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eef11b0 0x562e3f2a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccf5a00640 1 -- 172.21.15.79:0/4132542709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 msgr2=0x562e3f2a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccf5a00640 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccf5a00640 1 -- 172.21.15.79:0/4132542709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eef11b0 msgr2=0x562e3f2a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccf5a00640 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eef11b0 0x562e3f2a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccf5a00640 1 -- 172.21.15.79:0/4132542709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e3f2a6bc0 con 0x562e3eec82f0 2024-09-21T02:50:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccf6400640 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eef11b0 0x562e3f2a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:50:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccf5a00640 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f2a7f80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcce40ca130 tx=0x7fcce4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c0ef72624ce3e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.799+0000 7fccd7400640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:50:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.805+0000 7fccd7400640 1 -- 172.21.15.79:0/4132542709 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40f5040 con 0x562e3eec82f0 2024-09-21T02:50:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.805+0000 7fccd7400640 1 -- 172.21.15.79:0/4132542709 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcce40c9dd0 con 0x562e3eec82f0 2024-09-21T02:50:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.805+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce40ce260 con 0x562e3eec82f0 2024-09-21T02:50:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.806+0000 7fccd7400640 1 -- 172.21.15.79:0/4132542709 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcce40cd670 con 0x562e3eec82f0 2024-09-21T02:50:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.806+0000 7fccff47f740 10 client.27040 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.806+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562e3f319b30 con 0x562e3eec82f0 2024-09-21T02:50:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.807+0000 7fccd7400640 1 -- 172.21.15.79:0/4132542709 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce40ce260 con 0x562e3eec82f0 2024-09-21T02:50:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccd7400640 1 -- 172.21.15.79:0/4132542709 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcce40b6070 con 0x562e3eec82f0 2024-09-21T02:50:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccff47f740 10 client.27040 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccff47f740 10 client.27040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccff47f740 20 client.27040 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccff47f740 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3ee851c0 0x562e3f31c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccff47f740 4 client.27040 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:50:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e3f2090b0 con 0x562e3ee851c0 2024-09-21T02:50:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.808+0000 7fccf5000640 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3ee851c0 0x562e3f31c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.809+0000 7fccf5000640 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3ee851c0 0x562e3f31c360 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d56769db9c7d2e server_cookie=fbc7b6e7fa58b3c in_seq=0 out_seq=0 2024-09-21T02:50:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.809+0000 7fccd7400640 10 client.27040 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:29.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.973+0000 7fccd7400640 1 -- 172.21.15.79:0/4132542709 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e3f2090b0 con 0x562e3ee851c0 2024-09-21T02:50:29.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.973+0000 7fccd7400640 10 client.27040 handle_command_reply: tid=0 2024-09-21T02:50:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.973+0000 7fccff47f740 1 client.27040 shutdown 2024-09-21T02:50:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.973+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 msgr2=0x562e3f2a7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.973+0000 7fccff47f740 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f2a7f80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcce40ca130 tx=0x7fcce4000bc0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.973+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 shutdown_connections 2024-09-21T02:50:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccff47f740 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x562e3ee851c0 0x562e3f31c360 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccff47f740 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e3eef11b0 0x562e3f2a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccff47f740 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e3eed04d0 0x562e3f2a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccff47f740 1 --2- 172.21.15.79:0/4132542709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e3eec82f0 0x562e3f2a7f80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 >> 172.21.15.79:0/4132542709 conn(0x562e3eee5300 msgr2=0x562e3f2b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccd7400640 0 client.27040 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 shutdown_connections 2024-09-21T02:50:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.974+0000 7fccff47f740 1 -- 172.21.15.79:0/4132542709 wait complete. 2024-09-21T02:50:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.975+0000 7fccff47f740 20 client.27040 trim_cache size 0 max 16384 2024-09-21T02:50:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:50:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:50:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:50:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:50:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.978+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fccd80b6540 msgr2=0x7fccd80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.978+0000 7fccf6e00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fccd80b6540 0x7fccd80b8a50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcce8007fd0 tx=0x7fcce8007d00 comp rx=0 tx=0).stop 2024-09-21T02:50:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.978+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 msgr2=0x7fccf019c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:29.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.978+0000 7fccf6e00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 0x7fccf019c180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcce402aa00 tx=0x7fcce4003c10 comp rx=0 tx=0).stop 2024-09-21T02:50:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.979+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 shutdown_connections 2024-09-21T02:50:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.979+0000 7fccf6e00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fccd80b6540 0x7fccd80b8a50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.979+0000 7fccf6e00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf019d2b0 0x7fccf019d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.979+0000 7fccf6e00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf010b4d0 0x7fccf019c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.979+0000 7fccf6e00640 1 --2- 172.21.15.79:0/934077258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccf0075c90 0x7fccf019c180 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:29.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.979+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 >> 172.21.15.79:0/934077258 conn(0x7fccf00fee20 msgr2=0x7fccf01074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.980+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 shutdown_connections 2024-09-21T02:50:29.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:29.980+0000 7fccf6e00640 1 -- 172.21.15.79:0/934077258 wait complete. 2024-09-21T02:50:30.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:29 smithi148 ceph-mon[34626]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.2 MiB/s wr, 464 op/s 2024-09-21T02:50:30.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:29 smithi098 ceph-mon[34832]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.2 MiB/s wr, 464 op/s 2024-09-21T02:50:30.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:29 smithi079 ceph-mon[30788]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.2 MiB/s wr, 464 op/s 2024-09-21T02:50:31.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 875.0 s, 531.0 tps, lat 193.049 ms stddev 201.465 2024-09-21T02:50:32.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:31 smithi148 ceph-mon[34626]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 4.5 MiB/s wr, 472 op/s 2024-09-21T02:50:32.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:31 smithi098 ceph-mon[34832]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 4.5 MiB/s wr, 472 op/s 2024-09-21T02:50:32.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:31 smithi079 ceph-mon[30788]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 4.5 MiB/s wr, 472 op/s 2024-09-21T02:50:34.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:33 smithi148 ceph-mon[34626]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.7 MiB/s wr, 496 op/s 2024-09-21T02:50:34.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:33 smithi098 ceph-mon[34832]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.7 MiB/s wr, 496 op/s 2024-09-21T02:50:34.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:33 smithi079 ceph-mon[30788]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.7 MiB/s wr, 496 op/s 2024-09-21T02:50:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:35 smithi098 ceph-mon[34832]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:50:36.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:35 smithi079 ceph-mon[30788]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:50:36.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:35 smithi148 ceph-mon[34626]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2024-09-21T02:50:36.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 880.0 s, 426.2 tps, lat 225.344 ms stddev 256.669 2024-09-21T02:50:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:37 smithi098 ceph-mon[34832]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2024-09-21T02:50:38.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:37 smithi079 ceph-mon[30788]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2024-09-21T02:50:38.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:37 smithi148 ceph-mon[34626]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2024-09-21T02:50:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:39 smithi098 ceph-mon[34832]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 4.5 MiB/s wr, 497 op/s 2024-09-21T02:50:40.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:39 smithi079 ceph-mon[30788]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 4.5 MiB/s wr, 497 op/s 2024-09-21T02:50:40.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:39 smithi148 ceph-mon[34626]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 4.5 MiB/s wr, 497 op/s 2024-09-21T02:50:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 885.0 s, 438.4 tps, lat 225.951 ms stddev 255.420 2024-09-21T02:50:42.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:41 smithi098 ceph-mon[34832]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-09-21T02:50:42.230 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:41 smithi079 ceph-mon[30788]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-09-21T02:50:42.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:41 smithi148 ceph-mon[34626]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 -- 172.21.15.79:0/755578915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 msgr2=0x7ff83c076080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 --2- 172.21.15.79:0/755578915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 0x7ff83c076080 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff828009900 tx=0x7ff82802a410 comp rx=0 tx=0).stop 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 -- 172.21.15.79:0/755578915 shutdown_connections 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 --2- 172.21.15.79:0/755578915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff83c10b6d0 0x7ff83c10db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 --2- 172.21.15.79:0/755578915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 0x7ff83c076080 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 --2- 172.21.15.79:0/755578915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83c077070 0x7ff83c075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 -- 172.21.15.79:0/755578915 >> 172.21.15.79:0/755578915 conn(0x7ff83c0ff000 msgr2=0x7ff83c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 -- 172.21.15.79:0/755578915 shutdown_connections 2024-09-21T02:50:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.378+0000 7ff841c00640 1 -- 172.21.15.79:0/755578915 wait complete. 2024-09-21T02:50:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.379+0000 7ff841c00640 1 Processor -- start 2024-09-21T02:50:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff841c00640 1 -- start start 2024-09-21T02:50:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff841c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 0x7ff83c1a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff841c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83c077070 0x7ff83c1a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff841c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff83c10b6d0 0x7ff83c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff841c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c111530 con 0x7ff83c077070 2024-09-21T02:50:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff841c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1113b0 con 0x7ff83c075c70 2024-09-21T02:50:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff841c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1116b0 con 0x7ff83c10b6d0 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff83aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 0x7ff83c1a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff83b400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff83c10b6d0 0x7ff83c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff83aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 0x7ff83c1a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35418/0 (socket says 172.21.15.79:35418) 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.380+0000 7ff83aa00640 1 -- 172.21.15.79:0/2674761028 learned_addr learned my addr 172.21.15.79:0/2674761028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.381+0000 7ff83a000640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83c077070 0x7ff83c1a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.381+0000 7ff83b400640 1 -- 172.21.15.79:0/2674761028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 msgr2=0x7ff83c1a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.381+0000 7ff83b400640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 0x7ff83c1a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.381+0000 7ff83b400640 1 -- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83c077070 msgr2=0x7ff83c1a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.381+0000 7ff83b400640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83c077070 0x7ff83c1a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.381+0000 7ff83b400640 1 -- 172.21.15.79:0/2674761028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c1a1fd0 con 0x7ff83c10b6d0 2024-09-21T02:50:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.381+0000 7ff83b400640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff83c10b6d0 0x7ff83c1a17b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff834005fd0 tx=0x7ff83400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.383+0000 7ff833400640 1 -- 172.21.15.79:0/2674761028 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83400cdf0 con 0x7ff83c10b6d0 2024-09-21T02:50:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.383+0000 7ff833400640 1 -- 172.21.15.79:0/2674761028 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff834005020 con 0x7ff83c10b6d0 2024-09-21T02:50:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.383+0000 7ff833400640 1 -- 172.21.15.79:0/2674761028 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834010690 con 0x7ff83c10b6d0 2024-09-21T02:50:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.383+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83c1a22c0 con 0x7ff83c10b6d0 2024-09-21T02:50:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.383+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83c1a89b0 con 0x7ff83c10b6d0 2024-09-21T02:50:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.387+0000 7ff848e1b740 1 Processor -- start 2024-09-21T02:50:43.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.387+0000 7ff848e1b740 1 -- start start 2024-09-21T02:50:43.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.388+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf99690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.388+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf9969740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.388+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf996a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.388+0000 7ff848e1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dbf98dc6b0 con 0x55dbf95a14d0 2024-09-21T02:50:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.388+0000 7ff848e1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dbf98cbae0 con 0x55dbf95992f0 2024-09-21T02:50:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.388+0000 7ff848e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dbf98cf8f0 con 0x55dbf95c21b0 2024-09-21T02:50:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.391+0000 7ff83aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf9969740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.391+0000 7ff83aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf9969740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35420/0 (socket says 172.21.15.79:35420) 2024-09-21T02:50:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.391+0000 7ff83aa00640 1 -- 172.21.15.79:0/871158975 learned_addr learned my addr 172.21.15.79:0/871158975 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.392+0000 7ff83aa00640 1 -- 172.21.15.79:0/871158975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 msgr2=0x55dbf99690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.392+0000 7ff83aa00640 1 --2- 172.21.15.79:0/871158975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf99690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.392+0000 7ff83aa00640 1 -- 172.21.15.79:0/871158975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 msgr2=0x55dbf996a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.392+0000 7ff83aa00640 1 --2- 172.21.15.79:0/871158975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf996a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.392+0000 7ff83aa00640 1 -- 172.21.15.79:0/871158975 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf9898780 con 0x55dbf95992f0 2024-09-21T02:50:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.393+0000 7ff83aa00640 1 --2- 172.21.15.79:0/871158975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf9969740 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00bda0 tx=0x7ff82c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa17f2dc6c35c4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.393+0000 7ff833400640 1 -- 172.21.15.79:0/2674761028 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff834005460 con 0x7ff83c10b6d0 2024-09-21T02:50:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.394+0000 7ff827e00640 1 -- 172.21.15.79:0/871158975 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c01c680 con 0x55dbf95992f0 2024-09-21T02:50:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.395+0000 7ff827e00640 1 -- 172.21.15.79:0/871158975 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff82c0118f0 con 0x55dbf95992f0 2024-09-21T02:50:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.395+0000 7ff827e00640 1 -- 172.21.15.79:0/871158975 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c01a800 con 0x55dbf95992f0 2024-09-21T02:50:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.398+0000 7ff833400640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff8200b66e0 0x7ff8200b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.398+0000 7ff833400640 1 -- 172.21.15.79:0/2674761028 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff8340e7da0 con 0x7ff83c10b6d0 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.399+0000 7ff848e1b740 1 -- 172.21.15.79:0/871158975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 msgr2=0x55dbf9969740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.399+0000 7ff848e1b740 1 --2- 172.21.15.79:0/871158975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf9969740 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00bda0 tx=0x7ff82c0107a0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.399+0000 7ff848e1b740 1 -- 172.21.15.79:0/871158975 shutdown_connections 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.399+0000 7ff848e1b740 1 --2- 172.21.15.79:0/871158975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf996a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.399+0000 7ff848e1b740 1 --2- 172.21.15.79:0/871158975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf9969740 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.399+0000 7ff848e1b740 1 --2- 172.21.15.79:0/871158975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf99690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.399+0000 7ff848e1b740 1 -- 172.21.15.79:0/871158975 >> 172.21.15.79:0/871158975 conn(0x55dbf95b6300 msgr2=0x55dbf9964b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.400+0000 7ff83a000640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff8200b66e0 0x7ff8200b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.401+0000 7ff83a000640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff8200b66e0 0x7ff8200b8bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff828031440 tx=0x7ff8280314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.402+0000 7ff848e1b740 1 -- 172.21.15.79:0/871158975 shutdown_connections 2024-09-21T02:50:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.402+0000 7ff848e1b740 1 -- 172.21.15.79:0/871158975 wait complete. 2024-09-21T02:50:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.402+0000 7ff848e1b740 1 -- start start 2024-09-21T02:50:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.403+0000 7ff848e1b740 1 Processor -- start 2024-09-21T02:50:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.406+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95992f0 0x55dbf9983880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.406+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9983f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.406+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95c21b0 0x55dbf9984ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.406+0000 7ff848e1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dbf9803ab0 con 0x55dbf95992f0 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.406+0000 7ff848e1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dbf9872570 con 0x55dbf95c21b0 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.406+0000 7ff848e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dbf996adb0 con 0x55dbf95a14d0 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.406+0000 7ff848e1b740 10 client.0 _ll_register_callbacks cb 0x55dbf9881100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.407+0000 7ff83a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9983f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.407+0000 7ff83a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9983f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:60770/0 (socket says 172.21.15.79:60770) 2024-09-21T02:50:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.407+0000 7ff83a000640 1 -- 172.21.15.79:0/879384650 learned_addr learned my addr 172.21.15.79:0/879384650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.408+0000 7ff83b400640 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95c21b0 0x55dbf9984ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.408+0000 7ff83aa00640 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95992f0 0x55dbf9983880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.409+0000 7ff83aa00640 1 -- 172.21.15.79:0/879384650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 msgr2=0x55dbf9983f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.409+0000 7ff83aa00640 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9983f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.409+0000 7ff83aa00640 1 -- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95c21b0 msgr2=0x55dbf9984ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.409+0000 7ff83aa00640 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95c21b0 0x55dbf9984ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.409+0000 7ff83aa00640 1 -- 172.21.15.79:0/879384650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf962d790 con 0x55dbf95992f0 2024-09-21T02:50:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.410+0000 7ff83aa00640 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95992f0 0x55dbf9983880 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff82c005f70 tx=0x7ff82c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c97d28ab4a1c53a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.410+0000 7ff824c00640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T02:50:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.418+0000 7ff824c00640 1 -- 172.21.15.79:0/879384650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c02a060 con 0x55dbf95992f0 2024-09-21T02:50:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.420+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff82c0118f0 con 0x55dbf95992f0 2024-09-21T02:50:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.420+0000 7ff824c00640 1 -- 172.21.15.79:0/879384650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff82c004040 con 0x55dbf95992f0 2024-09-21T02:50:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.421+0000 7ff824c00640 1 -- 172.21.15.79:0/879384650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff82c004240 con 0x55dbf95992f0 2024-09-21T02:50:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.424+0000 7ff848e1b740 10 client.16713 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.424+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dbf96a6620 con 0x55dbf95992f0 2024-09-21T02:50:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.426+0000 7ff824c00640 1 -- 172.21.15.79:0/879384650 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff82c0118f0 con 0x55dbf95992f0 2024-09-21T02:50:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.429+0000 7ff824c00640 1 -- 172.21.15.79:0/879384650 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff82c024030 con 0x55dbf95992f0 2024-09-21T02:50:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.429+0000 7ff848e1b740 10 client.16713 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.431+0000 7ff848e1b740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.432+0000 7ff848e1b740 20 client.16713 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.432+0000 7ff848e1b740 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf9580d80 0x55dbf9990ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.432+0000 7ff848e1b740 4 client.16713 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:50:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.433+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbf98de600 con 0x55dbf9580d80 2024-09-21T02:50:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.433+0000 7ff83a000640 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf9580d80 0x55dbf9990ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.434+0000 7ff83a000640 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf9580d80 0x55dbf9990ca0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5de86b88143755e2 server_cookie=a1f0265db30fa2d3 in_seq=0 out_seq=0 2024-09-21T02:50:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.434+0000 7ff824c00640 10 client.16713 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.435+0000 7ff824c00640 1 -- 172.21.15.79:0/879384650 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbf98de600 con 0x55dbf9580d80 2024-09-21T02:50:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.435+0000 7ff824c00640 10 client.16713 handle_command_reply: tid=0 2024-09-21T02:50:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.435+0000 7ff848e1b740 1 client.16713 shutdown 2024-09-21T02:50:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95992f0 msgr2=0x55dbf9983880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95992f0 0x55dbf9983880 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff82c005f70 tx=0x7ff82c011700 comp rx=0 tx=0).stop 2024-09-21T02:50:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 shutdown_connections 2024-09-21T02:50:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf9580d80 0x55dbf9990ca0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95c21b0 0x55dbf9984ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9983f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 --2- 172.21.15.79:0/879384650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95992f0 0x55dbf9983880 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff824c00640 0 client.16713 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 >> 172.21.15.79:0/879384650 conn(0x55dbf95b6300 msgr2=0x55dbf99630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 shutdown_connections 2024-09-21T02:50:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.438+0000 7ff848e1b740 1 -- 172.21.15.79:0/879384650 wait complete. 2024-09-21T02:50:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.439+0000 7ff848e1b740 20 client.16713 trim_cache size 0 max 16384 2024-09-21T02:50:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.472+0000 7ff848e1b740 1 Processor -- start 2024-09-21T02:50:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.472+0000 7ff848e1b740 1 -- start start 2024-09-21T02:50:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.473+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf99638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.473+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9963e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.473+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95c21b0 0x55dbf9982250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.473+0000 7ff848e1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c075110 con 0x55dbf95c21b0 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.473+0000 7ff848e1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1aae60 con 0x55dbf95992f0 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.473+0000 7ff848e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1a8c70 con 0x55dbf95a14d0 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.474+0000 7ff83a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9963e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.474+0000 7ff83a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9963e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:60784/0 (socket says 172.21.15.79:60784) 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.474+0000 7ff83a000640 1 -- 172.21.15.79:0/564755127 learned_addr learned my addr 172.21.15.79:0/564755127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.474+0000 7ff83b400640 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95c21b0 0x55dbf9982250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.475+0000 7ff83aa00640 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf99638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.475+0000 7ff83b400640 1 -- 172.21.15.79:0/564755127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 msgr2=0x55dbf9963e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.475+0000 7ff83b400640 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9963e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.475+0000 7ff83b400640 1 -- 172.21.15.79:0/564755127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 msgr2=0x55dbf99638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.475+0000 7ff83b400640 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf99638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.475+0000 7ff83b400640 1 -- 172.21.15.79:0/564755127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf9970fe0 con 0x55dbf95c21b0 2024-09-21T02:50:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.476+0000 7ff83b400640 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95c21b0 0x55dbf9982250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff8340adab0 tx=0x7ff8340ad3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c054c89d7b2daa27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.476+0000 7ff827400640 1 -- 172.21.15.79:0/564755127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8340b2600 con 0x55dbf95c21b0 2024-09-21T02:50:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.477+0000 7ff827400640 1 -- 172.21.15.79:0/564755127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8340aee50 con 0x55dbf95c21b0 2024-09-21T02:50:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.477+0000 7ff827400640 1 -- 172.21.15.79:0/564755127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8340b2390 con 0x55dbf95c21b0 2024-09-21T02:50:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.478+0000 7ff848e1b740 1 -- 172.21.15.79:0/564755127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95c21b0 msgr2=0x55dbf9982250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.478+0000 7ff848e1b740 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95c21b0 0x55dbf9982250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff8340adab0 tx=0x7ff8340ad3a0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 -- 172.21.15.79:0/564755127 shutdown_connections 2024-09-21T02:50:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95c21b0 0x55dbf9982250 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95a14d0 0x55dbf9963e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 --2- 172.21.15.79:0/564755127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf99638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 -- 172.21.15.79:0/564755127 >> 172.21.15.79:0/564755127 conn(0x55dbf95b6300 msgr2=0x55dbf9969f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 -- 172.21.15.79:0/564755127 shutdown_connections 2024-09-21T02:50:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 -- 172.21.15.79:0/564755127 wait complete. 2024-09-21T02:50:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.479+0000 7ff848e1b740 1 -- start start 2024-09-21T02:50:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.480+0000 7ff848e1b740 1 Processor -- start 2024-09-21T02:50:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.481+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf998af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.481+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf9989c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.481+0000 7ff848e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf998a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.481+0000 7ff83aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf998af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.481+0000 7ff83aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf998af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:35444/0 (socket says 172.21.15.79:35444) 2024-09-21T02:50:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.482+0000 7ff83a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf9989c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.482+0000 7ff83a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf9989c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33066/0 (socket says 172.21.15.79:33066) 2024-09-21T02:50:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff848e1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1a9320 con 0x55dbf95a14d0 2024-09-21T02:50:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff848e1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1aa790 con 0x55dbf95992f0 2024-09-21T02:50:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff848e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1a99f0 con 0x55dbf95c21b0 2024-09-21T02:50:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff848e1b740 10 client.0 _ll_register_callbacks cb 0x7ff82c00bbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff83aa00640 1 -- 172.21.15.79:0/256962320 learned_addr learned my addr 172.21.15.79:0/256962320 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff83b400640 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf998a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff83b400640 1 -- 172.21.15.79:0/256962320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 msgr2=0x55dbf998af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff83b400640 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf998af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff83b400640 1 -- 172.21.15.79:0/256962320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 msgr2=0x55dbf9989c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff83b400640 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf9989c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.485+0000 7ff83b400640 1 -- 172.21.15.79:0/256962320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf998a730 con 0x55dbf95c21b0 2024-09-21T02:50:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.486+0000 7ff83b400640 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf998a140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8340adab0 tx=0x7ff8340d1300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76a7e038b445bd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.486+0000 7ff824c00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:50:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.486+0000 7ff824c00640 1 -- 172.21.15.79:0/256962320 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8340ca020 con 0x55dbf95c21b0 2024-09-21T02:50:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.486+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8340aee50 con 0x55dbf95c21b0 2024-09-21T02:50:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.487+0000 7ff824c00640 1 -- 172.21.15.79:0/256962320 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7ff8340acd80 con 0x55dbf95c21b0 2024-09-21T02:50:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.487+0000 7ff824c00640 1 -- 172.21.15.79:0/256962320 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff8340b2600 con 0x55dbf95c21b0 2024-09-21T02:50:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 10 client.27055 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dbf99895a0 con 0x55dbf95c21b0 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff824c00640 1 -- 172.21.15.79:0/256962320 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8340aee50 con 0x55dbf95c21b0 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff824c00640 1 -- 172.21.15.79:0/256962320 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff8340b3790 con 0x55dbf95c21b0 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 10 client.27055 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 10 client.27055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 20 client.27055 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf95561c0 0x55dbf99fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 4 client.27055 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:50:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.488+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbf98da0b0 con 0x55dbf95561c0 2024-09-21T02:50:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.489+0000 7ff83aa00640 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf95561c0 0x55dbf99fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.490+0000 7ff83aa00640 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf95561c0 0x55dbf99fdb40 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e481dfa70300d7cd server_cookie=9869076ecd2c5af7 in_seq=0 out_seq=0 2024-09-21T02:50:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.492+0000 7ff824c00640 10 client.27055 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.716+0000 7ff824c00640 1 -- 172.21.15.79:0/256962320 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dbf98da0b0 con 0x55dbf95561c0 2024-09-21T02:50:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.716+0000 7ff824c00640 10 client.27055 handle_command_reply: tid=0 2024-09-21T02:50:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.716+0000 7ff848e1b740 1 client.27055 shutdown 2024-09-21T02:50:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.717+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 msgr2=0x55dbf998a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.717+0000 7ff848e1b740 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf998a140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8340adab0 tx=0x7ff8340d1300 comp rx=0 tx=0).stop 2024-09-21T02:50:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.717+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 shutdown_connections 2024-09-21T02:50:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.717+0000 7ff848e1b740 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55dbf95561c0 0x55dbf99fdb40 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.717+0000 7ff848e1b740 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf95c21b0 0x55dbf998a140 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.717+0000 7ff824c00640 0 client.27055 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.718+0000 7ff848e1b740 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbf95a14d0 0x55dbf9989c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.718+0000 7ff848e1b740 1 --2- 172.21.15.79:0/256962320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dbf95992f0 0x55dbf998af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.718+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 >> 172.21.15.79:0/256962320 conn(0x55dbf95b6300 msgr2=0x55dbf996d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.718+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 shutdown_connections 2024-09-21T02:50:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.718+0000 7ff848e1b740 1 -- 172.21.15.79:0/256962320 wait complete. 2024-09-21T02:50:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.718+0000 7ff848e1b740 20 client.27055 trim_cache size 0 max 16384 2024-09-21T02:50:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:50:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:50:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:50:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:50:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff8200b66e0 msgr2=0x7ff8200b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff8200b66e0 0x7ff8200b8bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff828031440 tx=0x7ff8280314a0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff83c10b6d0 msgr2=0x7ff83c1a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff83c10b6d0 0x7ff83c1a17b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff834005fd0 tx=0x7ff83400ef10 comp rx=0 tx=0).stop 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 shutdown_connections 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7ff8200b66e0 0x7ff8200b8bf0 secure :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff828031440 tx=0x7ff8280314a0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff83c10b6d0 0x7ff83c1a17b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff83c077070 0x7ff83c1a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 --2- 172.21.15.79:0/2674761028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff83c075c70 0x7ff83c1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.719+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 >> 172.21.15.79:0/2674761028 conn(0x7ff83c0ff000 msgr2=0x7ff83c0ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.720+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 shutdown_connections 2024-09-21T02:50:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:43.720+0000 7ff841c00640 1 -- 172.21.15.79:0/2674761028 wait complete. 2024-09-21T02:50:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:43 smithi098 ceph-mon[34832]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 4.6 MiB/s wr, 509 op/s 2024-09-21T02:50:44.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:43 smithi079 ceph-mon[30788]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 4.6 MiB/s wr, 509 op/s 2024-09-21T02:50:44.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:43 smithi148 ceph-mon[34626]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 4.6 MiB/s wr, 509 op/s 2024-09-21T02:50:46.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:45 smithi098 ceph-mon[34832]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 3.9 MiB/s wr, 449 op/s 2024-09-21T02:50:46.231 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:45 smithi079 ceph-mon[30788]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 3.9 MiB/s wr, 449 op/s 2024-09-21T02:50:46.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:45 smithi148 ceph-mon[34626]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 3.9 MiB/s wr, 449 op/s 2024-09-21T02:50:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 890.0 s, 486.6 tps, lat 207.657 ms stddev 253.100 2024-09-21T02:50:47.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:46 smithi098 ceph-mon[34832]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 4.1 MiB/s wr, 450 op/s 2024-09-21T02:50:47.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:46 smithi079 ceph-mon[30788]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 4.1 MiB/s wr, 450 op/s 2024-09-21T02:50:47.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:46 smithi148 ceph-mon[34626]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 4.1 MiB/s wr, 450 op/s 2024-09-21T02:50:49.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:49 smithi148 ceph-mon[34626]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 4.3 MiB/s wr, 475 op/s 2024-09-21T02:50:49.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:49 smithi098 ceph-mon[34832]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 4.3 MiB/s wr, 475 op/s 2024-09-21T02:50:49.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:49 smithi079 ceph-mon[30788]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 4.3 MiB/s wr, 475 op/s 2024-09-21T02:50:51.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:51 smithi148 ceph-mon[34626]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 5.0 MiB/s wr, 499 op/s 2024-09-21T02:50:51.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:51 smithi098 ceph-mon[34832]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 5.0 MiB/s wr, 499 op/s 2024-09-21T02:50:51.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:51 smithi079 ceph-mon[30788]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 5.0 MiB/s wr, 499 op/s 2024-09-21T02:50:51.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 895.0 s, 408.2 tps, lat 243.386 ms stddev 300.078 2024-09-21T02:50:53.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:53 smithi148 ceph-mon[34626]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 6.0 MiB/s wr, 495 op/s 2024-09-21T02:50:53.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:53 smithi098 ceph-mon[34832]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 6.0 MiB/s wr, 495 op/s 2024-09-21T02:50:53.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:53 smithi079 ceph-mon[30788]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 6.0 MiB/s wr, 495 op/s 2024-09-21T02:50:55.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:55 smithi148 ceph-mon[34626]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2024-09-21T02:50:55.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:55 smithi098 ceph-mon[34832]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2024-09-21T02:50:55.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:55 smithi079 ceph-mon[30788]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2024-09-21T02:50:56.493 INFO:teuthology.orchestra.run.smithi079.stderr:progress: 900.0 s, 482.4 tps, lat 214.428 ms stddev 274.544 2024-09-21T02:50:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 -- 172.21.15.79:0/2863797147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81036a0 msgr2=0x7fcee8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 --2- 172.21.15.79:0/2863797147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81036a0 0x7fcee8103b10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fced8009860 tx=0x7fced802a340 comp rx=0 tx=0).stop 2024-09-21T02:50:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 -- 172.21.15.79:0/2863797147 shutdown_connections 2024-09-21T02:50:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 --2- 172.21.15.79:0/2863797147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee81050c0 0x7fcee810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 --2- 172.21.15.79:0/2863797147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee8104720 0x7fcee8104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 --2- 172.21.15.79:0/2863797147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81036a0 0x7fcee8103b10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 -- 172.21.15.79:0/2863797147 >> 172.21.15.79:0/2863797147 conn(0x7fcee80fefe0 msgr2=0x7fcee8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.002+0000 7fceeea00640 1 -- 172.21.15.79:0/2863797147 shutdown_connections 2024-09-21T02:50:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.003+0000 7fceeea00640 1 -- 172.21.15.79:0/2863797147 wait complete. 2024-09-21T02:50:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 Processor -- start 2024-09-21T02:50:57.005 INFO:teuthology.orchestra.run.smithi079.stdout:transaction type: 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:scaling factor: 32 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:query mode: simple 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:number of clients: 100 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:number of threads: 4 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:duration: 900 s 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:number of transactions actually processed: 608428 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:latency average = 147.906 ms 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:latency stddev = 920.186 ms 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:tps = 675.646675 (including connections establishing) 2024-09-21T02:50:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:tps = 675.651551 (excluding connections establishing) 2024-09-21T02:50:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 -- start start 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee81036a0 0x7fcee819c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8104720 0x7fcee819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81050c0 0x7fcee819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcee810f2e0 con 0x7fcee8104720 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcee810f160 con 0x7fcee81050c0 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.004+0000 7fceeea00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcee810f460 con 0x7fcee81036a0 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee81036a0 0x7fcee819c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fceeca00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81050c0 0x7fcee819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee81036a0 0x7fcee819c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:60212/0 (socket says 172.21.15.79:60212) 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 -- 172.21.15.79:0/1488927660 learned_addr learned my addr 172.21.15.79:0/1488927660 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7400640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8104720 0x7fcee819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 -- 172.21.15.79:0/1488927660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81050c0 msgr2=0x7fcee819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81050c0 0x7fcee819d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 -- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8104720 msgr2=0x7fcee819c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8104720 0x7fcee819c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.005+0000 7fcee7e00640 1 -- 172.21.15.79:0/1488927660 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee819db80 con 0x7fcee81036a0 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.006+0000 7fcee7e00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee81036a0 0x7fcee819c140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fced8032d50 tx=0x7fced8032d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.006+0000 7fcee4c00640 1 -- 172.21.15.79:0/1488927660 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8037040 con 0x7fcee81036a0 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.006+0000 7fcee4c00640 1 -- 172.21.15.79:0/1488927660 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced8030c10 con 0x7fcee81036a0 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.006+0000 7fcee4c00640 1 -- 172.21.15.79:0/1488927660 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8003850 con 0x7fcee81036a0 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.006+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee819de10 con 0x7fcee81036a0 2024-09-21T02:50:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.006+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee81a4380 con 0x7fcee81036a0 2024-09-21T02:50:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.010+0000 7fcef5c4e740 1 Processor -- start 2024-09-21T02:50:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.010+0000 7fcef5c4e740 1 -- start start 2024-09-21T02:50:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.010+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.010+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c14740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.010+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c15290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557744b876b0 con 0x55774486d1b0 2024-09-21T02:50:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557744b76ae0 con 0x55774484c4d0 2024-09-21T02:50:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557744b7a8f0 con 0x5577448442f0 2024-09-21T02:50:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49262/0 (socket says 172.21.15.79:49262) 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 -- 172.21.15.79:0/1209494066 learned_addr learned my addr 172.21.15.79:0/1209494066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fcee7400640 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c15290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fcee4c00640 1 -- 172.21.15.79:0/1488927660 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fced8043030 con 0x7fcee81036a0 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 -- 172.21.15.79:0/1209494066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 msgr2=0x557744c14740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c14740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 -- 172.21.15.79:0/1209494066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 msgr2=0x557744c15290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c15290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.011+0000 7fceeca00640 1 -- 172.21.15.79:0/1209494066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557744b43780 con 0x55774486d1b0 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.012+0000 7fceeca00640 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c140d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009fd0 tx=0x7fcee00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e42e3ab9a0f6de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.012+0000 7fcedd200640 1 -- 172.21.15.79:0/1209494066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0004d20 con 0x55774486d1b0 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.012+0000 7fcedd200640 1 -- 172.21.15.79:0/1209494066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee0004050 con 0x55774486d1b0 2024-09-21T02:50:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.012+0000 7fcedd200640 1 -- 172.21.15.79:0/1209494066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0005280 con 0x55774486d1b0 2024-09-21T02:50:57.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcee4c00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcecc0b6590 0x7fcecc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 -- 172.21.15.79:0/1209494066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 msgr2=0x557744c140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c140d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009fd0 tx=0x7fcee00118d0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 -- 172.21.15.79:0/1209494066 shutdown_connections 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c15290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c14740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/1209494066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c140d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 -- 172.21.15.79:0/1209494066 >> 172.21.15.79:0/1209494066 conn(0x557744861300 msgr2=0x557744c0fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcee4c00640 1 -- 172.21.15.79:0/1488927660 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fced8106b20 con 0x7fcee81036a0 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcee7e00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcecc0b6590 0x7fcecc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 -- 172.21.15.79:0/1209494066 shutdown_connections 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.013+0000 7fcef5c4e740 1 -- 172.21.15.79:0/1209494066 wait complete. 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.014+0000 7fcee7e00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcecc0b6590 0x7fcecc0b8aa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fced80c9c00 tx=0x7fced802a340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.014+0000 7fcef5c4e740 1 -- start start 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.014+0000 7fcef5c4e740 1 Processor -- start 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c1d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c1def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c1ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557744aaeab0 con 0x55774486d1b0 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557744b1d570 con 0x55774484c4d0 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557744c15db0 con 0x5577448442f0 2024-09-21T02:50:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcef5c4e740 10 client.0 _ll_register_callbacks cb 0x557744b2c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c1def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c1def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33444/0 (socket says 172.21.15.79:33444) 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 -- 172.21.15.79:0/308536560 learned_addr learned my addr 172.21.15.79:0/308536560 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fceeca00640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c1d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fceeca00640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c1ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 -- 172.21.15.79:0/308536560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 msgr2=0x557744c1d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c1d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 -- 172.21.15.79:0/308536560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 msgr2=0x557744c1ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c1ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 -- 172.21.15.79:0/308536560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577448d8790 con 0x55774484c4d0 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fceeca00640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c1ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fcee7400640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c1def0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fced4009cb0 tx=0x7fced40039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2070587cddc1ee0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.015+0000 7fced1600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:50:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fced1600640 1 -- 172.21.15.79:0/308536560 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4012860 con 0x55774484c4d0 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcee0004050 con 0x55774484c4d0 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fced1600640 1 -- 172.21.15.79:0/308536560 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fced4012a00 con 0x55774484c4d0 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fced1600640 1 -- 172.21.15.79:0/308536560 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fced4025050 con 0x55774484c4d0 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fcef5c4e740 10 client.27041 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557744951620 con 0x55774484c4d0 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fced1600640 1 -- 172.21.15.79:0/308536560 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee0004050 con 0x55774484c4d0 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.016+0000 7fced1600640 1 -- 172.21.15.79:0/308536560 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fced401a020 con 0x55774484c4d0 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fcef5c4e740 10 client.27041 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fcef5c4e740 10 client.27041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fcef5c4e740 20 client.27041 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55774482bd80 0x557744c2b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fcef5c4e740 4 client.27041 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:50:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557744b89600 con 0x55774482bd80 2024-09-21T02:50:57.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fceeca00640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55774482bd80 0x557744c2b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fced1600640 10 client.27041 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.017+0000 7fceeca00640 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55774482bd80 0x557744c2b020 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=197f5f338c8b487 server_cookie=e1c6204925ce69d3 in_seq=0 out_seq=0 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fced1600640 1 -- 172.21.15.79:0/308536560 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557744b89600 con 0x55774482bd80 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fced1600640 10 client.27041 handle_command_reply: tid=0 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 client.27041 shutdown 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 msgr2=0x557744c1def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c1def0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fced4009cb0 tx=0x7fced40039c0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 shutdown_connections 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55774482bd80 0x557744c2b020 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c1ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c1def0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/308536560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c1d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fced1600640 0 client.27041 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.018+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 >> 172.21.15.79:0/308536560 conn(0x557744861300 msgr2=0x557744c0e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.019+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 shutdown_connections 2024-09-21T02:50:57.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.019+0000 7fcef5c4e740 1 -- 172.21.15.79:0/308536560 wait complete. 2024-09-21T02:50:57.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.019+0000 7fcef5c4e740 20 client.27041 trim_cache size 0 max 16384 2024-09-21T02:50:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 Processor -- start 2024-09-21T02:50:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 -- start start 2024-09-21T02:50:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c0aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c0e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c0ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81ac980 con 0x55774486d1b0 2024-09-21T02:50:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81af200 con 0x55774484c4d0 2024-09-21T02:50:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.042+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81acff0 con 0x5577448442f0 2024-09-21T02:50:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.043+0000 7fceeca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c0ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c0e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c0e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33450/0 (socket says 172.21.15.79:33450) 2024-09-21T02:50:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 -- 172.21.15.79:0/2206108465 learned_addr learned my addr 172.21.15.79:0/2206108465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fceeca00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c0ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49280/0 (socket says 172.21.15.79:49280) 2024-09-21T02:50:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fceeca00640 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c0aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 -- 172.21.15.79:0/2206108465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 msgr2=0x557744c0aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c0aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 -- 172.21.15.79:0/2206108465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 msgr2=0x557744c0ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c0ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.044+0000 7fcee7400640 1 -- 172.21.15.79:0/2206108465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557744c0fbb0 con 0x55774484c4d0 2024-09-21T02:50:57.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.045+0000 7fcee7400640 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c0e850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fced401cf60 tx=0x7fced40058f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972b5118dd07a2d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:57.047 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.045+0000 7fceeca00640 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c0ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:50:57.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.047+0000 7fced3e00640 1 -- 172.21.15.79:0/2206108465 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced402d020 con 0x55774484c4d0 2024-09-21T02:50:57.048 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.047+0000 7fced3e00640 1 -- 172.21.15.79:0/2206108465 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced40115d0 con 0x55774484c4d0 2024-09-21T02:50:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.047+0000 7fced3e00640 1 -- 172.21.15.79:0/2206108465 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced40054f0 con 0x55774484c4d0 2024-09-21T02:50:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.048+0000 7fcef5c4e740 1 -- 172.21.15.79:0/2206108465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 msgr2=0x557744c0e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.048+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c0e850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fced401cf60 tx=0x7fced40058f0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.048+0000 7fcef5c4e740 1 -- 172.21.15.79:0/2206108465 shutdown_connections 2024-09-21T02:50:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.048+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c0ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.048+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c0e850 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.048+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/2206108465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c0aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.048+0000 7fcef5c4e740 1 -- 172.21.15.79:0/2206108465 >> 172.21.15.79:0/2206108465 conn(0x557744861300 msgr2=0x557744c0f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.049+0000 7fcef5c4e740 1 -- 172.21.15.79:0/2206108465 shutdown_connections 2024-09-21T02:50:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.049+0000 7fcef5c4e740 1 -- 172.21.15.79:0/2206108465 wait complete. 2024-09-21T02:50:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.050+0000 7fcef5c4e740 1 -- start start 2024-09-21T02:50:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.050+0000 7fcef5c4e740 1 Processor -- start 2024-09-21T02:50:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.051+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c20930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.051+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c20ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.051+0000 7fcef5c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c24be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.051+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81ad6c0 con 0x55774486d1b0 2024-09-21T02:50:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.051+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81aeb30 con 0x55774484c4d0 2024-09-21T02:50:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.051+0000 7fcef5c4e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81add90 con 0x5577448442f0 2024-09-21T02:50:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.051+0000 7fcef5c4e740 10 client.0 _ll_register_callbacks cb 0x7fced4004080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c20ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c20ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:33460/0 (socket says 172.21.15.79:33460) 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 -- 172.21.15.79:0/342384817 learned_addr learned my addr 172.21.15.79:0/342384817 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fceeca00640 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c24be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fceeca00640 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c20930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 -- 172.21.15.79:0/342384817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 msgr2=0x557744c20930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c20930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 -- 172.21.15.79:0/342384817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 msgr2=0x557744c24be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:50:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c24be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.052+0000 7fcee7400640 1 -- 172.21.15.79:0/342384817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557744c25340 con 0x55774484c4d0 2024-09-21T02:50:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.053+0000 7fcee7400640 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c20ff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fced4009670 tx=0x7fced40054a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ae35672bb1d8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:50:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.053+0000 7fced1600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:50:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.054+0000 7fced1600640 1 -- 172.21.15.79:0/342384817 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4036020 con 0x55774484c4d0 2024-09-21T02:50:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.054+0000 7fced1600640 1 -- 172.21.15.79:0/342384817 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fced4011ce0 con 0x55774484c4d0 2024-09-21T02:50:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.054+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fced40115d0 con 0x55774484c4d0 2024-09-21T02:50:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.058+0000 7fced1600640 1 -- 172.21.15.79:0/342384817 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fced402d070 con 0x55774484c4d0 2024-09-21T02:50:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.058+0000 7fcef5c4e740 10 client.27047 fetch_fsmap learned FSMap version 21 2024-09-21T02:50:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.058+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557744c22730 con 0x55774484c4d0 2024-09-21T02:50:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fced1600640 1 -- 172.21.15.79:0/342384817 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced40115d0 con 0x55774484c4d0 2024-09-21T02:50:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fced1600640 1 -- 172.21.15.79:0/342384817 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fced401a040 con 0x55774484c4d0 2024-09-21T02:50:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fcef5c4e740 10 client.27047 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:50:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fcef5c4e740 10 client.27047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:50:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fcef5c4e740 20 client.27047 populate_metadata read hostname 'smithi079' 2024-09-21T02:50:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5577448011c0 0x557744ca07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:50:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fcef5c4e740 4 client.27047 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:50:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.059+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557744b850b0 con 0x5577448011c0 2024-09-21T02:50:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.060+0000 7fceeca00640 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5577448011c0 0x557744ca07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:50:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.061+0000 7fceeca00640 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5577448011c0 0x557744ca07b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c8819a3e477baeb server_cookie=8903f80a231528fa in_seq=0 out_seq=0 2024-09-21T02:50:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.061+0000 7fced1600640 10 client.27047 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.099+0000 7fced1600640 1 -- 172.21.15.79:0/342384817 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557744b850b0 con 0x5577448011c0 2024-09-21T02:50:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.099+0000 7fced1600640 10 client.27047 handle_command_reply: tid=0 2024-09-21T02:50:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.099+0000 7fcef5c4e740 1 client.27047 shutdown 2024-09-21T02:50:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.099+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 msgr2=0x557744c20ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.099+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c20ff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fced4009670 tx=0x7fced40054a0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 shutdown_connections 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5577448011c0 0x557744ca07b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fced1600640 0 client.27047 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55774486d1b0 0x557744c24be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55774484c4d0 0x557744c20ff0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 --2- 172.21.15.79:0/342384817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577448442f0 0x557744c20930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 >> 172.21.15.79:0/342384817 conn(0x557744861300 msgr2=0x557744c0f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 shutdown_connections 2024-09-21T02:50:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.100+0000 7fcef5c4e740 1 -- 172.21.15.79:0/342384817 wait complete. 2024-09-21T02:50:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.101+0000 7fcef5c4e740 20 client.27047 trim_cache size 0 max 16384 2024-09-21T02:50:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:50:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:50:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:50:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:50:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.102+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcecc0b6590 msgr2=0x7fcecc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.102+0000 7fceeea00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcecc0b6590 0x7fcecc0b8aa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fced80c9c00 tx=0x7fced802a340 comp rx=0 tx=0).stop 2024-09-21T02:50:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.102+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee81036a0 msgr2=0x7fcee819c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:50:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.102+0000 7fceeea00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee81036a0 0x7fcee819c140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fced8032d50 tx=0x7fced8032d80 comp rx=0 tx=0).stop 2024-09-21T02:50:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 shutdown_connections 2024-09-21T02:50:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcecc0b6590 0x7fcecc0b8aa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcee81050c0 0x7fcee819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee8104720 0x7fcee819c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:50:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 --2- 172.21.15.79:0/1488927660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcee81036a0 0x7fcee819c140 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fced8032d50 tx=0x7fced8032d80 comp rx=0 tx=0).stop 2024-09-21T02:50:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 >> 172.21.15.79:0/1488927660 conn(0x7fcee80fefe0 msgr2=0x7fcee80755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:50:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 shutdown_connections 2024-09-21T02:50:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:50:57.103+0000 7fceeea00640 1 -- 172.21.15.79:0/1488927660 wait complete. 2024-09-21T02:50:57.313 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:57 smithi148 ceph-mon[34626]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 7.2 MiB/s wr, 511 op/s 2024-09-21T02:50:57.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:57 smithi098 ceph-mon[34832]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 7.2 MiB/s wr, 511 op/s 2024-09-21T02:50:57.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:57 smithi079 ceph-mon[30788]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 7.2 MiB/s wr, 511 op/s 2024-09-21T02:50:59.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:50:59 smithi098 ceph-mon[34832]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 7.5 MiB/s wr, 536 op/s 2024-09-21T02:50:59.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:50:59 smithi079 ceph-mon[30788]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 7.5 MiB/s wr, 536 op/s 2024-09-21T02:50:59.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:50:59 smithi148 ceph-mon[34626]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 7.5 MiB/s wr, 536 op/s 2024-09-21T02:51:01.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:01 smithi098 ceph-mon[34832]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 7.9 MiB/s wr, 571 op/s 2024-09-21T02:51:01.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:01 smithi079 ceph-mon[30788]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 7.9 MiB/s wr, 571 op/s 2024-09-21T02:51:01.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:01 smithi148 ceph-mon[34626]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 7.9 MiB/s wr, 571 op/s 2024-09-21T02:51:03.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:03 smithi098 ceph-mon[34832]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 7.9 MiB/s wr, 619 op/s 2024-09-21T02:51:03.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:03 smithi079 ceph-mon[30788]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 7.9 MiB/s wr, 619 op/s 2024-09-21T02:51:03.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:03 smithi148 ceph-mon[34626]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 7.9 MiB/s wr, 619 op/s 2024-09-21T02:51:05.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:05 smithi098 ceph-mon[34832]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-09-21T02:51:05.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:05 smithi079 ceph-mon[30788]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-09-21T02:51:05.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:05 smithi148 ceph-mon[34626]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-09-21T02:51:07.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:07 smithi098 ceph-mon[34832]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.4 MiB/s wr, 587 op/s 2024-09-21T02:51:07.480 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:07 smithi079 ceph-mon[30788]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.4 MiB/s wr, 587 op/s 2024-09-21T02:51:07.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:07 smithi148 ceph-mon[34626]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.4 MiB/s wr, 587 op/s 2024-09-21T02:51:09.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:09 smithi098 ceph-mon[34832]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.1 MiB/s wr, 645 op/s 2024-09-21T02:51:09.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:09 smithi079 ceph-mon[30788]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.1 MiB/s wr, 645 op/s 2024-09-21T02:51:09.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:09 smithi148 ceph-mon[34626]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.1 MiB/s wr, 645 op/s 2024-09-21T02:51:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 -- 172.21.15.79:0/1668179156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f901034e0 msgr2=0x7f3f90103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 --2- 172.21.15.79:0/1668179156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f901034e0 0x7f3f90103950 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009900 tx=0x7f3f8402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 -- 172.21.15.79:0/1668179156 shutdown_connections 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 --2- 172.21.15.79:0/1668179156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f90104f00 0x7f3f9010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 --2- 172.21.15.79:0/1668179156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f90104560 0x7f3f90104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 --2- 172.21.15.79:0/1668179156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f901034e0 0x7f3f90103950 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 -- 172.21.15.79:0/1668179156 >> 172.21.15.79:0/1668179156 conn(0x7f3f900fee20 msgr2=0x7f3f901012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 -- 172.21.15.79:0/1668179156 shutdown_connections 2024-09-21T02:51:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.337+0000 7f3f96600640 1 -- 172.21.15.79:0/1668179156 wait complete. 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.338+0000 7f3f96600640 1 Processor -- start 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.338+0000 7f3f96600640 1 -- start start 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.338+0000 7f3f96600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f901034e0 0x7f3f9019bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.338+0000 7f3f96600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f90104560 0x7f3f9019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f96600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f90104f00 0x7f3f9019d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f96600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9010f160 con 0x7f3f90104f00 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f96600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9010efe0 con 0x7f3f90104560 2024-09-21T02:51:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f96600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9010f2e0 con 0x7f3f901034e0 2024-09-21T02:51:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f95200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f901034e0 0x7f3f9019bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f8fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f90104560 0x7f3f9019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f95200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f901034e0 0x7f3f9019bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40372/0 (socket says 172.21.15.79:40372) 2024-09-21T02:51:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f95200640 1 -- 172.21.15.79:0/2345836785 learned_addr learned my addr 172.21.15.79:0/2345836785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f95c00640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f90104f00 0x7f3f9019d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f8fe00640 1 -- 172.21.15.79:0/2345836785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f901034e0 msgr2=0x7f3f9019bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.339+0000 7f3f8fe00640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f901034e0 0x7f3f9019bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.340+0000 7f3f8fe00640 1 -- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f90104f00 msgr2=0x7f3f9019d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.340+0000 7f3f8fe00640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f90104f00 0x7f3f9019d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.340+0000 7f3f8fe00640 1 -- 172.21.15.79:0/2345836785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9019d9e0 con 0x7f3f90104560 2024-09-21T02:51:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.340+0000 7f3f95c00640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f90104f00 0x7f3f9019d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.340+0000 7f3f8fe00640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f90104560 0x7f3f9019c610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00e9f0 tx=0x7f3f7c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.341+0000 7f3f8d600640 1 -- 172.21.15.79:0/2345836785 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00cd80 con 0x7f3f90104560 2024-09-21T02:51:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.341+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9019dcd0 con 0x7f3f90104560 2024-09-21T02:51:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.341+0000 7f3f8d600640 1 -- 172.21.15.79:0/2345836785 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c0035f0 con 0x7f3f90104560 2024-09-21T02:51:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.341+0000 7f3f8d600640 1 -- 172.21.15.79:0/2345836785 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c010670 con 0x7f3f90104560 2024-09-21T02:51:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.341+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f901a43c0 con 0x7f3f90104560 2024-09-21T02:51:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 Processor -- start 2024-09-21T02:51:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 -- start start 2024-09-21T02:51:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299bf82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 0x557299bf9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557299b6b6b0 con 0x5572998304d0 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557299b5aae0 con 0x5572998282f0 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.345+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557299b5e8f0 con 0x5572998511b0 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299bf82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:40288/0 (socket says 172.21.15.79:40288) 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 -- 172.21.15.79:0/3800836475 learned_addr learned my addr 172.21.15.79:0/3800836475 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95c00640 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299bf82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40380/0 (socket says 172.21.15.79:40380) 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 -- 172.21.15.79:0/3800836475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 msgr2=0x557299bf82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299bf82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 -- 172.21.15.79:0/3800836475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 msgr2=0x557299bf9470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 0x557299bf9470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f8d600640 1 -- 172.21.15.79:0/2345836785 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3f7c0108d0 con 0x7f3f90104560 2024-09-21T02:51:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 -- 172.21.15.79:0/3800836475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557299b27780 con 0x5572998282f0 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.346+0000 7f3f95200640 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf8920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3f840096c0 tx=0x7f3f840040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56ef427f1031957b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.347+0000 7f3f82000640 1 -- 172.21.15.79:0/3800836475 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84035030 con 0x5572998282f0 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.347+0000 7f3f82000640 1 -- 172.21.15.79:0/3800836475 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f84040070 con 0x5572998282f0 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.347+0000 7f3f82000640 1 -- 172.21.15.79:0/3800836475 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84031970 con 0x5572998282f0 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3800836475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 msgr2=0x557299bf8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf8920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3f840096c0 tx=0x7f3f840040c0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3800836475 shutdown_connections 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 0x557299bf9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf8920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3800836475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299bf82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3800836475 >> 172.21.15.79:0/3800836475 conn(0x557299845300 msgr2=0x557299bf3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3800836475 shutdown_connections 2024-09-21T02:51:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f8d600640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3f780b6420 0x7f3f780b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.348+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3800836475 wait complete. 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.349+0000 7f3f8d600640 1 -- 172.21.15.79:0/2345836785 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3f7c0e7950 con 0x7f3f90104560 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.349+0000 7f3f95200640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3f780b6420 0x7f3f780b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.349+0000 7f3f9ec70740 1 -- start start 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.349+0000 7f3f9ec70740 1 Processor -- start 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299c01970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 0x557299c02030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299c02b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557299a92ab0 con 0x5572998304d0 2024-09-21T02:51:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557299b01570 con 0x5572998282f0 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557299bf9f30 con 0x5572998511b0 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f95200640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3f780b6420 0x7f3f780b8930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3f8402a9e0 tx=0x7f3f84047040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f9ec70740 10 client.0 _ll_register_callbacks cb 0x557299b10100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f95c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299c02b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f95200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299c01970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.350+0000 7f3f95c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299c02b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40396/0 (socket says 172.21.15.79:40396) 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f95c00640 1 -- 172.21.15.79:0/2605593890 learned_addr learned my addr 172.21.15.79:0/2605593890 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f8fe00640 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 0x557299c02030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f95c00640 1 -- 172.21.15.79:0/2605593890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 msgr2=0x557299c01970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f95c00640 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299c01970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f95c00640 1 -- 172.21.15.79:0/2605593890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 msgr2=0x557299c02030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f95c00640 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 0x557299c02030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f95c00640 1 -- 172.21.15.79:0/2605593890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572998bc790 con 0x5572998511b0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f95c00640 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299c02b80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3f88011eb0 tx=0x7f3f88013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0f5fb7266d5066 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f76a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f76a00640 1 -- 172.21.15.79:0/2605593890 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88020060 con 0x5572998511b0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f84040070 con 0x5572998511b0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.351+0000 7f3f76a00640 1 -- 172.21.15.79:0/2605593890 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3f880107e0 con 0x5572998511b0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.352+0000 7f3f76a00640 1 -- 172.21.15.79:0/2605593890 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3f88027050 con 0x5572998511b0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.352+0000 7f3f9ec70740 10 client.27079 fetch_fsmap learned FSMap version 21 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.352+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557299935620 con 0x5572998511b0 2024-09-21T02:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.352+0000 7f3f76a00640 1 -- 172.21.15.79:0/2605593890 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f84040070 con 0x5572998511b0 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f76a00640 1 -- 172.21.15.79:0/2605593890 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3f8801a030 con 0x5572998511b0 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f9ec70740 10 client.27079 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f9ec70740 10 client.27079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f9ec70740 20 client.27079 populate_metadata read hostname 'smithi079' 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55729980fd80 0x557299c0f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f9ec70740 4 client.27079 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557299b6d600 con 0x55729980fd80 2024-09-21T02:51:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.353+0000 7f3f95200640 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55729980fd80 0x557299c0f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.354+0000 7f3f76a00640 10 client.27079 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.354+0000 7f3f95200640 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55729980fd80 0x557299c0f110 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f923d47bda1ab189 server_cookie=d8346c27d28329d3 in_seq=0 out_seq=0 2024-09-21T02:51:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f76a00640 1 -- 172.21.15.79:0/2605593890 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557299b6d600 con 0x55729980fd80 2024-09-21T02:51:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f76a00640 10 client.27079 handle_command_reply: tid=0 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 client.27079 shutdown 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 msgr2=0x557299c02b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299c02b80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3f88011eb0 tx=0x7f3f88013830 comp rx=0 tx=0).stop 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 shutdown_connections 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55729980fd80 0x557299c0f110 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998511b0 0x557299c02b80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f76a00640 0 client.27079 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998304d0 0x557299c02030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/2605593890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299c01970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 >> 172.21.15.79:0/2605593890 conn(0x557299845300 msgr2=0x557299bf2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.355+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 shutdown_connections 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.356+0000 7f3f9ec70740 1 -- 172.21.15.79:0/2605593890 wait complete. 2024-09-21T02:51:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.356+0000 7f3f9ec70740 20 client.27079 trim_cache size 0 max 16384 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.373+0000 7f3f9ec70740 1 Processor -- start 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.373+0000 7f3f9ec70740 1 -- start start 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299bf7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998511b0 0x557299bf2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f901ac780 con 0x5572998511b0 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f901af000 con 0x5572998282f0 2024-09-21T02:51:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3f901acdf0 con 0x5572998304d0 2024-09-21T02:51:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f8fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299bf7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f95200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f95c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998511b0 0x557299bf2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f8fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299bf7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40410/0 (socket says 172.21.15.79:40410) 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f8fe00640 1 -- 172.21.15.79:0/3068281977 learned_addr learned my addr 172.21.15.79:0/3068281977 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f95200640 1 -- 172.21.15.79:0/3068281977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 msgr2=0x557299bf7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f95200640 1 --2- 172.21.15.79:0/3068281977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299bf7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f95200640 1 -- 172.21.15.79:0/3068281977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998511b0 msgr2=0x557299bf2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f95200640 1 --2- 172.21.15.79:0/3068281977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998511b0 0x557299bf2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.374+0000 7f3f95200640 1 -- 172.21.15.79:0/3068281977 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557299c023a0 con 0x5572998282f0 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.375+0000 7f3f95200640 1 --2- 172.21.15.79:0/3068281977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf3680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x557299c0f880 tx=0x7f3f84005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75fec64efb21811d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.375+0000 7f3f81600640 1 -- 172.21.15.79:0/3068281977 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f840038b0 con 0x5572998282f0 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.375+0000 7f3f81600640 1 -- 172.21.15.79:0/3068281977 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f84040040 con 0x5572998282f0 2024-09-21T02:51:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.375+0000 7f3f81600640 1 -- 172.21.15.79:0/3068281977 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84045ae0 con 0x5572998282f0 2024-09-21T02:51:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3068281977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 msgr2=0x557299bf3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3068281977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf3680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x557299c0f880 tx=0x7f3f84005850 comp rx=0 tx=0).stop 2024-09-21T02:51:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3068281977 shutdown_connections 2024-09-21T02:51:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3068281977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998511b0 0x557299bf2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3068281977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299bf7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/3068281977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998282f0 0x557299bf3680 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3068281977 >> 172.21.15.79:0/3068281977 conn(0x557299845300 msgr2=0x557299c00b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3068281977 shutdown_connections 2024-09-21T02:51:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.376+0000 7f3f9ec70740 1 -- 172.21.15.79:0/3068281977 wait complete. 2024-09-21T02:51:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.377+0000 7f3f9ec70740 1 -- start start 2024-09-21T02:51:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.377+0000 7f3f9ec70740 1 Processor -- start 2024-09-21T02:51:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998282f0 0x557299c08740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299c08c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f9ec70740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998511b0 0x557299c091c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f901ad4c0 con 0x5572998282f0 2024-09-21T02:51:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f901ae930 con 0x5572998511b0 2024-09-21T02:51:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f9ec70740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3f901adb90 con 0x5572998304d0 2024-09-21T02:51:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f9ec70740 10 client.0 _ll_register_callbacks cb 0x7f3f880113e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f95200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998282f0 0x557299c08740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299c08c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299c08c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:40416/0 (socket says 172.21.15.79:40416) 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 -- 172.21.15.79:0/1656689053 learned_addr learned my addr 172.21.15.79:0/1656689053 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f95c00640 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998511b0 0x557299c091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 -- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998511b0 msgr2=0x557299c091c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998511b0 0x557299c091c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 -- 172.21.15.79:0/1656689053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998282f0 msgr2=0x557299c08740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998282f0 0x557299c08740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f8fe00640 1 -- 172.21.15.79:0/1656689053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557299c09e60 con 0x5572998304d0 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.378+0000 7f3f95200640 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998282f0 0x557299c08740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f8fe00640 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299c08c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0a9ce0 tx=0x7f3f7c0ad2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a9eb41d880cdea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f76a00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f76a00640 1 -- 172.21.15.79:0/1656689053 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0b21f0 con 0x5572998304d0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f76a00640 1 -- 172.21.15.79:0/1656689053 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f3f7c009310 con 0x5572998304d0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f84040040 con 0x5572998304d0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f76a00640 1 -- 172.21.15.79:0/1656689053 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3f7c0b7130 con 0x5572998304d0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f9ec70740 10 client.27085 fetch_fsmap learned FSMap version 21 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557299c79e20 con 0x5572998304d0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.379+0000 7f3f76a00640 1 -- 172.21.15.79:0/1656689053 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f84040040 con 0x5572998304d0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f76a00640 1 -- 172.21.15.79:0/1656689053 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3f7c0ac3e0 con 0x5572998304d0 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f9ec70740 10 client.27085 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f9ec70740 10 client.27085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f9ec70740 20 client.27085 populate_metadata read hostname 'smithi079' 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5572997e51c0 0x557299c7c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f9ec70740 4 client.27085 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:51:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557299b690b0 con 0x5572997e51c0 2024-09-21T02:51:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.380+0000 7f3f95200640 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5572997e51c0 0x557299c7c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.381+0000 7f3f95200640 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5572997e51c0 0x557299c7c840 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc3729a3227a62d server_cookie=14a67e2f2ab2dd6b in_seq=0 out_seq=0 2024-09-21T02:51:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.381+0000 7f3f76a00640 10 client.27085 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.463+0000 7f3f76a00640 1 -- 172.21.15.79:0/1656689053 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557299b690b0 con 0x5572997e51c0 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.463+0000 7f3f76a00640 10 client.27085 handle_command_reply: tid=0 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 client.27085 shutdown 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 msgr2=0x557299c08c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299c08c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0a9ce0 tx=0x7f3f7c0ad2e0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 shutdown_connections 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x5572997e51c0 0x557299c7c840 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572998511b0 0x557299c091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f76a00640 0 client.27085 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5572998304d0 0x557299c08c80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 --2- 172.21.15.79:0/1656689053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572998282f0 0x557299c08740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 >> 172.21.15.79:0/1656689053 conn(0x557299845300 msgr2=0x557299bf7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 shutdown_connections 2024-09-21T02:51:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.464+0000 7f3f9ec70740 1 -- 172.21.15.79:0/1656689053 wait complete. 2024-09-21T02:51:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f9ec70740 20 client.27085 trim_cache size 0 max 16384 2024-09-21T02:51:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-09-21T02:51:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-09-21T02:51:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-09-21T02:51:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-09-21T02:51:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3f780b6420 msgr2=0x7f3f780b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3f780b6420 0x7f3f780b8930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3f8402a9e0 tx=0x7f3f84047040 comp rx=0 tx=0).stop 2024-09-21T02:51:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f90104560 msgr2=0x7f3f9019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f90104560 0x7f3f9019c610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00e9f0 tx=0x7f3f7c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 shutdown_connections 2024-09-21T02:51:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f3f780b6420 0x7f3f780b8930 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3f8402a9e0 tx=0x7f3f84047040 comp rx=0 tx=0).stop 2024-09-21T02:51:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f90104f00 0x7f3f9019d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f90104560 0x7f3f9019c610 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 --2- 172.21.15.79:0/2345836785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f901034e0 0x7f3f9019bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.465+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 >> 172.21.15.79:0/2345836785 conn(0x7f3f900fee20 msgr2=0x7f3f900755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.466+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 shutdown_connections 2024-09-21T02:51:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-09-21T02:51:10.466+0000 7f3f96600640 1 -- 172.21.15.79:0/2345836785 wait complete. 2024-09-21T02:51:10.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T02:51:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/: 2024-09-21T02:51:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:51:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 .. 2024-09-21T02:51:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 data 2024-09-21T02:51:10.753 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data: 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:total 36 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 . 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 .. 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 21 02:35 base 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 21 02:35 current_logfiles 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 21 02:35 global 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 log 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_commit_ts 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_dynshmem 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 21 02:35 pg_hba.conf 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 21 02:35 pg_ident.conf 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:51 pg_logical 2024-09-21T02:51:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 pg_multixact 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_notify 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_replslot 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_serial 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_snapshots 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:51 pg_stat 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:51 pg_stat_tmp 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:51 pg_subtrans 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_tblspc 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pg_twophase 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Sep 21 02:51 pg_wal 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 pg_xact 2024-09-21T02:51:10.755 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 21 02:35 postgresql.auto.conf 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 21 02:35 postgresql.conf 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 21 02:35 postmaster.opts 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base: 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 21 02:35 . 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 1 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 13493 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 21 02:42 13494 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 pgsql_tmp 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:total 7777 2024-09-21T02:51:10.756 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 . 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 21 02:35 .. 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 112 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 113 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 1247 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1247_fsm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1247_vm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 02:35 1249 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1249_fsm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1249_vm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 02:35 1255 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1255_fsm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1255_vm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 02:35 1259 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1259_fsm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1259_vm 2024-09-21T02:51:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 02:35 13344 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13344_fsm 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13344_vm 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13346 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13348 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13349_fsm 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349_vm 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13351 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13353 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13354_fsm 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354_vm 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13356 2024-09-21T02:51:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13358 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13359_fsm 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359_vm 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13361 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13363 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1417 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1418 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 174 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 175 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2187 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2224 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2328 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2336 2024-09-21T02:51:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2337 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2579 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2600 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2600_fsm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2600_vm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2601_fsm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601_vm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2602 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2602_fsm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2602_vm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2603 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2603_fsm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2603_vm 2024-09-21T02:51:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2604 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2605 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2605_fsm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2605_vm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2606_fsm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606_vm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2607 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2607_fsm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2607_vm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 02:35 2608 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2608_fsm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2608_vm 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 02:35 2609 2024-09-21T02:51:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2609_fsm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2609_vm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2610 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2610_fsm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2610_vm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2611 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2612_fsm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612_vm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2613 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2615_fsm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615_vm 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2616 2024-09-21T02:51:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2616_fsm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2616_vm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 02:35 2617 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2617_fsm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2617_vm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 02:35 2618 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2618_fsm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2618_vm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 02:35 2619 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2619_fsm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2619_vm 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2620 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2650 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2651 2024-09-21T02:51:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2652 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2653 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2654 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2655 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2656 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2657 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 02:35 2658 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 2659 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2660 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2661 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2662 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2663 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2664 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2665 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2666 2024-09-21T02:51:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2667 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2668 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2669 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2670 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 02:35 2673 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 02:35 2674 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 02:35 2675 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2678 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2679 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2680 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2681 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2682 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2683 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2684 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2685 2024-09-21T02:51:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2686 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2687 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2688 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2689 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 02:35 2690 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 02:35 2691 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2692 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2693 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2696 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2699 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2701 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2702 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2703 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2704 2024-09-21T02:51:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2753 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2753_fsm 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2753_vm 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2754 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2755 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2756 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2757 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2830 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2831 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2832 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2833 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2834 2024-09-21T02:51:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2835 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2836 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2837 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 02:35 2838 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2838_fsm 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2838_vm 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2839 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840_fsm 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2840_vm 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2841 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2995 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2996 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079 2024-09-21T02:51:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3079_fsm 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079_vm 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3080 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3081 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3085 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3118 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3119 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 02:35 3164 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3256 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3257 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3258 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3350 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3351 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3379 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3380 2024-09-21T02:51:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3381 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3394 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3394_fsm 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3394_vm 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3395 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3429 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3430 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3431 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3433 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3439 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3440 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3455 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 02:35 3456 2024-09-21T02:51:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3456_fsm 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3456_vm 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3466 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3467 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3468 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3501 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3502 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3503 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3534 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3541_fsm 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541_vm 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3542 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3574 2024-09-21T02:51:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3575 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3576 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3596 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3597 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3598 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3599 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3600_fsm 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600_vm 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3601_fsm 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601_vm 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3602_fsm 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602_vm 2024-09-21T02:51:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603_fsm 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3603_vm 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3604 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3605 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3606 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3607 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3608 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 3609 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3712 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3764_fsm 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764_vm 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3766 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3767 2024-09-21T02:51:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3997 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4143 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4144 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4145 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4146 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4147 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4148 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4149 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4150 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4151 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4152 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4153 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4154 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4155 2024-09-21T02:51:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4156 2024-09-21T02:51:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4157 2024-09-21T02:51:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4158 2024-09-21T02:51:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4159 2024-09-21T02:51:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4160 2024-09-21T02:51:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4161 2024-09-21T02:51:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4162 2024-09-21T02:51:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4163 2024-09-21T02:51:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4164 2024-09-21T02:51:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4165 2024-09-21T02:51:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4166 2024-09-21T02:51:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4167 2024-09-21T02:51:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4168 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4169 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4170 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4171 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4172 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4173 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4174 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 5002 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 548 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 549 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6102 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6104 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6106 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6110 2024-09-21T02:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6111 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6112 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6113 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6117 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 826 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 827 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 828 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-21T02:51:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:total 7777 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 21 02:35 . 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 21 02:35 .. 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 112 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 113 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 1247 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1247_fsm 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1247_vm 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 02:35 1249 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1249_fsm 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1249_vm 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 02:35 1255 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1255_fsm 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1255_vm 2024-09-21T02:51:10.780 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 02:35 1259 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1259_fsm 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1259_vm 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 02:35 13344 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13344_fsm 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13344_vm 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13346 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13348 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13349_fsm 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349_vm 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13351 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13353 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354 2024-09-21T02:51:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13354_fsm 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354_vm 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13356 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13358 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13359_fsm 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359_vm 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13361 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13363 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1417 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1418 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 174 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 175 2024-09-21T02:51:10.782 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2187 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2224 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2328 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2336 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2337 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2579 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2600 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2600_fsm 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2600_vm 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2601_fsm 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601_vm 2024-09-21T02:51:10.783 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2602 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2602_fsm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2602_vm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2603 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2603_fsm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2603_vm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2604 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2605 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2605_fsm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2605_vm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2606_fsm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2606_vm 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2607 2024-09-21T02:51:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2607_fsm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2607_vm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 02:35 2608 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2608_fsm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2608_vm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 02:35 2609 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2609_fsm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2609_vm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2610 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2610_fsm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2610_vm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2611 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2612_fsm 2024-09-21T02:51:10.785 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612_vm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2613 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2615_fsm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615_vm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2616 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2616_fsm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2616_vm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 02:35 2617 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2617_fsm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2617_vm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 02:35 2618 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2618_fsm 2024-09-21T02:51:10.786 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2618_vm 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 02:35 2619 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2619_fsm 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2619_vm 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2620 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2650 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2651 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2652 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2653 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2654 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2655 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2656 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2657 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 02:35 2658 2024-09-21T02:51:10.787 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:35 2659 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2660 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2661 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2662 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2663 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2664 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2665 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2666 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2667 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2668 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2669 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2670 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 02:35 2673 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 02:35 2674 2024-09-21T02:51:10.788 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 02:35 2675 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2678 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2679 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2680 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2681 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2682 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2683 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2684 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2685 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2686 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2687 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2688 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2689 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 02:35 2690 2024-09-21T02:51:10.789 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 02:35 2691 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2692 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2693 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2696 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2699 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2701 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2702 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2703 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2704 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2753 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2753_fsm 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2753_vm 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2754 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2755 2024-09-21T02:51:10.790 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2756 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2757 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2830 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2831 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2832 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2833 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2834 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2835 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2836 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2837 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 02:35 2838 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2838_fsm 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2838_vm 2024-09-21T02:51:10.791 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2839 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840_fsm 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2840_vm 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2841 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2995 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2996 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3079_fsm 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079_vm 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3080 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3081 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3085 2024-09-21T02:51:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3118 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3119 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 02:35 3164 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3256 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3257 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3258 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3350 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3351 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3379 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3380 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3381 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3394 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3394_fsm 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3394_vm 2024-09-21T02:51:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3395 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3429 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3430 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3431 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3433 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3439 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3440 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3455 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 02:35 3456 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3456_fsm 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3456_vm 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3466 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3467 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3468 2024-09-21T02:51:10.794 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3501 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3502 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3503 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3534 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3541_fsm 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541_vm 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3542 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3574 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3575 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3576 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3596 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3597 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3598 2024-09-21T02:51:10.795 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3599 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3600_fsm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600_vm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3601_fsm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601_vm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3602_fsm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602_vm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603_fsm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3603_vm 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3604 2024-09-21T02:51:10.796 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3605 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3606 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3607 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3608 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 3609 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3712 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3764_fsm 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764_vm 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3766 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3767 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3997 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4143 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4144 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4145 2024-09-21T02:51:10.797 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4146 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4147 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4148 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4149 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4150 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4151 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4152 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4153 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4154 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4155 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4156 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4157 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4158 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4159 2024-09-21T02:51:10.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4160 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4161 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4162 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4163 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4164 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4165 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4166 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4167 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4168 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4169 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4170 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4171 2024-09-21T02:51:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4172 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4173 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4174 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 5002 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 548 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 549 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6102 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6104 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6106 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6110 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6111 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6112 2024-09-21T02:51:10.804 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6113 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6117 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 826 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 827 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 828 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:total 540254 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 21 02:42 . 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 21 02:35 .. 2024-09-21T02:51:10.805 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 112 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 113 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:36 1247 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1247_fsm 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1247_vm 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 02:36 1249 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:36 1249_fsm 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:36 1249_vm 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 02:35 1255 2024-09-21T02:51:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1255_fsm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1255_vm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 02:51 1259 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1259_fsm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1259_vm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 02:35 13344 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13344_fsm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13344_vm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13346 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13348 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13349_fsm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13349_vm 2024-09-21T02:51:10.807 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13351 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13353 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13354_fsm 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13354_vm 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13356 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13358 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 13359_fsm 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13359_vm 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 13361 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 13363 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1417 2024-09-21T02:51:10.808 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 1418 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 439492608 Sep 21 02:51 16396 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 21 02:51 16396_fsm 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:49 16396_vm 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Sep 21 02:50 16397 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:50 16397_fsm 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:50 16397_vm 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Sep 21 02:50 16399 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:50 16399_fsm 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:49 16399_vm 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:50 16400 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:50 16402 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 21 02:51 16404 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32546816 Sep 21 02:51 16406 2024-09-21T02:51:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:50 16406_fsm 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:48 16406_vm 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 174 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 175 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2187 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2224 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2328 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2336 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2337 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:36 2579 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2600 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2600_fsm 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2600_vm 2024-09-21T02:51:10.810 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2601_fsm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2601_vm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2602 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2602_fsm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2602_vm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2603 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2603_fsm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2603_vm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2604 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2605 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2605_fsm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2605_vm 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:36 2606 2024-09-21T02:51:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2606_fsm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:36 2606_vm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2607 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2607_fsm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2607_vm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 02:36 2608 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2608_fsm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2608_vm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 02:35 2609 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2609_fsm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2609_vm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:36 2610 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2610_fsm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:36 2610_vm 2024-09-21T02:51:10.812 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2611 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2612_fsm 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2612_vm 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2613 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2615_fsm 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2615_vm 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2616 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2616_fsm 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2616_vm 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 02:35 2617 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2617_fsm 2024-09-21T02:51:10.813 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2617_vm 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 02:35 2618 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2618_fsm 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2618_vm 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 21 02:51 2619 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:38 2619_fsm 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:36 2619_vm 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2620 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2650 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2651 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2652 2024-09-21T02:51:10.814 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2653 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2654 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2655 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2656 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2657 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 02:36 2658 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:36 2659 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2660 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2661 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:36 2662 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:36 2663 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:36 2664 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:36 2665 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:36 2666 2024-09-21T02:51:10.815 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:36 2667 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2668 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2669 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2670 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 02:36 2673 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 02:36 2674 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 02:35 2675 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:36 2678 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:36 2679 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2680 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2681 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2682 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2683 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2684 2024-09-21T02:51:10.816 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2685 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2686 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2687 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 2688 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 02:35 2689 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 02:35 2690 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 02:35 2691 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2692 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2693 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:40 2696 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2699 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2701 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2702 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:36 2703 2024-09-21T02:51:10.817 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:36 2704 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2753 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2753_fsm 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2753_vm 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2754 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2755 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2756 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 2757 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2830 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2831 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2832 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2833 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2834 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2835 2024-09-21T02:51:10.818 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2836 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2837 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 02:35 2838 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2838_fsm 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2838_vm 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2839 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2840_fsm 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2840_vm 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2841 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2995 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2996 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3079_fsm 2024-09-21T02:51:10.819 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3079_vm 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3080 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3081 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:35 3085 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3118 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3119 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 02:35 3164 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3256 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3257 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3258 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3350 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3351 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3379 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3380 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3381 2024-09-21T02:51:10.820 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3394 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3394_fsm 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3394_vm 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3395 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3429 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3430 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3431 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3433 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3439 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3440 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 02:36 3455 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 02:35 3456 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3456_fsm 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3456_vm 2024-09-21T02:51:10.821 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3466 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3467 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3468 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3501 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3502 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3503 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3534 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3541_fsm 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3541_vm 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3542 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3574 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3575 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3576 2024-09-21T02:51:10.822 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3596 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3597 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3598 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3599 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3600_fsm 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3600_vm 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3601_fsm 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3601_vm 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3602_fsm 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3602_vm 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603 2024-09-21T02:51:10.823 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3603_fsm 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3603_vm 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3604 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3605 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3606 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3607 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3608 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 02:35 3609 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3712 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 3764_fsm 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3764_vm 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3766 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 3767 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3997 2024-09-21T02:51:10.824 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4143 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4144 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4145 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4146 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4147 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4148 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4149 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4150 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4151 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4152 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4153 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4154 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4155 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4156 2024-09-21T02:51:10.825 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4157 2024-09-21T02:51:10.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4158 2024-09-21T02:51:10.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4159 2024-09-21T02:51:10.826 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4160 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4161 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4162 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4163 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4164 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4165 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4166 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4167 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4168 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4169 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4170 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4171 2024-09-21T02:51:10.827 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4172 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4173 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4174 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 5002 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 548 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 549 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6102 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6104 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6106 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6110 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6111 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6112 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6113 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6117 2024-09-21T02:51:10.828 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 826 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 827 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 828 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 21 02:35 pg_internal.init 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:35 PG_VERSION 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.829 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 21 02:35 .. 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/global: 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:total 560 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 21 02:35 . 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1213 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1213_fsm 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1213_vm 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1214 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1214_fsm 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1214_vm 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 1232 2024-09-21T02:51:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 1233 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1260 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1260_fsm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1260_vm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1261 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1261_fsm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1261_vm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1262 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 1262_fsm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 1262_vm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2396 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 02:35 2396_fsm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2396_vm 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2397 2024-09-21T02:51:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2671 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2672 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2676 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2677 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2694 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2695 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2697 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 02:35 2698 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2846 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2847 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2964 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2965 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 2966 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 2967 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 3592 2024-09-21T02:51:10.832 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 3593 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4060 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4061 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4175 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4176 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4177 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4178 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4181 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4182 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4183 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4184 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 4185 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 4186 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6000 2024-09-21T02:51:10.833 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6001 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6002 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 6100 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6114 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 6115 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:51 pg_control 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 02:35 pg_filenode.map 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 21 02:35 pg_internal.init 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/log: 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:total 2 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1511 Sep 21 02:51 postgresql-Sat.log 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-21T02:51:10.835 INFO:teuthology.orchestra.run.smithi079.stdout:total 1 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:51 . 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 mappings 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 02:51 replorigin_checkpoint 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 snapshots 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:51 .. 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-21T02:51:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:51 .. 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 . 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 members 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 offsets 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:total 8 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 .. 2024-09-21T02:51:10.837 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:35 0000 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:total 8 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 21 02:35 .. 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 02:40 0000 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.838 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:total 15 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 02:51 . 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 21 02:51 db_0.stat 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 21 02:51 db_13494.stat 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 21 02:51 global.stat 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:51 . 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-21T02:51:10.840 INFO:teuthology.orchestra.run.smithi079.stdout:total 80 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:51 . 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 02:51 0009 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:total 901120 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Sep 21 02:51 . 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:51 00000001000000000000005D 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:40 00000001000000000000005E 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 00000001000000000000005F 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:40 000000010000000000000060 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:44 000000010000000000000061 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000062 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 000000010000000000000063 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:45 000000010000000000000064 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 000000010000000000000065 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:43 000000010000000000000066 2024-09-21T02:51:10.842 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000067 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000068 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000069 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 00000001000000000000006A 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:44 00000001000000000000006B 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:44 00000001000000000000006C 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:40 00000001000000000000006D 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 00000001000000000000006E 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 00000001000000000000006F 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000070 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 000000010000000000000071 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 000000010000000000000072 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000073 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:43 000000010000000000000074 2024-09-21T02:51:10.843 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:40 000000010000000000000075 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:44 000000010000000000000076 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000077 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:42 000000010000000000000078 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:41 000000010000000000000079 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 00000001000000000000007A 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:48 00000001000000000000007B 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 00000001000000000000007C 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:47 00000001000000000000007D 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:50 00000001000000000000007E 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:50 00000001000000000000007F 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000080 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:48 000000010000000000000081 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000082 2024-09-21T02:51:10.844 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000083 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:48 000000010000000000000084 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000085 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:47 000000010000000000000086 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000087 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:49 000000010000000000000088 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:47 000000010000000000000089 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:49 00000001000000000000008A 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 00000001000000000000008B 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:47 00000001000000000000008C 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 00000001000000000000008D 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:47 00000001000000000000008E 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:47 00000001000000000000008F 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:48 000000010000000000000090 2024-09-21T02:51:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000091 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000092 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 02:46 000000010000000000000093 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 archive_status 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:total 0 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 02:35 . 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Sep 21 02:51 .. 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:total 152 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 21 02:35 . 2024-09-21T02:51:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 21 02:51 .. 2024-09-21T02:51:10.847 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Sep 21 02:51 0000 2024-09-21T02:51:10.847 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T02:51:10.857 INFO:tasks.quiescer:joining Quiescers 2024-09-21T02:51:10.858 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T02:51:10.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:51:11.226 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:11.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:11 smithi079 ceph-mon[30788]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-09-21T02:51:11.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:11 smithi098 ceph-mon[34832]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-09-21T02:51:11.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:11 smithi148 ceph-mon[34626]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-09-21T02:51:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 -- 172.21.15.79:0/1994237042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c1092d0 msgr2=0x7f1f9c1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 --2- 172.21.15.79:0/1994237042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c1092d0 0x7f1f9c1096e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009900 tx=0x7f1f8802a410 comp rx=0 tx=0).stop 2024-09-21T02:51:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 -- 172.21.15.79:0/1994237042 shutdown_connections 2024-09-21T02:51:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 --2- 172.21.15.79:0/1994237042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f9c109c20 0x7f1f9c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 --2- 172.21.15.79:0/1994237042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c1092d0 0x7f1f9c1096e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 --2- 172.21.15.79:0/1994237042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f9c103990 0x7f1f9c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 -- 172.21.15.79:0/1994237042 >> 172.21.15.79:0/1994237042 conn(0x7f1f9c0ff3e0 msgr2=0x7f1f9c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 -- 172.21.15.79:0/1994237042 shutdown_connections 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.997+0000 7f1fa2800640 1 -- 172.21.15.79:0/1994237042 wait complete. 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.998+0000 7f1fa2800640 1 Processor -- start 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.998+0000 7f1fa2800640 1 -- start start 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa2800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c103990 0x7f1f9c19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa2800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f9c1092d0 0x7f1f9c19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:12.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f9c109c20 0x7f1f9c1a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa2800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c113930 con 0x7f1f9c103990 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa2800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c1137b0 con 0x7f1f9c109c20 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa2800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c113ab0 con 0x7f1f9c1092d0 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c103990 0x7f1f9c19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c103990 0x7f1f9c19c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45328/0 (socket says 172.21.15.79:45328) 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa0a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f9c1092d0 0x7f1f9c19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 -- 172.21.15.79:0/2405284943 learned_addr learned my addr 172.21.15.79:0/2405284943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:12.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1e00640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f9c109c20 0x7f1f9c1a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 -- 172.21.15.79:0/2405284943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f9c1092d0 msgr2=0x7f1f9c19caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f9c1092d0 0x7f1f9c19caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 -- 172.21.15.79:0/2405284943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f9c109c20 msgr2=0x7f1f9c1a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f9c109c20 0x7f1f9c1a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:11.999+0000 7f1fa1400640 1 -- 172.21.15.79:0/2405284943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c1a2470 con 0x7f1f9c103990 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.000+0000 7f1fa1400640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c103990 0x7f1f9c19c500 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000e9f0 tx=0x7f1f9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.000+0000 7f1f9a000640 1 -- 172.21.15.79:0/2405284943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000cd80 con 0x7f1f9c103990 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.000+0000 7f1f9a000640 1 -- 172.21.15.79:0/2405284943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f900108e0 con 0x7f1f9c103990 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.000+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c1a2760 con 0x7f1f9c103990 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.000+0000 7f1f9a000640 1 -- 172.21.15.79:0/2405284943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90018980 con 0x7f1f9c103990 2024-09-21T02:51:12.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.000+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c1a8ec0 con 0x7f1f9c103990 2024-09-21T02:51:12.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.001+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c103da0 con 0x7f1f9c103990 2024-09-21T02:51:12.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.004+0000 7f1f9a000640 1 -- 172.21.15.79:0/2405284943 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1f90010430 con 0x7f1f9c103990 2024-09-21T02:51:12.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.005+0000 7f1f9a000640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f840b6590 0x7f1f840b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:12.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.005+0000 7f1f9a000640 1 -- 172.21.15.79:0/2405284943 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f1f900e7e30 con 0x7f1f9c103990 2024-09-21T02:51:12.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.005+0000 7f1fa0a00640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f840b6590 0x7f1f840b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:12.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.006+0000 7f1fa0a00640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f840b6590 0x7f1f840b8aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1f8802aa00 tx=0x7f1f88005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:12.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.007+0000 7f1f9a000640 1 -- 172.21.15.79:0/2405284943 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f900b2690 con 0x7f1f9c103990 2024-09-21T02:51:12.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.230+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f9c1a91b0 con 0x7f1f9c103990 2024-09-21T02:51:12.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.231+0000 7f1f9a000640 1 -- 172.21.15.79:0/2405284943 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f1f900b75d0 con 0x7f1f9c103990 2024-09-21T02:51:12.233 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:12.233 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:51:12.233 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f840b6590 msgr2=0x7f1f840b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f840b6590 0x7f1f840b8aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1f8802aa00 tx=0x7f1f88005a20 comp rx=0 tx=0).stop 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c103990 msgr2=0x7f1f9c19c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c103990 0x7f1f9c19c500 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000e9f0 tx=0x7f1f9000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 shutdown_connections 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f1f840b6590 0x7f1f840b8aa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f9c109c20 0x7f1f9c1a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f9c1092d0 0x7f1f9c19caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 --2- 172.21.15.79:0/2405284943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9c103990 0x7f1f9c19c500 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:12.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 >> 172.21.15.79:0/2405284943 conn(0x7f1f9c0ff3e0 msgr2=0x7f1f9c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:12.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 shutdown_connections 2024-09-21T02:51:12.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:12.233+0000 7f1fa2800640 1 -- 172.21.15.79:0/2405284943 wait complete. 2024-09-21T02:51:13.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:13 smithi079 ceph-mon[30788]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.6 MiB/s wr, 643 op/s 2024-09-21T02:51:13.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:13 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2405284943' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:13.400 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --cancel --all' 2024-09-21T02:51:13.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --cancel --all 2024-09-21T02:51:13.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:13 smithi098 ceph-mon[34832]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.6 MiB/s wr, 643 op/s 2024-09-21T02:51:13.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:13 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2405284943' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:13 smithi148 ceph-mon[34626]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.6 MiB/s wr, 643 op/s 2024-09-21T02:51:13.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:13 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2405284943' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:13.772 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:14.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 -- 172.21.15.79:0/1475942270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 msgr2=0x7f8cdc109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 --2- 172.21.15.79:0/1475942270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 0x7f8cdc109700 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009900 tx=0x7f8cc402a410 comp rx=0 tx=0).stop 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 -- 172.21.15.79:0/1475942270 shutdown_connections 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 --2- 172.21.15.79:0/1475942270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 0x7f8cdc110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 --2- 172.21.15.79:0/1475942270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 0x7f8cdc109700 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 --2- 172.21.15.79:0/1475942270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cdc1039b0 0x7f8cdc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 -- 172.21.15.79:0/1475942270 >> 172.21.15.79:0/1475942270 conn(0x7f8cdc0ff440 msgr2=0x7f8cdc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 -- 172.21.15.79:0/1475942270 shutdown_connections 2024-09-21T02:51:14.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.505+0000 7f8ce2200640 1 -- 172.21.15.79:0/1475942270 wait complete. 2024-09-21T02:51:14.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.506+0000 7f8ce2200640 1 Processor -- start 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce2200640 1 -- start start 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce2200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cdc1039b0 0x7f8cdc19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce2200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 0x7f8cdc19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce2200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 0x7f8cdc1a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce2200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc113950 con 0x7f8cdc1092f0 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce2200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1137d0 con 0x7f8cdc109c40 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce2200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc113ad0 con 0x7f8cdc1039b0 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 0x7f8cdc19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce1800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 0x7f8cdc1a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cdc1039b0 0x7f8cdc19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce1800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 0x7f8cdc1a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:57754/0 (socket says 172.21.15.79:57754) 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8ce1800640 1 -- 172.21.15.79:0/2524112486 learned_addr learned my addr 172.21.15.79:0/2524112486 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:14.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.507+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 0x7f8cdc19cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56596/0 (socket says 172.21.15.79:56596) 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8ce1800640 1 -- 172.21.15.79:0/2524112486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cdc1039b0 msgr2=0x7f8cdc19c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8ce1800640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cdc1039b0 0x7f8cdc19c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8ce1800640 1 -- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 msgr2=0x7f8cdc19cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8ce1800640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 0x7f8cdc19cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8ce1800640 1 -- 172.21.15.79:0/2524112486 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc1a2490 con 0x7f8cdc109c40 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8ce1800640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 0x7f8cdc1a1d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400eb10 tx=0x7f8cd400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8cda000640 1 -- 172.21.15.79:0/2524112486 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4004b20 con 0x7f8cdc109c40 2024-09-21T02:51:14.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8cda000640 1 -- 172.21.15.79:0/2524112486 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd4004cc0 con 0x7f8cdc109c40 2024-09-21T02:51:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.508+0000 7f8cda000640 1 -- 172.21.15.79:0/2524112486 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4010670 con 0x7f8cdc109c40 2024-09-21T02:51:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.509+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cdc1a2780 con 0x7f8cdc109c40 2024-09-21T02:51:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.509+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cdc1a8ee0 con 0x7f8cdc109c40 2024-09-21T02:51:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.512+0000 7f8cea469740 1 Processor -- start 2024-09-21T02:51:14.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.512+0000 7f8cda000640 1 -- 172.21.15.79:0/2524112486 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8cd4005020 con 0x7f8cdc109c40 2024-09-21T02:51:14.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.512+0000 7f8cea469740 1 -- start start 2024-09-21T02:51:14.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cea469740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4198ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cea469740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f4198ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cea469740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f4198eff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cea469740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f419866ff0 con 0x55f4195492d0 2024-09-21T02:51:14.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cea469740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f419856420 con 0x55f4195285f0 2024-09-21T02:51:14.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cea469740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f41985a230 con 0x55f419520410 2024-09-21T02:51:14.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4198ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4198ef4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56602/0 (socket says 172.21.15.79:56602) 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8cd3e00640 1 -- 172.21.15.79:0/459358816 learned_addr learned my addr 172.21.15.79:0/459358816 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.513+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f4198ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8cd3e00640 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f4198eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8ce0e00640 1 -- 172.21.15.79:0/459358816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 msgr2=0x55f4198eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f4198eff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8ce0e00640 1 -- 172.21.15.79:0/459358816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 msgr2=0x55f4198ef4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4198ef4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8ce0e00640 1 -- 172.21.15.79:0/459358816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4195b48b0 con 0x55f419520410 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f4198ef9e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009c00 tx=0x7f8ccc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=229aaafaa63442b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8cda000640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cc00b6510 0x7f8cc00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8cd2000640 1 -- 172.21.15.79:0/459358816 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc004230 con 0x55f419520410 2024-09-21T02:51:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.514+0000 7f8cda000640 1 -- 172.21.15.79:0/2524112486 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8cd40e7c60 con 0x7f8cdc109c40 2024-09-21T02:51:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.515+0000 7f8cd2000640 1 -- 172.21.15.79:0/459358816 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ccc0043d0 con 0x55f419520410 2024-09-21T02:51:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.515+0000 7f8cd2000640 1 -- 172.21.15.79:0/459358816 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc004b90 con 0x55f419520410 2024-09-21T02:51:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.515+0000 7f8cd3e00640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cc00b6510 0x7f8cc00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.515+0000 7f8cea469740 1 -- 172.21.15.79:0/459358816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 msgr2=0x55f4198ef9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.515+0000 7f8cea469740 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f4198ef9e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009c00 tx=0x7f8ccc011810 comp rx=0 tx=0).stop 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.515+0000 7f8cd3e00640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cc00b6510 0x7f8cc00b8a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4000c00 tx=0x7f8cc4005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 -- 172.21.15.79:0/459358816 shutdown_connections 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f4198eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f4198ef9e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 --2- 172.21.15.79:0/459358816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4198ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 -- 172.21.15.79:0/459358816 >> 172.21.15.79:0/459358816 conn(0x55f41953d6c0 msgr2=0x55f4198ed390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 -- 172.21.15.79:0/459358816 shutdown_connections 2024-09-21T02:51:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 -- 172.21.15.79:0/459358816 wait complete. 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 -- start start 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.516+0000 7f8cea469740 1 Processor -- start 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cea469740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198fab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cea469740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198fb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cea469740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198fb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cea469740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f4196b7810 con 0x55f419520410 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cea469740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f4197f1550 con 0x55f4195492d0 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cea469740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f4198fdc80 con 0x55f4195285f0 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cea469740 10 client.0 _ll_register_callbacks cb 0x55f419801040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8ce1800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198fb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41972/0 (socket says 172.21.15.79:41972) 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8cd3e00640 1 -- 172.21.15.79:0/2934238096 learned_addr learned my addr 172.21.15.79:0/2934238096 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.517+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ce1800640 1 -- 172.21.15.79:0/2934238096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 msgr2=0x55f4198fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ce1800640 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ce1800640 1 -- 172.21.15.79:0/2934238096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 msgr2=0x55f4198fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ce1800640 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198fab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ce1800640 1 -- 172.21.15.79:0/2934238096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4197e3200 con 0x55f4195492d0 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ce1800640 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198fb580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40e5720 tx=0x7f8cd40ad8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc28795e5a0c9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ccaa00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ccaa00640 1 -- 172.21.15.79:0/2934238096 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40ae140 con 0x55f4195492d0 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8ccaa00640 1 -- 172.21.15.79:0/2934238096 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8cd40b21d0 con 0x55f4195492d0 2024-09-21T02:51:14.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.518+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ccc0043d0 con 0x55f4195492d0 2024-09-21T02:51:14.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8ccaa00640 1 -- 172.21.15.79:0/2934238096 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8cd40b2520 con 0x55f4195492d0 2024-09-21T02:51:14.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 10 client.27083 fetch_fsmap learned FSMap version 21 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f419909960 con 0x55f4195492d0 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8ccaa00640 1 -- 172.21.15.79:0/2934238096 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ccc0043d0 con 0x55f4195492d0 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8ccaa00640 1 -- 172.21.15.79:0/2934238096 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8cd40ac710 con 0x55f4195492d0 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 10 client.27083 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 10 client.27083 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 20 client.27083 populate_metadata read hostname 'smithi079' 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f419507c50 0x55f41990ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 4 client.27083 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.519+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f419868f40 con 0x55f419507c50 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.520+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f419507c50 0x55f41990ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.520+0000 7f8ccaa00640 10 client.27083 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:14.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.520+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f419507c50 0x55f41990ce30 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23ea11462880785f server_cookie=b177e0cd24b2a57c in_seq=0 out_seq=0 2024-09-21T02:51:14.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.521+0000 7f8ccaa00640 1 -- 172.21.15.79:0/2934238096 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f419868f40 con 0x55f419507c50 2024-09-21T02:51:14.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.521+0000 7f8ccaa00640 10 client.27083 handle_command_reply: tid=0 2024-09-21T02:51:14.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 client.27083 shutdown 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 msgr2=0x55f4198fb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198fb580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40e5720 tx=0x7f8cd40ad8d0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 shutdown_connections 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f419507c50 0x55f41990ce30 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198fb580 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 --2- 172.21.15.79:0/2934238096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8ccaa00640 0 client.27083 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 >> 172.21.15.79:0/2934238096 conn(0x55f41953d6c0 msgr2=0x55f4198f2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 shutdown_connections 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 1 -- 172.21.15.79:0/2934238096 wait complete. 2024-09-21T02:51:14.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.522+0000 7f8cea469740 20 client.27083 trim_cache size 0 max 16384 2024-09-21T02:51:14.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.540+0000 7f8cea469740 1 Processor -- start 2024-09-21T02:51:14.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.540+0000 7f8cea469740 1 -- start start 2024-09-21T02:51:14.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8cea469740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8cea469740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8cea469740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198f8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8cea469740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b0a90 con 0x55f419520410 2024-09-21T02:51:14.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8cea469740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b3310 con 0x55f4195492d0 2024-09-21T02:51:14.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8cea469740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b1100 con 0x55f4195285f0 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198f0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56620/0 (socket says 172.21.15.79:56620) 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce0e00640 1 -- 172.21.15.79:0/1317185509 learned_addr learned my addr 172.21.15.79:0/1317185509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8cd3e00640 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce1800640 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce1800640 1 -- 172.21.15.79:0/1317185509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 msgr2=0x55f4198f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce1800640 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198f7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce1800640 1 -- 172.21.15.79:0/1317185509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 msgr2=0x55f4198f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce1800640 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce1800640 1 -- 172.21.15.79:0/1317185509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4198e8730 con 0x55f4195492d0 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.541+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.542+0000 7f8ce1800640 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198f8230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40acbc0 tx=0x7f8cd400efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952548b7b0ff91b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.542+0000 7f8cd1600640 1 -- 172.21.15.79:0/1317185509 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40ad1b0 con 0x55f4195492d0 2024-09-21T02:51:14.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.542+0000 7f8cd1600640 1 -- 172.21.15.79:0/1317185509 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd40cc070 con 0x55f4195492d0 2024-09-21T02:51:14.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.542+0000 7f8cd1600640 1 -- 172.21.15.79:0/1317185509 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40b21d0 con 0x55f4195492d0 2024-09-21T02:51:14.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 -- 172.21.15.79:0/1317185509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 msgr2=0x55f4198f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198f8230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40acbc0 tx=0x7f8cd400efd0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 -- 172.21.15.79:0/1317185509 shutdown_connections 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195492d0 0x55f4198f8230 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4195285f0 0x55f4198f7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 --2- 172.21.15.79:0/1317185509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f419520410 0x55f4198f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 -- 172.21.15.79:0/1317185509 >> 172.21.15.79:0/1317185509 conn(0x55f41953d6c0 msgr2=0x55f4198faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 -- 172.21.15.79:0/1317185509 shutdown_connections 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.543+0000 7f8cea469740 1 -- 172.21.15.79:0/1317185509 wait complete. 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.544+0000 7f8cea469740 1 -- start start 2024-09-21T02:51:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.544+0000 7f8cea469740 1 Processor -- start 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.544+0000 7f8cea469740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f419901620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8cea469740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f419901b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8cea469740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4199767b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8cea469740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b17d0 con 0x55f4195492d0 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8cea469740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b2c40 con 0x55f4195285f0 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8cea469740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b1ea0 con 0x55f419520410 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8cea469740 10 client.0 _ll_register_callbacks cb 0x7f8cd40aa090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f419901620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce1800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4199767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f419901620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:41990/0 (socket says 172.21.15.79:41990) 2024-09-21T02:51:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 -- 172.21.15.79:0/3402674977 learned_addr learned my addr 172.21.15.79:0/3402674977 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8cd3e00640 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f419901b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 -- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 msgr2=0x55f419901b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f419901b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 -- 172.21.15.79:0/3402674977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 msgr2=0x55f4199767b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4199767b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.545+0000 7f8ce0e00640 1 -- 172.21.15.79:0/3402674977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f419976cf0 con 0x55f419520410 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8ce0e00640 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f419901620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc005fd0 tx=0x7f8ccc005d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6185684874eea916 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8ccaa00640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8ccaa00640 1 -- 172.21.15.79:0/3402674977 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc032060 con 0x55f419520410 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cd40cc070 con 0x55f419520410 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8ccaa00640 1 -- 172.21.15.79:0/3402674977 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f8ccc019830 con 0x55f419520410 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8ccaa00640 1 -- 172.21.15.79:0/3402674977 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8ccc039050 con 0x55f419520410 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8cea469740 10 client.27109 fetch_fsmap learned FSMap version 21 2024-09-21T02:51:14.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f419977f90 con 0x55f419520410 2024-09-21T02:51:14.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.546+0000 7f8ccaa00640 1 -- 172.21.15.79:0/3402674977 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd40cc070 con 0x55f419520410 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8ccaa00640 1 -- 172.21.15.79:0/3402674977 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8ccc024040 con 0x55f419520410 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8cea469740 10 client.27109 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8cea469740 10 client.27109 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8cea469740 20 client.27109 populate_metadata read hostname 'smithi079' 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8cea469740 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4194dd000 0x55f41997a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8cea469740 4 client.27109 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 --> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55f4198649f0 con 0x55f4194dd000 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.547+0000 7f8cd3e00640 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4194dd000 0x55f41997a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:14.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.548+0000 7f8cd3e00640 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4194dd000 0x55f41997a5f0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=580f92116c408e7c server_cookie=55298ecd6217cddb in_seq=0 out_seq=0 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.548+0000 7f8ccaa00640 10 client.27109 ms_handle_connect on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.548+0000 7f8ccaa00640 1 -- 172.21.15.79:0/3402674977 <== mds.0 v2:172.21.15.98:6838/413408652 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55f4198649f0 con 0x55f4194dd000 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.548+0000 7f8ccaa00640 10 client.27109 handle_command_reply: tid=0 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.548+0000 7f8cea469740 1 client.27109 shutdown 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.548+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 msgr2=0x55f419901620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.548+0000 7f8cea469740 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f419901620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc005fd0 tx=0x7f8ccc005d70 comp rx=0 tx=0).stop 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 shutdown_connections 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:6838/413408652,v1:172.21.15.98:6839/413408652] conn(0x55f4194dd000 0x55f41997a5f0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4195492d0 0x55f4199767b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4195285f0 0x55f419901b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 --2- 172.21.15.79:0/3402674977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f419520410 0x55f419901620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 >> 172.21.15.79:0/3402674977 conn(0x55f41953d6c0 msgr2=0x55f4198fbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8ccaa00640 0 client.27109 ms_handle_reset on v2:172.21.15.98:6838/413408652 2024-09-21T02:51:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 shutdown_connections 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 1 -- 172.21.15.79:0/3402674977 wait complete. 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.549+0000 7f8cea469740 20 client.27109 trim_cache size 0 max 16384 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 21, 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stdout: "leader": 24704, 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stdout: "set_version": 60, 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stdout: "sets": {} 2024-09-21T02:51:14.553 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:51:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cc00b6510 msgr2=0x7f8cc00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cc00b6510 0x7f8cc00b8a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4000c00 tx=0x7f8cc4005d50 comp rx=0 tx=0).stop 2024-09-21T02:51:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 msgr2=0x7f8cdc1a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 0x7f8cdc1a1d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400eb10 tx=0x7f8cd400c2d0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 shutdown_connections 2024-09-21T02:51:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f8cc00b6510 0x7f8cc00b8a20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc109c40 0x7f8cdc1a1d60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cdc1092f0 0x7f8cdc19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 --2- 172.21.15.79:0/2524112486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cdc1039b0 0x7f8cdc19c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:14.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 >> 172.21.15.79:0/2524112486 conn(0x7f8cdc0ff440 msgr2=0x7f8cdc108950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:14.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 shutdown_connections 2024-09-21T02:51:14.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:14.550+0000 7f8ce2200640 1 -- 172.21.15.79:0/2524112486 wait complete. 2024-09-21T02:51:15.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:15 smithi098 ceph-mon[34832]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.5 MiB/s wr, 526 op/s 2024-09-21T02:51:15.427 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:15 smithi079 ceph-mon[30788]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.5 MiB/s wr, 526 op/s 2024-09-21T02:51:15.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:15 smithi148 ceph-mon[34626]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.5 MiB/s wr, 526 op/s 2024-09-21T02:51:15.881 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T02:51:15.881 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T02:51:15.890 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:51:15.903 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T02:51:15.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 -- 172.21.15.79:0/4154868224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104ee0 msgr2=0x7fd20410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 --2- 172.21.15.79:0/4154868224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104ee0 0x7fd20410b880 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009ca0 tx=0x7fd1fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 -- 172.21.15.79:0/4154868224 shutdown_connections 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 --2- 172.21.15.79:0/4154868224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104ee0 0x7fd20410b880 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 --2- 172.21.15.79:0/4154868224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd204104540 0x7fd204104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 --2- 172.21.15.79:0/4154868224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2041034c0 0x7fd204103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 -- 172.21.15.79:0/4154868224 >> 172.21.15.79:0/4154868224 conn(0x7fd2040fee00 msgr2=0x7fd2041012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 -- 172.21.15.79:0/4154868224 shutdown_connections 2024-09-21T02:51:16.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.176+0000 7fd209200640 1 -- 172.21.15.79:0/4154868224 wait complete. 2024-09-21T02:51:16.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 Processor -- start 2024-09-21T02:51:16.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 -- start start 2024-09-21T02:51:16.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041034c0 0x7fd204076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd204104540 0x7fd204075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd204104ee0 0x7fd204075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd20410f100 con 0x7fd2041034c0 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd20410ef80 con 0x7fd204104ee0 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.177+0000 7fd209200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd20410f280 con 0x7fd204104540 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041034c0 0x7fd204076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd202a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd204104540 0x7fd204075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041034c0 0x7fd204076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56648/0 (socket says 172.21.15.79:56648) 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 -- 172.21.15.79:0/2208864983 learned_addr learned my addr 172.21.15.79:0/2208864983 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203e00640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd204104ee0 0x7fd204075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 -- 172.21.15.79:0/2208864983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd204104540 msgr2=0x7fd204075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd204104540 0x7fd204075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 -- 172.21.15.79:0/2208864983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd204104ee0 msgr2=0x7fd204075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd204104ee0 0x7fd204075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd203400640 1 -- 172.21.15.79:0/2208864983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd204076380 con 0x7fd2041034c0 2024-09-21T02:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.178+0000 7fd202a00640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd204104540 0x7fd204075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:16.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.179+0000 7fd203400640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041034c0 0x7fd204076e50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400d950 tx=0x7fd1f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:16.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.179+0000 7fd1fbe00640 1 -- 172.21.15.79:0/2208864983 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4017030 con 0x7fd2041034c0 2024-09-21T02:51:16.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.179+0000 7fd1fbe00640 1 -- 172.21.15.79:0/2208864983 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1f4004020 con 0x7fd2041034c0 2024-09-21T02:51:16.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.179+0000 7fd1fbe00640 1 -- 172.21.15.79:0/2208864983 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40047a0 con 0x7fd2041034c0 2024-09-21T02:51:16.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.179+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2041a3d50 con 0x7fd2041034c0 2024-09-21T02:51:16.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.179+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2041a4190 con 0x7fd2041034c0 2024-09-21T02:51:16.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.183+0000 7fd1fbe00640 1 -- 172.21.15.79:0/2208864983 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd1f4009a30 con 0x7fd2041034c0 2024-09-21T02:51:16.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.185+0000 7fd1fbe00640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd1e80b6590 0x7fd1e80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.185+0000 7fd1fbe00640 1 -- 172.21.15.79:0/2208864983 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fd1f40e70f0 con 0x7fd2041034c0 2024-09-21T02:51:16.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.185+0000 7fd202a00640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd1e80b6590 0x7fd1e80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.180+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20410a670 con 0x7fd2041034c0 2024-09-21T02:51:16.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.188+0000 7fd202a00640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd1e80b6590 0x7fd1e80b8aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009f40 tx=0x7fd1ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:16.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.193+0000 7fd1fbe00640 1 -- 172.21.15.79:0/2208864983 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1f40ad570 con 0x7fd2041034c0 2024-09-21T02:51:16.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.385+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd204063fc0 con 0x7fd2041034c0 2024-09-21T02:51:16.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.386+0000 7fd1fbe00640 1 -- 172.21.15.79:0/2208864983 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24834 (secure 0 0 0) 0x7fd1f40b1950 con 0x7fd2041034c0 2024-09-21T02:51:16.388 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:16.388 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:34:31.402384+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd1e80b6590 msgr2=0x7fd1e80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd1e80b6590 0x7fd1e80b8aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009f40 tx=0x7fd1ec005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041034c0 msgr2=0x7fd204076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041034c0 0x7fd204076e50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400d950 tx=0x7fd1f400de10 comp rx=0 tx=0).stop 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 shutdown_connections 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fd1e80b6590 0x7fd1e80b8aa0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd204104ee0 0x7fd204075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd204104540 0x7fd204075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 --2- 172.21.15.79:0/2208864983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2041034c0 0x7fd204076e50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 >> 172.21.15.79:0/2208864983 conn(0x7fd2040fee00 msgr2=0x7fd204107840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 shutdown_connections 2024-09-21T02:51:16.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.389+0000 7fd209200640 1 -- 172.21.15.79:0/2208864983 wait complete. 2024-09-21T02:51:16.414 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T02:27:31.612693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T02:32:37.014569+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T02:32:39.466025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T02:32:48.676381+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T02:51:16.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T02:51:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.635+0000 7fb514c00640 1 -- 172.21.15.79:0/1476932951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510103480 msgr2=0x7fb5101038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.635+0000 7fb514c00640 1 --2- 172.21.15.79:0/1476932951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510103480 0x7fb5101038f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb500009900 tx=0x7fb50002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.636+0000 7fb514c00640 1 -- 172.21.15.79:0/1476932951 shutdown_connections 2024-09-21T02:51:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.636+0000 7fb514c00640 1 --2- 172.21.15.79:0/1476932951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb510104ea0 0x7fb51010b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.636+0000 7fb514c00640 1 --2- 172.21.15.79:0/1476932951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb510104500 0x7fb510104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.636+0000 7fb514c00640 1 --2- 172.21.15.79:0/1476932951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510103480 0x7fb5101038f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.636+0000 7fb514c00640 1 -- 172.21.15.79:0/1476932951 >> 172.21.15.79:0/1476932951 conn(0x7fb5100feda0 msgr2=0x7fb510101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.636+0000 7fb514c00640 1 -- 172.21.15.79:0/1476932951 shutdown_connections 2024-09-21T02:51:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.636+0000 7fb514c00640 1 -- 172.21.15.79:0/1476932951 wait complete. 2024-09-21T02:51:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 Processor -- start 2024-09-21T02:51:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 -- start start 2024-09-21T02:51:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb510103480 0x7fb51019bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb510104500 0x7fb51019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510104ea0 0x7fb51019d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010f110 con 0x7fb510104ea0 2024-09-21T02:51:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010ef90 con 0x7fb510103480 2024-09-21T02:51:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb514c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010f290 con 0x7fb510104500 2024-09-21T02:51:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb50fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510104ea0 0x7fb51019d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.637+0000 7fb50fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510104ea0 0x7fb51019d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56668/0 (socket says 172.21.15.79:56668) 2024-09-21T02:51:16.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50fe00640 1 -- 172.21.15.79:0/3072881377 learned_addr learned my addr 172.21.15.79:0/3072881377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50f400640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb510103480 0x7fb51019bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb507e00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb510104500 0x7fb51019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50fe00640 1 -- 172.21.15.79:0/3072881377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb510104500 msgr2=0x7fb51019c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50fe00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb510104500 0x7fb51019c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50fe00640 1 -- 172.21.15.79:0/3072881377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb510103480 msgr2=0x7fb51019bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50fe00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb510103480 0x7fb51019bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50fe00640 1 -- 172.21.15.79:0/3072881377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51019d8e0 con 0x7fb510104ea0 2024-09-21T02:51:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb507e00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb510104500 0x7fb51019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:51:16.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50fe00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510104ea0 0x7fb51019d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb50800eb10 tx=0x7fb50800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.638+0000 7fb50cc00640 1 -- 172.21.15.79:0/3072881377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508004b20 con 0x7fb510104ea0 2024-09-21T02:51:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.639+0000 7fb50cc00640 1 -- 172.21.15.79:0/3072881377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb508004cc0 con 0x7fb510104ea0 2024-09-21T02:51:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.639+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51019dbd0 con 0x7fb510104ea0 2024-09-21T02:51:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.639+0000 7fb50cc00640 1 -- 172.21.15.79:0/3072881377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508010670 con 0x7fb510104ea0 2024-09-21T02:51:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.639+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5101a42c0 con 0x7fb510104ea0 2024-09-21T02:51:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.640+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5101a44f0 con 0x7fb510104ea0 2024-09-21T02:51:16.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.642+0000 7fb50cc00640 1 -- 172.21.15.79:0/3072881377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb508005000 con 0x7fb510104ea0 2024-09-21T02:51:16.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.644+0000 7fb50cc00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4f40b6510 0x7fb4f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:16.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.644+0000 7fb50cc00640 1 -- 172.21.15.79:0/3072881377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fb5080e7f20 con 0x7fb510104ea0 2024-09-21T02:51:16.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.644+0000 7fb50f400640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4f40b6510 0x7fb4f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:16.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.645+0000 7fb50f400640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4f40b6510 0x7fb4f40b8a20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb500004770 tx=0x7fb5000314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:16.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.645+0000 7fb50cc00640 1 -- 172.21.15.79:0/3072881377 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb508056710 con 0x7fb510104ea0 2024-09-21T02:51:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.835+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5101a46c0 con 0x7fb510104ea0 2024-09-21T02:51:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.836+0000 7fb50cc00640 1 -- 172.21.15.79:0/3072881377 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fb5080ae3a0 con 0x7fb510104ea0 2024-09-21T02:51:16.837 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4f40b6510 msgr2=0x7fb4f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4f40b6510 0x7fb4f40b8a20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb500004770 tx=0x7fb5000314a0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510104ea0 msgr2=0x7fb51019d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510104ea0 0x7fb51019d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb50800eb10 tx=0x7fb50800c2d0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 shutdown_connections 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fb4f40b6510 0x7fb4f40b8a20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb510104ea0 0x7fb51019d0c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb510104500 0x7fb51019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 --2- 172.21.15.79:0/3072881377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb510103480 0x7fb51019bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 >> 172.21.15.79:0/3072881377 conn(0x7fb5100feda0 msgr2=0x7fb5100755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 shutdown_connections 2024-09-21T02:51:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:16.838+0000 7fb514c00640 1 -- 172.21.15.79:0/3072881377 wait complete. 2024-09-21T02:51:16.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T02:51:17.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 -- 172.21.15.79:0/3442324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 msgr2=0x7fcd3c105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 --2- 172.21.15.79:0/3442324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c105d20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009900 tx=0x7fcd3002a410 comp rx=0 tx=0).stop 2024-09-21T02:51:17.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 -- 172.21.15.79:0/3442324 shutdown_connections 2024-09-21T02:51:17.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 --2- 172.21.15.79:0/3442324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd3c1072d0 0x7fcd3c10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 --2- 172.21.15.79:0/3442324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c106930 0x7fcd3c106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 --2- 172.21.15.79:0/3442324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c105d20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 -- 172.21.15.79:0/3442324 >> 172.21.15.79:0/3442324 conn(0x7fcd3c1011f0 msgr2=0x7fcd3c1036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:17.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 -- 172.21.15.79:0/3442324 shutdown_connections 2024-09-21T02:51:17.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.080+0000 7fcd44400640 1 -- 172.21.15.79:0/3442324 wait complete. 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.081+0000 7fcd44400640 1 Processor -- start 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.081+0000 7fcd44400640 1 -- start start 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd44400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd44400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c106930 0x7fcd3c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd44400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd3c1072d0 0x7fcd3c19d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd44400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c1114f0 con 0x7fcd3c1058b0 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd44400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c111370 con 0x7fcd3c106930 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd44400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c111670 con 0x7fcd3c1072d0 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c19c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56694/0 (socket says 172.21.15.79:56694) 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 -- 172.21.15.79:0/3343831938 learned_addr learned my addr 172.21.15.79:0/3343831938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41000640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c106930 0x7fcd3c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd42400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd3c1072d0 0x7fcd3c19d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 -- 172.21.15.79:0/3343831938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd3c1072d0 msgr2=0x7fcd3c19d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd3c1072d0 0x7fcd3c19d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 -- 172.21.15.79:0/3343831938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c106930 msgr2=0x7fcd3c19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c106930 0x7fcd3c19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.082+0000 7fcd41a00640 1 -- 172.21.15.79:0/3343831938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c19db60 con 0x7fcd3c1058b0 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd42400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd3c1072d0 0x7fcd3c19d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd41000640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c106930 0x7fcd3c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd41a00640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c19c120 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcd30006010 tx=0x7fcd300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd3a000640 1 -- 172.21.15.79:0/3343831938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3003f030 con 0x7fcd3c1058b0 2024-09-21T02:51:17.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd3a000640 1 -- 172.21.15.79:0/3343831938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd30032e50 con 0x7fcd3c1058b0 2024-09-21T02:51:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3c19ddf0 con 0x7fcd3c1058b0 2024-09-21T02:51:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd3a000640 1 -- 172.21.15.79:0/3343831938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30035070 con 0x7fcd3c1058b0 2024-09-21T02:51:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.083+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3c19e100 con 0x7fcd3c1058b0 2024-09-21T02:51:17.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.084+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3c10ca80 con 0x7fcd3c1058b0 2024-09-21T02:51:17.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.087+0000 7fcd3a000640 1 -- 172.21.15.79:0/3343831938 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fcd30042030 con 0x7fcd3c1058b0 2024-09-21T02:51:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.089+0000 7fcd3a000640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcd240b6510 0x7fcd240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.090+0000 7fcd3a000640 1 -- 172.21.15.79:0/3343831938 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fcd30108370 con 0x7fcd3c1058b0 2024-09-21T02:51:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.090+0000 7fcd41000640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcd240b6510 0x7fcd240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.090+0000 7fcd41000640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcd240b6510 0x7fcd240b8a20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009fc0 tx=0x7fcd28005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:17.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.092+0000 7fcd3a000640 1 -- 172.21.15.79:0/3343831938 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd300ce7f0 con 0x7fcd3c1058b0 2024-09-21T02:51:17.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.280+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcd3c063fc0 con 0x7fcd3c1058b0 2024-09-21T02:51:17.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.281+0000 7fcd3a000640 1 -- 172.21.15.79:0/3343831938 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fcd300d2bd0 con 0x7fcd3c1058b0 2024-09-21T02:51:17.282 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcd240b6510 msgr2=0x7fcd240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcd240b6510 0x7fcd240b8a20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009fc0 tx=0x7fcd28005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 msgr2=0x7fcd3c19c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c19c120 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcd30006010 tx=0x7fcd300042f0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 shutdown_connections 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcd240b6510 0x7fcd240b8a20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd3c1072d0 0x7fcd3c19d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c106930 0x7fcd3c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 --2- 172.21.15.79:0/3343831938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd3c1058b0 0x7fcd3c19c120 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 >> 172.21.15.79:0/3343831938 conn(0x7fcd3c1011f0 msgr2=0x7fcd3c109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 shutdown_connections 2024-09-21T02:51:17.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.283+0000 7fcd44400640 1 -- 172.21.15.79:0/3343831938 wait complete. 2024-09-21T02:51:17.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T02:51:17.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:17 smithi098 ceph-mon[34832]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-09-21T02:51:17.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:17 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2208864983' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:51:17.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:17 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3072881377' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:51:17.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:17 smithi079 ceph-mon[30788]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-09-21T02:51:17.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:17 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2208864983' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:51:17.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:17 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3072881377' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:51:17.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 -- 172.21.15.79:0/209336913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c106880 msgr2=0x7f366c108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 --2- 172.21.15.79:0/209336913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c106880 0x7f366c108ca0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3654009900 tx=0x7f365402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 -- 172.21.15.79:0/209336913 shutdown_connections 2024-09-21T02:51:17.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 --2- 172.21.15.79:0/209336913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366c1093e0 0x7f366c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 --2- 172.21.15.79:0/209336913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c106880 0x7f366c108ca0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 --2- 172.21.15.79:0/209336913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f366c06c370 0x7f366c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 -- 172.21.15.79:0/209336913 >> 172.21.15.79:0/209336913 conn(0x7f366c0fdee0 msgr2=0x7f366c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:17.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 -- 172.21.15.79:0/209336913 shutdown_connections 2024-09-21T02:51:17.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.528+0000 7f3673200640 1 -- 172.21.15.79:0/209336913 wait complete. 2024-09-21T02:51:17.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.529+0000 7f3673200640 1 Processor -- start 2024-09-21T02:51:17.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.529+0000 7f3673200640 1 -- start start 2024-09-21T02:51:17.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3673200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f366c06c370 0x7f366c103980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3673200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366c106880 0x7f366c102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3673200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c1093e0 0x7f366c102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3673200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f366c10f320 con 0x7f366c1093e0 2024-09-21T02:51:17.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3673200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f366c10f1a0 con 0x7f366c106880 2024-09-21T02:51:17.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3673200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f366c10f4a0 con 0x7f366c06c370 2024-09-21T02:51:17.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3671200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c1093e0 0x7f366c102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3671200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c1093e0 0x7f366c102780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56698/0 (socket says 172.21.15.79:56698) 2024-09-21T02:51:17.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f366be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f366c06c370 0x7f366c103980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3671200640 1 -- 172.21.15.79:0/2326729809 learned_addr learned my addr 172.21.15.79:0/2326729809 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.530+0000 7f3663e00640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366c106880 0x7f366c102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3671200640 1 -- 172.21.15.79:0/2326729809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f366c06c370 msgr2=0x7f366c103980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3671200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f366c06c370 0x7f366c103980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3671200640 1 -- 172.21.15.79:0/2326729809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366c106880 msgr2=0x7f366c102240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3671200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366c106880 0x7f366c102240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3671200640 1 -- 172.21.15.79:0/2326729809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c102eb0 con 0x7f366c1093e0 2024-09-21T02:51:17.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f366be00640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f366c06c370 0x7f366c103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:17.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3671200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c1093e0 0x7f366c102780 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f366400efd0 tx=0x7f366400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:17.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3669600640 1 -- 172.21.15.79:0/2326729809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664003b70 con 0x7f366c1093e0 2024-09-21T02:51:17.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c1a4060 con 0x7f366c1093e0 2024-09-21T02:51:17.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3669600640 1 -- 172.21.15.79:0/2326729809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3664003d10 con 0x7f366c1093e0 2024-09-21T02:51:17.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c1a44d0 con 0x7f366c1093e0 2024-09-21T02:51:17.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.531+0000 7f3669600640 1 -- 172.21.15.79:0/2326729809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640108c0 con 0x7f366c1093e0 2024-09-21T02:51:17.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.532+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c0ffa00 con 0x7f366c1093e0 2024-09-21T02:51:17.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.535+0000 7f3669600640 1 -- 172.21.15.79:0/2326729809 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3664004b40 con 0x7f366c1093e0 2024-09-21T02:51:17.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.536+0000 7f3669600640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f36500b6510 0x7f36500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.536+0000 7f3669600640 1 -- 172.21.15.79:0/2326729809 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f36640e7ec0 con 0x7f366c1093e0 2024-09-21T02:51:17.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.536+0000 7f366be00640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f36500b6510 0x7f36500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.537+0000 7f366be00640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f36500b6510 0x7f36500b8a20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f365c009fc0 tx=0x7f365c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.538+0000 7f3669600640 1 -- 172.21.15.79:0/2326729809 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36640ae340 con 0x7f366c1093e0 2024-09-21T02:51:17.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:17 smithi148 ceph-mon[34626]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-09-21T02:51:17.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:17 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2208864983' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:51:17.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:17 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3072881377' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:51:17.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.722+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f366c063fc0 con 0x7f366c1093e0 2024-09-21T02:51:17.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.723+0000 7f3669600640 1 -- 172.21.15.79:0/2326729809 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f36640b2720 con 0x7f366c1093e0 2024-09-21T02:51:17.724 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-09-21T02:51:17.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f36500b6510 msgr2=0x7f36500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f36500b6510 0x7f36500b8a20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f365c009fc0 tx=0x7f365c005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:17.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c1093e0 msgr2=0x7f366c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c1093e0 0x7f366c102780 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f366400efd0 tx=0x7f366400c6a0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 shutdown_connections 2024-09-21T02:51:17.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f36500b6510 0x7f36500b8a20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c1093e0 0x7f366c102780 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366c106880 0x7f366c102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 --2- 172.21.15.79:0/2326729809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f366c06c370 0x7f366c103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.725+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 >> 172.21.15.79:0/2326729809 conn(0x7f366c0fdee0 msgr2=0x7f366c104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:17.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.726+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 shutdown_connections 2024-09-21T02:51:17.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.726+0000 7f3673200640 1 -- 172.21.15.79:0/2326729809 wait complete. 2024-09-21T02:51:17.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 -- 172.21.15.79:0/4251974334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe978106920 msgr2=0x7fe978106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 --2- 172.21.15.79:0/4251974334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe978106920 0x7fe978106d30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe964009900 tx=0x7fe96402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 -- 172.21.15.79:0/4251974334 shutdown_connections 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 --2- 172.21.15.79:0/4251974334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9781072c0 0x7fe97810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 --2- 172.21.15.79:0/4251974334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe978106920 0x7fe978106d30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 --2- 172.21.15.79:0/4251974334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9781058a0 0x7fe978105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 -- 172.21.15.79:0/4251974334 >> 172.21.15.79:0/4251974334 conn(0x7fe978101220 msgr2=0x7fe978103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 -- 172.21.15.79:0/4251974334 shutdown_connections 2024-09-21T02:51:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.971+0000 7fe97fa00640 1 -- 172.21.15.79:0/4251974334 wait complete. 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.972+0000 7fe97fa00640 1 Processor -- start 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.972+0000 7fe97fa00640 1 -- start start 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.972+0000 7fe97fa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9781058a0 0x7fe97819c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.972+0000 7fe97fa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe978106920 0x7fe97819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.972+0000 7fe97fa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9781072c0 0x7fe97819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe97fa00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe9781114f0 con 0x7fe978106920 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe97fa00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe978111370 con 0x7fe9781058a0 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe97fa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe978111670 con 0x7fe9781072c0 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe978106920 0x7fe97819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe978106920 0x7fe97819c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56722/0 (socket says 172.21.15.79:56722) 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 -- 172.21.15.79:0/682566028 learned_addr learned my addr 172.21.15.79:0/682566028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe97d000640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9781058a0 0x7fe97819c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe97da00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9781072c0 0x7fe97819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 -- 172.21.15.79:0/682566028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9781072c0 msgr2=0x7fe97819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9781072c0 0x7fe97819d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 -- 172.21.15.79:0/682566028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9781058a0 msgr2=0x7fe97819c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9781058a0 0x7fe97819c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe977e00640 1 -- 172.21.15.79:0/682566028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97819db80 con 0x7fe978106920 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.973+0000 7fe97d000640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9781058a0 0x7fe97819c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.974+0000 7fe977e00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe978106920 0x7fe97819c7b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe964006010 tx=0x7fe9640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.974+0000 7fe975600640 1 -- 172.21.15.79:0/682566028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96403f030 con 0x7fe978106920 2024-09-21T02:51:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.974+0000 7fe975600640 1 -- 172.21.15.79:0/682566028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe964032e50 con 0x7fe978106920 2024-09-21T02:51:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.974+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97819de10 con 0x7fe978106920 2024-09-21T02:51:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.974+0000 7fe975600640 1 -- 172.21.15.79:0/682566028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964035070 con 0x7fe978106920 2024-09-21T02:51:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.974+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97819e120 con 0x7fe978106920 2024-09-21T02:51:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.975+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97810ca70 con 0x7fe978106920 2024-09-21T02:51:17.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.979+0000 7fe975600640 1 -- 172.21.15.79:0/682566028 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe964042030 con 0x7fe978106920 2024-09-21T02:51:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.980+0000 7fe975600640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe9600b6510 0x7fe9600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.980+0000 7fe975600640 1 -- 172.21.15.79:0/682566028 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fe964108270 con 0x7fe978106920 2024-09-21T02:51:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.980+0000 7fe97d000640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe9600b6510 0x7fe9600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:17.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.981+0000 7fe97d000640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe9600b6510 0x7fe9600b8a20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009fc0 tx=0x7fe96c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:17.983+0000 7fe975600640 1 -- 172.21.15.79:0/682566028 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9640ce750 con 0x7fe978106920 2024-09-21T02:51:18.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.172+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe978063fc0 con 0x7fe978106920 2024-09-21T02:51:18.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.172+0000 7fe975600640 1 -- 172.21.15.79:0/682566028 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) ==== 103+0+11 (secure 0 0 0) 0x7fe9640d2b30 con 0x7fe978106920 2024-09-21T02:51:18.174 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-09-21T02:51:18.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe9600b6510 msgr2=0x7fe9600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe9600b6510 0x7fe9600b8a20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009fc0 tx=0x7fe96c005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe978106920 msgr2=0x7fe97819c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe978106920 0x7fe97819c7b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe964006010 tx=0x7fe9640042f0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 shutdown_connections 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fe9600b6510 0x7fe9600b8a20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9781072c0 0x7fe97819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe978106920 0x7fe97819c7b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 --2- 172.21.15.79:0/682566028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9781058a0 0x7fe97819c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 >> 172.21.15.79:0/682566028 conn(0x7fe978101220 msgr2=0x7fe978109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 shutdown_connections 2024-09-21T02:51:18.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.175+0000 7fe97fa00640 1 -- 172.21.15.79:0/682566028 wait complete. 2024-09-21T02:51:18.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T02:51:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:18 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3343831938' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T02:51:18.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:18 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2326729809' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 -- 172.21.15.79:0/1374996694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974103680 msgr2=0x7fc974103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 --2- 172.21.15.79:0/1374996694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974103680 0x7fc974103af0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc964009ca0 tx=0x7fc96402a8b0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 -- 172.21.15.79:0/1374996694 shutdown_connections 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 --2- 172.21.15.79:0/1374996694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741050a0 0x7fc97410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 --2- 172.21.15.79:0/1374996694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc974104700 0x7fc974104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 --2- 172.21.15.79:0/1374996694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974103680 0x7fc974103af0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 -- 172.21.15.79:0/1374996694 >> 172.21.15.79:0/1374996694 conn(0x7fc9740fefe0 msgr2=0x7fc974101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:18.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 -- 172.21.15.79:0/1374996694 shutdown_connections 2024-09-21T02:51:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.417+0000 7fc97a000640 1 -- 172.21.15.79:0/1374996694 wait complete. 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.418+0000 7fc97a000640 1 Processor -- start 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.418+0000 7fc97a000640 1 -- start start 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.418+0000 7fc97a000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc974103680 0x7fc97419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc97a000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974104700 0x7fc97419c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc97a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741050a0 0x7fc97419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc97a000640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc97410f2c0 con 0x7fc974104700 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc97a000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc97410f140 con 0x7fc974103680 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc97a000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc97410f440 con 0x7fc9741050a0 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc96aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974104700 0x7fc97419c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc973400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc974103680 0x7fc97419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc96aa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974104700 0x7fc97419c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56742/0 (socket says 172.21.15.79:56742) 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc96aa00640 1 -- 172.21.15.79:0/3121031573 learned_addr learned my addr 172.21.15.79:0/3121031573 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc973e00640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741050a0 0x7fc97419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc973400640 1 -- 172.21.15.79:0/3121031573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741050a0 msgr2=0x7fc97419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc973400640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741050a0 0x7fc97419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc973400640 1 -- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974104700 msgr2=0x7fc97419c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc973400640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974104700 0x7fc97419c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc973400640 1 -- 172.21.15.79:0/3121031573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97419db40 con 0x7fc974103680 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.419+0000 7fc96aa00640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974104700 0x7fc97419c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.420+0000 7fc973400640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc974103680 0x7fc97419c100 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc964009ca0 tx=0x7fc964003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.420+0000 7fc970c00640 1 -- 172.21.15.79:0/3121031573 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964004450 con 0x7fc974103680 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.420+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97419ddd0 con 0x7fc974103680 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.420+0000 7fc970c00640 1 -- 172.21.15.79:0/3121031573 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc964040070 con 0x7fc974103680 2024-09-21T02:51:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.420+0000 7fc970c00640 1 -- 172.21.15.79:0/3121031573 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964045ca0 con 0x7fc974103680 2024-09-21T02:51:18.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.420+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741a4520 con 0x7fc974103680 2024-09-21T02:51:18.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.421+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc974103af0 con 0x7fc974103680 2024-09-21T02:51:18.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.423+0000 7fc970c00640 1 -- 172.21.15.79:0/3121031573 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc964045470 con 0x7fc974103680 2024-09-21T02:51:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.425+0000 7fc970c00640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9580b6510 0x7fc9580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.425+0000 7fc970c00640 1 -- 172.21.15.79:0/3121031573 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fc964108940 con 0x7fc974103680 2024-09-21T02:51:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.425+0000 7fc96aa00640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9580b6510 0x7fc9580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.426+0000 7fc96aa00640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9580b6510 0x7fc9580b8a20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc95c011550 tx=0x7fc95c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.427+0000 7fc970c00640 1 -- 172.21.15.79:0/3121031573 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9640cedc0 con 0x7fc974103680 2024-09-21T02:51:18.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:18 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3343831938' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T02:51:18.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:18 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2326729809' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T02:51:18.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:18 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3343831938' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T02:51:18.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:18 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2326729809' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T02:51:18.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.664+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc9741a48b0 con 0x7fc974103680 2024-09-21T02:51:18.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.675+0000 7fc970c00640 1 -- 172.21.15.79:0/3121031573 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v19) ==== 81+0+833520 (secure 0 0 0) 0x7fc9640d31a0 con 0x7fc974103680 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 19, 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: "active_gid": 14152, 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: "active_name": "x", 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: "active_addrs": { 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T02:51:18.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 863078239 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 863078239 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "active_addr": "172.21.15.79:6801/863078239", 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "active_change": "2024-09-21T02:24:29.283683+0000", 2024-09-21T02:51:18.688 INFO:teuthology.orchestra.run.smithi079.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "available": true, 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "standbys": [ 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "gid": 24121, 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "z", 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_features": 4540719139924082687, 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:18.689 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.691 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.692 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.693 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.694 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.695 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.696 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2024-09-21T02:51:18.697 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.698 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2024-09-21T02:51:18.699 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2024-09-21T02:51:18.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.700 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.701 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2024-09-21T02:51:18.701 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.701 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.701 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.701 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2024-09-21T02:51:18.701 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.702 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.703 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.704 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.705 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2024-09-21T02:51:18.706 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.707 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:51:18.708 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:51:18.709 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.710 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T02:51:18.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2024-09-21T02:51:18.712 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2359", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T02:51:18.713 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T02:51:18.714 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.715 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.716 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.717 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.718 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.719 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T02:51:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "upmap", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2024-09-21T02:51:18.721 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "read", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap-read" 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.722 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.725 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_optimizations": { 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_optimizations", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm", 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.727 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_down_multiplier": { 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_down_multiplier", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_refresh_rate": { 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_refresh_rate", 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "20", 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T02:51:18.729 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_starting_port": { 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_starting_port", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4721", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T02:51:18.730 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_ptrace": { 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_ptrace", 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_interval": { 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_interval", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T02:51:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_memory_target_ratio": { 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.7", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T02:51:18.733 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_log_destination": { 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm_log_destination", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "file", 2024-09-21T02:51:18.734 INFO:teuthology.orchestra.run.smithi079.stdout: "file,syslog", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "syslog" 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "cgroups_split": { 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cgroups_split", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.735 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "config_checks_enabled": { 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_checks_enabled", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.736 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "config_dashboard": { 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_dashboard", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.737 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_alertmanager": { 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_alertmanager", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.738 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_base": { 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_base", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.739 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Container image name, without the tag", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_elasticsearch": { 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_elasticsearch", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.740 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "elasticsearch container image", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_grafana": { 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_grafana", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.741 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_haproxy": { 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_haproxy", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.742 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "HAproxy container image", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_agent": { 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_agent", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.743 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger agent container image", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_collector": { 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_collector", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.744 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger collector container image", 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_query": { 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_query", 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.745 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger query container image", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_keepalived": { 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_keepalived", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.746 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Keepalived container image", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_loki": { 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_loki", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.747 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Loki container image", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nginx": { 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nginx", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.748 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nginx container image", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_node_exporter": { 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_node_exporter", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.749 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nvmeof": { 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nvmeof", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.750 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nvme-of container image", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_oauth2_proxy": { 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.751 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "oauth2-proxy container image", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_prometheus": { 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_prometheus", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.752 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_promtail": { 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_promtail", 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.753 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Promtail container image", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba": { 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.754 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB container image", 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba_metrics": { 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba_metrics", 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T02:51:18.755 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_snmp_gateway": { 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_snmp_gateway", 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.756 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SNMP Gateway container image", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "container_init": { 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_init", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.757 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "daemon_cache_timeout": { 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "daemon_cache_timeout", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.758 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "default_cephadm_command_timeout": { 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "900", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.759 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "default_registry": { 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_registry", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "device_cache_timeout": { 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_cache_timeout", 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1800", 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.761 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache device inventory", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "device_enhanced_scan": { 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_enhanced_scan", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.762 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "facts_cache_timeout": { 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "facts_cache_timeout", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.763 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache host facts data", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "grafana_dashboards_path": { 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "grafana_dashboards_path", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.764 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "host_check_interval": { 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "host_check_interval", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to perform a host check", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "hw_monitoring": { 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hw_monitoring", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.766 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_list_all": { 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_list_all", 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.767 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "log_refresh_metadata": { 2024-09-21T02:51:18.769 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_refresh_metadata", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.770 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.772 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.773 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T02:51:18.774 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "*", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T02:51:18.775 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "max_count_per_host": { 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_count_per_host", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of daemons per service per host", 2024-09-21T02:51:18.776 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd_draining_count": { 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_osd_draining_count", 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.777 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "migration_current": { 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "migration_current", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.778 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "internal - do not modify", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "root", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.779 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm-package", 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "root" 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "oob_default_addr": { 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "oob_default_addr", 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "169.254.1.1", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "prometheus_alerts_path": { 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus_alerts_path", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T02:51:18.781 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_insecure": { 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_insecure", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_password": { 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_password", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.783 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_url": { 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_url", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.784 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_username": { 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_username", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.785 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "secure_monitoring_stack": { 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secure_monitoring_stack", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.786 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "service_discovery_port": { 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "service_discovery_port", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8765", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "cephadm service discovery port", 2024-09-21T02:51:18.787 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.788 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.789 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_keepalive_count_max": { 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.790 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_keepalive_interval": { 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_keepalive_interval", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.791 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "use_agent": { 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_agent", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.792 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "use_repo_digest": { 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_repo_digest", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T02:51:18.793 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_failed_host_check": { 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_failed_host_check", 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_daemons": { 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_daemons", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.795 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_hosts": { 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_hosts", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T02:51:18.796 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.797 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.798 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.800 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.801 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2024-09-21T02:51:18.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.803 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2024-09-21T02:51:18.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.805 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.806 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.807 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.808 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.809 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.810 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.811 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.812 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.813 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.814 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.815 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.816 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.817 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.818 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.819 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.820 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.821 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "[]", 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "{}", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "cross_origin_url": { 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cross_origin_url", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2024-09-21T02:51:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-09-21T02:51:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "motd": { 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "motd", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "The message of the day", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect_resolve_ip_addr": { 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "sso_oauth2": { 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sso_oauth2", 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2024-09-21T02:51:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "predictor_model": { 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predictor_model", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "prophetstor", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server hostname", 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "5", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "password of InfluxDB server user", 2024-09-21T02:51:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server port", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "32", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "username of InfluxDB server user", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "k8sevents", 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_event_retention_days": { 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ceph_event_retention_days", 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "config_check_secs": { 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_check_secs", 2024-09-21T02:51:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "10", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T02:51:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mds_autoscaler", 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirroring", 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "nfs", 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "fail_fs": { 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "fail_fs", 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rook", 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "test_orchestrator" 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Orchestrator backend", 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_perf_query", 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_support", 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.984 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.985 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.986 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.987 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.988 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2024-09-21T02:51:18.990 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.991 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.993 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.995 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:18.996 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "threshold": { 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threshold", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:18.997 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1.0", 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "scaling threshold", 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:18.998 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_pg_recovery_event": { 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_pg_recovery_event", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:18.999 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.000 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.003 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2024-09-21T02:51:19.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long the module is going to sleep", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cache", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.009 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "exclude_perf_counters": { 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "exclude_perf_counters", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.011 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.012 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.013 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.014 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.015 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.016 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15.0", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "9283", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2024-09-21T02:51:19.021 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "log", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-09-21T02:51:19.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "default", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "default", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "error" 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.023 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.025 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.026 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.027 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.028 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.029 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_snap_create": { 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_snap_create", 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.030 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "mirror_snapshot_schedule": { 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.031 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.032 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "trash_purge_schedule": { 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "trash_purge_schedule", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.033 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.034 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_auth": { 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_auth", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.035 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.037 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.038 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.040 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "max_requests": { 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_requests", 2024-09-21T02:51:19.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.042 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.043 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.044 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rgw", 2024-09-21T02:51:19.045 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.046 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.047 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.048 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.049 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.050 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T02:51:19.051 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.052 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.053 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.054 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.055 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.056 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.057 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.058 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "storage_class": { 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "storage_class", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "local", 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.060 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.061 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.064 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.065 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.066 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.068 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.069 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.070 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.071 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.073 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption7": { 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption7", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "42", 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.074 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.075 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.076 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.077 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.078 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smb", 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "internal_store_backend": { 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "internal_store_backend", 2024-09-21T02:51:19.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.080 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.081 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.083 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.084 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.085 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "update_orchestration": { 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "update_orchestration", 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.086 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.087 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snap_schedule", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_m_granularity": { 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_m_granularity", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T02:51:19.088 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "dump_on_update": { 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dump_on_update", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "dump database to debug log on update", 2024-09-21T02:51:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.090 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.093 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.094 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stats", 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.096 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.097 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.098 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.099 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.100 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.101 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.103 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.106 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.107 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.108 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.109 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.110 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.112 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.113 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.114 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.115 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.116 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.118 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.120 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.121 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_perf": { 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_perf", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.122 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.123 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.124 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.125 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.126 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.127 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.128 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard_description": { 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard_description", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.130 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.131 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.132 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.133 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.134 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.135 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.136 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.137 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.138 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.139 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.140 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.141 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.142 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.143 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.144 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.145 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.146 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.147 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.148 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.149 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.150 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "periodic_async_work": { 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "periodic_async_work", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Periodically check for async work", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_delay": { 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_delay", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.154 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_no_wait": { 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "discovery_interval": { 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "discovery_interval", 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "100", 2024-09-21T02:51:19.157 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.158 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.159 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.160 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.163 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.164 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.165 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T02:51:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "gid": 24122, 2024-09-21T02:51:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "y", 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_features": 4540719139924082687, 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2359", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "upmap", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "read", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap", 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap-read" 2024-09-21T02:51:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_optimizations": { 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_optimizations", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T02:51:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm", 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_down_multiplier": { 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_down_multiplier", 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_refresh_rate": { 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_refresh_rate", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "20", 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_starting_port": { 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_starting_port", 2024-09-21T02:51:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4721", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_ptrace": { 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_ptrace", 2024-09-21T02:51:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_interval": { 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_interval", 2024-09-21T02:51:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_memory_target_ratio": { 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T02:51:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.7", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_log_destination": { 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm_log_destination", 2024-09-21T02:51:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "file", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "file,syslog", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "syslog" 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "cgroups_split": { 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cgroups_split", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "config_checks_enabled": { 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_checks_enabled", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "config_dashboard": { 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_dashboard", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_alertmanager": { 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_alertmanager", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_base": { 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_base", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Container image name, without the tag", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_elasticsearch": { 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_elasticsearch", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "elasticsearch container image", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_grafana": { 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_grafana", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_haproxy": { 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_haproxy", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "HAproxy container image", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_agent": { 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_agent", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger agent container image", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_collector": { 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_collector", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger collector container image", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_query": { 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_query", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger query container image", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_keepalived": { 2024-09-21T02:51:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_keepalived", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Keepalived container image", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_loki": { 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_loki", 2024-09-21T02:51:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Loki container image", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nginx": { 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nginx", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nginx container image", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_node_exporter": { 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_node_exporter", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nvmeof": { 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nvmeof", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nvme-of container image", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_oauth2_proxy": { 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "oauth2-proxy container image", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_prometheus": { 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_prometheus", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_promtail": { 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_promtail", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Promtail container image", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba": { 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB container image", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba_metrics": { 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba_metrics", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_snmp_gateway": { 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_snmp_gateway", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SNMP Gateway container image", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "container_init": { 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_init", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "daemon_cache_timeout": { 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "daemon_cache_timeout", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "default_cephadm_command_timeout": { 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "900", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "default_registry": { 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_registry", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io", 2024-09-21T02:51:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "device_cache_timeout": { 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_cache_timeout", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1800", 2024-09-21T02:51:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache device inventory", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "device_enhanced_scan": { 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_enhanced_scan", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "facts_cache_timeout": { 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "facts_cache_timeout", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache host facts data", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "grafana_dashboards_path": { 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "grafana_dashboards_path", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T02:51:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "host_check_interval": { 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "host_check_interval", 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to perform a host check", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "hw_monitoring": { 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hw_monitoring", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_list_all": { 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_list_all", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "log_refresh_metadata": { 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_refresh_metadata", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T02:51:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "*", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "max_count_per_host": { 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_count_per_host", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of daemons per service per host", 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd_draining_count": { 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_osd_draining_count", 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "migration_current": { 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "migration_current", 2024-09-21T02:51:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "internal - do not modify", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-09-21T02:51:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "root", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm-package", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "root" 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "oob_default_addr": { 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "oob_default_addr", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "169.254.1.1", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "prometheus_alerts_path": { 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus_alerts_path", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.260 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_insecure": { 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_insecure", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_password": { 2024-09-21T02:51:19.261 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_password", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_url": { 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_url", 2024-09-21T02:51:19.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_username": { 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_username", 2024-09-21T02:51:19.263 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "secure_monitoring_stack": { 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secure_monitoring_stack", 2024-09-21T02:51:19.264 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "service_discovery_port": { 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "service_discovery_port", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.265 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8765", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "cephadm service discovery port", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.266 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.267 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_keepalive_count_max": { 2024-09-21T02:51:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.269 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_keepalive_interval": { 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_keepalive_interval", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "use_agent": { 2024-09-21T02:51:19.270 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_agent", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "use_repo_digest": { 2024-09-21T02:51:19.271 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_repo_digest", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_failed_host_check": { 2024-09-21T02:51:19.272 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_failed_host_check", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.273 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_daemons": { 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_daemons", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.274 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_hosts": { 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_hosts", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.276 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.279 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.280 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.281 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.282 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T02:51:19.284 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T02:51:19.285 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T02:51:19.286 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.287 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.292 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.296 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T02:51:19.297 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T02:51:19.298 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.299 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.300 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T02:51:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T02:51:19.302 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T02:51:19.303 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T02:51:19.304 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T02:51:19.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T02:51:19.306 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "[]", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T02:51:19.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "{}", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T02:51:19.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T02:51:19.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T02:51:19.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T02:51:19.311 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.312 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.313 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.314 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.316 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.317 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.318 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.320 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.321 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.322 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.323 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.324 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.325 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T02:51:19.326 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T02:51:19.327 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T02:51:19.328 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T02:51:19.329 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cross_origin_url": { 2024-09-21T02:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cross_origin_url", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.331 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2024-09-21T02:51:19.332 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.333 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.334 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.335 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.336 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.337 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.338 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.339 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.340 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "motd": { 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "motd", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "The message of the day", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.341 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect_resolve_ip_addr": { 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-09-21T02:51:19.345 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.346 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "sso_oauth2": { 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sso_oauth2", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.348 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.349 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.351 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.352 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.353 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.354 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.356 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.357 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.358 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.359 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2024-09-21T02:51:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T02:51:19.361 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.362 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.363 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.364 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.366 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.367 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.368 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.369 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.370 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.371 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "predictor_model": { 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predictor_model", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "prophetstor", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.373 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.374 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.375 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.377 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server hostname", 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.378 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "5", 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.380 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.381 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2024-09-21T02:51:19.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "password of InfluxDB server user", 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2024-09-21T02:51:19.385 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server port", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.386 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.387 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.388 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "32", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "username of InfluxDB server user", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.390 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.393 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.394 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.395 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.396 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2024-09-21T02:51:19.398 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.399 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.400 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.402 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.403 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.404 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "k8sevents", 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_event_retention_days": { 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ceph_event_retention_days", 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.405 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "config_check_secs": { 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_check_secs", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.406 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "10", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.407 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.408 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.410 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.411 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.412 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2024-09-21T02:51:19.413 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.414 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.415 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.417 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.418 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2024-09-21T02:51:19.420 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.421 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.422 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.423 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T02:51:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mds_autoscaler", 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.425 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.426 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.428 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.430 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirroring", 2024-09-21T02:51:19.431 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.432 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.433 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.434 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.435 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.436 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.437 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "nfs", 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.438 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.440 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.441 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.442 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.443 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.444 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "fail_fs": { 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "fail_fs", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.446 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.447 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.448 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "rook", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "test_orchestrator" 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Orchestrator backend", 2024-09-21T02:51:19.451 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.452 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_perf_query", 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.454 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.455 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.456 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.457 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.458 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_support", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.460 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.462 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.464 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.466 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.467 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.468 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.469 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.470 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.471 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.472 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "threshold": { 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threshold", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1.0", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.473 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "scaling threshold", 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_pg_recovery_event": { 2024-09-21T02:51:19.474 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_pg_recovery_event", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-09-21T02:51:19.475 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.477 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.478 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.479 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.480 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.481 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long the module is going to sleep", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.483 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.484 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cache", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.485 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "exclude_perf_counters": { 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "exclude_perf_counters", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T02:51:19.486 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.487 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.488 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.489 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.490 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.492 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2024-09-21T02:51:19.493 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15.0", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.494 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.495 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "9283", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.496 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2024-09-21T02:51:19.497 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "log", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-09-21T02:51:19.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "default", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "default", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "error" 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_snap_create": { 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_snap_create", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "mirror_snapshot_schedule": { 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "trash_purge_schedule": { 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "trash_purge_schedule", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_auth": { 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_auth", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "max_requests": { 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_requests", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rgw", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "storage_class": { 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "storage_class", 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "local", 2024-09-21T02:51:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2024-09-21T02:51:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2024-09-21T02:51:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption7": { 2024-09-21T02:51:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption7", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "42", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2024-09-21T02:51:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2024-09-21T02:51:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2024-09-21T02:51:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smb", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "internal_store_backend": { 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "internal_store_backend", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "update_orchestration": { 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "update_orchestration", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snap_schedule", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_m_granularity": { 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_m_granularity", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "dump_on_update": { 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dump_on_update", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "dump database to debug log on update", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stats", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_perf": { 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_perf", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2024-09-21T02:51:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard_description": { 2024-09-21T02:51:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard_description", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T02:51:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "periodic_async_work": { 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "periodic_async_work", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Periodically check for async work", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_delay": { 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_delay", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_no_wait": { 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "discovery_interval": { 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "discovery_interval", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "100", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "modules": [ 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "dashboard", 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "iostat", 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "nfs", 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "restful" 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2024-09-21T02:51:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2024-09-21T02:51:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2024-09-21T02:51:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2024-09-21T02:51:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2024-09-21T02:51:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2024-09-21T02:51:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2024-09-21T02:51:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2024-09-21T02:51:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2359", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2024-09-21T02:51:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "upmap", 2024-09-21T02:51:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "read", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap-read" 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_optimizations": { 2024-09-21T02:51:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_optimizations", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_down_multiplier": { 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_down_multiplier", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_refresh_rate": { 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_refresh_rate", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "20", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_starting_port": { 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_starting_port", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4721", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_ptrace": { 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_ptrace", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_interval": { 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_interval", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T02:51:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_memory_target_ratio": { 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.7", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_log_destination": { 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm_log_destination", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "file", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "file,syslog", 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "syslog" 2024-09-21T02:51:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "cgroups_split": { 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cgroups_split", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "config_checks_enabled": { 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_checks_enabled", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "config_dashboard": { 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_dashboard", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_alertmanager": { 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_alertmanager", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_base": { 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_base", 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Container image name, without the tag", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_elasticsearch": { 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_elasticsearch", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "elasticsearch container image", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_grafana": { 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_grafana", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_haproxy": { 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_haproxy", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "HAproxy container image", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_agent": { 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_agent", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger agent container image", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_collector": { 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_collector", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger collector container image", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_query": { 2024-09-21T02:51:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_query", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger query container image", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_keepalived": { 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_keepalived", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Keepalived container image", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_loki": { 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_loki", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Loki container image", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nginx": { 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nginx", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nginx container image", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_node_exporter": { 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_node_exporter", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T02:51:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nvmeof": { 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nvmeof", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nvme-of container image", 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_oauth2_proxy": { 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "oauth2-proxy container image", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_prometheus": { 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_prometheus", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_promtail": { 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_promtail", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Promtail container image", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba": { 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB container image", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba_metrics": { 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba_metrics", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_snmp_gateway": { 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_snmp_gateway", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SNMP Gateway container image", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "container_init": { 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_init", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "daemon_cache_timeout": { 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "daemon_cache_timeout", 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "default_cephadm_command_timeout": { 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "900", 2024-09-21T02:51:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "default_registry": { 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_registry", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "device_cache_timeout": { 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_cache_timeout", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1800", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache device inventory", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "device_enhanced_scan": { 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_enhanced_scan", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "facts_cache_timeout": { 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "facts_cache_timeout", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache host facts data", 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "grafana_dashboards_path": { 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "grafana_dashboards_path", 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T02:51:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "host_check_interval": { 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "host_check_interval", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to perform a host check", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "hw_monitoring": { 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hw_monitoring", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_list_all": { 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_list_all", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "log_refresh_metadata": { 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_refresh_metadata", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T02:51:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "*", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "max_count_per_host": { 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_count_per_host", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of daemons per service per host", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd_draining_count": { 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_osd_draining_count", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "migration_current": { 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "migration_current", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "internal - do not modify", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "root", 2024-09-21T02:51:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm-package", 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "root" 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "oob_default_addr": { 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "oob_default_addr", 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "169.254.1.1", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "prometheus_alerts_path": { 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus_alerts_path", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_insecure": { 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_insecure", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_password": { 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_password", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_url": { 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_url", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_username": { 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_username", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "secure_monitoring_stack": { 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secure_monitoring_stack", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "service_discovery_port": { 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "service_discovery_port", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8765", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "cephadm service discovery port", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_keepalive_count_max": { 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_keepalive_interval": { 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_keepalive_interval", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "use_agent": { 2024-09-21T02:51:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_agent", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "use_repo_digest": { 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_repo_digest", 2024-09-21T02:51:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_failed_host_check": { 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_failed_host_check", 2024-09-21T02:51:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_daemons": { 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_daemons", 2024-09-21T02:51:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_hosts": { 2024-09-21T02:51:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_hosts", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2024-09-21T02:51:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2024-09-21T02:51:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "[]", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "{}", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T02:51:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T02:51:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T02:51:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T02:51:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T02:51:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T02:51:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T02:51:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "cross_origin_url": { 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cross_origin_url", 2024-09-21T02:51:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2024-09-21T02:51:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2024-09-21T02:51:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "motd": { 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "motd", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "The message of the day", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect_resolve_ip_addr": { 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "sso_oauth2": { 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sso_oauth2", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-09-21T02:51:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-09-21T02:51:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "predictor_model": { 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predictor_model", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "prophetstor", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2024-09-21T02:51:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2024-09-21T02:51:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server hostname", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "5", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "password of InfluxDB server user", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server port", 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.856 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "32", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "username of InfluxDB server user", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2024-09-21T02:51:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "k8sevents", 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.874 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_event_retention_days": { 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ceph_event_retention_days", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.875 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "config_check_secs": { 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_check_secs", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "10", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.877 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.878 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.879 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.880 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T02:51:19.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.884 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.885 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.887 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.889 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.890 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.893 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T02:51:19.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mds_autoscaler", 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.895 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.896 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.897 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.898 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirroring", 2024-09-21T02:51:19.901 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.902 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.903 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.904 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.907 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "nfs", 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.908 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.909 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.910 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.911 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-09-21T02:51:19.914 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "fail_fs": { 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "fail_fs", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.916 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.917 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.919 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "rook", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "test_orchestrator" 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Orchestrator backend", 2024-09-21T02:51:19.921 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.922 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_perf_query", 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.923 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.925 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.926 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.927 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_support", 2024-09-21T02:51:19.929 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.930 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.934 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.935 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2024-09-21T02:51:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.937 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.938 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.939 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.940 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.944 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "threshold": { 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threshold", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1.0", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "scaling threshold", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_pg_recovery_event": { 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_pg_recovery_event", 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.946 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.950 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.951 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.952 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.954 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long the module is going to sleep", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.955 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.956 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cache", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "exclude_perf_counters": { 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "exclude_perf_counters", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.958 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.959 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.960 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.961 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.962 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2024-09-21T02:51:19.963 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T02:51:19.964 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:19.965 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15.0", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.966 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.967 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "9283", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.968 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "log", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.969 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "default", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.970 INFO:teuthology.orchestra.run.smithi079.stdout: "default", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "error" 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-09-21T02:51:19.971 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.974 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.975 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_snap_create": { 2024-09-21T02:51:19.977 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_snap_create", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.978 INFO:teuthology.orchestra.run.smithi079.stdout: "mirror_snapshot_schedule": { 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.979 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "trash_purge_schedule": { 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "trash_purge_schedule", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.980 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2024-09-21T02:51:19.981 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_auth": { 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_auth", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.982 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.983 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.984 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.985 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.987 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "max_requests": { 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_requests", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.990 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.991 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rgw", 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:19.992 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.993 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.994 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:19.998 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:19.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.000 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.001 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.002 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.003 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "storage_class": { 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "storage_class", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "local", 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2024-09-21T02:51:20.006 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.007 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.008 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.011 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.012 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.013 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.016 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2024-09-21T02:51:20.017 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.018 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption7": { 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption7", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "42", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.020 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.021 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.022 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.023 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smb", 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "internal_store_backend": { 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "internal_store_backend", 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.025 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.026 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.027 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.028 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.030 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.031 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "update_orchestration": { 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "update_orchestration", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:20.032 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snap_schedule", 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_m_granularity": { 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_m_granularity", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "dump_on_update": { 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dump_on_update", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "dump database to debug log on update", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.035 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.036 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.037 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.039 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.040 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stats", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.042 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.043 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.045 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.046 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.048 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.049 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.050 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.051 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.052 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.053 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.055 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.056 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.057 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.058 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.060 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.061 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.062 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2024-09-21T02:51:20.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2024-09-21T02:51:20.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2024-09-21T02:51:20.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2024-09-21T02:51:20.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_perf": { 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_perf", 2024-09-21T02:51:20.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2024-09-21T02:51:20.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.069 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.071 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.073 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.074 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard_description": { 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard_description", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.077 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.078 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.079 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.080 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.081 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.082 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.085 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.086 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.087 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.088 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.092 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.093 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.094 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.095 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.096 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.097 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "periodic_async_work": { 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "periodic_async_work", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.098 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Periodically check for async work", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_delay": { 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_delay", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T02:51:20.099 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_no_wait": { 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T02:51:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "discovery_interval": { 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "discovery_interval", 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.102 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "100", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.103 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-09-21T02:51:20.104 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.105 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-09-21T02:51:20.108 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-09-21T02:51:20.109 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-09-21T02:51:20.110 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.111 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.112 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-09-21T02:51:20.113 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "services": { 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "dashboard": "https://172.21.15.79:8443/" 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "always_on_modules": { 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "octopus": [ 2024-09-21T02:51:20.114 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "pacific": [ 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-09-21T02:51:20.115 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "quincy": [ 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-09-21T02:51:20.116 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "reef": [ 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-09-21T02:51:20.117 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "squid": [ 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:20.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "last_failure_osd_epoch": 3, 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "active_clients": [ 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3138137294 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "libcephsqlite", 2024-09-21T02:51:20.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1178365537 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3534476640 2024-09-21T02:51:20.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3355512948 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T02:51:20.121 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.682+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9580b6510 msgr2=0x7fc9580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.682+0000 7fc97a000640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9580b6510 0x7fc9580b8a20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc95c011550 tx=0x7fc95c005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.682+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc974103680 msgr2=0x7fc97419c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.682+0000 7fc97a000640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc974103680 0x7fc97419c100 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc964009ca0 tx=0x7fc964003c20 comp rx=0 tx=0).stop 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 shutdown_connections 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc9580b6510 0x7fc9580b8a20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741050a0 0x7fc97419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc974104700 0x7fc97419c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 --2- 172.21.15.79:0/3121031573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc974103680 0x7fc97419c100 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 >> 172.21.15.79:0/3121031573 conn(0x7fc9740fefe0 msgr2=0x7fc9740755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 shutdown_connections 2024-09-21T02:51:20.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:18.683+0000 7fc97a000640 1 -- 172.21.15.79:0/3121031573 wait complete. 2024-09-21T02:51:20.174 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T02:51:20.184 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T02:51:20.184 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:51:20.184 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:51:20.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:19 smithi079 ceph-mon[30788]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.3 MiB/s wr, 397 op/s 2024-09-21T02:51:20.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:19 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/682566028' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T02:51:20.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:19 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3121031573' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T02:51:20.186 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:19 smithi148 ceph-mon[34626]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.3 MiB/s wr, 397 op/s 2024-09-21T02:51:20.186 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:19 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/682566028' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T02:51:20.186 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:19 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3121031573' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T02:51:20.186 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:19 smithi098 ceph-mon[34832]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 3.3 MiB/s wr, 397 op/s 2024-09-21T02:51:20.186 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:19 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/682566028' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T02:51:20.186 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:19 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3121031573' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T02:51:20.950 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T02:51:20.950 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:51:21.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:51:21.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:21 smithi098 ceph-mon[34832]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2024-09-21T02:51:21.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:21 smithi079 ceph-mon[30788]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2024-09-21T02:51:21.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:21 smithi148 ceph-mon[34626]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2024-09-21T02:51:21.730 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:23.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:23 smithi098 ceph-mon[34832]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-09-21T02:51:23.451 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:23 smithi079 ceph-mon[30788]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-09-21T02:51:23.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:23 smithi148 ceph-mon[34626]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-09-21T02:51:23.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.762+0000 7f0c4fe00640 1 -- 172.21.15.79:0/3145689262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50077380 msgr2=0x7f0c500757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:23.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.762+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/3145689262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50077380 0x7f0c500757b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009900 tx=0x7f0c4002a410 comp rx=0 tx=0).stop 2024-09-21T02:51:23.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.763+0000 7f0c4fe00640 1 -- 172.21.15.79:0/3145689262 shutdown_connections 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.763+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/3145689262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50114280 0x7f0c50116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.763+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/3145689262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c50075dd0 0x7f0c500761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.763+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/3145689262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50077380 0x7f0c500757b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.763+0000 7f0c4fe00640 1 -- 172.21.15.79:0/3145689262 >> 172.21.15.79:0/3145689262 conn(0x7f0c500ff440 msgr2=0x7f0c50101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.763+0000 7f0c4fe00640 1 -- 172.21.15.79:0/3145689262 shutdown_connections 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.763+0000 7f0c4fe00640 1 -- 172.21.15.79:0/3145689262 wait complete. 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 Processor -- start 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 -- start start 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50075dd0 0x7f0c501a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c50077380 0x7f0c501a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50114280 0x7f0c501a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50119ec0 con 0x7f0c50075dd0 2024-09-21T02:51:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50119d40 con 0x7f0c50077380 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4fe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5011a040 con 0x7f0c50114280 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50075dd0 0x7f0c501a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50075dd0 0x7f0c501a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56748/0 (socket says 172.21.15.79:56748) 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.764+0000 7f0c4ea00640 1 -- 172.21.15.79:0/631625870 learned_addr learned my addr 172.21.15.79:0/631625870 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4e000640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c50077380 0x7f0c501a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4f400640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50114280 0x7f0c501a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4ea00640 1 -- 172.21.15.79:0/631625870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50114280 msgr2=0x7f0c501a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4ea00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50114280 0x7f0c501a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4ea00640 1 -- 172.21.15.79:0/631625870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c50077380 msgr2=0x7f0c501a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4ea00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c50077380 0x7f0c501a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4ea00640 1 -- 172.21.15.79:0/631625870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c501a6840 con 0x7f0c50075dd0 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c4ea00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50075dd0 0x7f0c501a08d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0c40005940 tx=0x7f0c400040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.765+0000 7f0c47400640 1 -- 172.21.15.79:0/631625870 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4003f030 con 0x7f0c50075dd0 2024-09-21T02:51:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.766+0000 7f0c47400640 1 -- 172.21.15.79:0/631625870 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c400044c0 con 0x7f0c50075dd0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.766+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c501a6ad0 con 0x7f0c50075dd0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.766+0000 7f0c47400640 1 -- 172.21.15.79:0/631625870 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40035070 con 0x7f0c50075dd0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.766+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501ad290 con 0x7f0c50075dd0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.767+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c500761e0 con 0x7f0c50075dd0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.769+0000 7f0c47400640 1 -- 172.21.15.79:0/631625870 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f0c40042030 con 0x7f0c50075dd0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.771+0000 7f0c47400640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0c340b6510 0x7f0c340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.771+0000 7f0c47400640 1 -- 172.21.15.79:0/631625870 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f0c40107c80 con 0x7f0c50075dd0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.771+0000 7f0c4e000640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0c340b6510 0x7f0c340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.772+0000 7f0c4e000640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0c340b6510 0x7f0c340b8a20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0c50116400 tx=0x7f0c3c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.773+0000 7f0c47400640 1 -- 172.21.15.79:0/631625870 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c400d24e0 con 0x7f0c50075dd0 2024-09-21T02:51:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.973+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c501a1a00 con 0x7f0c50075dd0 2024-09-21T02:51:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.974+0000 7f0c47400640 1 -- 172.21.15.79:0/631625870 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+591 (secure 0 0 0) 0x7f0c400c9030 con 0x7f0c50075dd0 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/4255899352 2024-09-22T02:24:29.283557+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1266728310 2024-09-22T02:24:29.283557+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/1983375903 2024-09-22T02:24:29.283557+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1676746603 2024-09-22T02:23:58.098675+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/467580513 2024-09-22T02:23:58.098675+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1861363948 2024-09-22T02:24:29.283557+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/4027877964 2024-09-22T02:23:58.098675+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/1983375903 2024-09-22T02:24:29.283557+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/4027877964 2024-09-22T02:23:58.098675+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3080648711 2024-09-22T02:23:58.098675+0000 2024-09-21T02:51:23.976 INFO:teuthology.orchestra.run.smithi079.stderr:listed 10 entries 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0c340b6510 msgr2=0x7f0c340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0c340b6510 0x7f0c340b8a20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0c50116400 tx=0x7f0c3c005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50075dd0 msgr2=0x7f0c501a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50075dd0 0x7f0c501a08d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0c40005940 tx=0x7f0c400040c0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 shutdown_connections 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f0c340b6510 0x7f0c340b8a20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c50114280 0x7f0c501a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c50077380 0x7f0c501a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 --2- 172.21.15.79:0/631625870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c50075dd0 0x7f0c501a08d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 >> 172.21.15.79:0/631625870 conn(0x7f0c500ff440 msgr2=0x7f0c50110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 shutdown_connections 2024-09-21T02:51:23.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:23.977+0000 7f0c4fe00640 1 -- 172.21.15.79:0/631625870 wait complete. 2024-09-21T02:51:24.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:24 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/631625870' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:51:24.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:24 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/631625870' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:51:24.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:24 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/631625870' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:51:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:25 smithi098 ceph-mon[34832]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 383 KiB/s wr, 50 op/s 2024-09-21T02:51:25.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:25 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:25.464 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:25 smithi148 ceph-mon[34626]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 383 KiB/s wr, 50 op/s 2024-09-21T02:51:25.464 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:25 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:25.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:25 smithi079 ceph-mon[30788]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 383 KiB/s wr, 50 op/s 2024-09-21T02:51:25.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:25 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:25.943 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T02:51:25.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:51:25.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /tmp/cephfs 2024-09-21T02:51:26.224 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.224 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.224 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.224 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.224 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:26.224 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:26.224 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:26 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:51:26.226 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T02:51:26.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:51:26.226 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-21T02:51:26.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:51:26.264 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-09-21T02:51:26.379 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-21T02:51:26.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:51:26.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-21T02:51:26.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:26.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:26.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:26 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:51:26.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:51:26.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-09-21T02:51:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:26.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:26 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' 2024-09-21T02:51:26.770 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T02:51:26.782 INFO:tasks.cephadm:Teardown begin 2024-09-21T02:51:26.782 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T02:51:26.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:51:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:27.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:27 smithi098 ceph-mon[34832]: Adjusting osd_memory_target on smithi079 to 176.4M 2024-09-21T02:51:27.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:27 smithi098 ceph-mon[34832]: Unable to set osd_memory_target on smithi079 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T02:51:27.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:27 smithi098 ceph-mon[34832]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T02:51:27.470 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:27 smithi079 ceph-mon[30788]: Adjusting osd_memory_target on smithi079 to 176.4M 2024-09-21T02:51:27.470 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:27 smithi079 ceph-mon[30788]: Unable to set osd_memory_target on smithi079 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T02:51:27.470 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:27 smithi079 ceph-mon[30788]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T02:51:27.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:27 smithi148 ceph-mon[34626]: Adjusting osd_memory_target on smithi079 to 176.4M 2024-09-21T02:51:27.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:27 smithi148 ceph-mon[34626]: Unable to set osd_memory_target on smithi079 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T02:51:27.564 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:27 smithi148 ceph-mon[34626]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T02:51:27.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 -- 172.21.15.79:0/1133648756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928110440 msgr2=0x7fc928116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 --2- 172.21.15.79:0/1133648756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928110440 0x7fc928116c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc920009ca0 tx=0x7fc92002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 -- 172.21.15.79:0/1133648756 shutdown_connections 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 --2- 172.21.15.79:0/1133648756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc928110440 0x7fc928116c70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 --2- 172.21.15.79:0/1133648756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc92810faf0 0x7fc92810ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 --2- 172.21.15.79:0/1133648756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc92810a1b0 0x7fc92810a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 -- 172.21.15.79:0/1133648756 >> 172.21.15.79:0/1133648756 conn(0x7fc9280780e0 msgr2=0x7fc9281081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.860+0000 7fc92ea00640 1 -- 172.21.15.79:0/1133648756 shutdown_connections 2024-09-21T02:51:27.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.861+0000 7fc92ea00640 1 -- 172.21.15.79:0/1133648756 wait complete. 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 Processor -- start 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 -- start start 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc92810a1b0 0x7fc9281a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92810faf0 0x7fc9281a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc928110440 0x7fc9281a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc92811a110 con 0x7fc92810faf0 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc928119f90 con 0x7fc928110440 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc92ea00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc92811a290 con 0x7fc92810a1b0 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.862+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92810faf0 0x7fc9281a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc927e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc92810a1b0 0x7fc9281a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92810faf0 0x7fc9281a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50090/0 (socket says 172.21.15.79:50090) 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc91fe00640 1 -- 172.21.15.79:0/47605348 learned_addr learned my addr 172.21.15.79:0/47605348 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc92ca00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc928110440 0x7fc9281a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc927e00640 1 -- 172.21.15.79:0/47605348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc928110440 msgr2=0x7fc9281a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc927e00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc928110440 0x7fc9281a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc927e00640 1 -- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92810faf0 msgr2=0x7fc9281a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc927e00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92810faf0 0x7fc9281a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc927e00640 1 -- 172.21.15.79:0/47605348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9281a69f0 con 0x7fc92810a1b0 2024-09-21T02:51:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.863+0000 7fc927e00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc92810a1b0 0x7fc9281a0a80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc91800e9f0 tx=0x7fc91800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:27.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.864+0000 7fc925600640 1 -- 172.21.15.79:0/47605348 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91800ccc0 con 0x7fc92810a1b0 2024-09-21T02:51:27.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.864+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9281a6ce0 con 0x7fc92810a1b0 2024-09-21T02:51:27.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.864+0000 7fc925600640 1 -- 172.21.15.79:0/47605348 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9180108e0 con 0x7fc92810a1b0 2024-09-21T02:51:27.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.864+0000 7fc925600640 1 -- 172.21.15.79:0/47605348 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918018880 con 0x7fc92810a1b0 2024-09-21T02:51:27.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.864+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9281ad440 con 0x7fc92810a1b0 2024-09-21T02:51:27.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.865+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92810a5c0 con 0x7fc92810a1b0 2024-09-21T02:51:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.867+0000 7fc925600640 1 -- 172.21.15.79:0/47605348 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc918010430 con 0x7fc92810a1b0 2024-09-21T02:51:27.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.869+0000 7fc925600640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc90c0b6510 0x7fc90c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.869+0000 7fc925600640 1 -- 172.21.15.79:0/47605348 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fc9180e7ed0 con 0x7fc92810a1b0 2024-09-21T02:51:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.869+0000 7fc91fe00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc90c0b6510 0x7fc90c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.870+0000 7fc91fe00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc90c0b6510 0x7fc90c0b8a20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc92806b040 tx=0x7fc910005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:27.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:27.871+0000 7fc925600640 1 -- 172.21.15.79:0/47605348 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9180b2730 con 0x7fc92810a1b0 2024-09-21T02:51:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.097+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9281a1bb0 con 0x7fc92810a1b0 2024-09-21T02:51:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.098+0000 7fc925600640 1 -- 172.21.15.79:0/47605348 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7fc9180b7670 con 0x7fc92810a1b0 2024-09-21T02:51:28.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:28.101 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:51:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc90c0b6510 msgr2=0x7fc90c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc90c0b6510 0x7fc90c0b8a20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc92806b040 tx=0x7fc910005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc92810a1b0 msgr2=0x7fc9281a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc92810a1b0 0x7fc9281a0a80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc91800e9f0 tx=0x7fc91800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 shutdown_connections 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fc90c0b6510 0x7fc90c0b8a20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc928110440 0x7fc9281a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc92810faf0 0x7fc9281a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 --2- 172.21.15.79:0/47605348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc92810a1b0 0x7fc9281a0a80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 >> 172.21.15.79:0/47605348 conn(0x7fc9280780e0 msgr2=0x7fc928078760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 shutdown_connections 2024-09-21T02:51:28.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:28.101+0000 7fc92ea00640 1 -- 172.21.15.79:0/47605348 wait complete. 2024-09-21T02:51:28.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:28 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/47605348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:28.478 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:28 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/47605348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:28.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:28 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/47605348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:28.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:51:29.267 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:29.405 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:29 smithi079 ceph-mon[30788]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.3 KiB/s wr, 3 op/s 2024-09-21T02:51:29.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:29 smithi098 ceph-mon[34832]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.3 KiB/s wr, 3 op/s 2024-09-21T02:51:29.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:29 smithi148 ceph-mon[34626]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.3 KiB/s wr, 3 op/s 2024-09-21T02:51:29.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 -- 172.21.15.79:0/2011317800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c105bb0 msgr2=0x7f2a9c105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:29.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 --2- 172.21.15.79:0/2011317800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c105bb0 0x7f2a9c105fc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009900 tx=0x7f2a8c02a410 comp rx=0 tx=0).stop 2024-09-21T02:51:29.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 -- 172.21.15.79:0/2011317800 shutdown_connections 2024-09-21T02:51:29.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 --2- 172.21.15.79:0/2011317800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a9c10be40 0x7f2a9c112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:29.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 --2- 172.21.15.79:0/2011317800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 0x7f2a9c10b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:29.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 --2- 172.21.15.79:0/2011317800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c105bb0 0x7f2a9c105fc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:29.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 -- 172.21.15.79:0/2011317800 >> 172.21.15.79:0/2011317800 conn(0x7f2a9c101680 msgr2=0x7f2a9c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:29.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.887+0000 7f2a9b200640 1 -- 172.21.15.79:0/2011317800 shutdown_connections 2024-09-21T02:51:29.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.888+0000 7f2a9b200640 1 -- 172.21.15.79:0/2011317800 wait complete. 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 Processor -- start 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 -- start start 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a9c105bb0 0x7f2a9c19c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 0x7f2a9c19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c10be40 0x7f2a9c1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c115b00 con 0x7f2a9c10be40 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c115980 con 0x7f2a9c10b4f0 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9b200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c115c80 con 0x7f2a9c105bb0 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.889+0000 7f2a9a800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c10be40 0x7f2a9c1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a99400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 0x7f2a9c19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a99400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 0x7f2a9c19cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59334/0 (socket says 172.21.15.79:59334) 2024-09-21T02:51:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a9a800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c10be40 0x7f2a9c1a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50104/0 (socket says 172.21.15.79:50104) 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a99400640 1 -- 172.21.15.79:0/4281968277 learned_addr learned my addr 172.21.15.79:0/4281968277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a99e00640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a9c105bb0 0x7f2a9c19c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a9a800640 1 -- 172.21.15.79:0/4281968277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a9c105bb0 msgr2=0x7f2a9c19c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a9a800640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a9c105bb0 0x7f2a9c19c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a9a800640 1 -- 172.21.15.79:0/4281968277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 msgr2=0x7f2a9c19cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a9a800640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 0x7f2a9c19cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a9a800640 1 -- 172.21.15.79:0/4281968277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c1a2480 con 0x7f2a9c10be40 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a99400640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 0x7f2a9c19cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.890+0000 7f2a9a800640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c10be40 0x7f2a9c1a1d50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009fd0 tx=0x7f2a9400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.891+0000 7f2a92a00640 1 -- 172.21.15.79:0/4281968277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400ce20 con 0x7f2a9c10be40 2024-09-21T02:51:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.891+0000 7f2a92a00640 1 -- 172.21.15.79:0/4281968277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a94005020 con 0x7f2a9c10be40 2024-09-21T02:51:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.891+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c1a2770 con 0x7f2a9c10be40 2024-09-21T02:51:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.891+0000 7f2a92a00640 1 -- 172.21.15.79:0/4281968277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94010690 con 0x7f2a9c10be40 2024-09-21T02:51:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.891+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c1a8ed0 con 0x7f2a9c10be40 2024-09-21T02:51:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.892+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c105fc0 con 0x7f2a9c10be40 2024-09-21T02:51:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.894+0000 7f2a92a00640 1 -- 172.21.15.79:0/4281968277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2a940054d0 con 0x7f2a9c10be40 2024-09-21T02:51:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.896+0000 7f2a92a00640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2a800b6590 0x7f2a800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.896+0000 7f2a92a00640 1 -- 172.21.15.79:0/4281968277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f2a940e7d70 con 0x7f2a9c10be40 2024-09-21T02:51:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.896+0000 7f2a99e00640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2a800b6590 0x7f2a800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:29.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.897+0000 7f2a99e00640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2a800b6590 0x7f2a800b8aa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c031440 tx=0x7f2a8c009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:29.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:29.900+0000 7f2a92a00640 1 -- 172.21.15.79:0/4281968277 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a940ae1f0 con 0x7f2a9c10be40 2024-09-21T02:51:30.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.125+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a9c02e640 con 0x7f2a9c10be40 2024-09-21T02:51:30.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.126+0000 7f2a92a00640 1 -- 172.21.15.79:0/4281968277 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11843 (secure 0 0 0) 0x7f2a940b25d0 con 0x7f2a9c10be40 2024-09-21T02:51:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:30.127 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-21T02:33:34:644799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/209829654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":209829654},{"type":"v1","addr":"172.21.15.79:6835","nonce":209829654}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/3299395115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":3299395115},{"type":"v1","addr":"172.21.15.79:6839","nonce":3299395115}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/1013037631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":1013037631},{"type":"v1","addr":"172.21.15.79:6841","nonce":1013037631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4025923803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4025923803},{"type":"v1","addr":"172.21.15.148:6833","nonce":4025923803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24614,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/2247079967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2247079967},{"type":"v1","addr":"172.21.15.98:6833","nonce":2247079967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/4018398914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":4018398914},{"type":"v1","addr":"172.21.15.79:6837","nonce":4018398914}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1431054933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1431054933},{"type":"v1","addr":"172.21.15.148:6835","nonce":1431054933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/265425700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":265425700},{"type":"v1","addr":"172.21.15.98:6835","nonce":265425700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/4145654738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":4145654738},{"type":"v1","addr":"172.21.15.148:6837","nonce":4145654738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/566296306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":566296306},{"type":"v1","addr":"172.21.15.148:6839","nonce":566296306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:32:42.479233+0000","modified":"2024-09-21T02:33:34.630634+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24668":{"gid":24668,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/2031151027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2031151027},{"type":"v1","addr":"172.21.15.98:6837","nonce":2031151027}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.98:6839/413408652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":413408652},{"type":"v1","addr":"172.21.15.98:6839","nonce":413408652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:51:30.128 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-21T02:51:30.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2a800b6590 msgr2=0x7f2a800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:30.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2a800b6590 0x7f2a800b8aa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c031440 tx=0x7f2a8c009560 comp rx=0 tx=0).stop 2024-09-21T02:51:30.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c10be40 msgr2=0x7f2a9c1a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:30.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c10be40 0x7f2a9c1a1d50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009fd0 tx=0x7f2a9400ef10 comp rx=0 tx=0).stop 2024-09-21T02:51:30.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 shutdown_connections 2024-09-21T02:51:30.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2a800b6590 0x7f2a800b8aa0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:30.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a9c10be40 0x7f2a9c1a1d50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a9c10b4f0 0x7f2a9c19cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 --2- 172.21.15.79:0/4281968277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a9c105bb0 0x7f2a9c19c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.128+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 >> 172.21.15.79:0/4281968277 conn(0x7f2a9c101680 msgr2=0x7f2a9c103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.129+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 shutdown_connections 2024-09-21T02:51:30.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:30.129+0000 7f2a9b200640 1 -- 172.21.15.79:0/4281968277 wait complete. 2024-09-21T02:51:30.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:30 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4281968277' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:30.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:30 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4281968277' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:30.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:30 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4281968277' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:51:30.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:51:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:31.432 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:31 smithi079 ceph-mon[30788]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 4 op/s 2024-09-21T02:51:31.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:31 smithi148 ceph-mon[34626]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 4 op/s 2024-09-21T02:51:31.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:31 smithi098 ceph-mon[34832]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 4 op/s 2024-09-21T02:51:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 -- 172.21.15.79:0/815519811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 msgr2=0x7efc04112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 --2- 172.21.15.79:0/815519811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 0x7efc04112870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efc00009ca0 tx=0x7efc0002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:51:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 -- 172.21.15.79:0/815519811 shutdown_connections 2024-09-21T02:51:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 --2- 172.21.15.79:0/815519811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 0x7efc04112870 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 --2- 172.21.15.79:0/815519811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc0410b6f0 0x7efc0410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 --2- 172.21.15.79:0/815519811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc04105db0 0x7efc041061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 -- 172.21.15.79:0/815519811 >> 172.21.15.79:0/815519811 conn(0x7efc041017e0 msgr2=0x7efc04103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 -- 172.21.15.79:0/815519811 shutdown_connections 2024-09-21T02:51:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.986+0000 7efc0c800640 1 -- 172.21.15.79:0/815519811 wait complete. 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.987+0000 7efc0c800640 1 Processor -- start 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.987+0000 7efc0c800640 1 -- start start 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc0c800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc04105db0 0x7efc0419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc0c800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc0410b6f0 0x7efc0419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc0c800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 0x7efc041a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc0c800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc04115d00 con 0x7efc0410c040 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc0c800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc04115b80 con 0x7efc0410b6f0 2024-09-21T02:51:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc0c800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc04115e80 con 0x7efc04105db0 2024-09-21T02:51:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc09e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc04105db0 0x7efc0419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc0a800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 0x7efc041a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc09e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc04105db0 0x7efc0419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.79:45750/0 (socket says 172.21.15.79:45750) 2024-09-21T02:51:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc09e00640 1 -- 172.21.15.79:0/4227564425 learned_addr learned my addr 172.21.15.79:0/4227564425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.988+0000 7efc09400640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc0410b6f0 0x7efc0419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc09400640 1 -- 172.21.15.79:0/4227564425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc04105db0 msgr2=0x7efc0419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc09400640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc04105db0 0x7efc0419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc09400640 1 -- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 msgr2=0x7efc041a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc09400640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 0x7efc041a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc09400640 1 -- 172.21.15.79:0/4227564425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc041a2600 con 0x7efc0410b6f0 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc0a800640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 0x7efc041a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc09400640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc0410b6f0 0x7efc0419cc30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efc0406ca20 tx=0x7efbf400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efbfea00640 1 -- 172.21.15.79:0/4227564425 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400cc40 con 0x7efc0410b6f0 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc041a28f0 con 0x7efc0410b6f0 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efbfea00640 1 -- 172.21.15.79:0/4227564425 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbf400cde0 con 0x7efc0410b6f0 2024-09-21T02:51:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.989+0000 7efbfea00640 1 -- 172.21.15.79:0/4227564425 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4004a00 con 0x7efc0410b6f0 2024-09-21T02:51:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.990+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc041a9050 con 0x7efc0410b6f0 2024-09-21T02:51:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.991+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc041061c0 con 0x7efc0410b6f0 2024-09-21T02:51:31.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.994+0000 7efbfea00640 1 -- 172.21.15.79:0/4227564425 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7efbf4004ba0 con 0x7efc0410b6f0 2024-09-21T02:51:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.995+0000 7efbfea00640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efbec0b6510 0x7efbec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.996+0000 7efbfea00640 1 -- 172.21.15.79:0/4227564425 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7efbf40e76d0 con 0x7efc0410b6f0 2024-09-21T02:51:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.996+0000 7efc09e00640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efbec0b6510 0x7efbec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:31.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.997+0000 7efbfea00640 1 -- 172.21.15.79:0/4227564425 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efbf40adbe0 con 0x7efc0410b6f0 2024-09-21T02:51:31.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:31.997+0000 7efc09e00640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efbec0b6510 0x7efbec0b8a20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009c90 tx=0x7efbf8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:32.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.186+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc0419d7c0 con 0x7efc0410b6f0 2024-09-21T02:51:32.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.188+0000 7efbfea00640 1 -- 172.21.15.79:0/4227564425 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24834 (secure 0 0 0) 0x7efbf40b1fc0 con 0x7efc0410b6f0 2024-09-21T02:51:32.190 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T02:51:32.190 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"fsid":"56d10306-77c0-11ef-baf5-efdc52797490","created":"2024-09-21T02:23:32.342666+0000","modified":"2024-09-21T02:34:31.402384+0000","last_up_change":"2024-09-21T02:31:45.190143+0000","last_in_change":"2024-09-21T02:31:21.157977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:27:31.612693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:32:37.014569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:32:39.466025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:32:48.676381+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c4c62-2d11-4950-ae9e-2eae3c70d216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6803","nonce":3943221665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6805","nonce":3943221665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6809","nonce":3943221665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3943221665},{"type":"v1","addr":"172.21.15.79:6807","nonce":3943221665}]},"public_addr":"172.21.15.79:6803/3943221665","cluster_addr":"172.21.15.79:6805/3943221665","heartbeat_back_addr":"172.21.15.79:6809/3943221665","heartbeat_front_addr":"172.21.15.79:6807/3943221665","state":["exists","up"]},{"osd":1,"uuid":"d15ddd7c-8be1-4eec-904a-88fb150baae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6801","nonce":1838130596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6803","nonce":1838130596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6807","nonce":1838130596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1838130596},{"type":"v1","addr":"172.21.15.98:6805","nonce":1838130596}]},"public_addr":"172.21.15.98:6801/1838130596","cluster_addr":"172.21.15.98:6803/1838130596","heartbeat_back_addr":"172.21.15.98:6807/1838130596","heartbeat_front_addr":"172.21.15.98:6805/1838130596","state":["exists","up"]},{"osd":2,"uuid":"152e63e3-25e3-4219-bea1-94fdb639be4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6801","nonce":1764684633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6803","nonce":1764684633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6807","nonce":1764684633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":1764684633},{"type":"v1","addr":"172.21.15.148:6805","nonce":1764684633}]},"public_addr":"172.21.15.148:6801/1764684633","cluster_addr":"172.21.15.148:6803/1764684633","heartbeat_back_addr":"172.21.15.148:6807/1764684633","heartbeat_front_addr":"172.21.15.148:6805/1764684633","state":["exists","up"]},{"osd":3,"uuid":"37557004-b63b-4a46-8eb8-4925af257828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6811","nonce":748592463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6813","nonce":748592463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6817","nonce":748592463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":748592463},{"type":"v1","addr":"172.21.15.79:6815","nonce":748592463}]},"public_addr":"172.21.15.79:6811/748592463","cluster_addr":"172.21.15.79:6813/748592463","heartbeat_back_addr":"172.21.15.79:6817/748592463","heartbeat_front_addr":"172.21.15.79:6815/748592463","state":["exists","up"]},{"osd":4,"uuid":"cf8be53e-2fbd-4ba9-8186-73a91f978b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6809","nonce":1179399736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6811","nonce":1179399736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6815","nonce":1179399736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1179399736},{"type":"v1","addr":"172.21.15.98:6813","nonce":1179399736}]},"public_addr":"172.21.15.98:6809/1179399736","cluster_addr":"172.21.15.98:6811/1179399736","heartbeat_back_addr":"172.21.15.98:6815/1179399736","heartbeat_front_addr":"172.21.15.98:6813/1179399736","state":["exists","up"]},{"osd":5,"uuid":"446809f9-3274-40e0-a46d-0537ad693e9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6809","nonce":517086756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6811","nonce":517086756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6815","nonce":517086756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":517086756},{"type":"v1","addr":"172.21.15.148:6813","nonce":517086756}]},"public_addr":"172.21.15.148:6809/517086756","cluster_addr":"172.21.15.148:6811/517086756","heartbeat_back_addr":"172.21.15.148:6815/517086756","heartbeat_front_addr":"172.21.15.148:6813/517086756","state":["exists","up"]},{"osd":6,"uuid":"6873243a-bb31-4cea-a715-e58b6a9a0141","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6819","nonce":1578312751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6821","nonce":1578312751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6825","nonce":1578312751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1578312751},{"type":"v1","addr":"172.21.15.79:6823","nonce":1578312751}]},"public_addr":"172.21.15.79:6819/1578312751","cluster_addr":"172.21.15.79:6821/1578312751","heartbeat_back_addr":"172.21.15.79:6825/1578312751","heartbeat_front_addr":"172.21.15.79:6823/1578312751","state":["exists","up"]},{"osd":7,"uuid":"0ed3149d-a298-4054-98cd-4eead484fcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6817","nonce":3242795120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6819","nonce":3242795120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6823","nonce":3242795120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3242795120},{"type":"v1","addr":"172.21.15.98:6821","nonce":3242795120}]},"public_addr":"172.21.15.98:6817/3242795120","cluster_addr":"172.21.15.98:6819/3242795120","heartbeat_back_addr":"172.21.15.98:6823/3242795120","heartbeat_front_addr":"172.21.15.98:6821/3242795120","state":["exists","up"]},{"osd":8,"uuid":"a779fd91-38a2-419c-922e-2103f448b87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6817","nonce":2813432297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6819","nonce":2813432297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6823","nonce":2813432297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2813432297},{"type":"v1","addr":"172.21.15.148:6821","nonce":2813432297}]},"public_addr":"172.21.15.148:6817/2813432297","cluster_addr":"172.21.15.148:6819/2813432297","heartbeat_back_addr":"172.21.15.148:6823/2813432297","heartbeat_front_addr":"172.21.15.148:6821/2813432297","state":["exists","up"]},{"osd":9,"uuid":"23af2a6a-e9f6-46b4-97ce-cb34126eae65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6827","nonce":89755781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6829","nonce":89755781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6833","nonce":89755781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":89755781},{"type":"v1","addr":"172.21.15.79:6831","nonce":89755781}]},"public_addr":"172.21.15.79:6827/89755781","cluster_addr":"172.21.15.79:6829/89755781","heartbeat_back_addr":"172.21.15.79:6833/89755781","heartbeat_front_addr":"172.21.15.79:6831/89755781","state":["exists","up"]},{"osd":10,"uuid":"c22ae343-edd0-4ed8-861d-f2ca54d92b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6825","nonce":3998530479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6827","nonce":3998530479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6831","nonce":3998530479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3998530479},{"type":"v1","addr":"172.21.15.98:6829","nonce":3998530479}]},"public_addr":"172.21.15.98:6825/3998530479","cluster_addr":"172.21.15.98:6827/3998530479","heartbeat_back_addr":"172.21.15.98:6831/3998530479","heartbeat_front_addr":"172.21.15.98:6829/3998530479","state":["exists","up"]},{"osd":11,"uuid":"a9592a1c-5ad9-4b3a-8161-c213cf18a3cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6825","nonce":2210220942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6827","nonce":2210220942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6831","nonce":2210220942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2210220942},{"type":"v1","addr":"172.21.15.148:6829","nonce":2210220942}]},"public_addr":"172.21.15.148:6825/2210220942","cluster_addr":"172.21.15.148:6827/2210220942","heartbeat_back_addr":"172.21.15.148:6831/2210220942","heartbeat_front_addr":"172.21.15.148:6829/2210220942","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:26:38.117392+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:06.144650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:27:30.057583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:00.956187+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:27.832882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:28:54.401417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:24.721089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:29:52.856897+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:18.957030+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:30:50.040697+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:17.298997+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:31:42.484983+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.8","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/4255899352":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1266728310":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:0/1676746603":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/467580513":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/1861363948":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6801/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:6801/1983375903":"2024-09-22T02:24:29.283557+0000","172.21.15.79:6800/4027877964":"2024-09-22T02:23:58.098675+0000","172.21.15.79:0/3080648711":"2024-09-22T02:23:58.098675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:51:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efbec0b6510 msgr2=0x7efbec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efbec0b6510 0x7efbec0b8a20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009c90 tx=0x7efbf8005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc0410b6f0 msgr2=0x7efc0419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc0410b6f0 0x7efc0419cc30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efc0406ca20 tx=0x7efbf400ee50 comp rx=0 tx=0).stop 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 shutdown_connections 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7efbec0b6510 0x7efbec0b8a20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0410c040 0x7efc041a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc0410b6f0 0x7efc0419cc30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 --2- 172.21.15.79:0/4227564425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc04105db0 0x7efc0419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 >> 172.21.15.79:0/4227564425 conn(0x7efc041017e0 msgr2=0x7efc0410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 shutdown_connections 2024-09-21T02:51:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:32.191+0000 7efc0c800640 1 -- 172.21.15.79:0/4227564425 wait complete. 2024-09-21T02:51:32.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T02:51:33.295 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:33.434 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:33 smithi079 ceph-mon[30788]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:33.434 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:33 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/4227564425' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:51:33.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:33 smithi148 ceph-mon[34626]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:33.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:33 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/4227564425' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:51:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:33 smithi098 ceph-mon[34832]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:33.655 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:33 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/4227564425' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:51:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 -- 172.21.15.79:0/1932796597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010c010 msgr2=0x7fcec0112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 --2- 172.21.15.79:0/1932796597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010c010 0x7fcec0112840 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009ca0 tx=0x7fceb802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:51:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 -- 172.21.15.79:0/1932796597 shutdown_connections 2024-09-21T02:51:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 --2- 172.21.15.79:0/1932796597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010c010 0x7fcec0112840 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 --2- 172.21.15.79:0/1932796597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec010b6c0 0x7fcec010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 --2- 172.21.15.79:0/1932796597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcec0105d80 0x7fcec0106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 -- 172.21.15.79:0/1932796597 >> 172.21.15.79:0/1932796597 conn(0x7fcec0101810 msgr2=0x7fcec0103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 -- 172.21.15.79:0/1932796597 shutdown_connections 2024-09-21T02:51:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.978+0000 7fcec5800640 1 -- 172.21.15.79:0/1932796597 wait complete. 2024-09-21T02:51:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.979+0000 7fcec5800640 1 Processor -- start 2024-09-21T02:51:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.979+0000 7fcec5800640 1 -- start start 2024-09-21T02:51:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcec5800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec0105d80 0x7fcec019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcec5800640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010b6c0 0x7fcec019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcec5800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcec010c010 0x7fcec01a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcec5800640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0115cd0 con 0x7fcec010b6c0 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcec5800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0115b50 con 0x7fcec0105d80 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcec5800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0115e50 con 0x7fcec010c010 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcebe000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010b6c0 0x7fcec019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcebe000640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010b6c0 0x7fcec019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36416/0 (socket says 172.21.15.79:36416) 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcebea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec0105d80 0x7fcec019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcebe000640 1 -- 172.21.15.79:0/219022402 learned_addr learned my addr 172.21.15.79:0/219022402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.980+0000 7fcebf400640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcec010c010 0x7fcec01a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcebe000640 1 -- 172.21.15.79:0/219022402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcec010c010 msgr2=0x7fcec01a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcebe000640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcec010c010 0x7fcec01a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcebe000640 1 -- 172.21.15.79:0/219022402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec0105d80 msgr2=0x7fcec019c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcebe000640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec0105d80 0x7fcec019c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcebe000640 1 -- 172.21.15.79:0/219022402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec01a2650 con 0x7fcec010b6c0 2024-09-21T02:51:33.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcebea00640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec0105d80 0x7fcec019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:33.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcebe000640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010b6c0 0x7fcec019cc80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fceac00d950 tx=0x7fceac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:33.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fceb7400640 1 -- 172.21.15.79:0/219022402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac017070 con 0x7fcec010b6c0 2024-09-21T02:51:33.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec01a2940 con 0x7fcec010b6c0 2024-09-21T02:51:33.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fceb7400640 1 -- 172.21.15.79:0/219022402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceac009c30 con 0x7fcec010b6c0 2024-09-21T02:51:33.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fceb7400640 1 -- 172.21.15.79:0/219022402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0047a0 con 0x7fcec010b6c0 2024-09-21T02:51:33.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.981+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01a90a0 con 0x7fcec010b6c0 2024-09-21T02:51:33.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.982+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec0106190 con 0x7fcec010b6c0 2024-09-21T02:51:33.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.985+0000 7fceb7400640 1 -- 172.21.15.79:0/219022402 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fceac004020 con 0x7fcec010b6c0 2024-09-21T02:51:33.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.987+0000 7fceb7400640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcea40b6510 0x7fcea40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:33.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.987+0000 7fceb7400640 1 -- 172.21.15.79:0/219022402 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7fceac0e76a0 con 0x7fcec010b6c0 2024-09-21T02:51:33.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.987+0000 7fcebea00640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcea40b6510 0x7fcea40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:33.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.988+0000 7fcebea00640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcea40b6510 0x7fcea40b8a20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009fc0 tx=0x7fceb0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:33.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:33.988+0000 7fceb7400640 1 -- 172.21.15.79:0/219022402 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fceac020020 con 0x7fcec010b6c0 2024-09-21T02:51:34.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.211+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcec010de30 con 0x7fcec010b6c0 2024-09-21T02:51:34.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.214+0000 7fceb7400640 1 -- 172.21.15.79:0/219022402 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7fceac0adb20 con 0x7fcec010b6c0 2024-09-21T02:51:34.216 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcea40b6510 msgr2=0x7fcea40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcea40b6510 0x7fcea40b8a20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009fc0 tx=0x7fceb0005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010b6c0 msgr2=0x7fcec019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010b6c0 0x7fcec019cc80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fceac00d950 tx=0x7fceac00de10 comp rx=0 tx=0).stop 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 shutdown_connections 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fcea40b6510 0x7fcea40b8a20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcec010c010 0x7fcec01a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcec010b6c0 0x7fcec019cc80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 --2- 172.21.15.79:0/219022402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec0105d80 0x7fcec019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:34.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 >> 172.21.15.79:0/219022402 conn(0x7fcec0101810 msgr2=0x7fcec0108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:34.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 shutdown_connections 2024-09-21T02:51:34.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:34.218+0000 7fcec5800640 1 -- 172.21.15.79:0/219022402 wait complete. 2024-09-21T02:51:34.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:34 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a[30784]: 2024-09-21T02:51:34.212+0000 7ff597a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b[63207]: ignoring --setuser ceph since I am not root 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b[63207]: ignoring --setgroup ceph since I am not root 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mds[63211]: -- 172.21.15.98:0/3164525123 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55652263bc20 con 0x5565267e3600 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b[63207]: starting mds.b at 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: ignoring --setuser ceph since I am not root 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: ignoring --setgroup ceph since I am not root 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mds[62930]: -- 172.21.15.98:0/2580027878 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557612c15860 con 0x557616dbd180 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: starting mds.h at 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: 2024-09-21T02:51:34.320+0000 7f502d45f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6836/0: (98) Address already in use 2024-09-21T02:51:34.656 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: 2024-09-21T02:51:34.321+0000 7f502d45f640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6838/0: (98) Address already in use 2024-09-21T02:51:34.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:34 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/219022402' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T02:51:34.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:34 smithi079 ceph-mon[30788]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T02:51:34.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:34 smithi079 ceph-mon[30788]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:51:34.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:34 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/219022402' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T02:51:34.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:34 smithi079 ceph-mon[30788]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T02:51:34.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:34 smithi079 ceph-mon[30788]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T02:51:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:34 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/219022402' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T02:51:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:34 smithi148 ceph-mon[34626]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T02:51:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:34 smithi148 ceph-mon[34626]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:51:35.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:34 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/219022402' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T02:51:35.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:34 smithi148 ceph-mon[34626]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T02:51:35.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:34 smithi148 ceph-mon[34626]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T02:51:35.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/219022402' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T02:51:35.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mon[34832]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T02:51:35.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mon[34832]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:51:35.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/219022402' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T02:51:35.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mon[34832]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T02:51:35.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:34 smithi098 ceph-mon[34832]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T02:51:35.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T02:51:35.615 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:35.999 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:35 smithi079 ceph-mon[30788]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:35.999 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:35 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.98:6837/1062415882,v1:172.21.15.98:6839/1062415882] up:boot 2024-09-21T02:51:35.999 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:35 smithi079 ceph-mon[30788]: mds.? [v2:172.21.15.98:6836/1390455961,v1:172.21.15.98:6838/1390455961] up:boot 2024-09-21T02:51:35.999 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:35 smithi079 ceph-mon[30788]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T02:51:35.999 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:51:35.999 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:35 smithi079 ceph-mon[30788]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:51:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:35 smithi148 ceph-mon[34626]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:35 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.98:6837/1062415882,v1:172.21.15.98:6839/1062415882] up:boot 2024-09-21T02:51:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:35 smithi148 ceph-mon[34626]: mds.? [v2:172.21.15.98:6836/1390455961,v1:172.21.15.98:6838/1390455961] up:boot 2024-09-21T02:51:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:35 smithi148 ceph-mon[34626]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T02:51:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:51:36.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:35 smithi148 ceph-mon[34626]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:51:36.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:35 smithi098 ceph-mon[34832]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:36.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:35 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.98:6837/1062415882,v1:172.21.15.98:6839/1062415882] up:boot 2024-09-21T02:51:36.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:35 smithi098 ceph-mon[34832]: mds.? [v2:172.21.15.98:6836/1390455961,v1:172.21.15.98:6838/1390455961] up:boot 2024-09-21T02:51:36.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:35 smithi098 ceph-mon[34832]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T02:51:36.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:51:36.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:35 smithi098 ceph-mon[34832]: from='mgr.14152 172.21.15.79:0/1836363896' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 -- 172.21.15.79:0/1426800371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c30105d80 msgr2=0x7f4c30106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 --2- 172.21.15.79:0/1426800371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c30105d80 0x7f4c30106190 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009900 tx=0x7f4c2002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 -- 172.21.15.79:0/1426800371 shutdown_connections 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 --2- 172.21.15.79:0/1426800371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3010c010 0x7f4c30112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 --2- 172.21.15.79:0/1426800371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c3010b6c0 0x7f4c3010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 --2- 172.21.15.79:0/1426800371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c30105d80 0x7f4c30106190 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 -- 172.21.15.79:0/1426800371 >> 172.21.15.79:0/1426800371 conn(0x7f4c30101810 msgr2=0x7f4c30103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 -- 172.21.15.79:0/1426800371 shutdown_connections 2024-09-21T02:51:36.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.323+0000 7f4c36400640 1 -- 172.21.15.79:0/1426800371 wait complete. 2024-09-21T02:51:36.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.324+0000 7f4c36400640 1 Processor -- start 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.324+0000 7f4c36400640 1 -- start start 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c36400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c30105d80 0x7f4c3019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c36400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3010b6c0 0x7f4c3019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c36400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c3010c010 0x7f4c301a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c36400640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30115cd0 con 0x7f4c3010c010 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c36400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30115b50 con 0x7f4c30105d80 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c36400640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30115e50 con 0x7f4c3010b6c0 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c30105d80 0x7f4c3019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c3010c010 0x7f4c301a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c3010c010 0x7f4c301a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36438/0 (socket says 172.21.15.79:36438) 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c26a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3010b6c0 0x7f4c3019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:36.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2fe00640 1 -- 172.21.15.79:0/1081936643 learned_addr learned my addr 172.21.15.79:0/1081936643 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c30105d80 0x7f4c3019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.79:59136/0 (socket says 172.21.15.79:59136) 2024-09-21T02:51:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2f400640 1 -- 172.21.15.79:0/1081936643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3010b6c0 msgr2=0x7f4c3019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2f400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3010b6c0 0x7f4c3019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2f400640 1 -- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c3010c010 msgr2=0x7f4c301a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2f400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c3010c010 0x7f4c301a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.325+0000 7f4c2f400640 1 -- 172.21.15.79:0/1081936643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c301a2630 con 0x7f4c30105d80 2024-09-21T02:51:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.326+0000 7f4c2f400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c30105d80 0x7f4c3019c6c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4c2002a910 tx=0x7f4c20031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.326+0000 7f4c2cc00640 1 -- 172.21.15.79:0/1081936643 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2003f030 con 0x7f4c30105d80 2024-09-21T02:51:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.326+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c301a28c0 con 0x7f4c30105d80 2024-09-21T02:51:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.326+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c301a9080 con 0x7f4c30105d80 2024-09-21T02:51:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.326+0000 7f4c2cc00640 1 -- 172.21.15.79:0/1081936643 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c20004490 con 0x7f4c30105d80 2024-09-21T02:51:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.326+0000 7f4c2cc00640 1 -- 172.21.15.79:0/1081936643 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20049060 con 0x7f4c30105d80 2024-09-21T02:51:36.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.328+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c0052c0 con 0x7f4c30105d80 2024-09-21T02:51:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.330+0000 7f4c2cc00640 1 -- 172.21.15.79:0/1081936643 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4c20042030 con 0x7f4c30105d80 2024-09-21T02:51:36.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.331+0000 7f4c2cc00640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c140b6590 0x7f4c140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:36.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.332+0000 7f4c2cc00640 1 -- 172.21.15.79:0/1081936643 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9265+0+0 (secure 0 0 0) 0x7f4c20107330 con 0x7f4c30105d80 2024-09-21T02:51:36.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.332+0000 7f4c26a00640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c140b6590 0x7f4c140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:36.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.332+0000 7f4c26a00640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c140b6590 0x7f4c140b8aa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c3010b1c0 tx=0x7f4c18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:36.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.334+0000 7f4c2cc00640 1 -- 172.21.15.79:0/1081936643 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c200d1b30 con 0x7f4c30105d80 2024-09-21T02:51:36.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.558+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4c0c005880 con 0x7f4c30105d80 2024-09-21T02:51:36.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.751+0000 7f4c2cc00640 1 -- 172.21.15.79:0/1081936643 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f4c200d6a70 con 0x7f4c30105d80 2024-09-21T02:51:36.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c140b6590 msgr2=0x7f4c140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c140b6590 0x7f4c140b8aa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c3010b1c0 tx=0x7f4c18005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c30105d80 msgr2=0x7f4c3019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c30105d80 0x7f4c3019c6c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4c2002a910 tx=0x7f4c20031a20 comp rx=0 tx=0).stop 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 shutdown_connections 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f4c140b6590 0x7f4c140b8aa0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c3010c010 0x7f4c301a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3010b6c0 0x7f4c3019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 --2- 172.21.15.79:0/1081936643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c30105d80 0x7f4c3019c6c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 >> 172.21.15.79:0/1081936643 conn(0x7f4c30101810 msgr2=0x7f4c30103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 shutdown_connections 2024-09-21T02:51:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:36.754+0000 7f4c36400640 1 -- 172.21.15.79:0/1081936643 wait complete. 2024-09-21T02:51:36.960 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:36 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1081936643' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:51:36.960 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:36 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:51:37.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:36 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1081936643' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:51:37.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:36 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:51:37.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:36 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1081936643' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:51:37.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:36 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:51:37.609 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T02:51:37.978 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:37 smithi079 ceph-mon[30788]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 KiB/s wr, 3 op/s 2024-09-21T02:51:37.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:37 smithi079 ceph-mon[30788]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T02:51:37.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:37 smithi079 ceph-mon[30788]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T02:51:37.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:37 smithi079 ceph-mon[30788]: Cluster is now healthy 2024-09-21T02:51:37.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:37 smithi079 ceph-mon[30788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:51:37.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:37 smithi079 ceph-mon[30788]: fsmap 12 up:standby 2024-09-21T02:51:37.983 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:37 smithi148 ceph-mon[34626]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 KiB/s wr, 3 op/s 2024-09-21T02:51:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:37 smithi148 ceph-mon[34626]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T02:51:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:37 smithi148 ceph-mon[34626]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T02:51:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:37 smithi148 ceph-mon[34626]: Cluster is now healthy 2024-09-21T02:51:38.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:37 smithi148 ceph-mon[34626]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:51:38.064 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:37 smithi148 ceph-mon[34626]: fsmap 12 up:standby 2024-09-21T02:51:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:37 smithi098 ceph-mon[34832]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 KiB/s wr, 3 op/s 2024-09-21T02:51:38.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:37 smithi098 ceph-mon[34832]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T02:51:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:37 smithi098 ceph-mon[34832]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T02:51:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:37 smithi098 ceph-mon[34832]: Cluster is now healthy 2024-09-21T02:51:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:37 smithi098 ceph-mon[34832]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:51:38.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:37 smithi098 ceph-mon[34832]: fsmap 12 up:standby 2024-09-21T02:51:38.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1282763232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca01092f0 msgr2=0x7f2ca0109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:38.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1282763232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca01092f0 0x7f2ca0109700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009860 tx=0x7f2c8802a340 comp rx=0 tx=0).stop 2024-09-21T02:51:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1282763232 shutdown_connections 2024-09-21T02:51:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1282763232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca0109c40 0x7f2ca0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1282763232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca01092f0 0x7f2ca0109700 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1282763232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca01039b0 0x7f2ca0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1282763232 >> 172.21.15.79:0/1282763232 conn(0x7f2ca00ff440 msgr2=0x7f2ca0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1282763232 shutdown_connections 2024-09-21T02:51:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.666+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1282763232 wait complete. 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.667+0000 7f2c9fe00640 1 Processor -- start 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9fe00640 1 -- start start 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca01039b0 0x7f2ca0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca01092f0 0x7f2ca0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9fe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0109c40 0x7f2ca0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9fe00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca0113900 con 0x7f2ca01039b0 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9fe00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca0113780 con 0x7f2ca01092f0 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9fe00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca0113a80 con 0x7f2ca0109c40 2024-09-21T02:51:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca01039b0 0x7f2ca0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:38.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9ea00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca01039b0 0x7f2ca0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36462/0 (socket says 172.21.15.79:36462) 2024-09-21T02:51:38.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c9ea00640 1 -- 172.21.15.79:0/1892410540 learned_addr learned my addr 172.21.15.79:0/1892410540 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:38.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.668+0000 7f2c97e00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca01092f0 0x7f2ca0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:38.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c9f400640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0109c40 0x7f2ca0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c9ea00640 1 -- 172.21.15.79:0/1892410540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0109c40 msgr2=0x7f2ca0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c9ea00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0109c40 0x7f2ca0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c9ea00640 1 -- 172.21.15.79:0/1892410540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca01092f0 msgr2=0x7f2ca0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c9ea00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca01092f0 0x7f2ca0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c9ea00640 1 -- 172.21.15.79:0/1892410540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca01a8650 con 0x7f2ca01039b0 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c97e00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca01092f0 0x7f2ca0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.669+0000 7f2c9ea00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca01039b0 0x7f2ca0075710 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000e9f0 tx=0x7f2c9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.670+0000 7f2ca4a00640 1 -- 172.21.15.79:0/1892410540 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000cd80 con 0x7f2ca01039b0 2024-09-21T02:51:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.670+0000 7f2ca4a00640 1 -- 172.21.15.79:0/1892410540 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c900054d0 con 0x7f2ca01039b0 2024-09-21T02:51:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.670+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca01a8940 con 0x7f2ca01039b0 2024-09-21T02:51:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.670+0000 7f2ca4a00640 1 -- 172.21.15.79:0/1892410540 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90010690 con 0x7f2ca01039b0 2024-09-21T02:51:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.670+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca01a8e00 con 0x7f2ca01039b0 2024-09-21T02:51:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.671+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca0103dc0 con 0x7f2ca01039b0 2024-09-21T02:51:38.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.674+0000 7f2ca4a00640 1 -- 172.21.15.79:0/1892410540 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2c90004e30 con 0x7f2ca01039b0 2024-09-21T02:51:38.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.676+0000 7f2ca4a00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c840b6510 0x7f2c840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.676+0000 7f2ca4a00640 1 -- 172.21.15.79:0/1892410540 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9265+0+0 (secure 0 0 0) 0x7f2c900e7d60 con 0x7f2ca01039b0 2024-09-21T02:51:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.677+0000 7f2c97e00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c840b6510 0x7f2c840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:38.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.677+0000 7f2c97e00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c840b6510 0x7f2c840b8a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c88005940 tx=0x7f2c880058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:38.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.679+0000 7f2ca4a00640 1 -- 172.21.15.79:0/1892410540 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c900ae180 con 0x7f2ca01039b0 2024-09-21T02:51:38.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:38.873+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ca0076a10 con 0x7f2ca01039b0 2024-09-21T02:51:39.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.748+0000 7f2ca4a00640 1 -- 172.21.15.79:0/1892410540 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7f2c900b2560 con 0x7f2ca01039b0 2024-09-21T02:51:39.751 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-09-21T02:51:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c840b6510 msgr2=0x7f2c840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c840b6510 0x7f2c840b8a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c88005940 tx=0x7f2c880058d0 comp rx=0 tx=0).stop 2024-09-21T02:51:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca01039b0 msgr2=0x7f2ca0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca01039b0 0x7f2ca0075710 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000e9f0 tx=0x7f2c9000edf0 comp rx=0 tx=0).stop 2024-09-21T02:51:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 shutdown_connections 2024-09-21T02:51:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f2c840b6510 0x7f2c840b8a20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0109c40 0x7f2ca0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ca01092f0 0x7f2ca0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 --2- 172.21.15.79:0/1892410540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ca01039b0 0x7f2ca0075710 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.755+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 >> 172.21.15.79:0/1892410540 conn(0x7f2ca00ff440 msgr2=0x7f2ca0101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:39.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.756+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 shutdown_connections 2024-09-21T02:51:39.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:39.756+0000 7f2c9fe00640 1 -- 172.21.15.79:0/1892410540 wait complete. 2024-09-21T02:51:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:39 smithi148 ceph-mon[34626]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:40.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:39 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1892410540' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:40.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:39 smithi079 ceph-mon[30788]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:40.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:39 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1892410540' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:39 smithi098 ceph-mon[34832]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T02:51:40.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:39 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1892410540' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:40.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T02:51:40.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:40 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/1892410540' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:40.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:40 smithi079 ceph-mon[30788]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T02:51:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:41.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:40 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/1892410540' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:41.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:40 smithi148 ceph-mon[34626]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T02:51:41.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:40 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/1892410540' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:41.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:40 smithi098 ceph-mon[34832]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T02:51:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.636+0000 7fea3fa00640 1 -- 172.21.15.79:0/448447834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea38105db0 msgr2=0x7fea381061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.636+0000 7fea3fa00640 1 --2- 172.21.15.79:0/448447834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea38105db0 0x7fea381061c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fea28009900 tx=0x7fea2802a410 comp rx=0 tx=0).stop 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.636+0000 7fea3fa00640 1 -- 172.21.15.79:0/448447834 shutdown_connections 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.636+0000 7fea3fa00640 1 --2- 172.21.15.79:0/448447834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea3810c040 0x7fea38112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.637+0000 7fea3fa00640 1 --2- 172.21.15.79:0/448447834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3810b6f0 0x7fea3810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.637+0000 7fea3fa00640 1 --2- 172.21.15.79:0/448447834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea38105db0 0x7fea381061c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.637+0000 7fea3fa00640 1 -- 172.21.15.79:0/448447834 >> 172.21.15.79:0/448447834 conn(0x7fea381017e0 msgr2=0x7fea38103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.637+0000 7fea3fa00640 1 -- 172.21.15.79:0/448447834 shutdown_connections 2024-09-21T02:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.637+0000 7fea3fa00640 1 -- 172.21.15.79:0/448447834 wait complete. 2024-09-21T02:51:41.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.638+0000 7fea3fa00640 1 Processor -- start 2024-09-21T02:51:41.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.638+0000 7fea3fa00640 1 -- start start 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3fa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea38105db0 0x7fea3819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3fa00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3810b6f0 0x7fea3819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3fa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3810c040 0x7fea381a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3fa00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fea38115d00 con 0x7fea3810b6f0 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3fa00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fea38115b80 con 0x7fea38105db0 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3fa00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fea38115e80 con 0x7fea3810c040 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3810b6f0 0x7fea3819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3d000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea38105db0 0x7fea3819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3810b6f0 0x7fea3819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36494/0 (socket says 172.21.15.79:36494) 2024-09-21T02:51:41.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea2fe00640 1 -- 172.21.15.79:0/3309662195 learned_addr learned my addr 172.21.15.79:0/3309662195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:41.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.639+0000 7fea3da00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3810c040 0x7fea381a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:41.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea2fe00640 1 -- 172.21.15.79:0/3309662195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3810c040 msgr2=0x7fea381a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:41.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea2fe00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3810c040 0x7fea381a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea2fe00640 1 -- 172.21.15.79:0/3309662195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea38105db0 msgr2=0x7fea3819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea2fe00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea38105db0 0x7fea3819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea2fe00640 1 -- 172.21.15.79:0/3309662195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea381a26a0 con 0x7fea3810b6f0 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea3d000640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea38105db0 0x7fea3819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea2fe00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3810b6f0 0x7fea3819ccd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fea2000e9c0 tx=0x7fea2000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea36000640 1 -- 172.21.15.79:0/3309662195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2000ccc0 con 0x7fea3810b6f0 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea36000640 1 -- 172.21.15.79:0/3309662195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea200054d0 con 0x7fea3810b6f0 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea381a2990 con 0x7fea3810b6f0 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.640+0000 7fea36000640 1 -- 172.21.15.79:0/3309662195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20010430 con 0x7fea3810b6f0 2024-09-21T02:51:41.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.641+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea381a90f0 con 0x7fea3810b6f0 2024-09-21T02:51:41.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.642+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea381061c0 con 0x7fea3810b6f0 2024-09-21T02:51:41.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.644+0000 7fea36000640 1 -- 172.21.15.79:0/3309662195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fea20005000 con 0x7fea3810b6f0 2024-09-21T02:51:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.645+0000 7fea36000640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fea1c0b6510 0x7fea1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.646+0000 7fea36000640 1 -- 172.21.15.79:0/3309662195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8711+0+0 (secure 0 0 0) 0x7fea200e7a50 con 0x7fea3810b6f0 2024-09-21T02:51:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.646+0000 7fea3d000640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fea1c0b6510 0x7fea1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:41.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.647+0000 7fea3d000640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fea1c0b6510 0x7fea1c0b8a20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea28031440 tx=0x7fea28032ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:41.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.648+0000 7fea36000640 1 -- 172.21.15.79:0/3309662195 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea20056710 con 0x7fea3810b6f0 2024-09-21T02:51:41.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:41.837+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea3819d860 con 0x7fea3810b6f0 2024-09-21T02:51:42.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:41 smithi148 ceph-mon[34626]: pgmap v895: 97 pgs: 97 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:42.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:41 smithi098 ceph-mon[34832]: pgmap v895: 97 pgs: 97 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:42.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:41 smithi079 ceph-mon[30788]: pgmap v895: 97 pgs: 97 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:42.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.773+0000 7fea36000640 1 -- 172.21.15.79:0/3309662195 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7fea3819d860 con 0x7fea3810b6f0 2024-09-21T02:51:42.775 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.778+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fea1c0b6510 msgr2=0x7fea1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.778+0000 7fea3fa00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fea1c0b6510 0x7fea1c0b8a20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea28031440 tx=0x7fea28032ed0 comp rx=0 tx=0).stop 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.778+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3810b6f0 msgr2=0x7fea3819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.778+0000 7fea3fa00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3810b6f0 0x7fea3819ccd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fea2000e9c0 tx=0x7fea2000ee80 comp rx=0 tx=0).stop 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.779+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 shutdown_connections 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.779+0000 7fea3fa00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7fea1c0b6510 0x7fea1c0b8a20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.779+0000 7fea3fa00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3810c040 0x7fea381a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.779+0000 7fea3fa00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3810b6f0 0x7fea3819ccd0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:42.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.779+0000 7fea3fa00640 1 --2- 172.21.15.79:0/3309662195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea38105db0 0x7fea3819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.779+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 >> 172.21.15.79:0/3309662195 conn(0x7fea381017e0 msgr2=0x7fea3810add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.780+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 shutdown_connections 2024-09-21T02:51:42.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:42.780+0000 7fea3fa00640 1 -- 172.21.15.79:0/3309662195 wait complete. 2024-09-21T02:51:43.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:42 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3309662195' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:43.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:42 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3309662195' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:43.206 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:42 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3309662195' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:43.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56d10306-77c0-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T02:51:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:44.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:43 smithi148 ceph-mon[34626]: pgmap v896: 97 pgs: 97 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:44.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:43 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/3309662195' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:44.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:43 smithi148 ceph-mon[34626]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T02:51:44.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:43 smithi079 ceph-mon[30788]: pgmap v896: 97 pgs: 97 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:44.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:43 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/3309662195' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:44.122 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:43 smithi079 ceph-mon[30788]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T02:51:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:43 smithi098 ceph-mon[34832]: pgmap v896: 97 pgs: 97 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:43 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/3309662195' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:44.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:43 smithi098 ceph-mon[34832]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T02:51:44.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 -- 172.21.15.79:0/2625443160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0105d80 msgr2=0x7f24b0106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 --2- 172.21.15.79:0/2625443160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0105d80 0x7f24b0106190 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009900 tx=0x7f24a002a410 comp rx=0 tx=0).stop 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 -- 172.21.15.79:0/2625443160 shutdown_connections 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 --2- 172.21.15.79:0/2625443160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b010c010 0x7f24b0112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 --2- 172.21.15.79:0/2625443160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24b010b6c0 0x7f24b010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 --2- 172.21.15.79:0/2625443160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0105d80 0x7f24b0106190 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 -- 172.21.15.79:0/2625443160 >> 172.21.15.79:0/2625443160 conn(0x7f24b0101810 msgr2=0x7f24b0103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 -- 172.21.15.79:0/2625443160 shutdown_connections 2024-09-21T02:51:44.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.627+0000 7f24b5600640 1 -- 172.21.15.79:0/2625443160 wait complete. 2024-09-21T02:51:44.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.628+0000 7f24b5600640 1 Processor -- start 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24b5600640 1 -- start start 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24b5600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0105d80 0x7f24b010fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24b5600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24b010b6c0 0x7f24b0110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24b5600640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b010c010 0x7f24b0110780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24b5600640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0115cd0 con 0x7f24b010c010 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24b5600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0115b50 con 0x7f24b0105d80 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24b5600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0115e50 con 0x7f24b010b6c0 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24af400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b010c010 0x7f24b0110780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24af400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b010c010 0x7f24b0110780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38248/0 (socket says 172.21.15.79:38248) 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24af400640 1 -- 172.21.15.79:0/2706888009 learned_addr learned my addr 172.21.15.79:0/2706888009 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24aea00640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0105d80 0x7f24b010fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.629+0000 7f24ae000640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24b010b6c0 0x7f24b0110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24af400640 1 -- 172.21.15.79:0/2706888009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24b010b6c0 msgr2=0x7f24b0110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:44.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24af400640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24b010b6c0 0x7f24b0110240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:44.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24af400640 1 -- 172.21.15.79:0/2706888009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0105d80 msgr2=0x7f24b010fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:44.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24af400640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0105d80 0x7f24b010fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:44.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24af400640 1 -- 172.21.15.79:0/2706888009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b01acba0 con 0x7f24b010c010 2024-09-21T02:51:44.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24af400640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b010c010 0x7f24b0110780 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009fd0 tx=0x7f24a800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24a7400640 1 -- 172.21.15.79:0/2706888009 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8017070 con 0x7f24b010c010 2024-09-21T02:51:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24a7400640 1 -- 172.21.15.79:0/2706888009 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a8003e20 con 0x7f24b010c010 2024-09-21T02:51:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.630+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b01ace90 con 0x7f24b010c010 2024-09-21T02:51:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.631+0000 7f24a7400640 1 -- 172.21.15.79:0/2706888009 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8010460 con 0x7f24b010c010 2024-09-21T02:51:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.631+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01ad340 con 0x7f24b010c010 2024-09-21T02:51:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.632+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0106190 con 0x7f24b010c010 2024-09-21T02:51:44.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.634+0000 7f24a7400640 1 -- 172.21.15.79:0/2706888009 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f24a8003970 con 0x7f24b010c010 2024-09-21T02:51:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.636+0000 7f24a7400640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f24940b6590 0x7f24940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.636+0000 7f24a7400640 1 -- 172.21.15.79:0/2706888009 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8152+0+0 (secure 0 0 0) 0x7f24a80e6f30 con 0x7f24b010c010 2024-09-21T02:51:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.636+0000 7f24aea00640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f24940b6590 0x7f24940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:44.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.637+0000 7f24aea00640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f24940b6590 0x7f24940b8aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000c00 tx=0x7f24a0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:44.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.638+0000 7f24a7400640 1 -- 172.21.15.79:0/2706888009 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24a80b1c20 con 0x7f24b010c010 2024-09-21T02:51:44.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:44.831+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f24b0111000 con 0x7f24b010c010 2024-09-21T02:51:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.787+0000 7f24a7400640 1 -- 172.21.15.79:0/2706888009 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v92) ==== 178+0+0 (secure 0 0 0) 0x7f24b0111000 con 0x7f24b010c010 2024-09-21T02:51:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data_ec' removed 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f24940b6590 msgr2=0x7f24940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f24940b6590 0x7f24940b8aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000c00 tx=0x7f24a0031400 comp rx=0 tx=0).stop 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b010c010 msgr2=0x7f24b0110780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b010c010 0x7f24b0110780 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009fd0 tx=0x7f24a800b260 comp rx=0 tx=0).stop 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 shutdown_connections 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:6800/863078239,v1:172.21.15.79:6801/863078239] conn(0x7f24940b6590 0x7f24940b8aa0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b010c010 0x7f24b0110780 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24b010b6c0 0x7f24b0110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 --2- 172.21.15.79:0/2706888009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0105d80 0x7f24b010fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 >> 172.21.15.79:0/2706888009 conn(0x7f24b0101810 msgr2=0x7f24b0103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.790+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 shutdown_connections 2024-09-21T02:51:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T02:51:45.791+0000 7f24b5600640 1 -- 172.21.15.79:0/2706888009 wait complete. 2024-09-21T02:51:46.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:45 smithi148 ceph-mon[34626]: pgmap v898: 33 pgs: 33 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:46.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:45 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2706888009' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:46.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:45 smithi098 ceph-mon[34832]: pgmap v898: 33 pgs: 33 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:46.156 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:45 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2706888009' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:46.228 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:45 smithi079 ceph-mon[30788]: pgmap v898: 33 pgs: 33 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:51:46.229 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:45 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2706888009' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:51:46.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:46.765 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:46.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:46.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:46 smithi079 ceph-mon[30788]: from='client.? 172.21.15.79:0/2706888009' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:46.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:46 smithi079 ceph-mon[30788]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T02:51:47.021 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T02:51:47.021 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:51:47.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:46 smithi148 ceph-mon[34626]: from='client.? 172.21.15.79:0/2706888009' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:47.063 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:46 smithi148 ceph-mon[34626]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T02:51:47.073 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:51:47.089 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:51:47.104 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T02:51:47.105 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T02:51:47.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a 2024-09-21T02:51:47.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:46 smithi098 ceph-mon[34832]: from='client.? 172.21.15.79:0/2706888009' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:51:47.155 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:46 smithi098 ceph-mon[34832]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T02:51:47.479 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:47 smithi079 systemd[1]: Stopping Ceph mon.a for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:51:47.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a[30784]: 2024-09-21T02:51:47.590+0000 7ff59e800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:51:47.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a[30784]: 2024-09-21T02:51:47.590+0000 7ff59e800640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T02:51:47.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:47 smithi079 podman[99827]: 2024-09-21 02:51:47.775567631 +0000 UTC m=+0.370240682 container died b8599cd87a62783196fd089c3a4db1f94faca4ae66a3d7609fed1b4a1f0c6738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T02:51:48.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:48 smithi079 podman[99827]: 2024-09-21 02:51:48.403072217 +0000 UTC m=+0.997745266 container cleanup b8599cd87a62783196fd089c3a4db1f94faca4ae66a3d7609fed1b4a1f0c6738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:51:48.729 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:48 smithi079 bash[99827]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a 2024-09-21T02:51:49.083 INFO:journalctl@ceph.mon.a.smithi079.stdout:Sep 21 02:51:48 smithi079 podman[99838]: 2024-09-21 02:51:48.754742792 +0000 UTC m=+0.969110040 container remove b8599cd87a62783196fd089c3a4db1f94faca4ae66a3d7609fed1b4a1f0c6738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T02:51:49.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T02:51:49.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:51:49.224 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T02:51:49.224 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T02:51:49.224 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.b 2024-09-21T02:51:49.589 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:49 smithi098 systemd[1]: Stopping Ceph mon.b for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:51:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:49 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-b[34828]: 2024-09-21T02:51:49.588+0000 7f896f92e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:51:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:49 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-b[34828]: 2024-09-21T02:51:49.588+0000 7f896f92e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T02:51:49.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:49 smithi098 podman[66988]: 2024-09-21 02:51:49.690454328 +0000 UTC m=+0.234399106 container died fb0061163c2204dc1d451574ae154b5e2c0f06005faebefe65f78a552bb8a94a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T02:51:50.405 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:50 smithi098 podman[66988]: 2024-09-21 02:51:50.192403682 +0000 UTC m=+0.736348460 container cleanup fb0061163c2204dc1d451574ae154b5e2c0f06005faebefe65f78a552bb8a94a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T02:51:50.406 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 21 02:51:50 smithi098 bash[66988]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-b 2024-09-21T02:51:50.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T02:51:50.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:51:50.657 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T02:51:50.657 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T02:51:50.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.c 2024-09-21T02:51:51.027 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:50 smithi148 systemd[1]: Stopping Ceph mon.c for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:51:51.307 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c[34622]: 2024-09-21T02:51:51.024+0000 7f63a051f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:51:51.307 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c[34622]: 2024-09-21T02:51:51.024+0000 7f63a051f640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T02:51:51.307 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:51 smithi148 podman[66183]: 2024-09-21 02:51:51.055900914 +0000 UTC m=+0.180826454 container died 05eb18de48fb81a7c44350718ed3866aa4258033c36d13254dfcb2996dd8acc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T02:51:51.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:51 smithi148 podman[66183]: 2024-09-21 02:51:51.497023307 +0000 UTC m=+0.621948847 container cleanup 05eb18de48fb81a7c44350718ed3866aa4258033c36d13254dfcb2996dd8acc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T02:51:51.563 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 02:51:51 smithi148 bash[66183]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mon-c 2024-09-21T02:51:51.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T02:51:52.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:51:52.031 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T02:51:52.031 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T02:51:52.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.x 2024-09-21T02:51:52.421 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:51:52 smithi079 systemd[1]: Stopping Ceph mgr.x for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:51:52.729 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:51:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x[31012]: 2024-09-21T02:51:52.418+0000 7fbb65400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:51:52.729 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:51:52 smithi079 podman[99949]: 2024-09-21 02:51:52.512638462 +0000 UTC m=+0.204000049 container died be1dafa6756ba6543e9eb74ca5aff069e85861fa0ca4d2e6304f5798c4e41cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T02:51:53.979 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:51:53 smithi079 podman[99949]: 2024-09-21 02:51:53.642762019 +0000 UTC m=+1.334123605 container cleanup be1dafa6756ba6543e9eb74ca5aff069e85861fa0ca4d2e6304f5798c4e41cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:51:53.979 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Sep 21 02:51:53 smithi079 bash[99949]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-x 2024-09-21T02:51:54.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T02:51:54.386 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:51:54.386 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T02:51:54.387 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T02:51:54.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.y 2024-09-21T02:51:54.730 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:51:54 smithi098 systemd[1]: Stopping Ceph mgr.y for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:51:55.058 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:51:54 smithi098 podman[67110]: 2024-09-21 02:51:54.728903885 +0000 UTC m=+0.150167158 container died b5c217b38a539d0acb166b0226cef3569e2e7ed2a226b6fc1362327cf1c8887f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T02:51:55.384 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:51:55 smithi098 podman[67110]: 2024-09-21 02:51:55.132103108 +0000 UTC m=+0.553366363 container cleanup b5c217b38a539d0acb166b0226cef3569e2e7ed2a226b6fc1362327cf1c8887f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T02:51:55.385 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 21 02:51:55 smithi098 bash[67110]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-y 2024-09-21T02:51:55.556 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T02:51:55.590 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:51:55.591 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T02:51:55.591 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T02:51:55.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.z 2024-09-21T02:51:55.933 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:51:55 smithi148 systemd[1]: Stopping Ceph mgr.z for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:51:56.280 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:51:55 smithi148 podman[66307]: 2024-09-21 02:51:55.931811833 +0000 UTC m=+0.147363393 container died 4985fdf89efaaf4faded05d73938ff8e1a46429bbd02e55fe5f3fc1da7651561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T02:51:56.563 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:51:56 smithi148 podman[66307]: 2024-09-21 02:51:56.419501189 +0000 UTC m=+0.635052748 container cleanup 4985fdf89efaaf4faded05d73938ff8e1a46429bbd02e55fe5f3fc1da7651561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T02:51:56.563 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 02:51:56 smithi148 bash[66307]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mgr-z 2024-09-21T02:51:56.885 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T02:51:56.921 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:51:56.921 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T02:51:56.921 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T02:51:56.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.0 2024-09-21T02:51:57.229 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:51:57 smithi079 systemd[1]: Stopping Ceph osd.0 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:51:57.728 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:51:57 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0[46279]: 2024-09-21T02:51:57.375+0000 7fbc47400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:51:57.729 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:51:57 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0[46279]: 2024-09-21T02:51:57.375+0000 7fbc47400640 -1 osd.0 92 *** Got signal Terminated *** 2024-09-21T02:51:57.729 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:51:57 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0[46279]: 2024-09-21T02:51:57.375+0000 7fbc47400640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:03.384 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:03 smithi079 podman[100070]: 2024-09-21 02:52:03.046464431 +0000 UTC m=+5.843839042 container died ddaad839063e2efa75b6dbc7b76d66603c143cd5383f4406bbec4723deb7057b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T02:52:03.729 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:03 smithi079 podman[100070]: 2024-09-21 02:52:03.555898323 +0000 UTC m=+6.353272936 container cleanup ddaad839063e2efa75b6dbc7b76d66603c143cd5383f4406bbec4723deb7057b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:52:03.729 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:03 smithi079 bash[100070]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0 2024-09-21T02:52:04.228 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:03 smithi079 podman[100088]: 2024-09-21 02:52:03.941419149 +0000 UTC m=+0.843306623 container remove ddaad839063e2efa75b6dbc7b76d66603c143cd5383f4406bbec4723deb7057b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T02:52:04.671 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:04 smithi079 podman[100173]: 2024-09-21 02:52:04.280038984 +0000 UTC m=+0.027375817 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:52:04.671 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:04 smithi079 podman[100173]: 2024-09-21 02:52:04.417336517 +0000 UTC m=+0.164673338 container create cfcb24140c622d8f4da29bf4a9ac40a49243bf5cf5dafb1acda00b0aefffb513 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:52:04.671 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:04 smithi079 podman[100173]: 2024-09-21 02:52:04.670129847 +0000 UTC m=+0.417466679 container init cfcb24140c622d8f4da29bf4a9ac40a49243bf5cf5dafb1acda00b0aefffb513 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T02:52:04.978 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:04 smithi079 podman[100173]: 2024-09-21 02:52:04.677617136 +0000 UTC m=+0.424953952 container start cfcb24140c622d8f4da29bf4a9ac40a49243bf5cf5dafb1acda00b0aefffb513 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T02:52:04.979 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:04 smithi079 podman[100173]: 2024-09-21 02:52:04.836611246 +0000 UTC m=+0.583948062 container attach cfcb24140c622d8f4da29bf4a9ac40a49243bf5cf5dafb1acda00b0aefffb513 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T02:52:05.416 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 21 02:52:05 smithi079 podman[100173]: 2024-09-21 02:52:05.029239252 +0000 UTC m=+0.776576074 container died cfcb24140c622d8f4da29bf4a9ac40a49243bf5cf5dafb1acda00b0aefffb513 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:52:05.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T02:52:05.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:52:05.898 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T02:52:05.898 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T02:52:05.898 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.1 2024-09-21T02:52:06.222 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:05 smithi098 systemd[1]: Stopping Ceph osd.1 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:52:06.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1[38783]: 2024-09-21T02:52:06.220+0000 7f8afd560640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:52:06.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1[38783]: 2024-09-21T02:52:06.220+0000 7f8afd560640 -1 osd.1 92 *** Got signal Terminated *** 2024-09-21T02:52:06.656 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1[38783]: 2024-09-21T02:52:06.220+0000 7f8afd560640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:12.104 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:11 smithi098 podman[67249]: 2024-09-21 02:52:11.793946454 +0000 UTC m=+5.699753450 container died 6ee738266b5ad9b28c19dfc1ed3a37891e6aa53ba185d8e4dea68f98dbc55207 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T02:52:12.399 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:12 smithi098 podman[67249]: 2024-09-21 02:52:12.180076873 +0000 UTC m=+6.085883859 container cleanup 6ee738266b5ad9b28c19dfc1ed3a37891e6aa53ba185d8e4dea68f98dbc55207 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T02:52:12.399 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:12 smithi098 bash[67249]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1 2024-09-21T02:52:12.655 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:12 smithi098 podman[67267]: 2024-09-21 02:52:12.398105291 +0000 UTC m=+0.601013162 container remove 6ee738266b5ad9b28c19dfc1ed3a37891e6aa53ba185d8e4dea68f98dbc55207 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:52:13.094 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:12 smithi098 podman[67357]: 2024-09-21 02:52:12.741096687 +0000 UTC m=+0.015449105 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:52:13.094 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:12 smithi098 podman[67357]: 2024-09-21 02:52:12.849181127 +0000 UTC m=+0.123533539 container create fafd40808b343b53585df6d22e7accf088280466ab72837cc4fdcc4c1a083308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:52:13.095 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:13 smithi098 podman[67357]: 2024-09-21 02:52:13.093663457 +0000 UTC m=+0.368015871 container init fafd40808b343b53585df6d22e7accf088280466ab72837cc4fdcc4c1a083308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T02:52:13.359 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:13 smithi098 podman[67357]: 2024-09-21 02:52:13.097236011 +0000 UTC m=+0.371588421 container start fafd40808b343b53585df6d22e7accf088280466ab72837cc4fdcc4c1a083308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:52:13.359 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:13 smithi098 podman[67357]: 2024-09-21 02:52:13.202132744 +0000 UTC m=+0.476485168 container attach fafd40808b343b53585df6d22e7accf088280466ab72837cc4fdcc4c1a083308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T02:52:13.647 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 21 02:52:13 smithi098 podman[67357]: 2024-09-21 02:52:13.358808394 +0000 UTC m=+0.633160811 container died fafd40808b343b53585df6d22e7accf088280466ab72837cc4fdcc4c1a083308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T02:52:13.973 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T02:52:14.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:52:14.012 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T02:52:14.012 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T02:52:14.012 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.2 2024-09-21T02:52:14.313 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:14 smithi148 systemd[1]: Stopping Ceph osd.2 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:52:14.813 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2[39081]: 2024-09-21T02:52:14.340+0000 7f0d22f66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:52:14.813 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2[39081]: 2024-09-21T02:52:14.340+0000 7f0d22f66640 -1 osd.2 92 *** Got signal Terminated *** 2024-09-21T02:52:14.813 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2[39081]: 2024-09-21T02:52:14.340+0000 7f0d22f66640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:20.134 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:19 smithi148 podman[66444]: 2024-09-21 02:52:19.850735524 +0000 UTC m=+5.634702758 container died ba5f1d39c1afdd1b13dc2331ae141f7b4f264ce053ce8553fc8e0cc4c35f9c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T02:52:20.534 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:20 smithi148 podman[66444]: 2024-09-21 02:52:20.254656136 +0000 UTC m=+6.038623327 container cleanup ba5f1d39c1afdd1b13dc2331ae141f7b4f264ce053ce8553fc8e0cc4c35f9c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T02:52:20.535 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:20 smithi148 bash[66444]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2 2024-09-21T02:52:20.813 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:20 smithi148 podman[66460]: 2024-09-21 02:52:20.534018533 +0000 UTC m=+0.675874760 container remove ba5f1d39c1afdd1b13dc2331ae141f7b4f264ce053ce8553fc8e0cc4c35f9c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T02:52:21.171 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:20 smithi148 podman[66549]: 2024-09-21 02:52:20.770090509 +0000 UTC m=+0.016146214 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:52:21.172 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:20 smithi148 podman[66549]: 2024-09-21 02:52:20.901611713 +0000 UTC m=+0.147667418 container create 93f9789e54eff4775c721daa3f25e070b581f01c40c5d420a3169a23d8e66636 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:52:21.563 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:21 smithi148 podman[66549]: 2024-09-21 02:52:21.171147647 +0000 UTC m=+0.417203351 container init 93f9789e54eff4775c721daa3f25e070b581f01c40c5d420a3169a23d8e66636 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T02:52:21.563 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:21 smithi148 podman[66549]: 2024-09-21 02:52:21.174613053 +0000 UTC m=+0.420668758 container start 93f9789e54eff4775c721daa3f25e070b581f01c40c5d420a3169a23d8e66636 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T02:52:21.564 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:21 smithi148 podman[66549]: 2024-09-21 02:52:21.270987159 +0000 UTC m=+0.517042879 container attach 93f9789e54eff4775c721daa3f25e070b581f01c40c5d420a3169a23d8e66636 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T02:52:21.564 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 02:52:21 smithi148 podman[66549]: 2024-09-21 02:52:21.407284252 +0000 UTC m=+0.653339957 container died 93f9789e54eff4775c721daa3f25e070b581f01c40c5d420a3169a23d8e66636 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T02:52:22.207 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T02:52:22.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:52:22.247 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T02:52:22.247 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T02:52:22.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.3 2024-09-21T02:52:22.671 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:22 smithi079 systemd[1]: Stopping Ceph osd.3 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:52:22.979 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:22 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:52:22.669+0000 7fd622600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:52:22.979 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:22 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:52:22.669+0000 7fd622600640 -1 osd.3 92 *** Got signal Terminated *** 2024-09-21T02:52:22.979 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:22 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:52:22.669+0000 7fd622600640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:24.079 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:23 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:52:23.931+0000 7fd619000640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.754897+0000 front 2024-09-21T02:52:00.754976+0000 (oldest deadline 2024-09-21T02:52:23.655040+0000) 2024-09-21T02:52:24.079 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:23 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:23.753+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:24.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:23.920+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:24.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:23.921+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:24.978 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:24 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:52:24.956+0000 7fd619000640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.754897+0000 front 2024-09-21T02:52:00.754976+0000 (oldest deadline 2024-09-21T02:52:23.655040+0000) 2024-09-21T02:52:24.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:24 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:24.721+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:25.215 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:24.919+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:25.215 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:24.873+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:26.228 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:25 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:52:25.942+0000 7fd619000640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.754897+0000 front 2024-09-21T02:52:00.754976+0000 (oldest deadline 2024-09-21T02:52:23.655040+0000) 2024-09-21T02:52:26.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:25 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:25.762+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:26.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:25.925+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:26.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:25.841+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:27.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:26.952+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:27.063 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:26.723+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:27.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:26.796+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:27.228 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:26 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3[52825]: 2024-09-21T02:52:26.942+0000 7fd619000640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.754897+0000 front 2024-09-21T02:52:00.754976+0000 (oldest deadline 2024-09-21T02:52:23.655040+0000) 2024-09-21T02:52:27.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:26 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:26.768+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:27.978 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:27.711+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:27.978 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:27.813+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:28.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:27 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:27.817+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:28.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:27 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:27.797+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:28.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:27.977+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:28.728 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:28 smithi079 podman[100278]: 2024-09-21 02:52:28.449286611 +0000 UTC m=+5.907669699 container died 7aae9077ffb165eb61c6c081796c09b75a6d3b3f52cc98b863c0759fe7074f42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T02:52:29.063 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:28.735+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:29.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:28.951+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:29.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:28.827+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:29.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:28 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:28.858+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:29.203 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:28 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:28.799+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:29.203 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:28 smithi079 podman[100278]: 2024-09-21 02:52:28.908127776 +0000 UTC m=+6.366510862 container cleanup 7aae9077ffb165eb61c6c081796c09b75a6d3b3f52cc98b863c0759fe7074f42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T02:52:29.203 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:28 smithi079 bash[100278]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3 2024-09-21T02:52:29.478 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:29 smithi079 podman[100308]: 2024-09-21 02:52:29.201381004 +0000 UTC m=+0.741152063 container remove 7aae9077ffb165eb61c6c081796c09b75a6d3b3f52cc98b863c0759fe7074f42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-21T02:52:29.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:29.873+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:29.995 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:29.743+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:30.067 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:29 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:29.765+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:30.067 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:29 smithi079 podman[100390]: 2024-09-21 02:52:29.723152208 +0000 UTC m=+0.027175392 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:52:30.067 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:29 smithi079 podman[100390]: 2024-09-21 02:52:29.926604864 +0000 UTC m=+0.230628037 container create a9429aa4e38b5b722355227084345bbafb4aa36cb7d2c8b6ba979db8711a916d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T02:52:30.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:29 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:29.861+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:30.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:29.993+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:30.449 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:30 smithi079 podman[100390]: 2024-09-21 02:52:30.180150998 +0000 UTC m=+0.484174181 container init a9429aa4e38b5b722355227084345bbafb4aa36cb7d2c8b6ba979db8711a916d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:52:30.450 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:30 smithi079 podman[100390]: 2024-09-21 02:52:30.187227518 +0000 UTC m=+0.491250694 container start a9429aa4e38b5b722355227084345bbafb4aa36cb7d2c8b6ba979db8711a916d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T02:52:30.450 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:30 smithi079 podman[100390]: 2024-09-21 02:52:30.312756304 +0000 UTC m=+0.616779489 container attach a9429aa4e38b5b722355227084345bbafb4aa36cb7d2c8b6ba979db8711a916d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T02:52:30.728 INFO:journalctl@ceph.osd.3.smithi079.stdout:Sep 21 02:52:30 smithi079 podman[100390]: 2024-09-21 02:52:30.449081955 +0000 UTC m=+0.753105138 container died a9429aa4e38b5b722355227084345bbafb4aa36cb7d2c8b6ba979db8711a916d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T02:52:31.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:30.758+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:31.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:30.952+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:31.065 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:30.824+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:31.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:30 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:30.863+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:31.167 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:30 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:30.779+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:31.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T02:52:31.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:52:31.271 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T02:52:31.271 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T02:52:31.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.4 2024-09-21T02:52:31.594 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:31 smithi098 systemd[1]: Stopping Ceph osd.4 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:52:31.875 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:31 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:52:31.592+0000 7f8b8f4c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:52:31.876 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:31 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:52:31.592+0000 7f8b8f4c0640 -1 osd.4 92 *** Got signal Terminated *** 2024-09-21T02:52:31.876 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:31 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:52:31.592+0000 7f8b8f4c0640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:32.063 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:31.801+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:32.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:31.915+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:32.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:31.853+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:32.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:31 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:31.874+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:32.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:31 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:31.742+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:33.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:32 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:32.854+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:33.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:32 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:32.854+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:33.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:32 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:32.730+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:33.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:32.960+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:33.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:32.870+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:33.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:32.834+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:33.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:32.834+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:33.882 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:33 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:52:33.592+0000 7f8b8baab640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.862924+0000 front 2024-09-21T02:52:09.862965+0000 (oldest deadline 2024-09-21T02:52:32.663708+0000) 2024-09-21T02:52:33.978 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:33 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:33.685+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:33.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:33 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:33.685+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:34.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:33 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:33.880+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:34.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:33 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:33.880+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:34.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:33.967+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:34.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:33.851+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:34.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:33.876+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:34.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:33.876+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:34.905 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:52:34.624+0000 7f8b8baab640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.862924+0000 front 2024-09-21T02:52:09.862965+0000 (oldest deadline 2024-09-21T02:52:32.663708+0000) 2024-09-21T02:52:34.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:34 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:34.690+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:34.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:34 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:34.690+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:35.271 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:34.989+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:35.271 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:34.890+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:35.271 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:34.890+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:35.272 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:34.888+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:35.272 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:34.888+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:35.405 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:34.921+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:35.405 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:34 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:34.921+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:35.729 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:35 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:35.417+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:35.926 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:35 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4[45078]: 2024-09-21T02:52:35.668+0000 7f8b8baab640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.862924+0000 front 2024-09-21T02:52:09.862965+0000 (oldest deadline 2024-09-21T02:52:32.663708+0000) 2024-09-21T02:52:36.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:35 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:35.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:36.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:35 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:35.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:36.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:35 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:35.981+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:36.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:35 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:35.912+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:36.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:35 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:35.912+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:36.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:35 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:35.849+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:36.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:35 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:35.849+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:36.405 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:35 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:35.928+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:36.406 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:35 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:35.924+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:36.406 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:35 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:35.924+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:36.728 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:36.370+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:37.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:36 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:36.879+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:37.157 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:36 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:36.958+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:37.157 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:36 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:36.958+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:37.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:36.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:37.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:36 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:36.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:37.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:36 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:36.959+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:37.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:36 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:36.959+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:37.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:36 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:36.892+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:37.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:36 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:36.892+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:37.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:36 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:36.945+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:37.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:36 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:36.945+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:37.543 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:37 smithi098 podman[67461]: 2024-09-21 02:52:37.240022285 +0000 UTC m=+5.779277030 container died f766cdc31048e390f1255b8fcbe4f84dd7d4a38d237bf36ebb426d6229c1ab0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T02:52:37.728 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:37 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:37.406+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:37.861 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:37 smithi098 podman[67461]: 2024-09-21 02:52:37.643285036 +0000 UTC m=+6.182539774 container cleanup f766cdc31048e390f1255b8fcbe4f84dd7d4a38d237bf36ebb426d6229c1ab0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T02:52:37.862 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:37 smithi098 bash[67461]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4 2024-09-21T02:52:38.155 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:37 smithi098 podman[67488]: 2024-09-21 02:52:37.861494033 +0000 UTC m=+0.622323540 container remove f766cdc31048e390f1255b8fcbe4f84dd7d4a38d237bf36ebb426d6229c1ab0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:52:38.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:37 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:37.860+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:38.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:37 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:37.972+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:38.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:37 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:37.972+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:38.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:37 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:37.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:38.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:37 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:37.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:38.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:37 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:37.885+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:38.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:37 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:37.885+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:38.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:37 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:37.946+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:38.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:37 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:37.946+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:38.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:37 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:37.912+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:38.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:37 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:37.912+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:38.449 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:38 smithi098 podman[67578]: 2024-09-21 02:52:38.080164168 +0000 UTC m=+0.015871159 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:52:38.449 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:38 smithi098 podman[67578]: 2024-09-21 02:52:38.187354316 +0000 UTC m=+0.123061286 container create b07ac3af6a4370d7bb11381a06f2843c962cd21e5ecdc020e3b46a30b0d91d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T02:52:38.449 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:38 smithi098 podman[67578]: 2024-09-21 02:52:38.448466854 +0000 UTC m=+0.384173824 container init b07ac3af6a4370d7bb11381a06f2843c962cd21e5ecdc020e3b46a30b0d91d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T02:52:38.728 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:38 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:38.438+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:38.878 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:38 smithi098 podman[67578]: 2024-09-21 02:52:38.452236518 +0000 UTC m=+0.387943494 container start b07ac3af6a4370d7bb11381a06f2843c962cd21e5ecdc020e3b46a30b0d91d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T02:52:38.879 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:38 smithi098 podman[67578]: 2024-09-21 02:52:38.532014916 +0000 UTC m=+0.467721899 container attach b07ac3af6a4370d7bb11381a06f2843c962cd21e5ecdc020e3b46a30b0d91d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T02:52:38.879 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 21 02:52:38 smithi098 podman[67578]: 2024-09-21 02:52:38.646618247 +0000 UTC m=+0.582325218 container died b07ac3af6a4370d7bb11381a06f2843c962cd21e5ecdc020e3b46a30b0d91d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T02:52:39.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:38 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:38.877+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:39.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:38 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:38.978+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:39.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:38 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:38.978+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:39.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:38 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:38.758+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:39.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:38 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:38.758+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:39.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:38 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:38.936+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:39.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:38 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:38.936+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:39.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:38 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:38.840+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:39.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:38 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:38.840+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:39.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:38 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:38.952+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:39.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:38 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:38.952+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:39.352 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T02:52:39.394 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:52:39.394 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T02:52:39.394 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T02:52:39.394 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.5 2024-09-21T02:52:39.712 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:39 smithi148 systemd[1]: Stopping Ceph osd.5 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:52:39.809 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:39 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:39.486+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:40.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:39.932+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:40.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:39.932+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:40.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:39.827+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:40.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:39.827+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:40.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:39.710+0000 7f1f1ac77640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:52:40.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:39.710+0000 7f1f1ac77640 -1 osd.5 92 *** Got signal Terminated *** 2024-09-21T02:52:40.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:39.710+0000 7f1f1ac77640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:40.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:39.944+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:40.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:39 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:39.944+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:40.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:39 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:39.808+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:40.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:39 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:39.808+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:40.405 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:39 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:39.911+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:40.406 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:39 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:39.972+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:40.406 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:39 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:39.972+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:40.839 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:40 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:40.510+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:41.063 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:40 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:40.976+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:41.063 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:40 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:40.976+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:41.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:40 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:40.810+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:41.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:40 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:40.810+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:41.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:40 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:40.931+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:41.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:40 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:40.931+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:41.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:40 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:40.931+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:41.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:40 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:40.890+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:41.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:41 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:41.011+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:41.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:41 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:41.011+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:41.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:40 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:40.838+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:41.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:40 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:40.838+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:41.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:40 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:40.838+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:41.797 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:41 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:41.511+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:42.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:41.788+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:42.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:41.788+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:42.063 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:41.932+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:42.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:41.932+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:42.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:41.932+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.832650+0000 front 2024-09-21T02:52:18.832667+0000 (oldest deadline 2024-09-21T02:52:41.732793+0000) 2024-09-21T02:52:42.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:41.934+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:42.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:41.934+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:42.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:41 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:41.934+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:42.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:41 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:41.796+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:42.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:41 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:41.796+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:42.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:41 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:41.796+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:42.405 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:41 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:41.917+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:42.406 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:41 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:41.917+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:42.406 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:41 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:41.995+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:42.406 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:41 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:41.995+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:42.406 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:41 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:41.995+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:42.787 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:42 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:42.526+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:43.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:42.984+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:43.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:42.984+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:43.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:42.984+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:43.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:42.919+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:43.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:42.919+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:43.064 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:42.919+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.832650+0000 front 2024-09-21T02:52:18.832667+0000 (oldest deadline 2024-09-21T02:52:41.732793+0000) 2024-09-21T02:52:43.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:42.790+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:43.065 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:42 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:42.790+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:43.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:42 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:42.786+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:43.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:42 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:42.786+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:43.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:42 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:42.786+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:43.406 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:42 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:42.914+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:43.406 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:42 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:42.914+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:43.407 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:42 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:42.946+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:43.407 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:42 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:42.946+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:43.407 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:42 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:42.946+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:43.770 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:43 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:43.518+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:44.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:43 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:43.869+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:44.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:43 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:43.869+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:44.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:43 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:43.909+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:44.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:43 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:43.909+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:44.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:43 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:43.909+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:44.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:43 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:43.769+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:44.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:43 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:43.769+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:44.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:43 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:43.769+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:44.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:43.975+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:44.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:43.975+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:44.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:43.975+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:44.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:43.950+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.330104+0000 front 2024-09-21T02:52:01.330020+0000 (oldest deadline 2024-09-21T02:52:26.530589+0000) 2024-09-21T02:52:44.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:43.950+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:06.531190+0000 front 2024-09-21T02:52:06.531269+0000 (oldest deadline 2024-09-21T02:52:32.431262+0000) 2024-09-21T02:52:44.314 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5[45348]: 2024-09-21T02:52:43.950+0000 7f1f1325a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.832650+0000 front 2024-09-21T02:52:18.832667+0000 (oldest deadline 2024-09-21T02:52:41.732793+0000) 2024-09-21T02:52:44.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:43.837+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:44.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:43 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:43.837+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:44.799 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:44 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:44.480+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:45.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:44 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:44.872+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:45.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:44 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:44.872+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:45.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:44 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:44.872+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:45.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:44 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:44.872+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:45.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:44 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:44.872+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:45.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:44 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:44.798+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:45.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:44 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:44.798+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:45.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:44 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:44.798+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:45.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:45.003+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:45.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:45.003+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:45.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:45.003+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:45.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:44 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:44.857+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:45.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:44 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:44.857+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:45.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:44 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:44.857+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:45.563 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:45 smithi148 podman[66665]: 2024-09-21 02:52:45.312338161 +0000 UTC m=+5.718766648 container died 7d58f870ee7ff4861bb14bcdf286aaba2e2ad7c58ffd51927d9d080593e105b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T02:52:45.728 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:45 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:45.464+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:45.729 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:45 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:45.464+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:45.891 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:45 smithi148 podman[66665]: 2024-09-21 02:52:45.661318791 +0000 UTC m=+6.067747278 container cleanup 7d58f870ee7ff4861bb14bcdf286aaba2e2ad7c58ffd51927d9d080593e105b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:52:45.891 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:45 smithi148 bash[66665]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5 2024-09-21T02:52:46.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:45 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:45.888+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:46.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:45 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:45.888+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:46.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:45 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:45.919+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:46.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:45 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:45.919+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:46.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:45 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:45.919+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:46.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:45 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:45.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:46.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:45 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:45.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:46.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:45 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:45.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:46.273 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:45 smithi148 podman[66680]: 2024-09-21 02:52:45.954275905 +0000 UTC m=+0.641423696 container remove 7d58f870ee7ff4861bb14bcdf286aaba2e2ad7c58ffd51927d9d080593e105b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T02:52:46.273 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:45.981+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:46.273 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:45.981+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:46.273 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:45.981+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:46.273 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:45.888+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:46.273 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:45.888+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:46.273 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:45 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:45.888+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:46.563 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:46 smithi148 podman[66770]: 2024-09-21 02:52:46.174782642 +0000 UTC m=+0.015469658 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:52:46.563 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:46 smithi148 podman[66770]: 2024-09-21 02:52:46.321876787 +0000 UTC m=+0.162563803 container create bea1040a1efe9f9194fdef864608dbaf95ca12f4c673437b7ae38fe848ecd9c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T02:52:46.761 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:46 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:46.492+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:46.762 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:46 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:46.492+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:46.924 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:46 smithi148 podman[66770]: 2024-09-21 02:52:46.591191528 +0000 UTC m=+0.431878544 container init bea1040a1efe9f9194fdef864608dbaf95ca12f4c673437b7ae38fe848ecd9c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T02:52:46.924 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:46 smithi148 podman[66770]: 2024-09-21 02:52:46.59472562 +0000 UTC m=+0.435412643 container start bea1040a1efe9f9194fdef864608dbaf95ca12f4c673437b7ae38fe848ecd9c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T02:52:46.924 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:46 smithi148 podman[66770]: 2024-09-21 02:52:46.691189512 +0000 UTC m=+0.531876527 container attach bea1040a1efe9f9194fdef864608dbaf95ca12f4c673437b7ae38fe848ecd9c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T02:52:46.924 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 02:52:46 smithi148 podman[66770]: 2024-09-21 02:52:46.786823556 +0000 UTC m=+0.627510575 container died bea1040a1efe9f9194fdef864608dbaf95ca12f4c673437b7ae38fe848ecd9c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:52:47.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:46 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:46.849+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:47.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:46 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:46.849+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:47.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:46 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:46.906+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:47.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:46 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:46.906+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:47.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:46 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:46.906+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:47.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:46 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:46.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:47.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:46 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:46.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:47.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:46 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:46.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:47.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:46 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:46.932+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:47.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:46 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:46.932+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:47.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:46 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:46.932+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:47.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:46 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:46.921+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:47.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:46 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:46.921+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:47.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:46 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:46.921+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:47.421 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T02:52:47.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:52:47.460 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T02:52:47.460 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T02:52:47.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.6 2024-09-21T02:52:47.779 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:47.513+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:47.779 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:47.513+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:47.779 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:47 smithi079 systemd[1]: Stopping Ceph osd.6 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:52:48.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:47 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:47.803+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:48.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:47 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:47.803+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:48.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:47 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:47.883+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:48.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:47 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:47.883+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:48.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:47 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:47.883+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:48.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:47.777+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:48.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:47.777+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:48.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:47.777+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:48.229 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:47.904+0000 7fe3da200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:52:48.229 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:47.904+0000 7fe3da200640 -1 osd.6 92 *** Got signal Terminated *** 2024-09-21T02:52:48.229 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:47 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:47.904+0000 7fe3da200640 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:48.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:47 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:47.898+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:48.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:47 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:47.898+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:48.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:47 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:47.898+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:48.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:47 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:47.936+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:48.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:47 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:47.936+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:48.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:47 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:47.936+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:48.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:48 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:48.539+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:48.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:48 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:48.539+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:48.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:48 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:48.764+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:48.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:48 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:48.764+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:48.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:48 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:48.764+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:49.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:48 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:48.804+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:49.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:48 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:48.804+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:49.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:48 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:48.838+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:49.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:48 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:48.838+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:49.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:48 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:48.838+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:49.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:48 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:48.982+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:49.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:48 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:48.982+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:49.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:48 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:48.982+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:49.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:48 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:48.889+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:49.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:48 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:48.889+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:49.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:48 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:48.889+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:49.978 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:49.551+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:49.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:49.551+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:49.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:49.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:49.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:49.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:49.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:49.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:49.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:49.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:50.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:49 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:49.799+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:50.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:49 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:49.799+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:50.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:49 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:49.874+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:50.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:49 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:49.874+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:50.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:49 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:49.874+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:50.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:49 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:49.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:50.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:49 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:49.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:50.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:49 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:49.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:50.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:49 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:49.850+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:50.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:49 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:49.850+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:50.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:49 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:49.850+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:50.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:50 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:50.567+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:50.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:50 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:50.567+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:50.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:50 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:50.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:50.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:50 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:50.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:50.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:50 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:50.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:50.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:50 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:50.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:51.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:50 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:50.755+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:51.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:50 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:50.755+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:51.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:50 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:50.859+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:51.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:50 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:50.859+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:51.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:50 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:50.859+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:51.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:50 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:50.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:51.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:50 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:50.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:51.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:50 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:50.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:51.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:50 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:50.890+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:51.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:50 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:50.890+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:51.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:50 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:50.890+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:51.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:50 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:50.890+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:51.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:51.554+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:51.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:51.554+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:51.979 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:51.554+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.298861+0000 front 2024-09-21T02:52:27.298986+0000 (oldest deadline 2024-09-21T02:52:50.798804+0000) 2024-09-21T02:52:51.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:51.797+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:51.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:51.797+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:51.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:51.797+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:51.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:51 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:51.797+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:52.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:51 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:51.731+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:52.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:51 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:51.731+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:52.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:51 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:51.821+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:52.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:51 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:51.821+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:52.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:51 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:51.821+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:52.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:51.961+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:52.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:51.961+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:52.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:51.961+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:52.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:51.888+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:52.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:51.888+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:52.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:51.888+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:52.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:51 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:51.888+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:52.783 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:52.510+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.195516+0000 front 2024-09-21T02:52:09.195537+0000 (oldest deadline 2024-09-21T02:52:34.495574+0000) 2024-09-21T02:52:52.784 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:52.510+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:15.597383+0000 front 2024-09-21T02:52:15.597351+0000 (oldest deadline 2024-09-21T02:52:44.998038+0000) 2024-09-21T02:52:52.784 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6[59424]: 2024-09-21T02:52:52.510+0000 7fe3d5c00640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.298861+0000 front 2024-09-21T02:52:27.298986+0000 (oldest deadline 2024-09-21T02:52:50.798804+0000) 2024-09-21T02:52:53.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:52.716+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:53.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:52.716+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:53.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:52.716+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:53.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:52.836+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:53.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:52.836+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:53.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:52.836+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:53.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:52.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:53.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:52.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:53.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:52.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:53.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:52 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:52.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:53.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:52 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:52.940+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:53.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:52 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:52.940+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:53.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:52 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:52.940+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:53.313 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:52 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:52.879+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:53.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:52 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:52.879+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:53.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:52 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:52.879+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:53.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:52 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:52.880+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:53.914 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:53 smithi079 podman[100493]: 2024-09-21 02:52:53.577415157 +0000 UTC m=+5.829044430 container died 2f8296cdaa4ae01e8f4d2495232e78b379cdf8ca1ff385067e2ac59791d50a22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:52:53.915 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:53 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:53.795+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:53.915 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:53 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:53.795+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:53.915 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:53 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:53.795+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:53.915 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:53 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:53.795+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:54.155 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:53.670+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:54.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:53.670+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:54.156 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:53.670+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:54.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:53.805+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:54.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:53.805+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:54.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:53.805+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:54.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:53 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:53.805+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:52:54.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:53.972+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:54.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:53.973+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:54.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:53.973+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:54.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:53.871+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:54.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:53.871+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:54.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:53.871+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:54.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:53 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:53.871+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:54.449 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:54 smithi079 podman[100493]: 2024-09-21 02:52:54.167378188 +0000 UTC m=+6.419007468 container cleanup 2f8296cdaa4ae01e8f4d2495232e78b379cdf8ca1ff385067e2ac59791d50a22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T02:52:54.449 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:54 smithi079 bash[100493]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6 2024-09-21T02:52:54.449 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:54 smithi079 podman[100508]: 2024-09-21 02:52:54.343816568 +0000 UTC m=+0.722429849 container remove 2f8296cdaa4ae01e8f4d2495232e78b379cdf8ca1ff385067e2ac59791d50a22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T02:52:54.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:54 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:54.638+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:54.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:54 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:54.638+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:54.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:54 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:54.638+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:54.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:54 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:54.763+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:54.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:54 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:54.763+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:54.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:54 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:54.763+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:54.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:54 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:54.763+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:52:55.063 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:54 smithi079 podman[100605]: 2024-09-21 02:52:54.803393204 +0000 UTC m=+0.027493367 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:52:55.063 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:54 smithi079 podman[100605]: 2024-09-21 02:52:54.936295548 +0000 UTC m=+0.160395698 container create b7715cecd7c07a5a59f1c60c06b81ff67e1202ba31dc61835bbdf0f01790d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T02:52:55.063 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:54 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:54.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:55.063 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:54 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:54.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:55.063 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:54 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:54.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:55.063 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:54 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:54.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:55.215 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:54 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:54.846+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:55.215 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:54 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:54.847+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:55.215 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:54 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:54.847+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:55.215 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:54 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:54.847+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:55.215 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:54 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:54.974+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:55.215 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:54 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:54.974+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:55.215 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:54 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:54.974+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:55.324 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:55 smithi079 podman[100605]: 2024-09-21 02:52:55.147457167 +0000 UTC m=+0.371557329 container init b7715cecd7c07a5a59f1c60c06b81ff67e1202ba31dc61835bbdf0f01790d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T02:52:55.324 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:55 smithi079 podman[100605]: 2024-09-21 02:52:55.154709886 +0000 UTC m=+0.378810050 container start b7715cecd7c07a5a59f1c60c06b81ff67e1202ba31dc61835bbdf0f01790d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T02:52:55.324 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:55 smithi079 podman[100605]: 2024-09-21 02:52:55.288728715 +0000 UTC m=+0.512828889 container attach b7715cecd7c07a5a59f1c60c06b81ff67e1202ba31dc61835bbdf0f01790d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T02:52:55.728 INFO:journalctl@ceph.osd.6.smithi079.stdout:Sep 21 02:52:55 smithi079 podman[100629]: 2024-09-21 02:52:55.466763994 +0000 UTC m=+0.026373636 container died b7715cecd7c07a5a59f1c60c06b81ff67e1202ba31dc61835bbdf0f01790d1bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T02:52:55.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:55.605+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:55.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:55.605+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:55.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:55.605+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:55.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:55.792+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:55.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:55.792+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:55.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:55.792+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:55.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:55.792+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:52:56.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:56.021+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:56.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:56.021+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:56.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:56.021+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:56.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:55 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:55.809+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:56.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:55 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:55.809+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:56.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:55 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:55.809+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:56.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:55 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:55.809+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:56.227 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:55 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:55.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:56.227 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:55 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:55.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:56.227 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:55 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:55.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:56.227 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:55 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:55.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:56.256 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T02:52:56.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:52:56.332 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T02:52:56.332 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T02:52:56.332 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.7 2024-09-21T02:52:56.632 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:56 smithi098 systemd[1]: Stopping Ceph osd.7 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:52:56.632 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:56.602+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:56.632 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:56.602+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:56.632 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:56.602+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:56.632 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:56.630+0000 7fd32dafe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:52:56.632 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:56.630+0000 7fd32dafe640 -1 osd.7 92 *** Got signal Terminated *** 2024-09-21T02:52:56.632 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:56.630+0000 7fd32dafe640 -1 osd.7 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:52:56.905 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:56.743+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:56.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:56.743+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:56.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:56.743+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:56.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:56 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:56.743+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:52:57.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:56 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:56.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:57.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:56 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:56.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:57.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:56 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:56.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:57.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:56 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:56.782+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:57.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:56.989+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:57.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:56.989+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:57.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:56.989+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:57.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:56.841+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:57.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:56.841+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:57.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:56.841+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:57.314 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:56 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:56.841+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:57.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:57 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:57.632+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:57.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:57 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:57.632+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:57.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:57 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:57.632+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:57.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:57 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:57.715+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:57.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:57 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:57.715+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:57.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:57 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:57.715+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:57.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:57 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:57.715+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:52:58.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:57 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:57.982+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:58.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:57 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:57.982+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:58.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:57 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:57.982+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:58.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:57 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:57.811+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:58.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:57 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:57.811+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:58.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:57 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:57.811+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:58.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:57 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:57.811+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:58.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:57 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:57.745+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:58.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:57 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:57.745+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:58.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:57 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:57.745+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:58.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:57 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:57.745+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:58.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:58.632+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:58.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:58.632+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:58.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:58.632+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:58.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:58.722+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:58.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:58.722+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:58.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:58.722+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:58.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:58.722+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:52:59.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:58.948+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:52:59.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:58.948+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:52:59.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:58.948+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:52:59.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:58.948+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:52:59.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:58.783+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:52:59.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:58.783+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:52:59.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:58.783+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:52:59.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:58 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:58.783+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:52:59.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:58 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:58.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:52:59.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:58 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:58.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:52:59.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:58 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:58.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:52:59.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:58 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:58.787+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:52:59.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:59.608+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:52:59.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:59.608+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:52:59.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:52:59.608+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:52:59.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:59.741+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:52:59.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:59.741+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:52:59.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:59.741+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:52:59.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:59.741+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:52:59.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:52:59 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:52:59.741+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:00.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:59.949+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:00.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:59.949+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:00.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:59.949+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:00.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:52:59.949+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:00.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:59.765+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:00.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:59.765+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:00.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:59.765+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:00.064 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:52:59 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:52:59.765+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:00.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:59.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:00.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:59.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:00.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:59.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:00.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:59.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:00.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:52:59 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:52:59.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:00.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:53:00.623+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:53:00.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:53:00.623+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:53:00.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:53:00.623+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:53:00.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:00.705+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:00.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:00.705+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:00.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:00.705+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:00.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:00.705+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:00.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:00 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:00.705+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:01.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:00.766+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:01.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:00.766+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:01.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:00.766+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:01.063 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:00.766+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:01.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:00.996+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:01.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:00.996+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:01.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:00.996+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:01.064 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:00 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:00.996+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:01.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:00 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:00.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:01.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:00 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:00.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:01.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:00 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:00.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:01.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:00 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:00.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:01.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:00 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:00.760+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:01.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:53:01.607+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:10.193296+0000 front 2024-09-21T02:52:10.193344+0000 (oldest deadline 2024-09-21T02:52:35.493505+0000) 2024-09-21T02:53:01.905 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:53:01.607+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:18.295276+0000 front 2024-09-21T02:52:18.295245+0000 (oldest deadline 2024-09-21T02:52:41.795298+0000) 2024-09-21T02:53:01.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:53:01.607+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.597247+0000 front 2024-09-21T02:52:27.597402+0000 (oldest deadline 2024-09-21T02:52:52.297246+0000) 2024-09-21T02:53:01.906 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7[51671]: 2024-09-21T02:53:01.607+0000 7fd32a0e9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:36.298885+0000 front 2024-09-21T02:52:36.298926+0000 (oldest deadline 2024-09-21T02:53:00.999053+0000) 2024-09-21T02:53:01.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:01.676+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:01.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:01.676+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:01.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:01.676+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:01.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:01.676+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:01.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:01 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:01.676+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:02.025 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:01 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:01.736+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:02.025 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:01 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:01.736+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:02.025 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:01 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:01.736+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:02.025 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:01 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:01.736+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:02.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:01 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:01.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:02.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:01 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:01.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:02.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:01 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:01.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:02.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:01 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:01.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:02.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:01 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:01.772+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:02.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:02.023+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:02.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:02.023+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:02.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:02.023+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:02.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:02.023+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:02.405 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:02 smithi098 podman[67679]: 2024-09-21 02:53:02.142868328 +0000 UTC m=+5.620542625 container died bd47691369824063a2c80513f0920e39e17b376b16bfe9a54fec08a93d1257d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T02:53:02.827 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:02 smithi098 podman[67679]: 2024-09-21 02:53:02.539306955 +0000 UTC m=+6.016981249 container cleanup bd47691369824063a2c80513f0920e39e17b376b16bfe9a54fec08a93d1257d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:53:02.827 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:02 smithi098 bash[67679]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7 2024-09-21T02:53:02.827 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:02 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:02.643+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:02.827 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:02 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:02.643+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:02.827 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:02 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:02.643+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:02.827 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:02 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:02.643+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:02.827 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:02 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:02.643+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:03.019 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:02.752+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:03.020 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:02.752+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:03.020 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:02.752+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:03.020 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:02 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:02.752+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:03.134 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:02 smithi098 podman[67694]: 2024-09-21 02:53:02.826299473 +0000 UTC m=+0.679223885 container remove bd47691369824063a2c80513f0920e39e17b376b16bfe9a54fec08a93d1257d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-21T02:53:03.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:02 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:02.771+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:03.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:02 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:02.771+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:03.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:02 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:02.771+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:03.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:02 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:02.771+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:03.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:02 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:02.771+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:03.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:03.018+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:03.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:03.018+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:03.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:03.018+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:03.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:03.018+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:03.397 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:03 smithi098 podman[67783]: 2024-09-21 02:53:03.036372919 +0000 UTC m=+0.015303874 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:53:03.397 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:03 smithi098 podman[67783]: 2024-09-21 02:53:03.160629753 +0000 UTC m=+0.139560694 container create 21d48e1893bf03534c3d495862f8a5eb6d8e6e9854a2e89fd43fe4ebba773364 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T02:53:03.397 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:03 smithi098 podman[67783]: 2024-09-21 02:53:03.396456354 +0000 UTC m=+0.375387300 container init 21d48e1893bf03534c3d495862f8a5eb6d8e6e9854a2e89fd43fe4ebba773364 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2) 2024-09-21T02:53:03.655 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:03 smithi098 podman[67783]: 2024-09-21 02:53:03.40014948 +0000 UTC m=+0.379080422 container start 21d48e1893bf03534c3d495862f8a5eb6d8e6e9854a2e89fd43fe4ebba773364 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T02:53:03.656 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:03 smithi098 podman[67783]: 2024-09-21 02:53:03.504927659 +0000 UTC m=+0.483858606 container attach 21d48e1893bf03534c3d495862f8a5eb6d8e6e9854a2e89fd43fe4ebba773364 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:53:03.656 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 21 02:53:03 smithi098 podman[67783]: 2024-09-21 02:53:03.59099117 +0000 UTC m=+0.569922121 container died 21d48e1893bf03534c3d495862f8a5eb6d8e6e9854a2e89fd43fe4ebba773364 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-21T02:53:03.656 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:03 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:03.629+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:03.656 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:03 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:03.629+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:03.656 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:03 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:03.629+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:03.656 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:03 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:03.629+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:03.656 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:03 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:03.629+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:04.022 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:03.725+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:04.022 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:03.725+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:04.022 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:03.725+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:04.022 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:03 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:03.725+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:04.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:03 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:03.789+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:04.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:03 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:03.789+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:04.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:03 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:03.789+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:04.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:03 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:03.789+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:04.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:03 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:03.789+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:04.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T02:53:04.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.020+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:04.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.020+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:04.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.020+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:04.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.020+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:04.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:04.331 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T02:53:04.331 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T02:53:04.332 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.8 2024-09-21T02:53:04.632 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 systemd[1]: Stopping Ceph osd.8 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:04.905 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:04 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:04.598+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:04.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:04 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:04.598+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:04.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:04 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:04.598+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:04.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:04 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:04.598+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:04.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:04 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:04.598+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:04.987 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:04.630+0000 7fdb9dafc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:04.987 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:04.630+0000 7fdb9dafc640 -1 osd.8 92 *** Got signal Terminated *** 2024-09-21T02:53:04.987 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:04.630+0000 7fdb9dafc640 -1 osd.8 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:53:04.987 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:04.712+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:04.987 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:04.712+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:04.987 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:04.712+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:04.987 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:04.712+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:05.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:04 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:04.824+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:05.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:04 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:04.824+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:05.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:04 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:04.824+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:05.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:04 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:04.824+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:05.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:04 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:04.824+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:05.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.985+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:05.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.985+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:05.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.985+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:05.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:04 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:04.985+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:05.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:05 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:05.631+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:05.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:05 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:05.631+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:05.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:05 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:05.631+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:05.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:05 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:05.631+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:05.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:05 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:05.631+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:06.018 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:05 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:05.702+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:06.018 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:05 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:05.702+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:06.018 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:05 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:05.702+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:06.018 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:05 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:05.702+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:06.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:05.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:06.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:05.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:06.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:05.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:06.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:05.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:06.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:05 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:05.781+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:06.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:06.017+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:06.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:06.017+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:06.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:06.017+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:06.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:06.017+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:07.027 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:06.659+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:07.027 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:06.659+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:07.027 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:06.659+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:07.027 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:06.659+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:07.027 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:06 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:06.659+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:40.499148+0000 front 2024-09-21T02:52:40.499178+0000 (oldest deadline 2024-09-21T02:53:06.299860+0000) 2024-09-21T02:53:07.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:06.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:07.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:06.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:07.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:06.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:07.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:06.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:07.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:06.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:07.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:06 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:06.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:07.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:06 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:06.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:07.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:06 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:06.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:07.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:06 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:06.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:07.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:06 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:06.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:07.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:06 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:06.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:07.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:06 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:06.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:07.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.025+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:07.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.025+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:07.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.025+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:07.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.025+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:07.978 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:07.643+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:07.978 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:07.643+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:07.978 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:07.643+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:07.978 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:07.643+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:07.978 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:07.643+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:40.499148+0000 front 2024-09-21T02:52:40.499178+0000 (oldest deadline 2024-09-21T02:53:06.299860+0000) 2024-09-21T02:53:07.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:07 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:07.719+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:07.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:07 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:07.719+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:07.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:07 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:07.719+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:07.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:07 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:07.719+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:07.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:07 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:07.719+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:07.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:07 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:07.719+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:08.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:07.711+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:08.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:07.711+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:08.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:07.711+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:08.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:07.711+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:08.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:07.711+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:08.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:07 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:07.711+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:08.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.977+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:08.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.977+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:08.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.977+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:08.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:07 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:07.977+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:08.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:08 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:08.708+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:08.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:08 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:08.708+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:08.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:08 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:08.708+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:08.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:08 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:08.708+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:08.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:08 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:08.708+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:08.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:08 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:08.708+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:08.999 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:08.654+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:08.999 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:08.654+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:08.999 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:08.654+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:08.999 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:08.654+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:08.999 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:08.654+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:40.499148+0000 front 2024-09-21T02:52:40.499178+0000 (oldest deadline 2024-09-21T02:53:06.299860+0000) 2024-09-21T02:53:09.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:08 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:08.674+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:09.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:08 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:08.674+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:09.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:08 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:08.674+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:09.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:08 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:08.674+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:09.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:08 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:08.674+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:09.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:08 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:08.674+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:09.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:08.998+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:09.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:08.998+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:09.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:08.998+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:09.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:08.998+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:09.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:08.998+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:09.955 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:09.630+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:00.992531+0000 front 2024-09-21T02:52:00.992485+0000 (oldest deadline 2024-09-21T02:52:23.892208+0000) 2024-09-21T02:53:09.955 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:09.630+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.494014+0000 front 2024-09-21T02:52:08.494052+0000 (oldest deadline 2024-09-21T02:52:36.694734+0000) 2024-09-21T02:53:09.955 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:09.630+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.695176+0000 front 2024-09-21T02:52:16.695144+0000 (oldest deadline 2024-09-21T02:52:40.795335+0000) 2024-09-21T02:53:09.955 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:09.630+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:23.696175+0000 front 2024-09-21T02:52:23.696280+0000 (oldest deadline 2024-09-21T02:52:50.096706+0000) 2024-09-21T02:53:09.955 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8[51704]: 2024-09-21T02:53:09.630+0000 7fdb960df640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:40.499148+0000 front 2024-09-21T02:52:40.499178+0000 (oldest deadline 2024-09-21T02:53:06.299860+0000) 2024-09-21T02:53:09.978 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:09 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:09.725+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:09.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:09 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:09.725+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:09.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:09 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:09.725+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:09.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:09 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:09.725+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:09.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:09 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:09.725+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:09.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:09 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:09.725+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:10.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:09 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:09.719+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:10.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:09 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:09.719+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:10.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:09 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:09.719+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:10.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:09 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:09.719+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:10.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:09 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:09.719+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:10.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:09 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:09.719+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:10.212 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:09.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:10.212 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:09.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:10.212 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:09.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:10.213 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:09.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:10.213 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:09 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:09.953+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:10.548 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:10 smithi148 podman[66872]: 2024-09-21 02:53:10.211873069 +0000 UTC m=+5.688754488 container stop 49b6ef968cdbeda29926cd7b1d1a4005fe66227245d0e6796494bbba5050bc6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T02:53:10.549 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:10 smithi148 podman[66872]: 2024-09-21 02:53:10.237653984 +0000 UTC m=+5.714535394 container died 49b6ef968cdbeda29926cd7b1d1a4005fe66227245d0e6796494bbba5050bc6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T02:53:10.813 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:10 smithi148 podman[66872]: 2024-09-21 02:53:10.638958263 +0000 UTC m=+6.115839673 container cleanup 49b6ef968cdbeda29926cd7b1d1a4005fe66227245d0e6796494bbba5050bc6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T02:53:10.813 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:10 smithi148 bash[66872]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8 2024-09-21T02:53:11.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:10 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:10.718+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:11.157 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:10 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:10.718+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:11.158 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:10 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:10.718+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:11.158 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:10 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:10.718+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:11.158 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:10 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:10.718+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:11.158 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:10 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:10.718+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:11.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:10 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:10.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:11.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:10 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:10.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:11.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:10 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:10.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:11.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:10 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:10.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:11.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:10 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:10.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:11.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:10 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:10.759+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:11.250 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:10 smithi148 podman[66889]: 2024-09-21 02:53:10.823644403 +0000 UTC m=+0.605524922 container remove 49b6ef968cdbeda29926cd7b1d1a4005fe66227245d0e6796494bbba5050bc6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T02:53:11.250 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:10 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:10.969+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:11.250 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:10 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:10.969+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:11.250 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:10 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:10.969+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:11.250 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:10 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:10.969+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:11.250 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:10 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:10.969+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:11.544 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:11 smithi148 podman[66980]: 2024-09-21 02:53:11.152310886 +0000 UTC m=+0.016392100 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:53:11.544 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:11 smithi148 podman[66980]: 2024-09-21 02:53:11.287919183 +0000 UTC m=+0.152000432 container create 7955463688aac36223b40eec2bd60a12f52ef8e24eb9c3c134377ad8cd359df4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:53:11.544 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:11 smithi148 podman[66980]: 2024-09-21 02:53:11.54360801 +0000 UTC m=+0.407689213 container init 7955463688aac36223b40eec2bd60a12f52ef8e24eb9c3c134377ad8cd359df4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T02:53:11.813 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:11 smithi148 podman[66980]: 2024-09-21 02:53:11.547191234 +0000 UTC m=+0.411272444 container start 7955463688aac36223b40eec2bd60a12f52ef8e24eb9c3c134377ad8cd359df4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:53:11.813 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:11 smithi148 podman[66980]: 2024-09-21 02:53:11.643667658 +0000 UTC m=+0.507748881 container attach 7955463688aac36223b40eec2bd60a12f52ef8e24eb9c3c134377ad8cd359df4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T02:53:11.813 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 02:53:11 smithi148 podman[66980]: 2024-09-21 02:53:11.740410505 +0000 UTC m=+0.604491721 container died 7955463688aac36223b40eec2bd60a12f52ef8e24eb9c3c134377ad8cd359df4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-21T02:53:12.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:11 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:11.759+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:12.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:11 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:11.759+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:12.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:11 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:11.759+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:12.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:11 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:11.759+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:12.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:11 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:11.759+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:12.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:11 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:11.759+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:12.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:11 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:11.765+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:12.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:11 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:11.765+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:12.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:11 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:11.765+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:12.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:11 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:11.765+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:12.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:11 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:11.765+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:12.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:11 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:11.765+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:12.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:11.993+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:12.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:11.993+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:12.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:11.993+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:12.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:11.993+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:12.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:11.993+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:12.559 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T02:53:12.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:12.602 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T02:53:12.602 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T02:53:12.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.9 2024-09-21T02:53:12.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:12 smithi079 systemd[1]: Stopping Ceph osd.9 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:12.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:12 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:12.720+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:12.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:12 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:12.720+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:12.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:12 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:12.720+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:12.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:12 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:12.720+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:12.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:12 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:12.720+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:12.979 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:12 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:12.720+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:13.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:12 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:12.797+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:13.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:12 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:12.797+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:13.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:12 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:12.797+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:13.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:12 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:12.797+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:13.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:12 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:12.797+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:13.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:12 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:12.797+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:13.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:13 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:13.019+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:13.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:13 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:13.019+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:13.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:13 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:13.019+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:13.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:13 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:13.019+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:13.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:13 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:13.019+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:13.478 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.001+0000 7f9412200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:13.478 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.001+0000 7f9412200640 -1 osd.9 92 *** Got signal Terminated *** 2024-09-21T02:53:13.479 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.001+0000 7f9412200640 -1 osd.9 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:53:14.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:13 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:13.756+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:14.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:13 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:13.756+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:14.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:13 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:13.756+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:14.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:13 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:13.756+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:14.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:13 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:13.756+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:14.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:13 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:13.756+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:14.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:14.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:14.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:14.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:14.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:14.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:13 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:13.770+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:14.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:14.006+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:14.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:14.006+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:14.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:14.006+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:14.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:14.006+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:14.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:14 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:14.006+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:15.003 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:14 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:14.725+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:15.003 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:14 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:14.725+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:15.003 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:14 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:14.725+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:15.003 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:14 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:14.725+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:15.003 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:14 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:14.725+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:15.003 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:14 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:14.725+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:15.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:14 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:14.784+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:15.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:14 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:14.784+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:15.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:14 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:14.784+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:15.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:14 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:14.784+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:15.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:14 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:14.784+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:15.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:14 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:14.784+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:15.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:15 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:15.050+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:15.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:15 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:15.050+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:15.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:15 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:15.050+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:15.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:15 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:15.050+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:15.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:15 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:15.050+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:15.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:15 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:15.707+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:15.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:15 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:15.707+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:15.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:15 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:15.707+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:15.907 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:15 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:15.707+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:15.907 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:15 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:15.707+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:15.907 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:15 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:15.707+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:16.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:15 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:15.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:16.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:15 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:15.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:16.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:15 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:15.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:16.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:15 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:15.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:16.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:15 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:15.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:16.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:15 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:15.752+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:16.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:16 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:16.041+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:16.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:16 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:16.041+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:16.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:16 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:16.041+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:16.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:16 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:16.041+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:16.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:16 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:16.041+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:17.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:16.702+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:17.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:16.702+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:17.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:16.702+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:17.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:16.702+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:17.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:16.702+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:17.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:16 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:16.702+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:17.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:16 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:16.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:17.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:16 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:16.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:17.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:16 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:16.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:17.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:16 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:16.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:17.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:16 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:16.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:17.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:16 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:16.739+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:17.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:17 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:17.073+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:17.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:17 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:17.073+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:17.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:17 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:17.073+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:17.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:17 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:17.073+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:17.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:17 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:17.073+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:18.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:17.688+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:18.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:17.688+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:18.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:17.688+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:18.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:17.688+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:18.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:17.688+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:18.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:17.688+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:18.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:17 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:17.688+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:18.228 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:17 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:17.785+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.626739+0000 front 2024-09-21T02:52:01.626773+0000 (oldest deadline 2024-09-21T02:52:23.327012+0000) 2024-09-21T02:53:18.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:17 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:17.785+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:08.529106+0000 front 2024-09-21T02:52:08.529022+0000 (oldest deadline 2024-09-21T02:52:33.229299+0000) 2024-09-21T02:53:18.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:17 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:17.785+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.031218+0000 front 2024-09-21T02:52:19.031152+0000 (oldest deadline 2024-09-21T02:52:40.130764+0000) 2024-09-21T02:53:18.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:17 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:17.785+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:24.831540+0000 front 2024-09-21T02:52:24.831567+0000 (oldest deadline 2024-09-21T02:52:48.931554+0000) 2024-09-21T02:53:18.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:17 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:17.785+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:34.232751+0000 front 2024-09-21T02:52:34.232718+0000 (oldest deadline 2024-09-21T02:52:58.932883+0000) 2024-09-21T02:53:18.229 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:17 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9[65648]: 2024-09-21T02:53:17.785+0000 7f9408c00640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.334573+0000 front 2024-09-21T02:52:42.334531+0000 (oldest deadline 2024-09-21T02:53:05.834432+0000) 2024-09-21T02:53:18.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:18 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:18.059+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:18.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:18 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:18.059+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:18.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:18 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:18.059+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:18.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:18 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:18.059+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:18.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:18 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:18.059+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:18.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:18 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:18.059+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:19.070 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:18 smithi079 podman[100708]: 2024-09-21 02:53:18.753588866 +0000 UTC m=+5.868141060 container died d93cfd6d119cdd9c6fd273554eeb38764f06c861ba894b9439f90b1b5f2a977e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:53:19.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:18 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:18.675+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:19.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:18 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:18.675+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:19.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:18 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:18.675+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:19.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:18 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:18.675+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:19.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:18 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:18.675+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:19.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:18 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:18.675+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:19.157 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:18 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:18.675+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:19.478 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:19 smithi079 podman[100708]: 2024-09-21 02:53:19.26772156 +0000 UTC m=+6.382273752 container cleanup d93cfd6d119cdd9c6fd273554eeb38764f06c861ba894b9439f90b1b5f2a977e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T02:53:19.479 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:19 smithi079 bash[100708]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9 2024-09-21T02:53:19.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:19.068+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:19.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:19.068+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:19.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:19.068+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:19.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:19.068+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:19.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:19.068+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:19.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:19 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:19.068+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:19.978 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:19 smithi079 podman[100725]: 2024-09-21 02:53:19.594829787 +0000 UTC m=+0.824185362 container remove d93cfd6d119cdd9c6fd273554eeb38764f06c861ba894b9439f90b1b5f2a977e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True) 2024-09-21T02:53:20.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:19 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:19.721+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:20.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:19 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:19.721+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:20.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:19 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:19.721+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:20.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:19 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:19.721+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:20.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:19 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:19.721+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:20.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:19 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:19.721+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:20.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:19 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:19.721+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:20.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:20.026+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:20.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:20.026+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:20.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:20.026+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:20.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:20.026+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:20.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:20.026+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:20.314 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:20.026+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:20.315 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:20 smithi079 podman[100808]: 2024-09-21 02:53:19.929832435 +0000 UTC m=+0.026412653 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:53:20.315 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:20 smithi079 podman[100808]: 2024-09-21 02:53:20.045650899 +0000 UTC m=+0.142231109 container create 9eff7a6e4a186c3e6ef0a911a0b0def9dde9748bf70291a6cf94423951b676ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:53:20.316 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:20 smithi079 podman[100808]: 2024-09-21 02:53:20.314841632 +0000 UTC m=+0.411421866 container init 9eff7a6e4a186c3e6ef0a911a0b0def9dde9748bf70291a6cf94423951b676ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:53:20.594 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:20 smithi079 podman[100808]: 2024-09-21 02:53:20.322391 +0000 UTC m=+0.418971218 container start 9eff7a6e4a186c3e6ef0a911a0b0def9dde9748bf70291a6cf94423951b676ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T02:53:20.594 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:20 smithi079 podman[100808]: 2024-09-21 02:53:20.414479444 +0000 UTC m=+0.511059666 container attach 9eff7a6e4a186c3e6ef0a911a0b0def9dde9748bf70291a6cf94423951b676ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:53:20.962 INFO:journalctl@ceph.osd.9.smithi079.stdout:Sep 21 02:53:20 smithi079 podman[100833]: 2024-09-21 02:53:20.636704534 +0000 UTC m=+0.026698392 container died 9eff7a6e4a186c3e6ef0a911a0b0def9dde9748bf70291a6cf94423951b676ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T02:53:21.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:20 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:20.673+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:21.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:20 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:20.673+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:21.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:20 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:20.673+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:21.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:20 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:20.673+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:21.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:20 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:20.673+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:21.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:20 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:20.673+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:21.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:20 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:20.673+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:21.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T02:53:21.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:21.384 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T02:53:21.384 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T02:53:21.384 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.10 2024-09-21T02:53:21.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:21 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:21.071+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:21.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:21 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:21.071+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:21.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:21 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:21.071+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:21.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:21 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:21.071+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:21.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:21 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:21.071+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:21.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:21 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:21.071+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 systemd[1]: Stopping Ceph osd.10 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.703+0000 7f1b542c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.703+0000 7f1b542c1640 -1 osd.10 92 *** Got signal Terminated *** 2024-09-21T02:53:21.705 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:21 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:21.703+0000 7f1b542c1640 -1 osd.10 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:53:22.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:22 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:22.086+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:22.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:22 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:22.086+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:22.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:22 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:22.086+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:22.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:22 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:22.086+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:22.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:22 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:22.086+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:22.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:22 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:22.086+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:22.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:22 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:22.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:22.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:22 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:22.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:22.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:22 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:22.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:22.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:22 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:22.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:22.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:22 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:22.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:22.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:22 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:22.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:22.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:22 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:22.633+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:23.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:23.100+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:23.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:23.100+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:23.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:23.100+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:23.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:23.100+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:23.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:23.100+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:23.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:23 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:23.100+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:23.905 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:23 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:23.584+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:23.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:23 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:23.584+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:23.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:23 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:23.584+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:23.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:23 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:23.584+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:23.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:23 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:23.584+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:23.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:23 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:23.584+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:23.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:23 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:23.584+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:24.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:24.134+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:24.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:24.134+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:24.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:24.134+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:24.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:24.134+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:24.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:24.134+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:24.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:24 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:24.134+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:24.905 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:24 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:24.623+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:24.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:24 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:24.623+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:24.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:24 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:24.623+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:24.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:24 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:24.623+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:24.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:24 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:24.623+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:24.906 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:24 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:24.623+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:24.907 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:24 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:24.623+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:25.464 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:25.184+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:25.465 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:25.184+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:25.465 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:25.184+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:25.465 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:25.184+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:25.465 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:25.184+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:25.465 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:25 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:25.184+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:26.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:25 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:25.662+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:26.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:25 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:25.662+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:26.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:25 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:25.662+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:26.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:25 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:25.662+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:26.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:25 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:25.662+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:26.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:25 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:25.662+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:26.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:25 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:25.662+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:26.481 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:26.227+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:26.481 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:26.227+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:26.481 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:26.227+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:26.481 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:26.227+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:26.481 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:26.227+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:26.481 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:26.227+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:26.481 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:26 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:26.227+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:27.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:26.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.653107+0000 front 2024-09-21T02:52:01.653232+0000 (oldest deadline 2024-09-21T02:52:27.552970+0000) 2024-09-21T02:53:27.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:26.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:07.553357+0000 front 2024-09-21T02:52:07.553395+0000 (oldest deadline 2024-09-21T02:52:32.253529+0000) 2024-09-21T02:53:27.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:26.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:16.254936+0000 front 2024-09-21T02:52:16.255116+0000 (oldest deadline 2024-09-21T02:52:41.554875+0000) 2024-09-21T02:53:27.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:26.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6814 osd.3 since back 2024-09-21T02:52:27.356499+0000 front 2024-09-21T02:52:27.356638+0000 (oldest deadline 2024-09-21T02:52:53.256572+0000) 2024-09-21T02:53:27.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:26.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.256901+0000 front 2024-09-21T02:52:33.256881+0000 (oldest deadline 2024-09-21T02:52:59.157021+0000) 2024-09-21T02:53:27.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:26.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:42.459286+0000 front 2024-09-21T02:52:42.459204+0000 (oldest deadline 2024-09-21T02:53:05.959019+0000) 2024-09-21T02:53:27.156 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:26 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10[58316]: 2024-09-21T02:53:26.680+0000 7f1b508ac640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:47.659975+0000 front 2024-09-21T02:52:47.660100+0000 (oldest deadline 2024-09-21T02:53:17.660564+0000) 2024-09-21T02:53:27.539 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:27 smithi098 podman[67896]: 2024-09-21 02:53:27.24710757 +0000 UTC m=+5.667527341 container died fff1fa6cae98cebd3b186e31580459b6c0ac3257f4038c5530f3abd4ca80131b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T02:53:27.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:27.217+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:27.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:27.217+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:27.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:27.217+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:27.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:27.217+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:27.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:27.217+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:27.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:27.217+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:27.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:27 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:27.217+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:27.897 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:27 smithi098 podman[67896]: 2024-09-21 02:53:27.645001705 +0000 UTC m=+6.065421473 container cleanup fff1fa6cae98cebd3b186e31580459b6c0ac3257f4038c5530f3abd4ca80131b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T02:53:27.897 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:27 smithi098 bash[67896]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10 2024-09-21T02:53:28.155 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:27 smithi098 podman[67914]: 2024-09-21 02:53:27.896183037 +0000 UTC m=+0.642241147 container remove fff1fa6cae98cebd3b186e31580459b6c0ac3257f4038c5530f3abd4ca80131b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T02:53:28.550 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:28 smithi098 podman[68004]: 2024-09-21 02:53:28.151043888 +0000 UTC m=+0.015728544 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:53:28.550 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:28 smithi098 podman[68004]: 2024-09-21 02:53:28.255378208 +0000 UTC m=+0.120062849 container create 9f2a7895287303b1a9b8cf43ce190c30a0a1e6c8b2b25a6500bc9f3e41acc21d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T02:53:28.550 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:28 smithi098 podman[68004]: 2024-09-21 02:53:28.466527684 +0000 UTC m=+0.331212323 container init 9f2a7895287303b1a9b8cf43ce190c30a0a1e6c8b2b25a6500bc9f3e41acc21d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T02:53:28.551 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:28 smithi098 podman[68004]: 2024-09-21 02:53:28.469707912 +0000 UTC m=+0.334392555 container start 9f2a7895287303b1a9b8cf43ce190c30a0a1e6c8b2b25a6500bc9f3e41acc21d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:53:28.551 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:28 smithi098 podman[68004]: 2024-09-21 02:53:28.549650292 +0000 UTC m=+0.414334946 container attach 9f2a7895287303b1a9b8cf43ce190c30a0a1e6c8b2b25a6500bc9f3e41acc21d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T02:53:28.565 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:28.210+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:28.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:28.210+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:28.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:28.210+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:28.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:28.210+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:28.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:28.210+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:28.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:28.210+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:28.566 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:28 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:28.210+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:28.905 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 21 02:53:28 smithi098 podman[68004]: 2024-09-21 02:53:28.665670113 +0000 UTC m=+0.530354764 container died 9f2a7895287303b1a9b8cf43ce190c30a0a1e6c8b2b25a6500bc9f3e41acc21d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T02:53:29.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T02:53:29.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:29.347 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T02:53:29.348 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T02:53:29.348 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.11 2024-09-21T02:53:29.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.211+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:29.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.211+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:29.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.211+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:29.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.211+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:29.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.211+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:29.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.211+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:29.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.211+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:29.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 systemd[1]: Stopping Ceph osd.11 for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:30.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.673+0000 7f475beb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:30.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.673+0000 7f475beb4640 -1 osd.11 92 *** Got signal Terminated *** 2024-09-21T02:53:30.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:29 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:29.673+0000 7f475beb4640 -1 osd.11 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:53:30.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:30.195+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:30.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:30.195+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:30.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:30.195+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:30.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:30.195+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:30.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:30.195+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:30.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:30.195+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:30.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:30 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:30.195+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:31.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:31.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:31.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:31.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:31.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:31.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:31.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:31.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:31 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:31.196+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6820 osd.8 since back 2024-09-21T02:53:05.737051+0000 front 2024-09-21T02:53:05.737068+0000 (oldest deadline 2024-09-21T02:53:31.037067+0000) 2024-09-21T02:53:32.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:32.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:32.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:32.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:32.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:32.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:32.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:32.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:32 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:32.165+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6820 osd.8 since back 2024-09-21T02:53:05.737051+0000 front 2024-09-21T02:53:05.737068+0000 (oldest deadline 2024-09-21T02:53:31.037067+0000) 2024-09-21T02:53:33.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:33.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:33.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:33.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:33.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:33.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:33.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:33.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:33 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:33.123+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6820 osd.8 since back 2024-09-21T02:53:05.737051+0000 front 2024-09-21T02:53:05.737068+0000 (oldest deadline 2024-09-21T02:53:31.037067+0000) 2024-09-21T02:53:34.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-21T02:52:01.824444+0000 front 2024-09-21T02:52:01.824722+0000 (oldest deadline 2024-09-21T02:52:23.524593+0000) 2024-09-21T02:53:34.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-21T02:52:09.227343+0000 front 2024-09-21T02:52:09.227222+0000 (oldest deadline 2024-09-21T02:52:34.527369+0000) 2024-09-21T02:53:34.563 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T02:52:19.228370+0000 front 2024-09-21T02:52:19.228402+0000 (oldest deadline 2024-09-21T02:52:43.928545+0000) 2024-09-21T02:53:34.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-21T02:52:33.032674+0000 front 2024-09-21T02:52:33.032632+0000 (oldest deadline 2024-09-21T02:52:58.332674+0000) 2024-09-21T02:53:34.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T02:52:44.233510+0000 front 2024-09-21T02:52:44.233892+0000 (oldest deadline 2024-09-21T02:53:08.933659+0000) 2024-09-21T02:53:34.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.79:6822 osd.6 since back 2024-09-21T02:52:52.335475+0000 front 2024-09-21T02:52:52.335441+0000 (oldest deadline 2024-09-21T02:53:17.635369+0000) 2024-09-21T02:53:34.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-21T02:52:59.336377+0000 front 2024-09-21T02:52:59.336358+0000 (oldest deadline 2024-09-21T02:53:25.236356+0000) 2024-09-21T02:53:34.564 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:34 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11[57965]: 2024-09-21T02:53:34.108+0000 7f4754497640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.148:6820 osd.8 since back 2024-09-21T02:53:05.737051+0000 front 2024-09-21T02:53:05.737068+0000 (oldest deadline 2024-09-21T02:53:31.037067+0000) 2024-09-21T02:53:35.592 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:35 smithi148 podman[67101]: 2024-09-21 02:53:35.314560739 +0000 UTC m=+5.760367638 container died 74534bfa7dc045300856962e0a34d438d415e60e2ecb759a4af40bf3601249ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T02:53:35.984 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:35 smithi148 podman[67101]: 2024-09-21 02:53:35.740785824 +0000 UTC m=+6.186592721 container cleanup 74534bfa7dc045300856962e0a34d438d415e60e2ecb759a4af40bf3601249ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T02:53:35.984 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:35 smithi148 bash[67101]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11 2024-09-21T02:53:36.313 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:35 smithi148 podman[67118]: 2024-09-21 02:53:35.983588817 +0000 UTC m=+0.667808889 container remove 74534bfa7dc045300856962e0a34d438d415e60e2ecb759a4af40bf3601249ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T02:53:36.720 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:36 smithi148 podman[67206]: 2024-09-21 02:53:36.304032722 +0000 UTC m=+0.015853988 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:53:36.721 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:36 smithi148 podman[67206]: 2024-09-21 02:53:36.42596699 +0000 UTC m=+0.137788239 container create 1950d5d97274c56e24d0b91baf66e2f0f4f7999fec681ca31e34030a761029c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T02:53:36.721 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:36 smithi148 podman[67206]: 2024-09-21 02:53:36.645116106 +0000 UTC m=+0.356937351 container init 1950d5d97274c56e24d0b91baf66e2f0f4f7999fec681ca31e34030a761029c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T02:53:36.721 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:36 smithi148 podman[67206]: 2024-09-21 02:53:36.648431105 +0000 UTC m=+0.360252365 container start 1950d5d97274c56e24d0b91baf66e2f0f4f7999fec681ca31e34030a761029c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T02:53:36.721 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:36 smithi148 podman[67206]: 2024-09-21 02:53:36.719918404 +0000 UTC m=+0.431739660 container attach 1950d5d97274c56e24d0b91baf66e2f0f4f7999fec681ca31e34030a761029c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T02:53:37.063 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 02:53:36 smithi148 podman[67206]: 2024-09-21 02:53:36.838452732 +0000 UTC m=+0.550273992 container died 1950d5d97274c56e24d0b91baf66e2f0f4f7999fec681ca31e34030a761029c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:53:37.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T02:53:37.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:37.467 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T02:53:37.467 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T02:53:37.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.a 2024-09-21T02:53:37.848 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:37 smithi079 systemd[1]: Stopping Ceph mds.a for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:38.228 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:37 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a[72033]: 2024-09-21T02:53:37.846+0000 7fda15400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:38.229 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:37 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a[72033]: 2024-09-21T02:53:37.846+0000 7fda15400640 -1 mds.a *** got signal Terminated *** 2024-09-21T02:53:39.421 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:39 smithi079 podman[100925]: 2024-09-21 02:53:39.060972944 +0000 UTC m=+1.307646918 container stop 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T02:53:39.422 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:39 smithi079 podman[100925]: 2024-09-21 02:53:39.086798024 +0000 UTC m=+1.333471997 container died 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T02:53:39.729 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:39 smithi079 podman[100925]: 2024-09-21 02:53:39.526602273 +0000 UTC m=+1.773276245 container cleanup 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T02:53:39.938 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:39 smithi079 bash[100925]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a 2024-09-21T02:53:40.053 INFO:journalctl@ceph.mds.a.smithi079.stdout:Sep 21 02:53:39 smithi079 podman[100939]: 2024-09-21 02:53:39.794840439 +0000 UTC m=+0.719150248 container remove 40a73dbd045f140c843277957781ec7ca54a1e876e8f08d04879f996e414ecf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T02:53:40.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T02:53:40.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:40.133 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T02:53:40.133 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T02:53:40.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.d 2024-09-21T02:53:40.479 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:40 smithi079 systemd[1]: Stopping Ceph mds.d for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:40.978 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:40 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-d[70993]: 2024-09-21T02:53:40.517+0000 7ffb30200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:40.979 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:40 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-d[70993]: 2024-09-21T02:53:40.517+0000 7ffb30200640 -1 mds.d *** got signal Terminated *** 2024-09-21T02:53:42.728 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:42 smithi079 podman[101047]: 2024-09-21 02:53:42.518197642 +0000 UTC m=+2.107801521 container died 09ee1b3d1d6baad83ef4717d154d04da87c715da5641ace05dcd325b9b233e0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:53:43.143 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:42 smithi079 podman[101047]: 2024-09-21 02:53:42.949129468 +0000 UTC m=+2.538733347 container cleanup 09ee1b3d1d6baad83ef4717d154d04da87c715da5641ace05dcd325b9b233e0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:53:43.143 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:42 smithi079 bash[101047]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-d 2024-09-21T02:53:43.393 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:43 smithi079 podman[101059]: 2024-09-21 02:53:43.142055673 +0000 UTC m=+0.614176563 container remove 09ee1b3d1d6baad83ef4717d154d04da87c715da5641ace05dcd325b9b233e0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-21T02:53:43.393 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:43 smithi079 systemd[1]: ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.d.service: Deactivated successfully. 2024-09-21T02:53:43.393 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:43 smithi079 systemd[1]: Stopped Ceph mds.d for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:53:43.393 INFO:journalctl@ceph.mds.d.smithi079.stdout:Sep 21 02:53:43 smithi079 systemd[1]: ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.d.service: Consumed 1.695s CPU time. 2024-09-21T02:53:43.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T02:53:43.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:43.465 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T02:53:43.465 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T02:53:43.466 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.g 2024-09-21T02:53:43.728 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:53:43 smithi079 systemd[1]: Stopping Ceph mds.g for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:44.228 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:53:43 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g[71722]: 2024-09-21T02:53:43.837+0000 7f5f78800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:44.229 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:53:43 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g[71722]: 2024-09-21T02:53:43.837+0000 7f5f78800640 -1 mds.g *** got signal Terminated *** 2024-09-21T02:53:47.879 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:53:47 smithi079 podman[101166]: 2024-09-21 02:53:47.572804578 +0000 UTC m=+3.842953940 container died bc562a0740aa779b8c4580f39fd69965c9763c7b6370b9eb7f990b559ae4bd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T02:53:48.229 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:53:47 smithi079 podman[101166]: 2024-09-21 02:53:47.993800541 +0000 UTC m=+4.263949911 container cleanup bc562a0740aa779b8c4580f39fd69965c9763c7b6370b9eb7f990b559ae4bd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T02:53:48.229 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:53:47 smithi079 bash[101166]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g 2024-09-21T02:53:48.617 INFO:journalctl@ceph.mds.g.smithi079.stdout:Sep 21 02:53:48 smithi079 podman[101179]: 2024-09-21 02:53:48.296048073 +0000 UTC m=+0.709028982 container remove bc562a0740aa779b8c4580f39fd69965c9763c7b6370b9eb7f990b559ae4bd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:53:48.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T02:53:48.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:48.715 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T02:53:48.716 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T02:53:48.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.j 2024-09-21T02:53:48.979 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:53:48 smithi079 systemd[1]: Stopping Ceph mds.j for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:49.728 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:53:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j[70610]: 2024-09-21T02:53:49.324+0000 7fad1b000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:49.729 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:53:49 smithi079 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j[70610]: 2024-09-21T02:53:49.324+0000 7fad1b000640 -1 mds.j *** got signal Terminated *** 2024-09-21T02:53:51.166 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:53:50 smithi079 podman[101286]: 2024-09-21 02:53:50.846680142 +0000 UTC m=+1.850902009 container died 03a9d34197bd0dc2d78fc7d0c64ba3b36a452a4977ebceb7c296cd9b95f1832b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T02:53:51.478 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:53:51 smithi079 podman[101286]: 2024-09-21 02:53:51.321970378 +0000 UTC m=+2.326192250 container cleanup 03a9d34197bd0dc2d78fc7d0c64ba3b36a452a4977ebceb7c296cd9b95f1832b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T02:53:51.479 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:53:51 smithi079 bash[101286]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j 2024-09-21T02:53:51.800 INFO:journalctl@ceph.mds.j.smithi079.stdout:Sep 21 02:53:51 smithi079 podman[101299]: 2024-09-21 02:53:51.573341068 +0000 UTC m=+0.667877154 container remove 03a9d34197bd0dc2d78fc7d0c64ba3b36a452a4977ebceb7c296cd9b95f1832b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T02:53:51.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T02:53:51.893 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:51.894 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T02:53:51.894 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T02:53:51.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.b 2024-09-21T02:53:52.178 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:53:51 smithi098 systemd[1]: Stopping Ceph mds.b for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:52.436 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:53:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b[63207]: 2024-09-21T02:53:52.179+0000 7f19478ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:52.436 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:53:52 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b[63207]: 2024-09-21T02:53:52.179+0000 7f19478ff640 -1 mds.b *** got signal Terminated *** 2024-09-21T02:53:54.648 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:53:54 smithi098 podman[68109]: 2024-09-21 02:53:54.336994472 +0000 UTC m=+2.255274417 container died 6189e3c1b5a954ad9e6f0e75a1b28d596f715a1b5a54d8f0fcde2520aaf26629 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T02:53:54.905 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:53:54 smithi098 podman[68109]: 2024-09-21 02:53:54.729441788 +0000 UTC m=+2.647721731 container cleanup 6189e3c1b5a954ad9e6f0e75a1b28d596f715a1b5a54d8f0fcde2520aaf26629 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T02:53:54.906 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 21 02:53:54 smithi098 bash[68109]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-b 2024-09-21T02:53:55.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T02:53:55.168 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:55.168 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T02:53:55.169 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T02:53:55.169 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.e 2024-09-21T02:53:55.405 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:53:55 smithi098 systemd[1]: Stopping Ceph mds.e for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:55.910 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:53:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e[62657]: 2024-09-21T02:53:55.516+0000 7f30655d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:55.910 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:53:55 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e[62657]: 2024-09-21T02:53:55.516+0000 7f30655d9640 -1 mds.e *** got signal Terminated *** 2024-09-21T02:53:57.405 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:53:57 smithi098 podman[68244]: 2024-09-21 02:53:57.10459701 +0000 UTC m=+1.721692461 container died facff1ce114b922dcd56c18e7975611c4a34652e16f01663920454e1533d34ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T02:53:57.827 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:53:57 smithi098 podman[68244]: 2024-09-21 02:53:57.583470747 +0000 UTC m=+2.200566197 container cleanup facff1ce114b922dcd56c18e7975611c4a34652e16f01663920454e1533d34ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:53:57.827 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 21 02:53:57 smithi098 bash[68244]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-e 2024-09-21T02:53:57.961 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T02:53:57.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:53:57.996 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T02:53:57.996 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T02:53:57.996 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.h 2024-09-21T02:53:58.155 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:53:58 smithi098 systemd[1]: Stopping Ceph mds.h for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:53:58.655 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:53:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: 2024-09-21T02:53:58.311+0000 7f502b45b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:53:58.656 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:53:58 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h[62926]: 2024-09-21T02:53:58.311+0000 7f502b45b640 -1 mds.h *** got signal Terminated *** 2024-09-21T02:54:02.655 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:54:02 smithi098 podman[68366]: 2024-09-21 02:54:02.322640836 +0000 UTC m=+4.110458055 container died 33becbff2747f7eb5c1e4800550d12058e30d3c78a44547f2a2f67bfaa819475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T02:54:02.956 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:54:02 smithi098 podman[68366]: 2024-09-21 02:54:02.770679521 +0000 UTC m=+4.558496733 container cleanup 33becbff2747f7eb5c1e4800550d12058e30d3c78a44547f2a2f67bfaa819475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T02:54:02.956 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:54:02 smithi098 bash[68366]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h 2024-09-21T02:54:03.198 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T02:54:03.219 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:54:02 smithi098 podman[68379]: 2024-09-21 02:54:02.955301355 +0000 UTC m=+0.625527116 container remove 33becbff2747f7eb5c1e4800550d12058e30d3c78a44547f2a2f67bfaa819475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T02:54:03.219 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:54:03 smithi098 systemd[1]: ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.h.service: Deactivated successfully. 2024-09-21T02:54:03.219 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:54:03 smithi098 systemd[1]: Stopped Ceph mds.h for 56d10306-77c0-11ef-baf5-efdc52797490. 2024-09-21T02:54:03.219 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 21 02:54:03 smithi098 systemd[1]: ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.h.service: Consumed 4.027s CPU time. 2024-09-21T02:54:03.230 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:54:03.231 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T02:54:03.231 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T02:54:03.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.k 2024-09-21T02:54:03.470 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 21 02:54:03 smithi098 systemd[1]: Stopping Ceph mds.k for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:54:03.905 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 21 02:54:03 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-k[62377]: 2024-09-21T02:54:03.591+0000 7f76fb586640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:54:03.906 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 21 02:54:03 smithi098 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-k[62377]: 2024-09-21T02:54:03.591+0000 7f76fb586640 -1 mds.k *** got signal Terminated *** 2024-09-21T02:54:07.244 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 21 02:54:06 smithi098 podman[68487]: 2024-09-21 02:54:06.984061108 +0000 UTC m=+3.531981742 container died c26334e489867db8dd5c7921c485692b9653c554fe34c110cfdfe34085f8b391 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T02:54:07.634 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 21 02:54:07 smithi098 podman[68487]: 2024-09-21 02:54:07.341361571 +0000 UTC m=+3.889282205 container cleanup c26334e489867db8dd5c7921c485692b9653c554fe34c110cfdfe34085f8b391 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T02:54:07.635 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 21 02:54:07 smithi098 bash[68487]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-k 2024-09-21T02:54:07.759 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T02:54:07.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:54:07.791 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T02:54:07.791 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T02:54:07.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.c 2024-09-21T02:54:08.108 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:54:07 smithi148 systemd[1]: Stopping Ceph mds.c for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:54:08.373 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:54:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c[62626]: 2024-09-21T02:54:08.106+0000 7fdbb7738640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:54:08.373 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:54:08 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c[62626]: 2024-09-21T02:54:08.106+0000 7fdbb7738640 -1 mds.c *** got signal Terminated *** 2024-09-21T02:54:10.811 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:54:10 smithi148 podman[67309]: 2024-09-21 02:54:10.544144044 +0000 UTC m=+2.557097396 container died 315e4d7f6a754c882b99216083e8d1a8c2e21dcc0f3d65a0c58eca0e3c6275b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T02:54:11.063 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:54:10 smithi148 podman[67309]: 2024-09-21 02:54:10.889354301 +0000 UTC m=+2.902307683 container cleanup 315e4d7f6a754c882b99216083e8d1a8c2e21dcc0f3d65a0c58eca0e3c6275b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T02:54:11.063 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 02:54:10 smithi148 bash[67309]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-c 2024-09-21T02:54:11.319 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T02:54:11.356 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:54:11.356 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T02:54:11.356 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T02:54:11.356 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.f 2024-09-21T02:54:11.686 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:54:11 smithi148 systemd[1]: Stopping Ceph mds.f for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:54:12.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:54:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f[62357]: 2024-09-21T02:54:11.683+0000 7ff820231640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:54:12.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:54:11 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f[62357]: 2024-09-21T02:54:11.683+0000 7ff820231640 -1 mds.f *** got signal Terminated *** 2024-09-21T02:54:16.063 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:54:15 smithi148 podman[67442]: 2024-09-21 02:54:15.790332508 +0000 UTC m=+4.219236788 container died bde048cdf11d15d49933f29b20eb85a6d785142f42901654ada75155726ece8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T02:54:16.436 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:54:16 smithi148 podman[67442]: 2024-09-21 02:54:16.15105175 +0000 UTC m=+4.579956029 container cleanup bde048cdf11d15d49933f29b20eb85a6d785142f42901654ada75155726ece8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:54:16.436 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 02:54:16 smithi148 bash[67442]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-f 2024-09-21T02:54:16.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T02:54:16.624 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:54:16.625 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T02:54:16.625 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T02:54:16.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.i 2024-09-21T02:54:17.063 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 02:54:16 smithi148 systemd[1]: Stopping Ceph mds.i for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:54:17.063 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 02:54:16 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-i[62905]: 2024-09-21T02:54:16.930+0000 7f156fd42640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:54:17.063 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 02:54:16 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-i[62905]: 2024-09-21T02:54:16.930+0000 7f156fd42640 -1 mds.i *** got signal Terminated *** 2024-09-21T02:54:19.981 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 02:54:19 smithi148 podman[67562]: 2024-09-21 02:54:19.701058931 +0000 UTC m=+2.861027469 container died f1459e8f61b2ed34c10dc515544af1e7c8c01bf4f9968bf9d5950fc430acc722 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T02:54:20.313 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 02:54:20 smithi148 podman[67562]: 2024-09-21 02:54:20.063439865 +0000 UTC m=+3.223408406 container cleanup f1459e8f61b2ed34c10dc515544af1e7c8c01bf4f9968bf9d5950fc430acc722 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T02:54:20.313 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 02:54:20 smithi148 bash[67562]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-i 2024-09-21T02:54:20.503 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T02:54:20.535 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:54:20.535 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T02:54:20.536 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T02:54:20.536 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.l 2024-09-21T02:54:20.868 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:54:20 smithi148 systemd[1]: Stopping Ceph mds.l for 56d10306-77c0-11ef-baf5-efdc52797490... 2024-09-21T02:54:21.313 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:54:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l[62088]: 2024-09-21T02:54:20.866+0000 7f9237ca6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:54:21.313 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:54:20 smithi148 ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l[62088]: 2024-09-21T02:54:20.866+0000 7f9237ca6640 -1 mds.l *** got signal Terminated *** 2024-09-21T02:54:24.563 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:54:24 smithi148 podman[67685]: 2024-09-21 02:54:24.289360947 +0000 UTC m=+3.526193512 container died 93fb027e6ddd60e8a7c80803d077b0a462db63c667189d71151b1342a10fc617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T02:54:24.952 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:54:24 smithi148 podman[67685]: 2024-09-21 02:54:24.658707462 +0000 UTC m=+3.895540022 container cleanup 93fb027e6ddd60e8a7c80803d077b0a462db63c667189d71151b1342a10fc617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T02:54:24.952 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 02:54:24 smithi148 bash[67685]: ceph-56d10306-77c0-11ef-baf5-efdc52797490-mds-l 2024-09-21T02:54:25.096 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56d10306-77c0-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T02:54:25.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:54:25.128 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T02:54:25.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56d10306-77c0-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T02:54:25.405 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:54:29.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56d10306-77c0-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T02:54:29.570 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:54:32.067 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56d10306-77c0-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T02:54:32.270 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T02:54:34.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:54:34.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:54:34.886 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:54:34.913 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T02:54:34.915 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi079/crash 2024-09-21T02:54:34.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash -- . 2024-09-21T02:54:34.993 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T02:54:34.993 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2024-09-21T02:54:34.996 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi098/crash 2024-09-21T02:54:34.997 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash -- . 2024-09-21T02:54:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T02:54:35.071 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-09-21T02:54:35.073 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi148/crash 2024-09-21T02:54:35.073 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash -- . 2024-09-21T02:54:35.112 INFO:teuthology.orchestra.run.smithi148.stderr:tar: /var/lib/ceph/56d10306-77c0-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T02:54:35.112 INFO:teuthology.orchestra.run.smithi148.stderr:tar: Error is not recoverable: exiting now 2024-09-21T02:54:35.113 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T02:54:35.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T02:54:35.260 INFO:teuthology.orchestra.run.smithi079.stdout:2024-09-21T02:30:00.000289+0000 mon.a (mon.0) 715 : cluster [WRN] pg 1.0 is stuck inactive for 64s, current state remapped, last acting [5,2,1] 2024-09-21T02:54:35.261 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-21T02:54:35.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[SEC\]' /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T02:54:35.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]' /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T02:54:35.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[WRN\]' /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T02:54:35.512 INFO:teuthology.orchestra.run.smithi079.stdout:2024-09-21T02:30:00.000289+0000 mon.a (mon.0) 715 : cluster [WRN] pg 1.0 is stuck inactive for 64s, current state remapped, last acting [5,2,1] 2024-09-21T02:54:35.513 INFO:tasks.cephadm:Compressing logs... 2024-09-21T02:54:35.513 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T02:54:35.517 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T02:54:35.519 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T02:54:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T02:54:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:: No such file or directory 2024-09-21T02:54:35.547 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T02:54:35.547 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T02:54:35.547 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T02:54:35.547 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T02:54:35.549 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T02:54:35.549 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T02:54:35.549 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log: /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T02:54:35.549 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log 2024-09-21T02:54:35.549 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T02:54:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T02:54:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T02:54:35.550 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T02:54:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T02:54:35.551 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T02:54:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T02:54:35.553 INFO:teuthology.orchestra.run.smithi148.stderr: 94.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T02:54:35.571 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T02:54:35.571 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T02:54:35.572 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T02:54:35.572 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T02:54:35.572 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T02:54:35.573 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T02:54:35.573 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T02:54:35.573 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T02:54:35.573 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.b.log: /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T02:54:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T02:54:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:gzip/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log: -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T02:54:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log 2024-09-21T02:54:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T02:54:35.575 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T02:54:35.575 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log: /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T02:54:35.575 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T02:54:35.584 INFO:teuthology.orchestra.run.smithi148.stderr: 82.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T02:54:35.586 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T02:54:35.586 INFO:teuthology.orchestra.run.smithi079.stderr:: No such file or directory 2024-09-21T02:54:35.587 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T02:54:35.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T02:54:35.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T02:54:35.589 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T02:54:35.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T02:54:35.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T02:54:35.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T02:54:35.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T02:54:35.593 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T02:54:35.594 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T02:54:35.594 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log 2024-09-21T02:54:35.596 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T02:54:35.597 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T02:54:35.598 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log: /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T02:54:35.599 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.x.log: 94.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T02:54:35.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T02:54:35.601 INFO:teuthology.orchestra.run.smithi079.stderr: 86.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T02:54:35.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T02:54:35.603 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.3.log: 94.8% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T02:54:35.605 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T02:54:35.607 INFO:teuthology.orchestra.run.smithi079.stderr: 94.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T02:54:35.625 INFO:teuthology.orchestra.run.smithi148.stderr: 90.3% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T02:54:35.626 INFO:teuthology.orchestra.run.smithi079.stderr: 82.2% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T02:54:35.633 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T02:54:35.662 INFO:teuthology.orchestra.run.smithi148.stderr: 87.0% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T02:54:35.667 INFO:teuthology.orchestra.run.smithi148.stderr: 93.0% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T02:54:35.690 INFO:teuthology.orchestra.run.smithi148.stderr: 95.0% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T02:54:35.699 INFO:teuthology.orchestra.run.smithi148.stderr: 94.8% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T02:54:35.705 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 92.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T02:54:35.761 INFO:teuthology.orchestra.run.smithi079.stderr: 90.1% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T02:54:35.762 INFO:teuthology.orchestra.run.smithi098.stderr: 94.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T02:54:35.783 INFO:teuthology.orchestra.run.smithi148.stderr: 90.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T02:54:35.790 INFO:teuthology.orchestra.run.smithi098.stderr: 94.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T02:54:35.817 INFO:teuthology.orchestra.run.smithi098.stderr: 82.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T02:54:35.858 INFO:teuthology.orchestra.run.smithi098.stderr: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T02:54:35.860 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T02:54:35.874 INFO:teuthology.orchestra.run.smithi098.stderr: 90.3% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T02:54:35.888 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T02:54:36.096 INFO:teuthology.orchestra.run.smithi148.stderr: 94.8% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T02:54:36.239 INFO:teuthology.orchestra.run.smithi079.stderr: 90.4% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T02:54:36.814 INFO:teuthology.orchestra.run.smithi098.stderr: 91.0% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T02:54:36.874 INFO:teuthology.orchestra.run.smithi098.stderr: 94.2% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T02:54:37.532 INFO:teuthology.orchestra.run.smithi098.stderr: 91.5% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T02:54:39.141 INFO:teuthology.orchestra.run.smithi148.stderr: 91.5% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T02:54:39.584 INFO:teuthology.orchestra.run.smithi079.stderr: 90.3% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T02:55:00.765 INFO:teuthology.orchestra.run.smithi098.stderr: 94.8% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T02:55:24.852 INFO:teuthology.orchestra.run.smithi098.stderr: 90.6% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T02:56:07.883 INFO:teuthology.orchestra.run.smithi148.stderr: 90.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T02:56:13.152 INFO:teuthology.orchestra.run.smithi098.stderr: 90.6% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T02:56:28.799 INFO:teuthology.orchestra.run.smithi098.stderr: 90.6% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T02:56:33.400 INFO:teuthology.orchestra.run.smithi148.stderr: 90.6% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T02:56:47.112 INFO:teuthology.orchestra.run.smithi098.stderr: 90.8% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T02:56:47.114 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-21T02:56:47.114 INFO:teuthology.orchestra.run.smithi098.stderr:real 2m11.579s 2024-09-21T02:56:47.114 INFO:teuthology.orchestra.run.smithi098.stderr:user 4m25.203s 2024-09-21T02:56:47.114 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m8.812s 2024-09-21T02:57:03.756 INFO:teuthology.orchestra.run.smithi148.stderr: 90.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T02:57:21.893 INFO:teuthology.orchestra.run.smithi148.stderr: 90.9% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T02:57:21.895 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T02:57:21.895 INFO:teuthology.orchestra.run.smithi148.stderr:real 2m46.360s 2024-09-21T02:57:21.895 INFO:teuthology.orchestra.run.smithi148.stderr:user 4m33.159s 2024-09-21T02:57:21.895 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m9.377s 2024-09-21T02:59:57.985 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T03:00:32.256 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T03:01:30.110 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T03:01:43.681 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/56d10306-77c0-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T03:01:43.685 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-21T03:01:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:real 7m8.139s 2024-09-21T03:01:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:user 5m16.992s 2024-09-21T03:01:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m31.867s 2024-09-21T03:01:43.686 INFO:tasks.cephadm:Archiving logs... 2024-09-21T03:01:43.687 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi079/log 2024-09-21T03:01:43.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:02:37.775 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi098/log 2024-09-21T03:02:37.776 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:03:23.733 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi148/log 2024-09-21T03:03:23.734 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:04:09.348 INFO:tasks.cephadm:Removing cluster... 2024-09-21T03:04:09.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56d10306-77c0-11ef-baf5-efdc52797490 --force 2024-09-21T03:04:09.870 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T03:04:11.621 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56d10306-77c0-11ef-baf5-efdc52797490 --force 2024-09-21T03:04:11.827 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T03:04:12.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56d10306-77c0-11ef-baf5-efdc52797490 --force 2024-09-21T03:04:12.650 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: 56d10306-77c0-11ef-baf5-efdc52797490 2024-09-21T03:04:13.289 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T03:04:13.290 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:04:13.344 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:04:13.364 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:04:13.380 INFO:tasks.cephadm:Teardown complete 2024-09-21T03:04:13.380 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T03:04:13.390 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T03:04:13.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:04:13.395 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:04:13.406 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:04:13.761 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T03:04:13.770 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T03:04:13.770 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:04:13.775 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:04:13.777 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:04:13.792 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:04:13.792 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:04:13.806 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:04:13.810 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:04:13.810 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T03:04:13.810 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 -56us[ -30us] +/- 38ms 2024-09-21T03:04:13.810 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -56us[ -56us] +/- 78ms 2024-09-21T03:04:13.810 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +223us[ +249us] +/- 72ms 2024-09-21T03:04:13.810 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:04:13.814 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:04:13.815 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-21T03:04:13.815 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -43us[ -19us] +/- 38ms 2024-09-21T03:04:13.815 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -56us[ -56us] +/- 78ms 2024-09-21T03:04:13.815 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +234us[ +234us] +/- 72ms 2024-09-21T03:04:13.815 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:04:13.924 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:04:13.924 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-09-21T03:04:13.924 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -79us[ -79us] +/- 38ms 2024-09-21T03:04:13.924 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 -87us[ -86us] +/- 78ms 2024-09-21T03:04:13.924 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +203us[ +203us] +/- 72ms 2024-09-21T03:04:13.924 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:04:13.926 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T03:04:13.935 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T03:04:13.936 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T03:04:13.947 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:04:14.158 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:04:14.318 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:04:14.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:04:14.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:04:14.470 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:04:14.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:04:14.501 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:04:14.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:04:14.530 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T03:04:14.540 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T03:04:14.592 INFO:teuthology.task.internal:Duration was 2895.387661 seconds 2024-09-21T03:04:14.592 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T03:04:14.666 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T03:04:14.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:04:14.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:04:14.674 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:04:14.739 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:04:14.759 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:04:14.785 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:04:15.110 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T03:04:15.110 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T03:04:15.110 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:04:15.165 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-21T03:04:15.166 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:04:15.199 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T03:04:15.199 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:04:15.231 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T03:04:15.231 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:04:15.235 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:04:15.241 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:04:15.298 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T03:04:15.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:04:15.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:04:15.312 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:04:16.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T03:04:16.091 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T03:04:16.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:04:16.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:04:16.175 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:04:16.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T03:04:16.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:04:16.218 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:04:16.221 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:04:16.255 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-21T03:04:16.266 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-21T03:04:16.321 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-21T03:04:16.384 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:04:16.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:04:16.418 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:04:16.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:04:16.432 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:04:16.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:04:16.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T03:04:16.461 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T03:04:16.462 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi079 2024-09-21T03:04:16.462 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:04:16.542 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi098 2024-09-21T03:04:16.542 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:04:16.577 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913418/remote/smithi148 2024-09-21T03:04:16.578 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:04:16.612 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T03:04:16.612 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:04:16.617 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:04:16.619 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:04:16.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T03:04:16.675 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T03:04:16.675 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T03:04:16.688 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T03:04:16.688 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:04:16.693 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:04:16.695 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:04:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:04 /home/ubuntu/cephtest 2024-09-21T03:04:16.717 INFO:teuthology.orchestra.run.smithi148.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:04 /home/ubuntu/cephtest 2024-09-21T03:04:16.723 INFO:teuthology.orchestra.run.smithi079.stdout: 393532 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:04 /home/ubuntu/cephtest 2024-09-21T03:04:16.729 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T03:04:16.741 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T03:04:16.774 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 2895.387660741806 failure_reason: '"2024-09-21T02:30:00.000289+0000 mon.a (mon.0) 715 : cluster [WRN] pg 1.0 is stuck inactive for 64s, current state remapped, last acting [5,2,1]" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2024-09-21T03:04:16.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:04:16.861 INFO:teuthology.run:FAIL